Set up process #

brew install cloudquery/tap/cloudquery

1. Download CLI and login

See installation options

2. Create source and destination configs

Plugin configuration

cloudquery sync crowddev.yml postgresql.yml

3. Run the sync

CloudQuery sync

Overview #

The Crowd.dev Source plugin for CloudQuery extracts information from the Crowd.dev API and loads it into any supported CloudQuery destination (e.g. PostgreSQL, BigQuery, Snowflake, and more).

Configuration #

To use this plugin you need to obtain a tenant ID and auth token from the Crowd.dev settings.

The following configuration syncs from Crowd.dev to a Postgres destination. The (top level) source spec section is described in the Source Spec Reference. The config for the postgresql destination is not shown here. See our Quickstart if you need help setting up the destination.

kind: source
spec:
  name: "crowddev"
  path: "cloudquery/crowddev"
  registry: "cloudquery"
  version: "v1.4.1"
  tables: ["*"]
  destinations:
    - "postgresql"
  # Learn more about the configuration options at https://cql.ink/crowddev_source
  spec:
    auth_token:
    tenant_id:

Crowd.dev Spec #

This is the (nested) spec used by the Crowd.dev source plugin:

auth_token (string) (required)
Authentication token of the Crowd.dev workspace. Obtained from the Crowd.dev settings.
tenant_id (string) (required)
Tenant ID of the Crowd.dev workspace. Obtained from the Crowd.dev settings.
base_url (string) (optional) (default: https://app.crowd.dev)
URL of the Crowd.dev API.
concurrency (integer) (optional) (default: 100)
A best effort maximum number of Go routines to use. Lower this number to reduce memory usage.
scheduler (string) (optional) (default: dfs)
The scheduler to use when determining the priority of resources to sync. Supported values are dfs (depth-first search), round-robin, shuffle and shuffle-queue.
For more information about this, see performance tuning.

Full config example #

Below is an example of the full config file with all the optional fields and their default values.

kind: source
spec:
  name: "crowddev"
  path: "cloudquery/crowddev"
  registry: "cloudquery"
  version: "v1.4.1"
  tables: ["*"]
  destinations:
    - "postgresql"
  spec:
    # required fields
    auth_token:
    tenant_id:
    # optional fields
    base_url: "https://app.crowd.dev"
    concurrency: 100