Snowflake Config Source Plugin

Example Config #

kind: source
spec:
  name: snowflake-config
  path: cloudquery/snowflake-config
  registry: cloudquery
  version: "v4.4.4"
  # Learn more about the configuration options at https://cql.ink/snowflake-config_source
  spec:
    connection_string: "${SNOWFLAKE_CONNECTION_STRING}"
    # Optional parameters
    # private_key: ""
    # concurrency: 10000

Authentication #

• A username and password in the DSN:

  kind: source
  spec:
    name: snowflake-config
    # ...
    spec:
      connection_string: "user:pass@account"

• A private key inline:

  kind: source
  spec:
    name: snowflake-config
    # ...
    spec:
      connection_string: "user@account"
      private_key: |
        -----BEGIN PRIVATE KEY-----
        MIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQC2ajPRIbPtbxZ1
        3DONLA02eZJuCzsgIkBWov/Me5TL6cKN0gnY+mbA8OnNCH+9HSzgiU9P8XhTUrIN
        85diD+rj6uK+E0sSyxGk6HG17TyR5oBq8nz2hbZlbaNi/HO9qYoHQgAgMq908YBz
        ...
        DUmOIrBYEMf2nDTlTu/QVcKb
        -----END PRIVATE KEY-----

• A private key included from a file:

  kind: source
  spec:
    name: snowflake-config
    # ...
    spec:
      connection_string: "user@account"
      private_key: "${file:./private.key}"

  where ./private.key is PEM-encoded private key file with contents of the form:

  -----BEGIN PRIVATE KEY-----
  MIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQC2ajPRIbPtbxZ1
  3DONLA02eZJuCzsgIkBWov/Me5TL6cKN0gnY+mbA8OnNCH+9HSzgiU9P8XhTUrIN
  85diD+rj6uK+E0sSyxGk6HG17TyR5oBq8nz2hbZlbaNi/HO9qYoHQgAgMq908YBz
  ...
  DUmOIrBYEMf2nDTlTu/QVcKb
  -----END PRIVATE KEY-----

Private Key Authentication Setup #

openssl pkcs8 -topk8 -nocrypt -in enc.key -out dec.key

Snowflake Config Spec #

• connection_string (string) (required)

  Snowflake connection_string.

# user[:password]@account
# or
# user[:password]@account/database/schema?warehouse=user_warehouse[&param1=value1&paramN=valueN]
# or
# user[:password]@account/database?warehouse=user_warehouse[&param1=value1&paramN=valueN]
# or
# user[:password]@host:port/database/schema?account=user_account&warehouse=user_warehouse[&param1=value1&paramN=valueN]
# or
# host:port/database/schema?account=user_account&warehouse=user_warehouse[&param1=value1&paramN=valueN]

• private_key (string) (optional)

  A PEM-encoded private key for connecting to Snowflake. Equivalent to adding authenticator=snowflake_jwt&privateKey=... to the connection_string but parses, validates, and correctly encodes the key for use with snowflake.
• concurrency (integer) (optional) (default: 10000) A best effort maximum number of Go routines to use. Lower this number to reduce memory usage.
• scheduler (string) (optional) (default: dfs) The scheduler to use when determining the priority of resources to sync. Supported values are dfs (depth-first search), round-robin, shuffle and shuffle-queue.

  For more information about this, see performance tuning.

Underlying library #