Official

Premium

OracleDB

The CloudQuery OracleDB plugin syncs your OracleDB database to any of the supported CloudQuery destinations

Publisher

cloudquery

Latest version

v4.5.1

Type

Source

Platforms

Date Published

October 30, 2024

Price per 1M rows

Starting from $15

monthly free quota

1M rows

Documentation Tables Changelog Destinations

Overview

Set up process #

brew install cloudquery/tap/cloudquery

1. Download CLI and login

See installation options

2. Create source and destination configs

Plugin configuration

cloudquery sync oracledb.yml postgresql.yml

3. Run the sync

CloudQuery sync

Overview #

The CloudQuery OracleDB plugin syncs your OracleDB database to any of the supported CloudQuery destinations (e.g. PostgreSQL, BigQuery, Snowflake, and more).

Example Configuration #

kind: source
spec:
  name: oracledb
  path: cloudquery/oracledb
  registry: cloudquery
  version: "v4.5.1"
  tables: ["*"]
  destinations: ["postgresql"]
  # Learn more about the configuration options at https://cql.ink/oracledb_source
  spec:
    # Connection string to connect to the database in the format oracle://user:password@server:port/service_name.
    # To use the default 1521 port, you can omit it from the connection string, but still need to keep the :, for example oracle://user:password@server:/service_name.
    connection_string: "${ORACLE_DB_CONNECTION_STRING}"
    # Optional parameters
    # queries: []
    # rows_per_record: 500
    # concurrency: 100

Configuration Reference #

This is the (nested) spec used by the OracleDB destination plugin.

connection_string (string) (required)
Connection string to connect to the database in the format oracle://<user>:<password>@<server>:<port>/<service_name>. To use the default 1521 port, you can omit it from the connection string, but still need to keep the :, for example oracle://<user>:<password>@<server>:/<service_name>. See the Go driver documentation for more details.
queries (list of queries Spec) (optional)
(Preview feature) List of queries to run instead of directly reading tables. The tables in top-level spec should be left as * or can be a subset of these tables.
rows_per_record (integer) (optional) (default: 500)
Amount of rows to be packed into a single Apache Arrow record to be sent over the wire during sync.
concurrency (integer) (optional) (default: 100)
Number of tables to sync concurrently. Lower or increase this number based on your database size and available resources.

Make sure you use environment variable expansion in production instead of committing the credentials to the configuration file directly.

Queries Spec (Preview) #

Allows running arbitrary queries instead of fetching existing tables. Each query will be run as a separate table.

name (string) (required)
Name of the table to be generated from the query.
query (string) (required)
SQL query to run.

Example

The below config duplicates the ALL_TABLES meta table to the destination, as all_oracle_tables table:

kind: source
spec:
  name: oracledb
  path: cloudquery/oracledb
  registry: cloudquery
  version: "v4.5.1"
  tables: ["*"] # We want all tables specified in queries to be synced
  destinations: ["postgresql"]
  spec:
    # Connection string to connect to the database in the format oracle://user:password@server:port/service_name.
    # To use the default 1521 port, you can omit it from the connection string, but still need to keep the :, for example oracle://user:password@server:/service_name.
    connection_string: "${ORACLE_DB_CONNECTION_STRING}"
    queries:
      - name: all_oracle_tables
        query: SELECT * FROM ALL_TABLES