Back to source plugin

Export from Simple Analytics to Apache Arrow Flight

CloudQuery is an open-source data integration platform that allows you to export data from any source to any destination.

The CloudQuery Simple Analytics plugin allows you to sync data from Simple Analytics to any destination, including Apache Arrow Flight. It takes only minutes to get started.

simple-analytics

Simple Analytics

A Simple Analytics source plugin for CloudQuery that loads raw page view and event data from Simple Analytics to any database, data warehouse or data lake supported by CloudQuery, such as PostgreSQL, BigQuery, Athena, and many more.

Publisher

simple-analytics

Repositorygithub.com
Latest version

v2.0.0

Type

Source

Platforms
Date Published

Nov 15, 2023

arrowflight

Apache Arrow Flight

This destination plugin lets you sync data from a CloudQuery source to an Apache Arrow Flight compatible service.

Publisher

spangenberg

Repositorygithub.com
Latest version

v1.0.4

Type

Destination

Platforms
Date Published

Mar 13, 2024

Windows Setup

Step 1. Install CloudQuery

curl -L https://github.com/cloudquery/cloudquery/releases/download/cli-v4.3.4/cloudquery_windows_amd64.exe -o cloudquery.exe

Step 2. Configure Simple Analytics source plugin

You can find more information about the configuration in the plugin documentation

kind: source
spec:
  name: "simple-analytics"
  path: "simple-analytics/simple-analytics"
  registry: cloudquery
  version: "v2.0.0"
  # use this to enable incremental syncing
  # backend_options:
  #   table_name: "cq_state_simpleanalytics
  #   connection: "@@plugins.arrowflight.connection"
  tables: 
    ["*"]
  destinations: 
    - "postgresql"
  spec:
    # plugin spec section
    user_id: "${SA_USER_ID}"
    api_key: "${SA_API_KEY}"
    websites:
      - hostname: mywebsite.com
        metadata_fields: 
          - fieldname_text
          - fieldname_int
          # - ...

Step 3. Configure Apache Arrow Flight destination plugin

You can find more information about the configuration in the plugin documentation

kind: destination
spec:
  name: "arrowflight"
  path: "cloudquery/arrowflight"
  registry: "cloudquery"
  version: "VERSION_DESTINATION_ARROWFLIGHT"
  spec:
    addr: "localhost:9090"
    # Optional parameters:
    # handshake: ""
    # token: ""
    # close_timeout: 1s
    # max_call_recv_msg_size: 10485760 # 10MB
    # max_call_send_msg_size: 10485760 # 10MB

Step 4. Run Sync

cloudquery sync simple-analytics.yml arrowflight.yml
Subscribe to product updates

Be the first to know about new features.