Back to destination list
Official
Amazon Kinesis Firehose destination integration documentation
This destination plugin lets you sync data from a CloudQuery source to Amazon Kinesis Firehose
Loading plugin documentation
This destination plugin lets you sync data from a CloudQuery source to Amazon Kinesis Firehose
Loading plugin documentation
CloudQuery's use of cookies
We use tracking cookies to understand how you use the product and help us improve it. Your consent is required before we can enable these cookies. You can opt out via the link in the footer.
AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY, AWS_SESSION_TOKEN)
Web Identity Token (AWS_WEB_IDENTITY_TOKEN_FILE)credentials file under .aws folder that is placed in the home folder on your computer.
SDK defaults to config file under .aws folder that is placed in the home folder on your computer.kind: destination
spec:
name: "firehose"
path: "cloudquery/firehose"
registry: "cloudquery"
version: "v2.8.4"
write_mode: "append" # this plugin only supports 'append' mode
send_sync_summary: true
spec:
# Required parameters e.g. arn:aws:firehose:us-east-1:111122223333:deliverystream/TestRedshiftStream
stream_arn: "${FIREHOSE_STREAM_ARN}"
# Optional parameters
# max_retries: 5
# max_record_size_bytes: 1024000 # optional
# max_batch_records: 500 # optional
# max_batch_size_bytes: 4194000 # optional
batch_size and batch_size_bytes.PutRecordBatch operation can take up to 500 records per batch or 4 MiB per batch, whichever is smaller.stream_arn (string) (required)arn:${Partition}:firehose:${Region}:${Account}:deliverystream/${DeliveryStreamName}.max_retries (integer) (optional) (default: 5)max_record_size_bytes (integer) (optional) (default: 1024000 (1000 KiB))max_batch_records (integer) (optional) (default: 500 (1000 KiB))max_batch_size_bytes (integer) (optional) (default: 4194000 (~4000 KiB))