Back to plugin list
aws
Official
Premium

AWS

The AWS Source plugin extracts information from many of the supported services by Amazon Web Services (AWS) and loads it into any supported CloudQuery destination

Publisher

cloudquery

Repositorygithub.com
Latest version

v26.4.0

Type

Source

Platforms
Date Published

Price per 1M rows

Starting from $15

monthly free quota

1M rows

v24.3.1


24.3.1 (2024-02-14)

 

Bug Fixes

  • Stop DynamoDB resolvers from making API calls that always fail (#16618) (6005e9e)
  • Update Primary Key components for aws_cloudwatch_metrics to ensure uniqueness (#1182) (2b267bf)

v24.3.0


24.3.0 (2024-02-14)

 

Features

  • services: Support newly added regions (#16589) (9ad84a0)
 

Bug Fixes

  • Correct workspaces directory ARN (#16582) (234ba17)

v24.2.0


24.2.0 (2024-02-12)

 

This Release has the Following Changes to Tables

  • Table aws_cloudwatchlogs_log_groups: column added with name log_group_arn and type utf8
  • Table aws_datapipeline_pipelines was added
  • Table aws_directoryservice_directories was added
  • Table aws_elasticache_serverless_cache_snapshots was added
  • Table aws_elasticache_serverless_caches was added
  • Table aws_elasticsearch_domains: column added with name domain_processing_status and type utf8
  • Table aws_elasticsearch_domains: column added with name modifying_properties and type json
  • Table aws_guardduty_detector_filters: column added with name arn and type utf8
  • Table aws_guardduty_detector_intel_sets: column added with name arn and type utf8
  • Table aws_guardduty_detector_intel_sets: column added with name id and type utf8
  • Table aws_guardduty_detector_ip_sets: column added with name arn and type utf8
  • Table aws_guardduty_detector_ip_sets: column added with name id and type utf8
  • Table aws_guardduty_detector_publishing_destinations: column added with name arn and type utf8
  • Table aws_ssm_parameters: column added with name tags and type json
  • Table aws_workspaces_workspaces: column added with name workspace_name and type utf8

Features

  • Add Support for Amazon ElastiCache Serverless for Redis and Memcached Clusters (#1142) (3423ed3)
  • Add Support for AWS Data Pipeline Pipelines (0325a54)
  • Add Support for AWS Data Pipeline Pipelines (#1152) (0325a54)
  • Add support for AWS Directory Service Directories (#1151) (929113e)
  • Add tags for AWS Systems Manager Parameters (#16542) (e0090a3)
  • services: Support newly added regions (#16543) (6189b49)
 

Bug Fixes

  • Clarify that aws_debug: true needs debug log level (#16552) (b03a4c3)
  • deps: Update aws-sdk-go-v2 monorepo (#1157) (89502d4)
  • deps: Update module go.opentelemetry.io/contrib/instrumentation/github.com/aws/aws-sdk-go-v2/otelaws to v0.48.0 (#1158) (a58e85f)
  • Streamline aws_guardduty_ tables primary keys (#15854) (b7458f2)

v24.1.0


24.1.0 (2024-02-06)

 

This Release has the Following Changes to Tables

  • Table aws_cognito_identity_pools: column added with name tags and type json
  • Table aws_cognito_user_pools: column added with name tags and type json
  • Table aws_route53resolver_resolver_rules: column added with name request_account_id and type utf8
  • Table aws_route53resolver_resolver_rules: column added with name request_region and type utf8
  • Table aws_ssoadmin_trusted_token_issuers was added

Features

  • Add support for AWS SSO Trusted Token Issuer (#1140) (bb3b3ea)
  • Support Incremental syncing for aws_inspector2_findings (#1138) (cf7dfc0)
 

Bug Fixes

  • Add explicit tag columns to aws_cognito_user_pools and aws_cognito_identity_pools (#16517) (b1553ab)
  • Fix Multiple PKs (#16524) (8f40ab5)
  • Properly handle different inputs for aws_inspector2_findings (#1141) (0ad11d9)
  • Update AWS docs (#1139) (6dbc781)

v24.0.0


24.0.0 (2024-02-05)

 

⚠ BREAKING CHANGES

  • Use _cq_id as the only Primary Key for all tables. This version changes the Primary Key for all tables to to uses the _cq_id column. The value is a deterministic hash of a subset of columns usually the resource arn. This change allows for releasing of new versions of this plugin without requiring a breaking change. If you are syncing to the Postgres Destination and using a version greater than v7.3.1 then the migration will be handled automatically without any data loss. If you are using an earlier version or a different destination then you will have to migrate manually or use the migrate_mode: forced to have CloudQuery drop and recreate the tables
  • Move from PrimaryKeysto PrimaryKeyComponents (#16403)

Features

  • Move from PrimaryKeysto PrimaryKeyComponents (#16403) (3323d53)
  • Use _cq_id as the only Primary Key for all tables. This version changes the Primary Key for all tables to to uses the _cq_id column. The value is a deterministic hash of a subset of columns usually the resource arn. This change allows for releasing of new versions of this plugin without requiring a breaking change. If you are syncing to the Postgres Destination and using a version greater than v7.3.1 then the migration will be handled automatically without any data loss. If you are using an earlier version or a different destination then you will have to migrate manually or use the migrate_mode: forced to have CloudQuery drop and recreate the tables (fcea1de)
 

Bug Fixes

  • AWS scheduler configuration docs (#1106) (c1525ea)
  • deps: Update aws-sdk-go-v2 monorepo (#1109) (1512463)
  • deps: Update github.com/cloudquery/jsonschema digest to d771afd (#1103) (c3427ba)
  • deps: Update golang.org/x/exp digest to 1b97071 (#1076) (7b9f326)
  • deps: Update google.golang.org/genproto/googleapis/api digest to 1f4bbc5 (#1082) (a4e925f)
  • deps: Update google.golang.org/genproto/googleapis/rpc digest to 1f4bbc5 (#1083) (11fdd76)
  • deps: Update module github.com/aws/aws-lambda-go to v1.46.0 (#1110) (d46d09b)
  • deps: Update module github.com/cloudquery/plugin-sdk/v4 to v4.29.0 (#1073) (d76b9c4)
  • deps: Update module github.com/cloudquery/plugin-sdk/v4 to v4.29.1 (#1093) (8875114)

v23.7.0


23.7.0 (2024-01-31)

 

This Release has the Following Changes to Tables

  • Table aws_datasync_agents was added
  • Table aws_datasync_azureblob_locations was added
  • Table aws_datasync_efs_locations was added
  • Table aws_datasync_fsxlustre_locations was added
  • Table aws_datasync_fsxontap_locations was added
  • Table aws_datasync_fsxopenzfs_locations was added
  • Table aws_datasync_fsxwindows_locations was added
  • Table aws_datasync_hdfs_locations was added
  • Table aws_datasync_locations was added
  • Table aws_datasync_nfs_locations was added
  • Table aws_datasync_objectstorage_locations was added
  • Table aws_datasync_s3_locations was added
  • Table aws_datasync_smb_locations was added
  • Table aws_kafka_cluster_policies was added
  • Table aws_rds_clusters: column added with name limitless_database and type json

Features

  • Add Support for AWS DataSync Locations and Agents (#1044) (e22dd82)
  • Add Support For AWS MSK Cluster Policies (#1043) (19a4c9b)
  • services: Support newly added regions (#16354) (32057e9)
 

Bug Fixes

  • deps: Update aws-sdk-go-v2 monorepo (#1045) (6677b4c)
  • deps: Update aws-sdk-go-v2 monorepo (#1046) (34428e7)
  • deps: Update module github.com/cloudquery/plugin-sdk/v4 to v4.27.2 (#1054) (0eb056a)
  • deps: Update module github.com/cloudquery/plugin-sdk/v4 to v4.28.0 (#1060) (60f05e8)
  • Update scheduler doc & JSON schema (#16319) (bbecd52)

v23.6.1


23.6.1 (2024-01-23)

 

Bug Fixes

  • deps: Update module github.com/cloudquery/plugin-sdk/v4 to v4.26.0 (#971) (8216650)
  • deps: Update module github.com/cloudquery/plugin-sdk/v4 to v4.27.0 (#1004) (a551257)
  • deps: Update module github.com/cloudquery/plugin-sdk/v4 to v4.27.1 (#1006) (f988301)

v23.6.0


23.6.0 (2024-01-23)

 

This Release has the Following Changes to Tables

  • Table aws_iam_mfa_devices was added
  • Table aws_keyspaces_tables: column added with name replica_specifications and type json

Features

  • Add mfa_devices for AWS IAM users (#16200) (d82dbb7)
  • Persist KMS Key data even if AccessDenied on kms:DescribeKey (#16165) (b86562b)
  • services: Support newly added regions (#16145) (c6758da)
 

Bug Fixes

  • Add N/A as stack_id when the value is unavailable (#16220) (5e98b85)
  • deps: Update aws-sdk-go-v2 monorepo (#962) (544f575)
  • deps: Update aws-sdk-go-v2 monorepo (#963) (255e70e)
  • deps: Update module github.com/aws/aws-lambda-go to v1.45.0 (#968) (7ff4d5c)
  • deps: Update module go.opentelemetry.io/contrib/instrumentation/github.com/aws/aws-sdk-go-v2/otelaws to v0.47.0 (#969) (1fd2b77)

v23.5.0


23.5.0 (2024-01-15)

 

This Release has the Following Changes to Tables

  • Table aws_docdb_instances: column added with name performance_insights_enabled and type bool
  • Table aws_docdb_instances: column added with name performance_insights_kms_key_id and type utf8
  • Table aws_eventbridge_event_bus_targets: column added with name app_sync_parameters and type json
  • Table aws_route53_hosted_zone_resource_record_sets: column added with name geo_proximity_location and type json
  • Table aws_transfer_connectors: column added with name service_managed_egress_ip_addresses and type list<item: utf8, nullable>
  • Table aws_transfer_servers: column added with name as2_service_managed_egress_ip_addresses and type list<item: utf8, nullable>

Features

  • AWS Tracing at API Level (#538) (9720563)
  • services: Support newly added regions (#16121) (e618608)
 

Bug Fixes

  • Add Cloudformation template to docs (#943) (1f85168)
  • deps: Update aws-sdk-go-v2 monorepo (#930) (59a8218)
  • deps: Update aws-sdk-go-v2 monorepo (#931) (326c772)
  • deps: Update aws-sdk-go-v2 monorepo (#940) (b49cb50)
  • deps: Update github.com/apache/arrow/go/v15 digest to 7e703aa (#942) (4c1cd07)
  • deps: Update github.com/apache/arrow/go/v15 digest to de3130e (#933) (1dc0458)
  • deps: Update module github.com/aws/aws-lambda-go to v1.44.0 (#941) (b082796)
  • deps: Update module github.com/cloudquery/plugin-sdk/v4 to v4.25.1 (#900) (b4183ec)
  • deps: Update module github.com/cloudquery/plugin-sdk/v4 to v4.25.2 (#938) (ceebfa4)

v23.4.0


23.4.0 (2024-01-04)

 

Features

  • services: Support newly added regions (#15913) (5dfe569)
 

Bug Fixes

  • deps: Update aws-sdk-go-v2 monorepo (#868) (719f6be)
  • deps: Update github.com/apache/arrow/go/v15 digest to 7c3480e (#869) (84c2e6b)
  • deps: Update github.com/gomarkdown/markdown digest to 1d6d208 (#870) (967ba60)
  • deps: Update golang.org/x/exp digest to 02704c9 (#872) (acbdefc)
  • deps: Update google.golang.org/genproto/googleapis/api digest to 995d672 (#874) (0500cd1)
  • deps: Update module github.com/cloudquery/plugin-sdk/v4 to v4.24.0 (#835) (9a1b202)
  • deps: Update module github.com/cloudquery/plugin-sdk/v4 to v4.24.1 (#878) (8398e71)
  • deps: Update module github.com/cloudquery/plugin-sdk/v4 to v4.25.0 (#884) (bb6e24a)
Versions per page:
Subscribe to product updates

Be the first to know about new features.