Carabas Research

• https://pypi.org/project/core-cdc

• https://github.com/sshd123/pypgoutput

• https://pypi.org/project/pypg-cdc/

• https://github.com/hcevikGA/dynamo-wrapper

• https://pypi.org/project/dynamo-pandas/

• https://aws.amazon.com/de/blogs/opensource/announcing-partiql-one-query-language-for-all-your-data/

• https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/ql-reference.html

• https://partiql.org/dql/overview.html

• https://github.com/MacHu-GWU/aws_lambda_layer-project

• https://github.com/MacHu-GWU/cottonformation-project

• https://docs.aws.amazon.com/lambda/latest/dg/python-package.html

• https://docs.aws.amazon.com/lambda/latest/dg/python-image.html

• https://docs.aws.amazon.com/lambda/latest/dg/lambda-runtimes.html

• https://docs.aws.amazon.com/lambda/latest/dg/file-processing-app.html

• https://www.tinybird.co/docs/guides/migrate-from-rockset#migrate-from-rockset

• https://www.tinybird.co/docs/guides/ingesting-data/ingest-from-dynamodb

AWS Lambda

• https://docs.aws.amazon.com/lambda/latest/dg/lambda-runtimes.html

• https://docs.aws.amazon.com/lambda/latest/dg/services-ddb-params.html

• https://docs.aws.amazon.com/lambda/latest/dg/best-practices.html

• https://docs.aws.amazon.com/lambda/latest/api/API_CreateEventSourceMapping.html

• https://aws.amazon.com/blogs/architecture/best-practices-for-developing-on-aws-lambda/

• https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-lambda-eventsourcemapping.html

• https://docs.aws.amazon.com/lambda/latest/dg/with-kinesis.html

RDS

• https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/Overview.DBInstance.html

• https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/rds-lambda-tutorial.html

• https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/creating-resources-with-cloudformation.html

• https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-rds-dbinstance.html

DMS

• https://stackoverflow.com/questions/77995867/dynamic-tables-via-dms-kinesis-iceberg-transactional-data-lake

• https://aws.amazon.com/blogs/database/tune-replication-performance-with-aws-dms-for-an-amazon-kinesis-data-streams-target-endpoint-part-3/

• https://www.cockroachlabs.com/docs/stable/aws-dms

wal2json

• https://hevodata.com/learn/pg-logical/

• https://aws.amazon.com/blogs/database/stream-changes-from-amazon-rds-for-postgresql-using-amazon-kinesis-data-streams-and-aws-lambda/

• https://github.com/eulerto/wal2json

• https://docs.aws.amazon.com/AmazonRDS/latest/PostgreSQLReleaseNotes/postgresql-extensions.html#postgresql-extensions-15x

CDC

• https://debezium.io/documentation/reference/stable/postgres-plugins.html

• https://github.com/debezium/postgres-decoderbufs