# Carabas Research - https://pypi.org/project/core-cdc - https://github.com/sshd123/pypgoutput - https://pypi.org/project/pypg-cdc/ - https://github.com/hcevikGA/dynamo-wrapper - https://pypi.org/project/dynamo-pandas/ - https://aws.amazon.com/de/blogs/opensource/announcing-partiql-one-query-language-for-all-your-data/ - https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/ql-reference.html - https://partiql.org/dql/overview.html - https://github.com/MacHu-GWU/aws_lambda_layer-project - https://github.com/MacHu-GWU/cottonformation-project - https://docs.aws.amazon.com/lambda/latest/dg/python-package.html - https://docs.aws.amazon.com/lambda/latest/dg/python-image.html - https://docs.aws.amazon.com/lambda/latest/dg/lambda-runtimes.html - https://docs.aws.amazon.com/lambda/latest/dg/file-processing-app.html - https://www.tinybird.co/docs/guides/migrate-from-rockset#migrate-from-rockset - https://www.tinybird.co/docs/guides/ingesting-data/ingest-from-dynamodb ## AWS Lambda - https://docs.aws.amazon.com/lambda/latest/dg/lambda-runtimes.html - https://docs.aws.amazon.com/lambda/latest/dg/services-ddb-params.html - https://docs.aws.amazon.com/lambda/latest/dg/best-practices.html - https://docs.aws.amazon.com/lambda/latest/api/API_CreateEventSourceMapping.html - https://aws.amazon.com/blogs/architecture/best-practices-for-developing-on-aws-lambda/ - https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-lambda-eventsourcemapping.html - https://docs.aws.amazon.com/lambda/latest/dg/with-kinesis.html ## RDS - https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/Overview.DBInstance.html - https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/rds-lambda-tutorial.html - https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/creating-resources-with-cloudformation.html - https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-rds-dbinstance.html ## DMS - https://stackoverflow.com/questions/77995867/dynamic-tables-via-dms-kinesis-iceberg-transactional-data-lake - https://aws.amazon.com/blogs/database/tune-replication-performance-with-aws-dms-for-an-amazon-kinesis-data-streams-target-endpoint-part-3/ - https://www.cockroachlabs.com/docs/stable/aws-dms ## wal2json - https://hevodata.com/learn/pg-logical/ - https://aws.amazon.com/blogs/database/stream-changes-from-amazon-rds-for-postgresql-using-amazon-kinesis-data-streams-and-aws-lambda/ - https://github.com/eulerto/wal2json - https://docs.aws.amazon.com/AmazonRDS/latest/PostgreSQLReleaseNotes/postgresql-extensions.html#postgresql-extensions-15x ## CDC - https://debezium.io/documentation/reference/stable/postgres-plugins.html - https://github.com/debezium/postgres-decoderbufs