Debezium Server streams PostgreSQL row changes into the Google Pub/Sub emulator, with Docker Compose, a theLook data generator and a Python reader.

Ingest fake customer and order data into Kafka with the MSK Data Generator and save it to S3, with connectors deployed as Strimzi custom resources.

Build a local Kafka to OpenSearch pipeline on Docker with the Aiven sink connector, ingesting fake impressions and clicks for near real time analytics.

Deploy the Camel DynamoDB sink connector and its data generator source on Amazon MSK and MSK Connect, moving the local pipeline onto AWS.

Schema registry support added to a Kafka Connect ingestion pipeline, so the source and sink connectors serialise through AWS Glue Schema Registry.

A Kafka Connect ingestion pipeline on Docker. The MSK Data Generator creates fake customer and order records, and the Confluent S3 sink saves them.

A survey of the Kafka connectors available for AWS service integration, as the starting point for building real time data pipelines on AWS.

Deploy a Change Data Capture pipeline to AWS with the Apicurio registry on ECS, private subnets over VPN and the Avro converter packaged with the connectors.

A local Change Data Capture setup on Docker Compose with Debezium, the Confluent S3 sink and the Apicurio registry, showing how schema evolution is managed.

Run a Hudi DeltaStreamer application on Amazon EMR, then query the resulting Hudi table with Athena and build a QuickSight dashboard on it.