
Read records from S3 and send them into a Kafka topic with PyFlink, using a custom pipeline jar for IAM authentication, which is useful for enrichment.

Read records from S3 and send them into a Kafka topic with PyFlink, using a custom pipeline jar for IAM authentication, which is useful for enrichment.

Build a local Kafka to OpenSearch pipeline on Docker with the Aiven sink connector, ingesting fake impressions and clicks for near real time analytics.

Three Flink DataStream applications from a Confluent Java course converted to PyFlink, from ingesting source data to calculating usage statistics.

Deploy a PyFlink app that reads and writes Kafka topics on Amazon MSK to Amazon Managed Service for Apache Flink, the managed Flink runtime.

Develop a PyFlink app against a Kafka cluster on Docker, running it both in a virtual environment and in a local Flink cluster for better monitoring.

Develop a fraud detection app locally on Docker with Kafka, Flink and DynamoDB, re-implementing a solution taken from an AWS workshop.

Control user access to Kafka resources with authorization rules, keeping SASL for client authentication, with Java and Python client examples.

Authenticate Kafka clients with SASL instead of client certificates, with Java and Python client examples of the SASL mechanisms.

Enforce two-way TLS verification so Kafka brokers check the client certificate, with Java and Python client examples of SSL authentication.

Configure TLS encryption between Kafka brokers and clients, where the client verifies the server certificate, with Java and Python examples.