Jaehyeon Kim
Jaehyeon Kim

  • Blog
    • Categories

      List of categories.

    • Tags

      List of tags.

    • Series

      List of series.

    • Archives

  • Projects
  • Slides

/

  • Github Linkedin RSS

  • Font Size
  • Palette
  • Mode
  1. Home
  2. Archives
  3. 2023

December

3 posts in total
  • Kafka Development on Kubernetes - Part 1 Cluster Setup Dec 21
  • Consume data from Kafka using Lambda - Real Time Streaming with Kafka and Flink Lab 6 Dec 14
  • Setup Local Development Environment for Apache Flink and Spark Using EMR Container Images Dec 7

November

5 posts in total
  • Write data to DynamoDB using Kafka Connect - Real Time Streaming with Kafka and Flink Lab 5 Nov 30
  • Clean, Aggregate, and Enrich Events with Flink - Real Time Streaming with Kafka and Flink Lab 4 Nov 23
  • Transform and write data to S3 from Kafka using Flink - Real Time Streaming with Kafka and Flink Lab 3 Nov 16
  • Write data to Kafka from S3 using Flink - Real Time Streaming with Kafka and Flink Lab 2 Nov 9
  • Benefits and Opportunities of Stateful Stream Processing Nov 2

October

6 posts in total
  • Deploy Aiven OpenSearch Sink Connector - Kafka Connect for AWS Services Integration Part 5 Oct 30
  • Produce data to Kafka using Lambda - Real Time Streaming with Kafka and Flink Lab 1 Oct 26
  • Develop Aiven OpenSearch Sink Connector - Kafka Connect for AWS Services Integration Part 4 Oct 23
  • Building Apache Flink Applications in Python Oct 19
  • How I Prepared for Certified Kubernetes Application Developer (CKAD) Oct 12
  • Real Time Streaming with Kafka and Flink - Introduction Oct 5

September

2 posts in total
  • Deployment via AWS Managed Flink - Kafka, Flink and DynamoDB for Real Time Fraud Detection Part 2 Sep 14
  • Getting Started with PyFlink on AWS - Part 3 AWS Managed Flink and MSK Sep 4

August

3 posts in total
  • Getting Started with PyFlink on AWS - Part 2 Local Flink and MSK Aug 28
  • Getting Started with PyFlink on AWS - Part 1 Local Flink and Local Kafka Aug 17
  • Local Development - Kafka, Flink and DynamoDB for Real Time Fraud Detection Part 1 Aug 10

July

4 posts in total
  • Kafka Development with Docker - Part 11 Kafka Authorization Jul 20
  • Kafka Development with Docker - Part 10 SASL Authentication Jul 13
  • Kafka Development with Docker - Part 9 SSL Authentication Jul 6
  • Deploy Camel DynamoDB Sink Connector - Kafka Connect for AWS Services Integration Part 3 Jul 3

June

6 posts in total
  • Kafka Development with Docker - Part 8 SSL Encryption Jun 29
  • Producer and Consumer with Glue Schema Registry - Kafka Development with Docker Part 7 Jun 22
  • Kafka Development with Docker - Part 6 Kafka Connect with Glue Schema Registry Jun 15
  • Kafka Development with Docker - Part 5 Glue Schema Registry Jun 8
  • Develop Camel DynamoDB Sink Connector - Kafka Connect for AWS Services Integration Part 2 Jun 4
  • Kafka Development with Docker - Part 4 Producer and Consumer Jun 1

May

5 posts in total
  • Kafka Development with Docker - Part 3 Kafka Connect May 25
  • Kafka Development with Docker - Part 2 Management App May 18
  • How I Prepared for Confluent Certified Developer for Apache Kafka as a Non-Java Developer May 11
  • Kafka Development with Docker - Part 1 Cluster Setup May 4
  • Kafka Connect for AWS Services Integration - Part 1 Introduction May 3

April

2 posts in total
  • Self-managed Blog with Hugo and GitHub Pages Apr 24
  • Integrate Glue Schema Registry with Your Python Kafka App Apr 12

March

1 post in total
  • Simplify Streaming Ingestion on AWS - Part 2 MSK and Athena Mar 14

February

1 post in total
  • Simplify Streaming Ingestion on AWS - Part 1 MSK and Redshift Feb 8

January

1 post in total
  • How to configure Kafka consumers to seek offsets by timestamp Jan 10
Profile
Jaehyeon Kim
Jaehyeon Kim
Data Engineer | Data Streaming Enthusiast | Powering ML & AI in Real Time
Taxonomies
Data Streaming 70 Data Engineering 38 Development 28 Data Analysis 17 Data Integration 12 Open Source 7 Kubernetes 6 Machine Learning 5 Security 5 Data Architecture 3 Data Processing 3 Big Data 2 System Architecture 2 Web Development 2
Python 75 Apache Kafka 68 AWS 50 Docker 50 R 37 Apache Flink 34 Kpow 22 Apache Beam 17 Apache Spark 16 Kafka Connect 15 Amazon MSK 14 AWS Lambda 14 dbt 13 Amazon EMR 11 Kubernetes 8 PyFlink 8 Kotlin 7 PostgreSQL 7 Change Data Capture (CDC) 6 Debezium 6 dynamic-des 6 Amazon DynamoDB 5 Apache Airflow 5 Discrete Event Simulation 5 Factor House Local 5 PySpark 5 Amazon API Gateway 4 Amazon Athena 4 Apache Iceberg 4 AWS Glue 4 AWS Glue Schema Registry 4 BigQuery 4 Digital Twin 4 FastAPI 4 Minikube 4 R Shiny 4 RServe 4 SimPy 4 Amazon EKS 3 Amazon QuickSight 3 ALL 137
Kafka Development with Docker 11 Apache Beam Python Examples 10 Real Time Streaming with Kafka and Flink 7 dbt Pizza Shop Demo 6 Tree Based Methods in R 6 Apache Beam Local Development with Python 5 Building Real-Time Digital Twins with dynamic-des 5 dbt for Effective Data Transformation on AWS 5 Getting Started with Real-Time Streaming in Kotlin 5 Kafka Connect for AWS Services Integration 5 Serverless Data Product 4 Data Lake Demo Using Change Data Capture 3 Getting Started with PyFlink on AWS 3 Kafka Development on Kubernetes 3 Parallel processing on single machine 3 Realtime Dashboard with FastAPI, Streamlit and Next.js 3 API development with R 2 dbt Guide for Production 2 Deploy Python Stream Processing App on Kubernetes 2 Download Stock Data 2 ALL 24
2026 11 2025 13 2024 29 2023 39 2022 15 2021 7 2020 1 2019 5 2018 2 2017 6 2016 6 2015 15 2014 5
Posts
  • featured.png
    Building an Agentic Analytics System over an Iceberg Lakehouse
    July 18, 2026
  • featured.png
    Dynamic DES v0.11.1: A Declarative API with Postgres and Redis Connectors
    July 17, 2026
  • featured.png
    Introducing odctl: One CLI for a Local Open Data Stack
    July 16, 2026
  • featured.png
    One Simulation, Two Pipelines: Batch Training and Live Inference with Dynamic DES v0.8.1
    May 25, 2026
  • featured.png
    Building an Event-Driven Hybrid Digital Twin with dynamic-des
    April 29, 2026
  • featured.png
    Why Digital Twins Are Rewiring Industry 4.0
    April 22, 2026
  • featured.png
    Building a Real-Time Industrial Digital Twin with Apache Flink and Online Machine Learning
    April 21, 2026
  • featured.png
    Slides as Code: Integrating Reveal.js into my Hugo Blog
    March 9, 2026
  • featured.gif
    Productionizing an Online Product Recommender using Event Driven Architecture
    February 23, 2026
  • featured.png
    Stream Processing with Flink in Kotlin
    December 10, 2025
  • featured.png
    Building an Agentic Analytics System over an Iceberg Lakehouse
    July 18, 2026
  • featured.png
    Dynamic DES v0.11.1: A Declarative API with Postgres and Redis Connectors
    July 17, 2026
  • featured.png
    Introducing odctl: One CLI for a Local Open Data Stack
    July 16, 2026
  • featured.png
    One Simulation, Two Pipelines: Batch Training and Live Inference with Dynamic DES v0.8.1
    May 25, 2026
  • featured.jfif
    Current London 2026: Building End-to-End Data Lineage
    May 22, 2026
  • featured.png
    Building an Event-Driven Hybrid Digital Twin with dynamic-des
    April 29, 2026
  • featured.png
    Why Digital Twins Are Rewiring Industry 4.0
    April 22, 2026
  • featured.png
    Building a Real-Time Industrial Digital Twin with Apache Flink and Online Machine Learning
    April 21, 2026
  • featured.png
    Slides as Code: Integrating Reveal.js into my Hugo Blog
    March 9, 2026
  • featured.gif
    Productionizing an Online Product Recommender using Event Driven Architecture
    February 23, 2026
Actions
Go back Reload Copy URL

Jaehyeon Kim

Data Engineer | Data Streaming Enthusiast | Powering ML & AI in Real Time

Copyright © 2023-2026 Jaehyeon Kim. All Rights Reserved.