Jaehyeon Kim
Jaehyeon Kim

  • Blog
    • Categories

      List of categories.

    • Tags

      List of tags.

    • Series

      List of series.

    • Archives

  • Projects
  • Slides

/

  • Github Linkedin RSS

  • Font Size
  • Palette
  • Mode

Building an Agentic Analytics System over an Iceberg Lakehouse

featured.png
July 18, 20266 min read Data-Engineering Machine-Learning Open SourceAgentic AIApache IcebergDynamic-DesMem0OdctlStrandsTrinoWrenAI

A local open source proof of concept that puts a semantic layer between a language model and an Iceberg lakehouse, using Strands, WrenAI and Trino.

Read More

Dynamic DES v0.11.1: A Declarative API with Postgres and Redis Connectors

featured.png
July 17, 20264 min read Data-Engineering Open Source Building Real-Time Digital Twins With Dynamic-DesApache KafkaDigital TwinDiscrete Event SimulationDynamic-DesPostgreSQLPythonRedisSimPy

Dynamic DES v0.11.1 adds a declarative SimulationContext API, native Postgres and Redis ingress and egress connectors, and broader object storage.

Read More

Introducing odctl: One CLI for a Local Open Data Stack

featured.png
July 16, 20264 min read Data-Engineering Open SourceApache FlinkApache IcebergApache KafkaApache SparkOdctlOpen Data StackPythonTrino

odctl is a CLI on PyPI that launches Kafka, Flink, Spark, Trino, Iceberg, Airflow and an MLOps and observability suite as one local stack.

Read More

One Simulation, Two Pipelines: Batch Training and Live Inference with Dynamic DES v0.8.1

featured.png
May 25, 20263 min read Data-Engineering Machine-Learning Open Source Building Real-Time Digital Twins With Dynamic-DesApache KafkaData LakeDiscrete Event SimulationDynamic-DesParquetPythonSimPy

Dynamic DES v0.8.1 adds data lake integration, so one SimPy codebase writes batch Parquet data for ML training and streams live Kafka events.

Read More

Current London 2026: Building End-to-End Data Lineage

featured.jfif
May 22, 20263 min read Data-EngineeringApache FlinkApache KafkaApache SparkData LineageOpenLineage

A comprehensive walkthrough from my session at Current London 2026 on capturing and visualizing data lineage across a production-style data stack.

Read More

Building an Event-Driven Hybrid Digital Twin with dynamic-des

featured.png
April 29, 20269 min read Data-Engineering Open Source System-Architecture Building Real-Time Digital Twins With Dynamic-DesApache KafkaDigital TwinDiscrete Event SimulationDynamic-DesIoTPythonSimPy

Turn a static model into a synchronized forecasting engine with dynamic-des, using the Switchboard pattern, mutable resources and dynamic topic routing.

Read More

Why Digital Twins Are Rewiring Industry 4.0

featured.png
April 22, 20265 min read Open Source System-Architecture Building Real-Time Digital Twins With Dynamic-DesDigital TwinDiscrete Event SimulationDynamic-DesIoTPythonSimPy

Compare the architectural layers that separate a traditional simulation, an operational digital twin and an event-driven hybrid pipeline.

Read More

Building a Real-Time Industrial Digital Twin with Apache Flink and Online Machine Learning

featured.png
April 21, 20269 min read Data-Streaming Machine-Learning Open Source Building Real-Time Digital Twins With Dynamic-DesApache FlinkApache KafkaDigital TwinDiscrete Event SimulationDynamic-DesKotlinOnline Machine LearningPython

An Apache Flink and Kotlin streaming architecture where online machine learning detects concept drift from machinery wear, controlled by a shadow mode router.

Read More

Slides as Code: Integrating Reveal.js into my Hugo Blog

featured.png
March 9, 20265 min read Web DevelopmentHugoJavaScriptMarkdownMarpReveal.js

Reveal.js slides written in Markdown and built by Hugo alongside blog posts, with code walkthroughs, fragments, MathJax and Mermaid diagrams.

Read More

Productionizing an Online Product Recommender using Event Driven Architecture

featured.gif
February 23, 202610 min read Machine-Learning From Prototype to Production: Real-Time Product Recommendation With Contextual BanditsApache FlinkApache KafkaContextual BanditsOnline Machine LearningOpen Data StackPythonRecommender SystemValkey

Apache Flink, Kafka and Valkey turn a contextual bandit recommender into an event driven service with stateful training and low latency inference.

Read More
  • ««
  • «
  • 1
  • 2
  • 3
  • 4
  • 5
  • »
  • »»
Profile
Jaehyeon Kim
Jaehyeon Kim
Data Engineer | Data Streaming Enthusiast | Powering ML & AI in Real Time
Taxonomies
Data Streaming 70 Data Engineering 38 Development 28 Data Analysis 17 Data Integration 12 Open Source 7 Kubernetes 6 Machine Learning 5 Security 5 Data Architecture 3 Data Processing 3 Big Data 2 System Architecture 2 Web Development 2
Python 75 Apache Kafka 68 AWS 50 Docker 50 R 37 Apache Flink 34 Kpow 22 Apache Beam 17 Apache Spark 16 Kafka Connect 15 Amazon MSK 14 AWS Lambda 14 dbt 13 Amazon EMR 11 Kubernetes 8 PyFlink 8 Kotlin 7 PostgreSQL 7 Change Data Capture (CDC) 6 Debezium 6 dynamic-des 6 Amazon DynamoDB 5 Apache Airflow 5 Discrete Event Simulation 5 Factor House Local 5 PySpark 5 Amazon API Gateway 4 Amazon Athena 4 Apache Iceberg 4 AWS Glue 4 AWS Glue Schema Registry 4 BigQuery 4 Digital Twin 4 FastAPI 4 Minikube 4 R Shiny 4 RServe 4 SimPy 4 Amazon EKS 3 Amazon QuickSight 3 ALL 137
Kafka Development with Docker 11 Apache Beam Python Examples 10 Real Time Streaming with Kafka and Flink 7 dbt Pizza Shop Demo 6 Tree Based Methods in R 6 Apache Beam Local Development with Python 5 Building Real-Time Digital Twins with dynamic-des 5 dbt for Effective Data Transformation on AWS 5 Getting Started with Real-Time Streaming in Kotlin 5 Kafka Connect for AWS Services Integration 5 Serverless Data Product 4 Data Lake Demo Using Change Data Capture 3 Getting Started with PyFlink on AWS 3 Kafka Development on Kubernetes 3 Parallel processing on single machine 3 Realtime Dashboard with FastAPI, Streamlit and Next.js 3 API development with R 2 dbt Guide for Production 2 Deploy Python Stream Processing App on Kubernetes 2 Download Stock Data 2 ALL 24
2026 11 2025 13 2024 29 2023 39 2022 15 2021 7 2020 1 2019 5 2018 2 2017 6 2016 6 2015 15 2014 5
Posts
  • featured.png
    Building an Agentic Analytics System over an Iceberg Lakehouse
    July 18, 2026
  • featured.png
    Dynamic DES v0.11.1: A Declarative API with Postgres and Redis Connectors
    July 17, 2026
  • featured.png
    Introducing odctl: One CLI for a Local Open Data Stack
    July 16, 2026
  • featured.png
    One Simulation, Two Pipelines: Batch Training and Live Inference with Dynamic DES v0.8.1
    May 25, 2026
  • featured.png
    Building an Event-Driven Hybrid Digital Twin with dynamic-des
    April 29, 2026
  • featured.png
    Why Digital Twins Are Rewiring Industry 4.0
    April 22, 2026
  • featured.png
    Building a Real-Time Industrial Digital Twin with Apache Flink and Online Machine Learning
    April 21, 2026
  • featured.png
    Slides as Code: Integrating Reveal.js into my Hugo Blog
    March 9, 2026
  • featured.gif
    Productionizing an Online Product Recommender using Event Driven Architecture
    February 23, 2026
  • featured.png
    Stream Processing with Flink in Kotlin
    December 10, 2025
  • featured.png
    Building an Agentic Analytics System over an Iceberg Lakehouse
    July 18, 2026
  • featured.png
    Dynamic DES v0.11.1: A Declarative API with Postgres and Redis Connectors
    July 17, 2026
  • featured.png
    Introducing odctl: One CLI for a Local Open Data Stack
    July 16, 2026
  • featured.png
    One Simulation, Two Pipelines: Batch Training and Live Inference with Dynamic DES v0.8.1
    May 25, 2026
  • featured.jfif
    Current London 2026: Building End-to-End Data Lineage
    May 22, 2026
  • featured.png
    Building an Event-Driven Hybrid Digital Twin with dynamic-des
    April 29, 2026
  • featured.png
    Why Digital Twins Are Rewiring Industry 4.0
    April 22, 2026
  • featured.png
    Building a Real-Time Industrial Digital Twin with Apache Flink and Online Machine Learning
    April 21, 2026
  • featured.png
    Slides as Code: Integrating Reveal.js into my Hugo Blog
    March 9, 2026
  • featured.gif
    Productionizing an Online Product Recommender using Event Driven Architecture
    February 23, 2026
Actions
Go back Reload Copy URL

Jaehyeon Kim

Data Engineer | Data Streaming Enthusiast | Powering ML & AI in Real Time

Copyright © 2023-2026 Jaehyeon Kim. All Rights Reserved.