Jaehyeon Kim
Jaehyeon Kim

  • Blog
    • Categories

      List of categories.

    • Tags

      List of tags.

    • Series

      List of series.

    • Archives

  • Projects
  • Slides

/

  • Github Linkedin RSS

  • Font Size
  • Palette
  • Mode

Guide to Building Integrated Web Applications with FastAPI and NiceGUI

Guide to Building Integrated Web Applications with FastAPI and NiceGUI
November 19, 202511 min read DevelopmentDockerFastAPINiceGUIPostgreSQLPydanticPythonSoftware ArchitectureSQLModel

FastAPI and NiceGUI served from one Python process give a backend API and a web UI in a single codebase, compared here with React and with Streamlit.

Read More: Guide to Building Integrated Web Applications with FastAPI and NiceGUI

Self-service Data Platform via a Multi-tenant SQL Gateway

Self-service Data Platform via a Multi-tenant SQL Gateway
July 17, 202515 min read Big Data Data Architecture Data-Engineering Data-StreamingApache FlinkApache KyuubiApache RangerApache SparkMarquezOpenLineageSQL GatewayTrino

Apache Kyuubi as a multi-tenant SQL gateway that provisions on-demand Spark, Flink and Trino engines, giving self-service analytics with central governance.

Read More: Self-service Data Platform via a Multi-tenant SQL Gateway

Flink Table API - Declarative Analytics for Supplier Stats in Real Time

Flink Table API - Declarative Analytics for Supplier Stats in Real Time
June 17, 202520 min read Data-Streaming Getting Started With Real-Time Streaming in KotlinApache FlinkApache KafkaBenchtopDockerKafka StreamsKafka-UiKotlinOdctl

Flink Table API in Kotlin states the supplier statistics as a declarative windowed aggregation over a DataStream, with late rows routed by hand.

Read More: Flink Table API - Declarative Analytics for Supplier Stats in Real Time

Flink DataStream API - Scalable Event Processing for Supplier Stats

Flink DataStream API - Scalable Event Processing for Supplier Stats
June 10, 202517 min read Data-Streaming Getting Started With Real-Time Streaming in KotlinApache FlinkApache KafkaBenchtopDockerKafka StreamsKafka-UiKotlinOdctl

Flink DataStream API in Kotlin computes the same supplier statistics, using watermarks for event time and side outputs to collect late order events.

Read More: Flink DataStream API - Scalable Event Processing for Supplier Stats

Kafka Streams - Lightweight Real-Time Processing for Supplier Stats

Kafka Streams - Lightweight Real-Time Processing for Supplier Stats
June 3, 202519 min read Data-Streaming Getting Started With Real-Time Streaming in KotlinApache KafkaBenchtopDockerKafka StreamsKafka-UiKotlinOdctl

Kafka Streams in Kotlin aggregates Avro order events into tumbling window supplier statistics and handles late records with a custom extractor.

Read More: Kafka Streams - Lightweight Real-Time Processing for Supplier Stats

Kafka Clients with Avro - Schema Registry and Order Events

Kafka Clients with Avro - Schema Registry and Order Events
May 27, 202514 min read Data-Streaming Getting Started With Real-Time Streaming in KotlinApache KafkaBenchtopDockerKafka-UiKotlinOdctl

Avro and Schema Registry replace hand written JSON codecs in a Kotlin Kafka producer and consumer, with generated classes and graceful shutdown.

Read More: Kafka Clients with Avro - Schema Registry and Order Events

Kafka Clients with JSON - Producing and Consuming Order Events

Kafka Clients with JSON - Producing and Consuming Order Events
May 20, 202514 min read Data-Streaming Getting Started With Real-Time Streaming in KotlinApache KafkaBenchtopDockerKafka-UiKotlinOdctl

A Kotlin Kafka producer and consumer for order events, with custom JSON serialisers, admin helpers and a Gradle build, run on odctl.

Read More: Kafka Clients with JSON - Producing and Consuming Order Events

Meet the Streamhouse Trio - Paimon, Fluss, and Iceberg for Unified Data Architectures

Meet the Streamhouse Trio - Paimon, Fluss, and Iceberg for Unified Data Architectures
May 6, 20256 min read Big Data Data Architecture Data-Engineering Data-StreamingApache FlinkApache IcebergApache PaimonFluss

Apache Paimon, Fluss and Apache Iceberg compared as table layers for streaming and batch, then combined into one architecture with Flink and Spark.

Read More: Meet the Streamhouse Trio - Paimon, Fluss, and Iceberg for Unified Data Architectures

Run Flink SQL Cookbook in Docker

Run Flink SQL Cookbook in Docker
April 15, 20256 min read Data-StreamingApache FlinkDockerDocker ComposeFlink SQL

Docker Compose runs a local Apache Flink cluster and SQL Client so the Ververica Flink SQL Cookbook recipes work without the Ververica Platform.

Read More: Run Flink SQL Cookbook in Docker

Next.js Dashboard - Realtime Dashboard with FastAPI, Streamlit and Next.js Part 3

Next.js Dashboard - Realtime Dashboard with FastAPI, Streamlit and Next.js Part 3
March 4, 20257 min read Development Realtime Dashboard With FastAPI, Streamlit and Next.jsApache EChartsBenchtopNext.jsReactWebSocket

Next.js and React with Apache ECharts show the same live order and revenue metrics, reading from the FastAPI WebSocket server in the browser.

Read More: Next.js Dashboard - Realtime Dashboard with FastAPI, Streamlit and Next.js Part 3
  • ««
  • «
  • 1
  • 2
  • 3
  • 4
  • 5
  • »
  • »»
Profile
Jaehyeon Kim
Jaehyeon Kim
Data Engineer | Data Streaming | Powering ML & AI in Real Time
Taxonomies
Data Streaming 70 Data Engineering 45 Development 28 Data Analysis 17 Open Source 15 Data Integration 12 Machine Learning 7 Kubernetes 6 Security 5 Data Architecture 3 Data Processing 3 Big Data 2 System Architecture 2 Web Development 2
Python 79 Apache Kafka 73 AWS 50 Docker 50 Apache Flink 39 Apache Beam 17 Apache Spark 17 Kafka Connect 16 Amazon MSK 14 AWS Lambda 14 Benchtop 13 dbt 13 desflow 13 odctl 12 Amazon EMR 11 PostgreSQL 10 Discrete Event Simulation 8 Kubernetes 8 PyFlink 8 Apache Iceberg 7 Change Data Capture (CDC) 7 Debezium 7 Kotlin 7 SimPy 7 Apache Airflow 6 Kafka UI 6 Amazon DynamoDB 5 PySpark 5 Amazon API Gateway 4 Amazon Athena 4 AWS Glue 4 AWS Glue Schema Registry 4 BigQuery 4 Digital Twin 4 FastAPI 4 Minikube 4 Amazon EKS 3 Amazon QuickSight 3 Amazon S3 3 Apache Hudi 3 ALL 144
Kafka Development with Docker 11 Apache Beam Python Examples 10 Building Real-Time Digital Twins with desflow 8 Real Time Streaming with Kafka and Flink 7 dbt Pizza Shop Demo 6 Apache Beam Local Development with Python 5 dbt for Effective Data Transformation on AWS 5 Getting Started with Real-Time Streaming in Kotlin 5 Kafka Connect for AWS Services Integration 5 Serverless Data Product 4 Data Lake Demo Using Change Data Capture 3 Getting Started with PyFlink on AWS 3 Kafka Development on Kubernetes 3 Parallel processing on single machine 3 Realtime Dashboard with FastAPI, Streamlit and Next.js 3 API development with R 2 dbt Guide for Production 2 Deploy Python Stream Processing App on Kubernetes 2 Download Stock Data 2 From Prototype to Production: Real-Time Product Recommendation with Contextual Bandits 2 ALL 25
2026 19 2025 13 2024 29 2023 39 2022 15 2021 7 2020 1 2019 5 2018 2 2017 6 2016 6 2015 15 2014 5
Posts
  • desflow from the Command Line: One Model, Every Command
    desflow from the Command Line: One Model, Every Command
    October 30, 2026
  • From dynamic-des to desflow: What Changed in Five Releases
    From dynamic-des to desflow: What Changed in Five Releases
    October 28, 2026
  • odctl 1.0: Kafka, Flink, Spark, Iceberg, Trino and MLflow on Your Laptop with One Command
    odctl 1.0: Kafka, Flink, Spark, Iceberg, Trino and MLflow on Your Laptop with One Command
    October 12, 2026
  • Defining Data-Streaming Simulations in YAML, Without Writing Python
    Defining Data-Streaming Simulations in YAML, Without Writing Python
    October 6, 2026
  • Keeping Game Leaderboards Up to Date in Real Time with Kafka and Flink SQL
    Keeping Game Leaderboards Up to Date in Real Time with Kafka and Flink SQL
    October 2, 2026
  • Change Data Capture on a Simulated Online Shop with Debezium and Kafka Connect
    Change Data Capture on a Simulated Online Shop with Debezium and Kafka Connect
    October 1, 2026
  • Building an Agentic Analytics System over an Iceberg Lakehouse
    Building an Agentic Analytics System over an Iceberg Lakehouse
    July 18, 2026
  • Current London 2026: Building End-to-End Data Lineage
    Current London 2026: Building End-to-End Data Lineage
    May 22, 2026
  • Building a Real-Time Industrial Digital Twin with Apache Flink and Online Machine Learning
    Building a Real-Time Industrial Digital Twin with Apache Flink and Online Machine Learning
    April 21, 2026
  • Productionizing an Online Product Recommender using Event Driven Architecture
    Productionizing an Online Product Recommender using Event Driven Architecture
    February 23, 2026
  • desflow from the Command Line: One Model, Every Command
    desflow from the Command Line: One Model, Every Command
    October 30, 2026
  • From dynamic-des to desflow: What Changed in Five Releases
    From dynamic-des to desflow: What Changed in Five Releases
    October 28, 2026
  • odctl 1.0: Kafka, Flink, Spark, Iceberg, Trino and MLflow on Your Laptop with One Command
    odctl 1.0: Kafka, Flink, Spark, Iceberg, Trino and MLflow on Your Laptop with One Command
    October 12, 2026
  • Defining Data-Streaming Simulations in YAML, Without Writing Python
    Defining Data-Streaming Simulations in YAML, Without Writing Python
    October 6, 2026
  • Keeping Game Leaderboards Up to Date in Real Time with Kafka and Flink SQL
    Keeping Game Leaderboards Up to Date in Real Time with Kafka and Flink SQL
    October 2, 2026
  • Change Data Capture on a Simulated Online Shop with Debezium and Kafka Connect
    Change Data Capture on a Simulated Online Shop with Debezium and Kafka Connect
    October 1, 2026
  • Data Streaming and Machine Learning Projects That Run on Your Laptop
    Data Streaming and Machine Learning Projects That Run on Your Laptop
    September 30, 2026
  • Learning MLOps with a Feature Store: A New Series
    Learning MLOps with a Feature Store: A New Series
    September 28, 2026
  • Building an Agentic Analytics System over an Iceberg Lakehouse
    Building an Agentic Analytics System over an Iceberg Lakehouse
    July 18, 2026
  • desflow: A Declarative API with Postgres and Redis Connectors
    desflow: A Declarative API with Postgres and Redis Connectors
    July 17, 2026
Actions
Go back Reload Copy URL

Jaehyeon Kim

Data Engineer | Data Streaming | Powering ML & AI in Real Time

Copyright © 2023-2026 Jaehyeon Kim. All Rights Reserved.