Jaehyeon Kim
Jaehyeon Kim

  • Blog
    • Archives

    • Series

      List of series.

    • Categories

      List of categories.

    • Tags

      List of tags.


/

  • Github Linkedin Paypal RSS

  • Font Size
  • Palette
  • Mode
  1. Home
  2. Tags
  3. Docker

Thoughts on Apache Airflow AWS Lambda Operator

featured.png
April 13, 20209 min read Data EngineeringApache AirflowAWSAWS LambdaDockerPython

In this post, it is demonstrated how AWS Lambda can be integrated with Apache Airflow using a custom operator inspired by the ECS Operator.

Read More

Dynamic Routing and Centralized Auth With Traefik, Python and R Example

featured.png
November 29, 20199 min read DevelopmentDockerFastAPIPythonRTraefik

Traefik is a modern HTTP reverse proxy and load balancer. In this post, it'll be demonstrated how path-based routing can be set up by Traefik with Docker. Also a centralized authentication will be illustrated with the Forward Authentication feature of Traefik.

Read More

Linux Dev Environment on Windows

featured.png
November 1, 201912 min read DevelopmentDockerKubernetesMinikubePythonRWSL

In this post, I'll demonstrate how to create a Linux development environment on Windows using WSL. Also an example app (Rserve web service with a sidecar container) on Minikube will be demonstrated.

Read More

AWS Local Development With LocalStack

featured.png
July 20, 20196 min read DevelopmentAWSAWS LambdaDockerFlaskLocalStackPython

LocalStack provides an easy-to-use test/mocking framework for developing AWS applications. In this post, I'll demonstrate how to utilize LocalStack for development using a web service.

Read More

Cronicle Multi Server Setup

featured.png
July 19, 20195 min read DevelopmentCronicleDocker

Cronicle is a multi-server task scheduler and runner. In this post, multi-server configuration of Cronicle will be demonstrated with Docker and Nginx as load balancer.

Read More

API Development With R Part II

featured.png
November 19, 20176 min read Development API Development With RDockerPlumberRRApacheRserve

In part I, it is discussed how to serve an R function with plumber, Rserve and rApache. In this post, the APIs are deployed in a Docker container and, after showing example requests, their performance is compared.

Read More

API Development With R Part I

featured.png
November 18, 20177 min read Development API Development With RDockerPlumberRRApacheRserve

API is an effective way of distributing analysis outputs to external clients. When it comes to API development with R, however, there are not many choices. In this post, serving an R function with plumber, Rserve and rApache is discussed.

Read More
  • ««
  • «
  • 1
  • 2
  • 3
  • 4
  • 5
  • »
  • »»
Profile
Jaehyeon Kim
Jaehyeon Kim
Developer Experience at Factor House | Technical Content Creator
Taxonomies
Data Streaming 63 Data Engineering 30 Development 27 Data Analysis 17 Data Integration 12 Kubernetes 5 Security 5 Data Processing 3 Data Architecture 2
Python 66 Apache Kafka 58 AWS 50 Docker 47 R 37 Apache Flink 28 Apache Beam 17 Kafka Connect 15 Amazon MSK 14 AWS Lambda 14 Apache Spark 13 Dbt 13 Amazon EMR 11 Kubernetes 8 Pyflink 8 Change Data Capture (CDC) 6 Debezium 6 Amazon DynamoDB 5 Apache Airflow 5 PostgreSQL 5 PySpark 5 Amazon API Gateway 4 Amazon Athena 4 AWS Glue 4 AWS Glue Schema Registry 4 BigQuery 4 Minikube 4 R Shiny 4 RServe 4 Amazon EKS 3 Amazon QuickSight 3 Apache Hudi 3 EMR on EKS 3 FastAPI 3 GCP 3 GRPC 3 Kpow 3 SparkR 3 WebSocket 3 Amazon Redshift 2 ALL 105
Kafka Development With Docker 11 Apache Beam Python Examples 10 Real Time Streaming With Kafka and Flink 7 DBT Pizza Shop Demo 6 Tree Based Methods in R 6 Apache Beam Local Development With Python 5 DBT for Effective Data Transformation on AWS 5 Kafka Connect for AWS Services Integration 5 Serverless Data Product 4 Data Lake Demo Using Change Data Capture 3 Getting Started With Pyflink on AWS 3 Kafka Development on Kubernetes 3 Parallel Processing on Single Machine 3 Realtime Dashboard With FastAPI, Streamlit and Next.js 3 API Development With R 2 DBT Guide for Production 2 Deploy Python Stream Processing App on Kubernetes 2 Getting Started With Real-Time Streaming in Kotlin 2 Integrate Schema Registry With MSK Connect 2 Kafka, Flink and DynamoDB for Real Time Fraud Detection 2 ALL 21
2025 7 2024 29 2023 39 2022 15 2021 7 2020 1 2019 5 2018 2 2017 6 2016 6 2015 15 2014 5
Posts
  • featured.png
    Meet the Streamhouse Trio - Paimon, Fluss, and Iceberg for Unified Data Architectures
    May 6, 2025
  • featured.gif
    Run Flink SQL Cookbook in Docker
    April 15, 2025
  • featured.gif
    Realtime Dashboard With FastAPI, Streamlit and Next.js - Part 1 Data Producer
    February 18, 2025
  • featured.png
    Change Data Capture (CDC) Local Development With PostgreSQL, Debezium Server and Pub/Sub Emulator
    November 7, 2024
  • featured.png
    Guide to Running DBT in Production
    September 13, 2024
  • featured.png
    DBT CI/CD Demo With BigQuery and GitHub Actions
    September 5, 2024
  • featured.png
    Cache Data on Apache Beam Pipelines Using a Shared Object
    August 22, 2024
  • featured.png
    Apache Beam Python Examples - Part 1 Calculate K Most Frequent Words and Max Word Length
    July 4, 2024
  • featured.png
    Deploy Python Stream Processing App on Kubernetes - Part 1 PyFlink Application
    May 30, 2024
  • featured.png
    Apache Beam Local Development With Python - Part 1 Pipeline, Notebook, SQL and DataFrame
    March 28, 2024
  • featured.png
    Kafka Clients With Avro - Schema Registry and Order Events
    May 27, 2025
  • featured.png
    Kafka Clients With JSON - Producing and Consuming Order Events
    May 20, 2025
  • featured.png
    Meet the Streamhouse Trio - Paimon, Fluss, and Iceberg for Unified Data Architectures
    May 6, 2025
  • featured.gif
    Run Flink SQL Cookbook in Docker
    April 15, 2025
  • featured.gif
    Realtime Dashboard With FastAPI, Streamlit and Next.js - Part 3 Next.js Dashboard
    March 4, 2025
  • featured.gif
    Realtime Dashboard With FastAPI, Streamlit and Next.js - Part 2 Streamlit Dashboard
    February 25, 2025
  • featured.gif
    Realtime Dashboard With FastAPI, Streamlit and Next.js - Part 1 Data Producer
    February 18, 2025
  • featured.png
    Apache Beam Python Examples - Part 10 Develop Streaming File Reader Using Splittable DoFn
    December 19, 2024
  • featured.png
    Apache Beam Python Examples - Part 9 Develop Batch File Reader and PiSampler Using Splittable DoFn
    December 5, 2024
  • featured.png
    Apache Beam Python Examples - Part 8 Enhance Sport Activity Tracker With Runner Motivation
    November 21, 2024
Actions
Go back Reload Copy URL

Jaehyeon Kim

Developer Experience at Factor House | Technical Content Creator

Copyright © 2023-2025 Jaehyeon Kim. All Rights Reserved.