Jaehyeon Kim
Jaehyeon Kim

  • Blog
    • Categories

      List of categories.

    • Tags

      List of tags.

    • Series

      List of series.

    • Archives

  • Projects
  • Slides

/

  • Github Linkedin RSS

  • Font Size
  • Palette
  • Mode
  1. Home
  2. blogs

Parallel Processing on Single Machine - Part 2

March 17, 20156 min read Data Analysis Parallel Processing on Single MachineR

Loop in parallel on one machine in R with the foreach and doParallel packages, with the iterators package covered for writing the loop itself.

Read More: Parallel Processing on Single Machine - Part 2

Parallel Processing on Single Machine - Part 1

March 14, 20157 min read Data Analysis Parallel Processing on Single MachineR

Run parallel tasks on one machine in R with the snow and parallel packages, comparing clusterApply, clusterApplyLB, parLapply and parLapplyLB.

Read More: Parallel Processing on Single Machine - Part 1

Tree Based Methods in R - Part 6

March 7, 20155 min read Data Analysis Tree Based Methods in RR

Compare a single classification tree in R with 500 bagged trees on out-of-bag and test errors, cumulative errors and variable importance measures.

Read More: Tree Based Methods in R - Part 6

Tree Based Methods in R - Part 5

March 5, 20154 min read Data Analysis Tree Based Methods in RR

Evaluate a single regression tree in R against 2000 bagged trees, comparing out-of-bag and test errors, cumulative errors and variable importance.

Read More: Tree Based Methods in R - Part 5

Tree Based Methods in R - Part 4

February 15, 201510 min read Data Analysis Tree Based Methods in RR

Part IV of tree based methods in R series. 3 R packages for classification analysis are compared - rpart, caret and mlr packages.

Read More: Tree Based Methods in R - Part 4

Tree Based Methods in R - Part 3

February 14, 201510 min read Data Analysis Tree Based Methods in RR

Fit a regression tree on the Carseats data in R, comparing the pruning parameter caret selects against the 1-SE rule that the rpart package recommends.

Read More: Tree Based Methods in R - Part 3

Tree Based Methods in R - Part 2

February 8, 20157 min read Data Analysis Tree Based Methods in RR

Cost-sensitive classification with rpart and caret in R, treating a missed High class as twice as expensive by altering the priors and the loss matrix.

Read More: Tree Based Methods in R - Part 2

Tree Based Methods in R - Part 1

February 1, 20156 min read Data Analysis Tree Based Methods in RR

Fit a CART classification model on the ISLR Carseats data with the rpart package in R, and tune the pruning parameter with the caret package.

Read More: Tree Based Methods in R - Part 1

Quick Trial of Adding Column

January 14, 20152 min read Data AnalysisR

Add overall and per-user average columns to an R data frame with base, plyr, dplyr and data.table, and time how long each of the five approaches takes.

Read More: Quick Trial of Adding Column

Looping without for

December 17, 20144 min read Data AnalysisR

Replace for-loops in R with the apply family of functions and the plyr package, using two worked examples that make the code shorter and easier to debug.

Read More: Looping without for
  • ««
  • «
  • 12
  • 13
  • 14
  • 15
  • 16
  • »
  • »»
Profile
Jaehyeon Kim
Jaehyeon Kim
Data Engineer | Data Streaming | Powering ML & AI in Real Time
Taxonomies
Data Streaming 70 Data Engineering 38 Development 28 Data Analysis 17 Data Integration 12 Open Source 7 Kubernetes 6 Machine Learning 5 Security 5 Data Architecture 3 Data Processing 3 Big Data 2 System Architecture 2 Web Development 2
Python 75 Apache Kafka 68 AWS 50 Docker 50 Apache Flink 34 Apache Beam 17 Apache Spark 16 Kafka Connect 15 Amazon MSK 14 AWS Lambda 14 dbt 13 Amazon EMR 11 Kubernetes 8 PyFlink 8 Kotlin 7 PostgreSQL 7 Change Data Capture (CDC) 6 Debezium 6 dynamic-des 6 Amazon DynamoDB 5 Apache Airflow 5 Discrete Event Simulation 5 Factor House Local 5 PySpark 5 Amazon API Gateway 4 Amazon Athena 4 Apache Iceberg 4 AWS Glue 4 AWS Glue Schema Registry 4 BigQuery 4 Digital Twin 4 FastAPI 4 Minikube 4 SimPy 4 Amazon EKS 3 Amazon QuickSight 3 Amazon S3 3 Apache Hudi 3 EMR on EKS 3 GCP 3 ALL 137
Kafka Development with Docker 11 Apache Beam Python Examples 10 Real Time Streaming with Kafka and Flink 7 dbt Pizza Shop Demo 6 Apache Beam Local Development with Python 5 Building Real-Time Digital Twins with dynamic-des 5 dbt for Effective Data Transformation on AWS 5 Getting Started with Real-Time Streaming in Kotlin 5 Kafka Connect for AWS Services Integration 5 Serverless Data Product 4 Data Lake Demo Using Change Data Capture 3 Getting Started with PyFlink on AWS 3 Kafka Development on Kubernetes 3 Parallel processing on single machine 3 Realtime Dashboard with FastAPI, Streamlit and Next.js 3 API development with R 2 dbt Guide for Production 2 Deploy Python Stream Processing App on Kubernetes 2 Download Stock Data 2 From Prototype to Production: Real-Time Product Recommendation with Contextual Bandits 2 ALL 24
2026 11 2025 13 2024 29 2023 39 2022 15 2021 7 2020 1 2019 5 2018 2 2017 6 2016 6 2015 15 2014 5
Posts
  • Building an Agentic Analytics System over an Iceberg Lakehouse
    Building an Agentic Analytics System over an Iceberg Lakehouse
    July 18, 2026
  • Dynamic DES v0.11.1: A Declarative API with Postgres and Redis Connectors
    Dynamic DES v0.11.1: A Declarative API with Postgres and Redis Connectors
    July 17, 2026
  • Introducing odctl: One CLI for a Local Open Data Stack
    Introducing odctl: One CLI for a Local Open Data Stack
    July 16, 2026
  • One Simulation, Two Pipelines: Batch Training and Live Inference with Dynamic DES v0.8.1
    One Simulation, Two Pipelines: Batch Training and Live Inference with Dynamic DES v0.8.1
    May 25, 2026
  • Building an Event-Driven Hybrid Digital Twin with dynamic-des
    Building an Event-Driven Hybrid Digital Twin with dynamic-des
    April 29, 2026
  • Why Digital Twins Are Rewiring Industry 4.0
    Why Digital Twins Are Rewiring Industry 4.0
    April 22, 2026
  • Building a Real-Time Industrial Digital Twin with Apache Flink and Online Machine Learning
    Building a Real-Time Industrial Digital Twin with Apache Flink and Online Machine Learning
    April 21, 2026
  • Slides as Code: Integrating Reveal.js into my Hugo Blog
    Slides as Code: Integrating Reveal.js into my Hugo Blog
    March 9, 2026
  • Productionizing an Online Product Recommender using Event Driven Architecture
    Productionizing an Online Product Recommender using Event Driven Architecture
    February 23, 2026
  • Stream Processing with Flink in Kotlin
    Stream Processing with Flink in Kotlin
    December 10, 2025
  • Building an Agentic Analytics System over an Iceberg Lakehouse
    Building an Agentic Analytics System over an Iceberg Lakehouse
    July 18, 2026
  • Dynamic DES v0.11.1: A Declarative API with Postgres and Redis Connectors
    Dynamic DES v0.11.1: A Declarative API with Postgres and Redis Connectors
    July 17, 2026
  • Introducing odctl: One CLI for a Local Open Data Stack
    Introducing odctl: One CLI for a Local Open Data Stack
    July 16, 2026
  • One Simulation, Two Pipelines: Batch Training and Live Inference with Dynamic DES v0.8.1
    One Simulation, Two Pipelines: Batch Training and Live Inference with Dynamic DES v0.8.1
    May 25, 2026
  • Current London 2026: Building End-to-End Data Lineage
    Current London 2026: Building End-to-End Data Lineage
    May 22, 2026
  • Building an Event-Driven Hybrid Digital Twin with dynamic-des
    Building an Event-Driven Hybrid Digital Twin with dynamic-des
    April 29, 2026
  • Why Digital Twins Are Rewiring Industry 4.0
    Why Digital Twins Are Rewiring Industry 4.0
    April 22, 2026
  • Building a Real-Time Industrial Digital Twin with Apache Flink and Online Machine Learning
    Building a Real-Time Industrial Digital Twin with Apache Flink and Online Machine Learning
    April 21, 2026
  • Slides as Code: Integrating Reveal.js into my Hugo Blog
    Slides as Code: Integrating Reveal.js into my Hugo Blog
    March 9, 2026
  • Productionizing an Online Product Recommender using Event Driven Architecture
    Productionizing an Online Product Recommender using Event Driven Architecture
    February 23, 2026
Actions
Go back Reload Copy URL

Jaehyeon Kim

Data Engineer | Data Streaming | Powering ML & AI in Real Time

Copyright © 2023-2026 Jaehyeon Kim. All Rights Reserved.