Jaehyeon Kim
Jaehyeon Kim
  • Blog

    • Archives

    • Series

      List of series.

    • Categories

      List of categories.

    • Tags

      List of tags.

/
  • Github Linkedin Paypal RSS
  • Font Size
  • Palette
  • Mode
  1. Home
  2. Tags
  3. VirtualBox

Spark Cluster Setup on VirtualBox

February 22, 20163 min read RApache SparkRSparkRVirtualBox

We discuss how to set up a Spark cluser between 2 Ubuntu guests. Firstly it begins with machine preparation.

Read More
Profile
Jaehyeon Kim
Jaehyeon Kim
⚙️ Data Engineer 📝 Blogger 👯 OSS Maintainer
Taxonomies
Data Streaming 28 Data Engineering 26 Development 19 R 15 Apache Beam 14 Apache Kafka 14 Machine Learning 7 General 5
Docker 62 Python 61 Docker Compose 52 Apache Kafka 46 AWS 43 R 36 Apache Flink 27 Amazon MSK 21 Apache Spark 17 Kafka Connect 17 Apache Beam 15 AWS Lambda 15 Terraform 14 Data Build Tool (DBT) 13 Amazon EMR 11 PyFlink 11 Kubernetes 10 Amazon MSK Connect 9 Amazon Athena 6 Minikube 6 PySpark 6 Amazon DynamoDB 5 Apache Airflow 5 GRPC 5 Rserve 5 Visual Studio Code 5 Amazon API Gateway 4 Amazon Managed Flink 4 Amazon Managed Service for Apache Flink 4 Amazon QuickSight 4 AWS Glue 4 BigQuery 4 GCP 4 OpenSearch 4 Security 4 Shiny 4 Amazon EKS 3 Amazon OpenSearch Service 3 Amazon S3 3 Apache Camel 3 ALL 104
Kafka Development With Docker 11 Apache Beam Python Examples 8 Real Time Streaming With Kafka and Flink 7 DBT Pizza Shop Demo 6 Tree Based Methods in R 6 Apache Beam Local Development With Python 5 DBT for Effective Data Transformation on AWS 5 Kafka Connect for AWS Services Integration 5 Serverless Data Product 4 Data Lake Demo Using Change Data Capture 3 Getting Started With Pyflink on AWS 3 Kafka Development on Kubernetes 3 Parallel Processing on Single Machine 3 API Development With R 2 DBT Guide for Production 2 Deploy Python Stream Processing App on Kubernetes 2 Integrate Schema Registry With MSK Connect 2 Kafka, Flink and DynamoDB for Real Time Fraud Detection 2 Simplify Streaming Ingestion on AWS 2
2024 27 2023 39 2022 15 2021 7 2020 1 2019 5 2018 2 2017 6 2016 6 2015 15 2014 5
Posts
  • featured.png
    Change Data Capture (CDC) Local Development With PostgreSQL, Debezium Server and Pub/Sub Emulator
    November 7, 2024
  • featured.png
    Guide to Running DBT in Production
    September 13, 2024
  • featured.png
    DBT CI/CD Demo With BigQuery and GitHub Actions
    September 5, 2024
  • featured.png
    Cache Data on Apache Beam Pipelines Using a Shared Object
    August 22, 2024
  • featured.png
    Apache Beam Python Examples - Part 1 Calculate K Most Frequent Words and Max Word Length
    July 4, 2024
  • featured.png
    Deploy Python Stream Processing App on Kubernetes - Part 1 PyFlink Application
    May 30, 2024
  • featured.png
    Apache Beam Local Development With Python - Part 1 Pipeline, Notebook, SQL and DataFrame
    March 28, 2024
  • featured.png
    Data Build Tool (Dbt) Pizza Shop Demo - Part 1 Modelling on PostgreSQL
    January 18, 2024
  • featured.png
    Kafka Development on Kubernetes - Part 1 Cluster Setup
    December 21, 2023
  • featured.png
    Setup Local Development Environment for Apache Flink and Spark Using EMR Container Images
    December 7, 2023
  • featured.png
    Apache Beam Python Examples - Part 8 Enhance Sport Activity Tracker With Runner Motivation
    November 21, 2024
  • featured.png
    Change Data Capture (CDC) Local Development With PostgreSQL, Debezium Server and Pub/Sub Emulator
    November 7, 2024
  • featured.png
    Apache Beam Python Examples - Part 7 Separate Droppable Data Into Side Output
    October 24, 2024
  • featured.png
    Apache Beam Python Examples - Part 6 Call RPC Service in Batch With Defined Batch Size Using Stateful DoFn
    October 2, 2024
  • featured.png
    Apache Beam Python Examples - Part 5 Call RPC Service in Batch Using Stateless DoFn
    September 18, 2024
  • featured.png
    Guide to Running DBT in Production
    September 13, 2024
  • featured.png
    DBT CI/CD Demo With BigQuery and GitHub Actions
    September 5, 2024
  • featured.png
    Cache Data on Apache Beam Pipelines Using a Shared Object
    August 22, 2024
  • featured.png
    Apache Beam Python Examples - Part 4 Call RPC Service for Data Augmentation
    August 15, 2024
  • featured.png
    Apache Beam Python Examples - Part 3 Build Sport Activity Tracker With/Without SQL
    August 1, 2024
Actions
Go back Reload Copy URL

Jaehyeon Kim

⚙️ Data Engineer 📝 Blogger 👯 OSS Maintainer

Copyright © 2023-2024 Jaehyeon Kim. All Rights Reserved.