Orchestrate the PostgreSQL pizza shop dbt project with Apache Airflow, scheduling the SCD type 2 dimension and fact table builds as an ETL process.

Model fictional pizza shop data on PostgreSQL with dbt, building two SCD type 2 dimension tables and one transactional fact table.

A local Flink and Spark environment built from EMR container images, where Flink ingests data in real time and Spark queries it via the Glue Data Catalog.

Transform IMDb data with dbt on Amazon Athena using the dbt-athena adapter, the last part of the dbt on AWS series.

Transform IMDb data with dbt on Amazon EMR on EKS, through a Spark Thrift server kept running on Kubernetes by a small wrapper class.

Transform IMDb data with dbt on Amazon EMR on EC2, running layered models through a Spark Thrift server.

Transform IMDb data in an S3 data lake with dbt on AWS Glue, running layered models through Glue interactive sessions with the dbt-glue adapter.

Transform IMDb data in Amazon Redshift Serverless with dbt, building layered models that follow dbt best practices.

Develop Spark apps on an EMR cluster in a private subnet over VPN and the VS Code remote SSH extension, with the cluster shared by several users.

Provision EMR on EKS with Terraform and EKS Blueprints, then compare two Spark jobs with and without Dynamic Resource Allocation under Karpenter.