A local open source proof of concept that puts a semantic layer between a language model and an Iceberg lakehouse, using Strands, WrenAI and Trino.

Dynamic DES v0.11.1 adds a declarative SimulationContext API, native Postgres and Redis ingress and egress connectors, and broader object storage.

odctl is a CLI on PyPI that launches Kafka, Flink, Spark, Trino, Iceberg, Airflow and an MLOps and observability suite as one local stack.

Dynamic DES v0.8.1 adds data lake integration, so one SimPy codebase writes batch Parquet data for ML training and streams live Kafka events.

A comprehensive walkthrough from my session at Current London 2026 on capturing and visualizing data lineage across a production-style data stack.

Turn a static model into a synchronized forecasting engine with dynamic-des, using the Switchboard pattern, mutable resources and dynamic topic routing.

Apache Kyuubi as a multi-tenant SQL gateway that provisions on-demand Spark, Flink and Trino engines, giving self-service analytics with central governance.

Apache Paimon, Fluss and Apache Iceberg compared as table layers for streaming and batch, then combined into one architecture with Flink and Spark.

Deploying a dbt project to dev and prod on BigQuery, covering slim CI, unit tests and a write audit publish step that builds on a cloned dataset.

GitHub Actions gives a dbt project on BigQuery a slim CI run on pull requests and a deploy job that publishes the project as a container image.