Direct text-to-SQL is hard to trust in production because raw schemas do not capture governed metrics or business meaning. This post walks through a local, open-source proof of concept that puts a semantic layer between the language model and the lakehouse, combining Strands, WrenAI, Trino, Iceberg, and long-term agent memory.

Since the v0.8.1 release, Dynamic DES has gained a declarative SimulationContext API, native Postgres and Redis ingress and egress connectors, and broader object storage support. This post walks through what changed and why the new builder pattern makes real-time digital twins far easier to write.

Provisioning a local data platform usually means fighting dependency conflicts, port clashes, and brittle Docker Compose files. odctl is a small CLI that turns Kafka, Flink, Spark, Trino, Iceberg, Airflow, and a full MLOps and observability suite into a cohesive stack you can launch with a single command. Now available on PyPI.

Dynamic DES v0.8.1 introduces native Data Lake integration. Learn how to use a single SimPy codebase to generate batch Parquet data for ML training, and seamlessly transition to streaming live Kafka events for production inference.

A comprehensive walkthrough from my session at Current London 2026 on capturing and visualizing data lineage across a production-style data stack.

In Part 2 of our series, we dive into the code and architecture of dynamic-des. Learn how to use the Switchboard pattern, mutable resources, and dynamic topic routing to transform a static model into a synchronized forecasting engine.

Many systems marketed as digital twins exist in an ambiguous middle ground. We look at the architectural layers separating traditional simulations, operational twins, and event-driven hybrid pipelines.

Discover how to build a fault-tolerant streaming architecture using Apache Flink and Kotlin. This guide demonstrates applying Online Machine Learning to autonomously detect concept drift and correct for physical machinery wear in real-time, which is safely managed by a deterministic Shadow Mode router.

For a long time, I wanted a way to host my technical presentations directly on my website without relying on external platforms or bulky PDF exports. I wanted a “Slides as Code” approach: version-controlled Markdown files that live natively alongside my blog posts.

In Part 1, we built a contextual bandit prototype using Python and Mab2Rec. While effective for testing algorithms locally, a monolithic script cannot handle production scale. Real-world recommendation systems require low-latency inference for users and high-throughput training for model updates.

This post demonstrates how to decouple these concerns using an event-driven architecture with Apache Flink, Kafka, and Redis.