Profiles
A profile is what odctl up starts. These pages are generated from registry.yml and the compose files when the site is built.
| Profile |
Technology |
Description |
kafka-lite |
Kafka |
Distributed event streaming and schema registry. Lite uses 1 Broker; Full uses 3 Brokers. |
kafka-full |
Kafka |
Distributed event streaming and schema registry. Lite uses 1 Broker; Full uses 3 Brokers. |
| Profile |
Technology |
Description |
flink-lite |
Apache Flink |
Stateful, real-time stream processing engine. Lite uses 1 TaskManager; Full uses 3 TaskManagers. |
flink-full |
Apache Flink |
Stateful, real-time stream processing engine. Lite uses 1 TaskManager; Full uses 3 TaskManagers. |
spark-lite |
Apache Spark |
Distributed batch and micro-batch data processing. Lite uses 1 Worker; Full uses 3 Workers. |
spark-full |
Apache Spark |
Distributed batch and micro-batch data processing. Lite uses 1 Worker; Full uses 3 Workers. |
| Profile |
Technology |
Description |
ch-lite |
ClickHouse |
Real-time OLAP database (ClickHouse), Federated SQL engine (Trino), and BI dashboards (Metabase). |
ch-full |
ClickHouse |
Real-time OLAP database (ClickHouse), Federated SQL engine (Trino), and BI dashboards (Metabase). |
trino |
Trino |
Real-time OLAP database (ClickHouse), Federated SQL engine (Trino), and BI dashboards (Metabase). |
metabase |
Metabase |
Real-time OLAP database (ClickHouse), Federated SQL engine (Trino), and BI dashboards (Metabase). |
| Profile |
Technology |
Description |
airflow |
Apache Airflow |
Workflow orchestration and pipeline scheduling (Airflow), and durable workflows written in code (Temporal). |
temporal |
Temporal |
Workflow orchestration and pipeline scheduling (Airflow), and durable workflows written in code (Temporal). |
| Profile |
Technology |
Description |
mlflow |
MLflow |
Experiment tracking, model registry and model serving (MLflow), the feature store (Feast), and ML monitoring (Evidently). |
feast |
Feast |
Experiment tracking, model registry and model serving (MLflow), the feature store (Feast), and ML monitoring (Evidently). |
evidently |
Evidently |
Experiment tracking, model registry and model serving (MLflow), the feature store (Feast), and ML monitoring (Evidently). |
| Profile |
Technology |
Description |
metadata |
OpenMetadata |
Data catalog, discovery, and governance platform. |
lineage |
Marquez |
System telemetry, monitoring, and data lineage. |
| Profile |
Technology |
Description |
telemetry |
Telemetry (grafana/otel-lgtm) |
System telemetry, monitoring, and data lineage. |
| Profile |
Technology |
Description |
postgres |
PostgreSQL |
PostgreSQL metadata backend. |
storage |
SeaweedFS |
SeaweedFS S3-compatible object storage. |
catalog |
Iceberg REST catalog |
Iceberg REST Catalog. |
valkey |
Valkey |
Stream storage (Fluss) and multi-model data store (Valkey Bundle). Valkey includes advanced JSON, Bloom, and Vector Search capabilities. |
fluss |
Apache Fluss |
Stream storage (Fluss) and multi-model data store (Valkey Bundle). Valkey includes advanced JSON, Bloom, and Vector Search capabilities. |
deps |
Shared dependencies |
Shared dependencies, JARs, connectors, and Docker network |