System Blueprints
Platform architecture patterns — the big structural decisions chosen once and lived with for years, from warehouses and lakes to lakehouses, mesh, and streaming.
mindmap ((System Blueprints)) (data warehouse) (data lake) (lakehouse) (data mesh) (streaming) (open table formats) (context and metadata)
Star/snowflake schema, Kimball vs Inmon, SCD types, Data Vault 2.0, cloud warehouse comparison. Start here if your data is structured and analytical.
Zone architecture (landing/cleansed/curated), file formats, governance, anti-patterns. Start here if you work with unstructured or semi-structured data at scale.
Combining lake storage with warehouse semantics: ACID on object storage, open table formats, query engines. Where most modern platforms are converging.
Domain-driven data ownership, data products, federated governance. When centralized architecture creates organizational bottlenecks.
Lambda vs Kappa, event-driven design, CDC, Kafka/Pub/Sub, windowing, exactly-once semantics. When batch latency isn’t acceptable.
Delta Lake, Apache Iceberg, Apache Hudi — format internals, time travel, schema evolution, maintenance operations. The technology layer that enables lakehouse.
The five types of pipeline context (run, provenance, temporal, quality, business), context propagation patterns, bi-temporal modeling, schema evolution. The semantic layer that makes data self-describing.