Articles
Writing from inside real data systems
Architecture walkthroughs, implementation notes and the occasional post-mortem written to be useful the moment you open your editor.
All Articles
Data Engineering
Data Engineering
DuckDB vs. Spark: When Does a Single-Node Engine Beat a Distributed Cluster?
·
10 -15 min read
Discover when DuckDB delivers better performance and simplicity than Apache Spark, and when distributed processing is worth the additional complexity.
Data Engineering
Data Engineering
Event-Driven Data Ingestion Building Reliable Real-Time Data Pipelines
·
15 min read
Explore how Kafka, stream processing, object storage, and lakehouse tables work together to deliver reliable real-time data ingestion.
Data Engineering
Data Engineering
Data Contracts Preventing Broken Data Pipelines Before They Reach Analytics
·
20 min read
Learn how data contracts, schema validation, and quality gates help prevent unreliable data from reaching analytics systems.
Data Engineering
Data Engineering
Embedding Cost Is a Design Decision
·
15 -20 min read
Learn how model selection, chunking, incremental processing, and vector storage help reduce embedding costs while maintaining retrieval quality.
Data Engineering
Data Engineering
Incremental Models in dbt Without the Pain
·
15 min read
Learn how dbt incremental models improve pipeline performance, reduce processing costs, and handle changing data reliably.
Cloud Architecture
Cloud Architecture
A Modern Data Platform Reference on AWS
·
15 min read
Explore a modern AWS data platform architecture for ingestion, storage, processing, analytics, governance, and AI.
AI Engineering
AI Engineering
RAG Architecture for Enterprise Use Cases
·
15 min read
Learn how RAG connects enterprise data with LLMs to deliver secure, relevant, and accurate answers.
Data Engineering
Data Engineering
Building a Lakehouse with DuckDB and Apache Iceberg
·
15 min read
Learn how DuckDB and Apache Iceberg enable efficient SQL analytics and flexible, reliable lakehouse architectures using open data formats.
Data Engineering
Data Engineering
DuckDB for Modern Data Engineering
·
15-20 min read
Explore how DuckDB simplifies analytical workloads.