Case studyIndependent project
From raw taxi files to a managed Spark job
An independent project that moves NYC taxi data through local Spark exploration, cloud storage, and a parameterised Dataproc job.
Explore the decisionsSelected work
How I think when the diagram meets reality.
Projects and reference architectures presented through the problem, constraints, decisions, and what should improve next.
Reference architectureReference design
Designing pipeline health around the consumer
A reference architecture for measuring freshness, completeness, and publication state—not just whether scheduled tasks ran.
Explore the decisions