writing

Notes from production

Lessons from data platforms that had to work — lakehouse design, batch orchestration, streaming ingestion, and putting LLMs on top of governed data.

Eight organizations, one Iceberg lakehouse, and the governance model that let them share infrastructure without sharing data.

In financial data, a duplicate is a defect. The patterns that kept replays and retries from double-counting events.