Data-Observability
- A poor man's data observability stack: table, stats, qc
Every table we produce automatically gets a stats file; assertions on those stats decide whether the data passes to the next step. This post describes the homemade framework that gave us data observability.