Reliable Pipelines and High Quality Data Without the Toil - Kyle Kirwan

Explore the power of data observability in this 26-minute talk by Kyle Kirwan. Learn why maintaining high-quality data is crucial and how data observability provides insights into pipeline operations. Discover techniques to identify issues early, optimize performance, and reduce maintenance toil in data projects. Delve into key components of data observability, including metrics, data, lineage, and alerts. Gain valuable knowledge on building reliable pipelines and improving data quality without excessive manual effort.

- Introductions
- Why data observability?
- How to reduce toil?
- Data Observability components: metrics
- Data Observability components: data
- Data Observability components: lineage
- Data Observability components: alerts