The Road to Exceptional Data Correctness - Strategies from Stripe

Explore strategies for achieving exceptional data correctness in this 11-minute lightning talk from Data Council. Discover insights from Stripe's early efforts to tackle data accuracy challenges, as shared by Emma Tang, former Big Data Infrastructure lead. Learn about the unique constraints faced by financial technology companies and the trade-offs made to maintain high levels of data integrity. Gain valuable knowledge on implementing data quality checks, fallback behaviors, and typesafe Spark. Understand the concept of $3 eventual consistency and the importance of data observability platforms. Delve into the process of recomputing the universe and find the silver lining in data correctness efforts. This talk provides essential information for data professionals seeking to improve data accuracy and reliability in their organizations.

Intro
How Data was used
Data quality checks
Fallback behavior
$3 eventual consistency
Typesafe Spark
Data observability platform
Recompute the universe
Silver lining
Conclusion