Bridging the Gap Between Batch and Real-Time with Mixed-Latency Pipelines
Offered By: Data Council via YouTube
Course Description
Overview
Explore the intricacies of building mixed-latency data platforms in this insightful 13-minute talk from Data Council. Delve into Will Goldstein's extensive experience from dynamic startups like Better to grasp time horizons, manage data freshness, and tackle pipeline bottlenecks effectively. Learn how to merge batch processing with low-latency data processing while maintaining explicit lineage and ensuring a unified view of processing jobs across different sources. Gain valuable tools and strategies to create reliable and consistent data products in mixed-latency environments.
Syllabus
Bridging the Gap Between Batch and Real-Time with Mixed-Latency Pipelines
Taught by
Data Council
Related Courses
Building Advanced Codeless Pipelines on Cloud Data FusionGoogle Cloud via Coursera Principles for Data Quality Measures
Pluralsight Manage workspaces and datasets in Power BI
Microsoft via Microsoft Learn Building Advanced Codeless Pipelines on Cloud Data Fusion
Google via Qwiklabs Exploring the Lineage of Data with Cloud Data Fusion
Google Cloud via Coursera