Streaming vs. Batch Processing: The Future of Data Architecture
Offered By: Confluent via YouTube
Course Description
Overview
Explore the future of data processing in this 44-minute panel discussion featuring industry experts from Treeverse, dbt Labs, Decodable, and Snowflake. Dive into the debate between batch and stream processing, examining the challenges of adopting streaming architectures, the role of micro-batching, and the potential for streaming to replace batch processing entirely. Gain insights on best practices, obstacles to widespread adoption, and the factors holding teams back from fully embracing streaming models. Discover when to use streaming versus batch processing and contemplate the future of stream processing in data architecture.
Syllabus
- Intro
- Is the Lambda Architecture here to stay?
- What is preventing streaming adoption today?
- Is streaming a semantic model?
- Should we push for stream processing?
- When should we use streaming vs. batch processing?
- What is the future of stream processing?
- It's a wrap!
Taught by
Confluent
Related Courses
Concevez des architectures Big DataCentraleSupélec via OpenClassrooms Designing Scalable Data Architectures on the Google Cloud
Pluralsight Demystifying Stream Processing with Apache Kafka
ChariotSolutions via YouTube Anatomy of a Big Data Application in Containers
Red Hat via YouTube Gandalf - An Intelligent, End-To-End Analytics Service for Safe Deployment in Large-Scale Cloud Infrastructure
USENIX via YouTube