Distributed Real-Time Stream Processing - Why and How

Explore the world of distributed real-time stream processing in this 42-minute conference talk from Scala Days Berlin 2016. Dive into various state-of-the-art open-source distributed streaming frameworks, comparing their similarities, differences, implementation trade-offs, and intended use cases. Focus on popular frameworks such as Spark Streaming, Storm, Samza, and Flink while gaining theoretical knowledge, understanding common pitfalls, and learning about popular architectures. Discover how to choose the right framework for your specific needs as the demand for stream processing continues to grow. Gain insights into processing immense amounts of data from rapidly expanding sets of disparate sources, pushing the limits of traditional data processing infrastructures. Learn about applications in trading, social networks, Internet of Things, and system monitoring. Whether you're considering, implementing, or have already deployed a streaming solution, this comprehensive overview of modern streaming solutions will help you make informed decisions for your particular use case.

Distributed Real-Time Stream Processing: Why and How by Petr Zapletal