Designing Streaming Data Pipelines: Best Practices - Cloud Native 2024

Explore best practices for designing streaming data pipelines in this 15-minute conference talk from Conf42 Cloud Native 2024. Delve into key streaming data terminology, examine intriguing challenges in the field, and analyze the dilemma between correctness and completion. Learn how to integrate various concepts and scale streaming solutions, focusing on both infrastructure and code considerations. Gain valuable insights to enhance your understanding of streaming data pipeline design and implementation.

intro
some terms used in streaming data
some interesting challenges in streaming
dilemma between correctness and completion
bringing all the concepts together
streaming at scale: infrastructure and code considerations