Understanding Data Streaming Platforms: Components and Evolution

Learn about the six major components of a Data Streaming Platform (DSP) in this 12-minute video. Explore the evolution of data streaming through a pyramid model, starting with Apache Kafka as the foundation. Dive into the Schema Registry, Data Portal, Connectors, Stream Processor Flink, and Tableflow, understanding how each component contributes to a comprehensive data streaming solution. Discover how a DSP enables unified end-to-end data streaming, providing capabilities for data connectivity, integration, discovery, security, and management. Gain insights into building, using, and sharing data across your organization for various use cases. Access additional resources on addressing bad data in event streams, data best practices, Kafka Connect, headless data architecture, schema evolution, data quality improvement, and data organization using Confluent Data Portal.

- Introduction, a DSP’s Six Parts
- Pyramid Model of Data Streaming Evolution
- Apache Kafka Part 1
- Schema Registry Part 2
- Data Portal Part 3
- Connectors Part 4
- Stream Processor Flink Part 5
- Tableflow Part 6
- Conclusion