Kafka as a Platform - The Ecosystem from the Ground Up

Explore the Apache Kafka ecosystem and its role as a streaming data platform in this comprehensive conference talk from GOTOpia Europe 2020. Delve into key concepts such as events, logs, topics, partitions, and pub/sub patterns. Learn about brokers, replication, and streaming pipelines. Discover how Kafka evolves from a simple messaging system to a powerful enterprise-grade platform. Gain insights into Producer and Consumer APIs, consumer groups, and advanced stream processing tools like Kafka Streams and ksqlDB. Understand schema management for team collaboration and legacy system integration. Watch a live demo and grasp how Kafka serves as the centerpiece of a robust streaming data infrastructure.

Intro
Events
The log
Immutable event log
Topics
Partitions
PUB/SUB
Brokers and replication
Streaming pipelines
Demo
Summary