Kafka as a Platform - The Ecosystem from the Ground Up

Explore the comprehensive ecosystem of Apache Kafka in this 1-hour conference talk from NDC Oslo 2020. Delve into the core concepts of Kafka as a streaming data platform, starting with the basics of events and progressing to advanced topics. Learn about topics, partitioning, replication, and low-level Producer and Consumer APIs. Discover how to create elastically scalable, fault-tolerant application clusters using consumer groups. Examine more sophisticated stream processing APIs like Kafka Streams and ksqlDB. Understand the importance of schema management for team collaboration and how to integrate with legacy systems without custom code. Watch live demonstrations of Kafka producer/consumer interactions and practical applications. By the end of this talk, gain a thorough understanding of how Kafka evolves from a simple messaging system to an enterprise-grade streaming platform. Access additional resources, including free eBooks and slides, to further enhance your Kafka knowledge.

Intro
What are Events?
A platform for events
The Log
Topics
Partitions
Publisher API
Message keys
Consumer API
Consumer Groups
Brokers
Demo 01 - Kafka producer/consumer
Kafka use cases
Kafka Connect
Schemas & Serialisation Formats
Stream processing introduction
Kafka Streams
ksqlDB
Demo 02
Recap & Resources