Embrace the Anarchy - Apache Kafka’s Role in Modern Data Architectures

Explore the role of Apache Kafka in modern data architectures through this conference talk. Learn how Kafka serves as a streaming platform and 'data backbone' for enterprises, enabling flexible, scalable, and real-time data integration. Discover the benefits of Kafka in architectural design, its ecosystem, and various design patterns addressing specific organizational challenges in managing data flows and availability. Gain insights into Kafka's capabilities for event-driven, high-performance data integration across the enterprise, as well as its messaging functionalities for direct application support. Delve into topics such as batch transformations, data lakes, scalable streaming data pipelines, stream processing, and real-time event stream enrichment. Understand how Kafka can be utilized for analytics, database offloading, and building event-centric architectures.

Embrace the Anarchy
Analytics-In the beginning...
Batch Transformations ... (ETL / ELT)
Add a Data Lake.
or Replace the Data Warehouse
The World has changed
Messaging Done Right
Scalable Streaming Data Pipelines
Foundation for Stream Processing
The Table Stream Duality
What is a Streaming Platform?
The log is a simple idea
Only Sequential Access
The Connect API
Stream Processing in Kafka
KSQL for Streaming ETL
Kafka Streams: a Java API for the same
Analytics - Database Offload
Real-time Event Stream Enrichment
It's all about the Events...
Build around the events...
Pragmatism is...
Confluent Open Source : Apache Kafka with a bunch of cool stuff! For free!