Distributed Commit Logs with Apache Kafka

Explore distributed commit logs with Apache Kafka in this 55-minute conference talk by James Ward, Principal Platform Evangelist at Salesforce.com. Dive into Kafka fundamentals, including its origins at LinkedIn and its current widespread use in large enterprises. Learn about Kafka's architecture, including topics like RAID 5, producers and consumers, leader followers, offsets, and consumer groups. Follow along with code examples demonstrating Kafka clients, Akka Streams, and Scala implementations. Discover various Kafka use cases, settings, and API features. Address common questions about slow consumers, Redis messaging, and the polling nature of Kafka clients. Gain practical insights into implementing and leveraging Apache Kafka for resilient and scalable distributed systems.

Introduction
Moving into distributed systems
Raid 5 and Kafka
Kafka Fundamentals
Kafka Use Cases
Kafka Records
Producers and Consumers
Leader Followers
Offsets
Consumer Groups
Demo
Kafka Client
akkaStreams
Scala Code
Kafka Settings
Kafka Producer Record
Kafka Consumer Record
Kafka Source
Kafka Offset
Kafka WebSocket
Questions
Slow Consumers
Redis Messaging
Why are Kafka clients polling
Kafka API