What Apache Kafka Developers Can Learn from Online Gaming

Explore how concepts from online gaming can enhance large-scale event management and real-time collaboration in Apache Kafka systems. Discover innovative techniques for handling real-time event processing at massive scales, including approaches to conflict resolution and seamless collaboration. Learn about integrating gaming concepts with Kafka's state management stream processing, masking latency issues, prioritizing performance improvements, and optimizing user experiences. Dive into strategies like "slicing" for resolving conflicts and atomic edits, and understand how pooling can facilitate seamless collaboration in real-time systems. Gain insights on implementing these gaming-inspired patterns in business applications to significantly improve user experiences and system performance.

- Intro
- Building real-time inspection machines
- Going Multiplayer with Kafka
- What does a real-time experience look like in gaming?
- Broken message offsets vs. dead letter queues
- The distributed transaction problem
- Solving for conflicting events with nano-batching
- Pooling in real-time systems
- Optimizing for latency
- Using column modeling to improve performance
- Principles for stream-processing
- It's a wrap!