Kafka - One More Arsenal in a Distributed Toolbox

Explore the powerful combination of Spring and Kafka in this conference talk from Spring I/O 2018. Delve into the world of distributed commit logs and learn how Kafka addresses low latency, high throughput, scalability, fault-tolerance, and disk-based retention. Discover how to leverage Spring Kafka for building scalable event-stores and messaging platforms capable of storing billions of messages. Gain insights into essential and advanced Spring-Kafka concepts, including producers, consumers, transactions, and their Spring counterparts like KafkaMessageListenerContainer, Kafka template, and @KafkaListener annotations. Learn about Spring-Kafka-test for developing and running unit tests against embedded Kafka servers. Explore recent enhancements such as synchronizing Kafka transactions with other transactions, configuring generic MessageConverter beans, and detecting idle asynchronous consumers. Conclude with valuable tips on potential pitfalls to avoid when deploying Kafka in production environments.

Introduction
About me
Lego
Kafka overview
Kafka guarantees
What is Kafka
Challenges
Opportunity
Kafka embrace immutability
Kafka log structure
Zero copy operation
Multiple machines
Fast writes
Resilience
Spring Kafka
Demo
Demo breakdown
Kafka consumer factory
Kafka listener
Kafka consumer
KafkaListener
Message Converter Beam
Type ID
Cancel Exclusion
Chain Transaction Manager
Order Service
Thread of Sleep
Uncommitted Messages
Santu
EventListener
Replay Time