Building Event-Driven Microservices with Apache Kafka

Explore the evolution of system architecture and the benefits of event-driven microservices using Apache Kafka in this comprehensive conference talk. Delve into the differences between microservices and service-oriented architectures, and learn why loosely-coupled protocols may be preferable to traditional REST APIs. Discover how a distributed log can create a central, persistent history of events and the advantages it offers. Examine the role of Apache Kafka in building an asynchronous, event-driven backbone, and understand the distinctions between request-driven and event-driven communication. Investigate modern stream processing systems, their ability to maintain state internally and in databases, and how this enhances service independence. Cover topics such as API gateways, event publishing, streaming sources, CQRS, event stores, and change data capture. Gain insights into Kafka Connect, log compaction, and Kafka streams, concluding with a summary of key concepts in building robust, scalable microservices architectures.

Introduction
Agenda
Where do you come from
World changes
Synchronous
What are MicroServices
API Gateways
Synchronous Request Response
What is eventdriven
Why not eventdriven
Publishing events
Streaming sources
Event processing
Event integration
Traditional systems
CQRS
Replayer
Events
State and State
Event store
Historical data
Big data cluster
Recap
Apache Kafka
Kafka Connect
Log compaction based
Change data capture explained
Kafka streams explained
Local results doors
Result store
Summary