The Database Unbundled - Commit Logs in an Age of Microservices

Explore the concept of unbundling databases and implementing distributed commit logs in microservice architectures. Dive into the challenges of traditional centralized databases and learn how event-based integration can solve common problems associated with RPC and database-based service integration. Examine the write path of various databases, understanding how mutations are stored as immutable events in a queue before being organized into different views. Discover how Apache Kafka can provide a durable, immutable log for storing events, allowing each microservice to create derived views of data according to client needs. Gain insights into the benefits of event-sourcing, the structure of events, and the immutability principle. Learn about Kafka's log-based architecture, consumers, and how to read logs effectively. Explore practical applications through examples of legacy systems integration, Kafka Connect, and Kafka Sequel. Understand the challenges and solutions in implementing event-driven microservices, including a minimum viable order service and customer service. Delve into database layers and Kafka services to gain a comprehensive understanding of this modern approach to information architecture.

Introduction
The era of the monolith
Integrate through the database
Integration via synchronous RPC
Integration via events
What are events
What are events made of
Events are immutable
Kafka
Logs
Consumers
Reading Logs
Legacy Systems
Kafka Connect
Kafka Sequel
Whats Easy
The Problem
The Solution
Minimum Viable
Order Service
Customer Service
Database Layers
Kafka Services