Streaming Database Changes with Debezium

Explore the world of change data capture (CDC) in this 48-minute conference talk by Gunnar Morling at Devoxx. Dive into the concept of CDC and its various applications, including cache and full-text index updates, microservices data synchronization, CQRS architecture read model maintenance, and analytics data feeding. Learn about Debezium, an open-source CDC solution built on Apache Kafka, and discover how it captures changes from databases like MySQL, PostgreSQL, and MongoDB. Understand the near real-time reaction to change events and Debezium's design for ensuring data correctness and completeness, even in challenging scenarios. Gain insights into CDC implementation, including database log examination, Kafka Connect topology, message structure, initial snapshots, and Debezium connectors. Explore message transformations using Single Message Transforms (SMTs) and get guidance on trying out CDC yourself. Conclude with a summary and resources for further learning about this powerful data synchronization technique.

Intro
Gunnar Morling
Change Data Capture what is it about?
CDC Use Cases
How to Capture Changes?
Database Logs A closer loos
CDC Topology with Kafka Connect
CDC Message Structure
Initial Snapshots
Debezium Connectors
Operating a Connector
Message Transformations Altering individual messages via SMTS
Trying It Out Yourself
Summary
Resources