YoVDO

Dynamic Change Data Capture with Flink CDC and Consistent Hashing

Offered By: Confluent via YouTube

Tags

Apache Flink Courses PostgreSQL Courses Data Streaming Courses Debezium Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore dynamic Change Data Capture (CDC) techniques using Flink CDC and consistent hashing in this informative conference talk. Learn how Goldsky tackled the challenge of configuring CDC for a large Postgres database dynamically, addressing issues with static deployments and the limitations of replication slots. Discover the implementation of incremental snapshotting and the innovative use of consistent hashing algorithms to distribute tables across multiple Flink jobs. Gain valuable insights into Debezium, Flink CDC, and Postgres replication as the speaker shares their experiences and learnings from this complex data extraction project.

Syllabus

Dynamic Change Data Capture with Flink CDC and Consistent Hashing


Taught by

Confluent

Related Courses

Developing Stream Processing Applications with AWS Kinesis
Pluralsight Developing Stream Processing Applications with AWS Kinesis
Pluralsight Conceptualizing the Processing Model for the AWS Kinesis Data Analytics Service
Pluralsight Processing Streaming Data Using Apache Flink
Pluralsight Complex Event Processing Using Apache Flink
Pluralsight