Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Apache Flink Change Data Capture (CDC) with Confluent Cloud - Interactive Demo

Confluent via YouTube

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore Apache Flink SQL on Confluent Cloud through an interactive 20-minute demonstration focused on Change Data Capture (CDC) for building real-time data pipelines. Master the fundamentals of syncing and transforming data into valuable business insights while seamlessly integrating with Apache Kafka and data warehouses. Begin with an introduction to Change Data Capture concepts and get an overview of Debezium connectors before diving into table structures and live CDC demonstrations. Learn about schema evolution handling and understand the Debezium envelope format for processing change events. Build enriched customer data products and create sales data products using temporal joins to combine streaming data with historical context. Discover Tableflow capabilities for working with Iceberg and Delta Lake formats, implement rolling 30-day customer activity analytics, and sync data with Amazon Redshift. Visualize your data pipeline architecture through stream lineage tools to understand data flow and dependencies across your entire system. Gain practical experience with real-time data processing, stream processing patterns, and modern data architecture approaches using industry-leading tools for building scalable, event-driven data platforms.

Syllabus

0:00 - Introduction to Change Data Capture
00:44 - Debezium Connector Overview
01:36 - Tables Overview
02:56 - Live Change Data Capture Demo
05:53 - Schema Evolution
07:39 - Debezium Envelope Format
09:44 - Building enriched_customers Data Product
13:23 - Creating Sales Data Product with Temporal Joins
15:09 - Tableflow for Iceberg/Delta Lake
16:08 - Rolling 30-Day Customer Activity
17:34 - Redshift Sync
18:26 - Stream Lineage Visualization
19:09 - Conclusion

Taught by

Confluent

Reviews

Start your review of Apache Flink Change Data Capture (CDC) with Confluent Cloud - Interactive Demo

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.