Building the Next Generation of Real Time Data Pipelines - Data Mesh and Streaming SQL at Netflix
StreamNative via YouTube
Learn AI, Data Science & Business — Earn Certificates That Get You Hired
Stuck in Tutorial Hell? Learn Backend Dev the Right Way
Overview
Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
Explore how Netflix built a state-of-the-art Data Mesh platform that processes trillions of events daily to power business-critical applications in this comprehensive conference talk. Discover the transformative journey of creating distributed, real-time data movement and processing infrastructure that delivers personalized user experiences, from real-time recommendations to game analytics, live events, and ad processing. Learn how Netflix operates at massive scale with approximately 20,000 Apache Flink jobs managing thousands of Kafka topics, while addressing critical challenges in scaling, reliability, and managing high-throughput, low-latency data streams. Understand the innovative implementation of Streaming SQL that democratizes stream processing, enabling platform users to perform complex data transformations with ease. Gain insights into integrating next-generation streaming connectors, particularly focusing on Apache Iceberg and Kafka integration strategies. Examine strategic leadership techniques for setting development roadmaps and driving planning and prioritization within technical teams. Acquire practical knowledge about streaming technologies used at one of the world's largest streaming services, with actionable insights for implementing similar scalable, efficient data platform solutions within your own organization.
Syllabus
Building the Next Generation of Real Time Data Pipelines: Data Mesh and Streaming SQL at Netflix
Taught by
StreamNative