Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Increasing Flink Performance to 4x - Optimising Flink SQL for High-Performance Streaming Workloads

StreamNative via YouTube

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Learn to optimize Apache Flink SQL queries for high-performance streaming workloads in this 35-minute conference talk that demonstrates how to achieve 4x performance improvements using practical techniques. Discover how Flink translates SQL queries into execution plans and identify common performance bottlenecks that occur in large-scale real-time analytics. Master strategies for optimizing joins and aggregations by handling stateful operations efficiently, minimizing data shuffling, and leveraging Flink's internal optimization capabilities. Explore memory and state tuning techniques including fine-tuning Flink's state backend, memory management, and parallelism to prevent excessive checkpointing overhead. Gain hands-on experience with debugging workflows using Flink's Web UI, metrics, and profiling tools for performance analysis. Learn from real-world case studies including optimization work performed for a European bank, where simple techniques transformed resource-heavy processes consuming excessive CPU and memory into efficient, cost-effective operations. Understand how leading companies scale Flink SQL to petabyte levels while maintaining reliability and cost efficiency. Acquire actionable strategies to reduce job latency, optimize resource usage, and scale Flink SQL jobs effectively in production environments for real-time analytics, ETL pipelines, and streaming machine learning applications.

Syllabus

Increasing Flink Performance to 4x: Optimising Flink SQL for High-Performance Streaming Workloads

Taught by

StreamNative

Reviews

Start your review of Increasing Flink Performance to 4x - Optimising Flink SQL for High-Performance Streaming Workloads

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.