Kafka Under Pressure - Netflix's Blueprint for Unshakeable Kafka Resilience
StreamNative via YouTube
Overview
Coursera Spring Sale
40% Off Coursera Plus Annual!
Grab it
Discover Netflix's proven strategies for building resilient Apache Kafka infrastructure that can withstand extreme traffic spikes of 10× to 100× normal loads in this 35-minute conference talk. Learn how Netflix engineers Jorge Rodriguez and Vinay Rayini tackle the unprecedented demands placed on core Kafka infrastructure during live streaming events, sharing innovative solutions that go far beyond standard configurations to maximize uptime, minimize data loss, and maintain peak performance under pressure. Explore advanced techniques for ensuring broker stability during traffic surges, including methods to keep Kafka brokers operational even when facing extreme overload conditions. Master the art of creating adaptive clients that transform producers and consumers into intelligent, real-time participants that dynamically adjust their behavior to protect overall cluster health. Gain valuable operational insights drawn from Netflix's experience scaling Kafka at massive scale, covering essential monitoring practices, failure mitigation strategies, and proactive management approaches that prevent issues before they impact service availability. Understand high-throughput design patterns and architectural approaches specifically engineered to sustain performance during unpredictable traffic spikes and demanding workloads. Whether you're responsible for Kafka engineering, platform architecture, or operations leadership, acquire actionable strategies and battle-tested insights for constructing resilient, scalable, and high-performing Kafka infrastructures capable of surviving the most challenging production scenarios.
Syllabus
[Use Case] Kafka Under Pressure: Netflix's Blueprint for Unshakeable Kafka Resilience
Taught by
StreamNative