Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Scaling Kafka on Kubernetes

Conf42 via YouTube

Overview

Coursera Spring Sale
40% Off Coursera Plus Annual!
Grab it
Learn how to effectively scale Apache Kafka on Kubernetes through this 13-minute conference talk from Conf42 KN 2025. Explore the problem space and understand why Kubernetes provides an ideal platform for running Kafka clusters at scale. Discover the key pillars that form the foundation of successful Kafka deployments on Kubernetes, including strategic resource allocation approaches and storage optimization techniques. Master network performance enhancements and implement auto-scaling mechanisms for dynamic cluster management. Examine multi-cluster deployment strategies and operational excellence practices using GitOps methodologies. Dive into comprehensive monitoring and metrics collection for maintaining cluster health and performance visibility. Review real-world performance metrics and achievements from production deployments. Understand disaster recovery strategies to ensure business continuity and data protection. Gain practical insights from industry experience on building resilient, scalable Kafka infrastructure that leverages Kubernetes' orchestration capabilities for enterprise-grade streaming data platforms.

Syllabus

00:00 Introduction to Kafka on Kubernetes
00:32 Understanding the Problem Space
01:11 Why Choose Kafka on Kubernetes?
02:06 Key Pillars of Kafka on Kubernetes
03:08 Resource Allocation Strategies
04:06 Optimizing Storage for Kafka
05:13 Enhancing Network Performance
06:02 Auto Scaling Kafka Clusters
07:00 Multi-Cluster Deployments
07:50 Operational Excellence with GitOps
08:35 Monitoring and Metrics
09:24 Performance Metrics and Achievements
10:28 Disaster Recovery Strategies
11:38 Conclusion and Key Takeaways
12:39 Q&A and Further Discussion

Taught by

Conf42

Reviews

Start your review of Scaling Kafka on Kubernetes

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.