Scheduling Framework: Batch Extensions with Apache YuniKorn
CNCF [Cloud Native Computing Foundation] via YouTube
Learn EDR Internals: Research & Development From The Masters
Build with Azure OpenAI, Copilot Studio & Agentic Frameworks — Microsoft Certified
Overview
AI, Data Science & Cloud Certificates from Google, IBM & Meta — 40% Off
One plan covers every Professional Certificate on Coursera. 40% off Coursera Plus Annual.
Unlock All Certificates
Explore batch extensions for Kubernetes scheduling using Apache YuniKorn in this informative conference talk. Delve into the challenges of running batch and data processing workloads on Kubernetes, and discover how Apache YuniKorn extends the scheduler to address these issues. Learn about job-aware preemption, gang scheduling, and queueing with quota enforcement while scheduling. Understand how these opt-in features can be used alongside existing default functionality to improve flexibility and efficiency in handling diverse workload types, including Apache Spark jobs. Gain insights into managing dynamic job requirements, handling pod creation on the fly, and mitigating issues related to quota enforcement and management pod preemption.
Syllabus
Scheduling Framework: Batch Extensions with Apache YuniKorn - Wilfred Spiegelenburg & Peter Bacsko
Taught by
CNCF [Cloud Native Computing Foundation]