Scheduling Framework: Batch Extensions with Apache YuniKorn
CNCF [Cloud Native Computing Foundation] via YouTube
PowerBI Data Analyst - Create visualizations and dashboards from scratch
Get 20% off all career paths from fullstack to AI
Overview
AI, Data Science & Cloud Certificates from Google, IBM & Meta — 40% Off
One plan covers every Professional Certificate on Coursera. 40% off Coursera Plus Annual.
Unlock All Certificates
Explore batch extensions for Kubernetes scheduling using Apache YuniKorn in this informative conference talk. Delve into the challenges of running batch and data processing workloads on Kubernetes, and discover how Apache YuniKorn extends the scheduler to address these issues. Learn about job-aware preemption, gang scheduling, and queueing with quota enforcement while scheduling. Understand how these opt-in features can be used alongside existing default functionality to improve flexibility and efficiency in handling diverse workload types, including Apache Spark jobs. Gain insights into managing dynamic job requirements, handling pod creation on the fly, and mitigating issues related to quota enforcement and management pod preemption.
Syllabus
Scheduling Framework: Batch Extensions with Apache YuniKorn - Wilfred Spiegelenburg & Peter Bacsko
Taught by
CNCF [Cloud Native Computing Foundation]