Maximizing GPU Utilization Over Multi-Cluster - Challenges and Solutions for Cloud-Native AI Platform
CNCF [Cloud Native Computing Foundation] via YouTube
Finance Certifications Goldman Sachs & Amazon Teams Trust
AI Engineer - Learn how to integrate AI into software applications
Overview
Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
Explore the challenges and solutions for maximizing GPU utilization in multi-cluster environments for cloud-native AI platforms in this 27-minute conference talk by William Wang and Hongcai Ren from Huawei. Delve into the complexities of managing large-scale, heterogeneous GPU environments across multiple Kubernetes clusters and data centers. Learn about innovative approaches to address resource fragmentation, operational costs, and cross-cluster workload scheduling using tools like Karmada and Volcano. Discover strategies for intelligent GPU workload scheduling, ensuring cluster failover support, maintaining two-level scheduling consistency, and balancing utilization with Quality of Service (QoS) for workloads with varying priorities. Gain valuable insights into optimizing AI/ML workloads on Kubernetes and enhancing the efficiency of cloud-native AI platforms.
Syllabus
Maximizing GPU Utilization Over Multi-Cluster: Challenges and Solutions for Cloud-Native AI Platform
Taught by
CNCF [Cloud Native Computing Foundation]