Which GPU Sharing Strategy Is Right for You? A Comprehensive Benchmark Study Using Dynamic Resource Allocation
CNCF [Cloud Native Computing Foundation] via YouTube
Live Online Classes in Design, Coding & AI — Small Classes, Free Retakes
Power BI Fundamentals - Create visualizations and dashboards from scratch
Overview
AI, Data Science & Cloud Certificates from Google, IBM & Meta — 40% Off
One plan covers every Professional Certificate on Coursera. 40% off Coursera Plus Annual.
Unlock All Certificates
Explore a comprehensive technical conference talk that delves into Dynamic Resource Allocation (DRA) in Kubernetes and its impact on GPU sharing strategies. Learn about different GPU sharing approaches including Multi-Instance GPUs, Multi-Process Service (MPS), and CUDA Time-Slicing through detailed benchmark comparisons. Discover which applications benefit most from each sharing strategy and how to combine multiple approaches for optimal performance. Gain practical insights through real-world application demonstrations and understand potential challenges and future enhancements in GPU resource management. Master the revolutionary capabilities of DRA for managing heterogeneous GPUs in a unified and configurable way, moving beyond traditional device plugin API limitations.
Syllabus
Which GPU Sharing Strategy Is Right for You? A Comprehensive Benchmark St... Kevin Klues & Yuan Chen
Taught by
CNCF [Cloud Native Computing Foundation]