Free courses from frontend to fullstack and AI
Lead AI-Native Products with Microsoft's Agentic AI Program
Overview
Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
This 42-minute conference talk from NVIDIA GTC 2025 explores scaling applications beyond single GPU capabilities using various multi-GPU communication libraries. Learn how to compute larger workloads or achieve faster performance when dedicated multi-GPU libraries aren't available for your specific needs. Discover the practical applications of CUDA-aware MPI, NVSHMEM, and NCCL through real-world examples presented by Jiri Kraus, Principal Developer Technology at NVIDIA. The session (ID: S72578) focuses on accelerated computing libraries within the Models/Libraries/Frameworks topic area, covering NVIDIA technologies including CUDA, CUDA-X, NCCL, and NVLink/NVSwitch. Perfect for developers looking to expand their applications across multiple GPUs and nodes for enhanced performance and scalability.
Syllabus
Advanced Multi-GPU Scaling: Communication Libraries | NVIDIA GTC 2025
Taught by
NVIDIA Developer