Overview
Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore Spotify's journey in adapting enterprise ML infrastructure to support large-scale AI models in this 30-minute conference talk from Ray Summit 2024. Gain insights from Abdullah Mobeen of Spotify and Brandon Royal of Google as they delve into Spotify's implementation of Ray on Google Kubernetes Engine, enabling LLM training beyond 70B parameters. Learn about the challenges of integrating specialized hardware like NVIDIA H100 GPUs and discover key optimizations in resource management. Acquire practical knowledge for building robust, scalable AI infrastructure in the era of generative AI, applicable to organizations facing similar complexities in their AI transformation efforts.
Syllabus
Spotify Harnesses Ray for Next-Gen AI Infrastructure | Ray Summit 2024
Taught by
Anyscale