Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Linux Foundation

An Open-Source Stack for AI Compute - Kubernetes + Ray + PyTorch + vLLM

Linux Foundation via YouTube

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore how to build a comprehensive open-source infrastructure for AI compute through this 16-minute keynote presentation by Ray co-creator Robert Nishihara. Learn about integrating Kubernetes for container orchestration, Ray for distributed computing, PyTorch for machine learning frameworks, and vLLM for large language model serving into a cohesive technology stack. Discover practical approaches to scaling AI workloads using these vendor-neutral open-source tools, understand the synergies between these technologies, and gain insights into building robust AI infrastructure from one of the key architects behind Ray's distributed computing platform.

Syllabus

Keynote: An Open-Source Stack for AI Compute: Kubernetes + Ray + PyTorch + vLLM - Robert Nishihara

Taught by

Linux Foundation

Reviews

Start your review of An Open-Source Stack for AI Compute - Kubernetes + Ray + PyTorch + vLLM

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.