Anyscale Courses

Anyscale's Governance Suite for Scalable AI Platforms - Ray Summit 2024

Explore Anyscale's Governance Suite for AI platforms, addressing security, controls, and productivity challenges in the era of Generative AI. Gain insights into sustainable AI practices for modern enterprises.

• YouTube
• 25 minutes
• Self-Paced
• Free Video

Roblox's Journey to Supporting Multimodality on vLLM - Ray Summit 2024

Explore Roblox's integration of multimodal language models into vLLM, uncovering technical challenges and insights for developers seeking to enhance their LLM deployments with advanced AI capabilities.

• YouTube
• 30 minutes
• Self-Paced
• Free Video

Uber's GenAI Leap: Batch Predictions Using Ray and vLLM - Ray Summit 2024

Dive into Uber's innovative approach to large-scale GenAI batch prediction using Ray and vLLM. Explore architecture, integration, and applications in Uber services, with insights on scaling GenAI capabilities.

• YouTube
• 33 minutes
• Self-Paced
• Free Video

Achieving vLLM Platform Portability with Triton Autotuning - Ray Summit 2024

Discover IBM Research's innovative approach to vLLM platform portability using Triton autotuning, enhancing LLM serving with improved cross-platform performance and reduced dependencies.

• YouTube
• 31 minutes
• Self-Paced
• Free Video

Scaling ML Pipelines for Autonomous Driving with Ray

Discover how Ray revolutionizes ML pipelines for autonomous driving, scaling data preparation and model evaluation. Learn about Motional's innovative approaches to reduce latency and achieve significant speedups in critical workflows.

• YouTube
• 29 minutes
• Self-Paced
• Free Video

Building Scalable AI Agents with Ray

Explore Ragent, a framework for scalable AI agents built on Ray's distributed computing capabilities. Learn about its key features and integration with popular tools for developing production-ready agent applications.

• YouTube
• 29 minutes
• Self-Paced
• Free Video

How to Scale Unstructured Data Processing with Ray Data

Explore Ray Data on Anyscale for efficient large-scale unstructured data processing. Learn about streaming batch models, adaptive scheduling, and performance optimizations through a live demo and real-time insights.

• YouTube
• 30 minutes
• Self-Paced
• Free Video

Managing Large-Scale Ray Deployments - Cloud, On-Prem, and Kubernetes

Explore strategies for managing Ray deployments across cloud, on-premises, and Kubernetes environments. Gain insights into Anyscale's approach to handling millions of cores and diverse workloads at scale.

• YouTube
• 31 minutes
• Self-Paced
• Free Video

The State of vLLM - Advancements in LLM Inference and Serving

Explore the latest advancements in vLLM, the open-source LLM inference engine. Gain insights into its growing adoption, new features, performance improvements, and future roadmap for efficient LLM deployment.

• YouTube
• 35 minutes
• Self-Paced
• Free Video

Exploring Hinge's ML Platform Evolution with Ray - Ray Summit 2024

Discover how Hinge leverages Ray to enhance ML capabilities, streamline processes, and reduce time-to-production for ML solutions in a dating app environment. Gain insights into Ray's adaptability and practical applications.

• YouTube
• 23 minutes
• Self-Paced
• Free Video

Accelerated LLM Inference with Anyscale - Ray Summit 2024

Dive into Anyscale's latest LLM enterprise features and open-source contributions. Explore advancements in vLLM, including FP8 support and speculative decoding, doubling throughput and latency efficiency for improved inference performance.

• YouTube
• 30 minutes
• Self-Paced
• Free Video

Overcoming Distributed ML Challenges with Ray Train

Unlock efficient distributed ML pipelines with Ray Train. Explore solutions for setup, integration, debugging, fault tolerance, and data processing challenges in scalable machine learning workflows.

• YouTube
• 33 minutes
• Self-Paced
• Free Video

Optimizing Large-Scale Model Training with Ray Compiled Graphs

Explore advanced techniques for optimizing large-scale model training using Ray's latest features. Learn to enhance efficiency for LLMs and multimodal AI models through GPU-GPU communication and pre-compiled execution paths.

• YouTube
• 28 minutes
• Self-Paced
• Free Video

Klaviyo's Journey to Robust Model Serving with Ray Serve

Explore Klaviyo's journey in building DART, a model serving platform using Ray Serve. Gain insights into architecture, deployment strategies, and practical advice for implementing Ray Serve in your own projects.

• YouTube
• 31 minutes
• Self-Paced
• Free Video

Faster Model Serving with Ray and Anyscale - Ray Summit 2024

Explore Ray Serve's capabilities for distributed model serving and deployment, focusing on Anyscale's solutions for large-scale AI models and the challenges of building AI applications in the era of generative AI.

• YouTube
• 31 minutes
• Self-Paced
• Free Video