Anyscale Courses

Pioneering a Next-Gen AI Platform with Ray at eBay

Dive into eBay's AI platform transformation, exploring Ray's impact on batch inference, feature engineering, distributed training, and comprehensive AI solutions. Gain insights on challenges, solutions, and lessons learned.

• YouTube
• 32 minutes
• Self-Paced
• Free Video

Generative AI and Proprietary Data: Ensuring Security in Enterprise AI Adoption

Unlock secure enterprise AI adoption with confidential computing. Learn how to leverage LLMs while keeping sensitive data encrypted throughout the AI workflow, maintaining prediction quality and data privacy.

• YouTube
• 28 minutes
• Self-Paced
• Free Video

Coinbase's ML Training Evolution: From Sagemaker to Ray - Ray Summit 2024

Uncover Coinbase's ML infrastructure transformation, exploring the shift from Sagemaker to Ray. Learn how this change accelerated training, scaled to terabyte datasets, and reduced costs by 20%, revolutionizing ML operations.

• YouTube
• 35 minutes
• Self-Paced
• Free Video

Transforming Multimodal Data Management with LanceDB-Ray

Discover how LanceDB and Ray revolutionize multimodal AI development by enhancing data management for massive video and audio datasets, offering rapid indexing and targeted filtering for ML training.

• YouTube
• 31 minutes
• Self-Paced
• Free Video

ByteDance's Platform for Reinforcement Learning from Human Feedback

Explore ByteDance's journey in building a video data processing pipeline using Ray's ecosystem for creating realistic video generation models from text instructions.

• YouTube
• 32 minutes
• Self-Paced
• Free Video

Scaling Video Generation with Ray - Genmo's Approach

Discover Genmo's innovative strategies for scaling text-to-video AI using Ray, including distributed computing techniques and cloud resource optimization for large-scale model deployment.

• YouTube
• 33 minutes
• Self-Paced
• Free Video

Spotify Harnesses Ray for Next-Gen AI Infrastructure

Dive into Spotify's journey of scaling AI infrastructure using Ray on Google Kubernetes Engine, exploring challenges and optimizations for large-scale LLM training and deployment.

• YouTube
• 30 minutes
• Self-Paced
• Free Video

Reddit's ML Evolution: Scaling with Ray and KubeRay

Discover how Reddit leverages Ray and KubeRay to scale ML operations, achieving 6x faster model training and enabling scalable LLM deployment for improved developer productivity.

• YouTube
• 35 minutes
• Self-Paced
• Free Video

Canva's AI Leap: Scaling with Ray and Anyscale - Ray Summit 2024

Discover how Canva scaled AI capabilities using Ray and Anyscale. Learn about integrating RayTurbo, leveraging heterogeneous training clusters, and improving efficiency in AI operations for high-growth environments.

• YouTube
• 26 minutes
• Self-Paced
• Free Video

Building Large-Scale Data Processing Pipelines for Multimodal Models with Ray - ByteDance Case Study

Uncover ByteDance's approach to building scalable data pipelines for video generation models using Ray. Gain insights into handling massive datasets and leveraging Ray's ecosystem for multimodal AI projects.

• YouTube
• 35 minutes
• Self-Paced
• Free Video

Databricks' vLLM Optimization for Cost-Effective LLM Inference - Ray Summit 2024

Discover strategies for optimizing vLLM to enhance LLM inference performance, reduce GPU idle time, and accelerate quantization, leading to cost-effective large-scale language model deployment.

• YouTube
• 28 minutes
• Self-Paced
• Free Video

Advanced Evaluation Techniques for AI Agents

Uncover advanced techniques for evaluating LLM-powered AI agents, addressing behavioral instability, comprehensive testing, and cascading failures. Gain insights from production experiences to implement robust evaluation pipelines.

• YouTube
• 36 minutes
• Self-Paced
• Free Video

Optimizing vLLM for Intel CPUs and XPUs - Ray Summit 2024

Dive into Intel's optimization strategies for vLLM on CPUs and XPUs, exploring technical advancements, performance data, and collaborative efforts to enhance GenAI inference efficiency.

• YouTube
• 30 minutes
• Self-Paced
• Free Video

Advancing Video Curation with Generative AI - NVIDIA's Approach

Explore NVIDIA's innovative approach to video comprehension in generative AI, focusing on data curation and multimodal video foundation models using Ray Data and NVIDIA DGX Cloud.

• YouTube
• 34 minutes
• Self-Paced
• Free Video

Spotify's Approach to Distributed LLM Training with Ray on GKE

Dive into Spotify's innovative approach to distributed LLM training using Ray on GKE. Learn about efficient training of 70B+ parameter models, resource management, and performance optimization techniques for scalable ML infrastructure.

• YouTube
• 31 minutes
• Self-Paced
• Free Video