Anyscale Courses

Fine-Tuning Large Language Models at Scale - Workday's Approach

Dive into Workday's innovative approach to fine-tuning LLMs securely in a multi-tenant environment, addressing GPU scarcity and data access controls using PEFT techniques and KubeRay's autoscaling capabilities.

• YouTube
• 31 minutes
• Self-Paced
• Free Video

How Rad AI is Revolutionizing Radiology with Ray - Ray Summit 2024

Explore Rad AI's innovative use of Generative AI in radiology, including specialized LLMs and Ray-based infrastructure for improved healthcare workflows and patient care.

• YouTube
• 31 minutes
• Self-Paced
• Free Video

Using Promptable Image Analysis for Clinical Diagnostics - Ray Summit 2024

Explore the integration of LLMs and Vision Transformers for enhanced clinical image analysis. Discover how Ray technologies enable real-time processing of multimodal data, revolutionizing diagnostic workflows in healthcare.

• YouTube
• 33 minutes
• Self-Paced
• Free Video

Scaling Inference Deployments with NVIDIA Triton Inference Server and Ray Serve

Explore the integration of Ray Serve and NVIDIA Triton Inference Server for enhanced ML model performance and scalability. Learn to optimize inference deployments using advanced tools and a new Python API.

• YouTube
• 32 minutes
• Self-Paced
• Free Video

Handshake's Approach to Content Tagging with vLLM and Anyscale

Explore Handshake's journey in implementing vLLM-based content tagging using Anyscale, enhancing job feed performance and addressing growing LLM requirements through innovative internal tools and methodologies.

• YouTube
• 24 minutes
• Self-Paced
• Free Video

Streamlining Data Access for Ray with Alluxio

Unlock efficient data access strategies for Ray using Alluxio. Learn how to overcome GPU limitations, unify fragmented data, and accelerate AI innovation across diverse storage environments.

• YouTube
• 32 minutes
• Self-Paced
• Free Video

Uber's Journey in Building Multi-Modal Foundation Models

Dive into Uber's approach to developing in-house multi-modal foundation models, optimizing earner onboarding and screening processes globally using Ray for distributed training and deployment.

• YouTube
• 35 minutes
• Self-Paced
• Free Video

IBM's Approach to Building a Cloud-Native AI Platform

Explore IBM and Red Hat's collaborative efforts in developing a cloud-native AI platform, addressing challenges in training and deploying foundation models at scale using KubeRay, Ray, and PyTorch.

• YouTube
• 33 minutes
• Self-Paced
• Free Video

Customizable Cluster Metrics Made Easy with Raydar and Anyscale

Unlock simplified Ray cluster monitoring with Raydar. Learn to set up, enable generic metrics, and create custom ML workflow visualizations for enhanced observability and scalability.

• YouTube
• 32 minutes
• Self-Paced
• Free Video

Training AI for Space: Slingshot's Ray Journey - Ray Summit 2024

Explore Slingshot Aerospace's innovative approach to managing satellites using AI and Ray-based training pipelines. Discover their multi-layered RL Gym for simulating space missions and agent training.

• YouTube
• 21 minutes
• Self-Paced
• Free Video

Shopify's Ray-Powered Approach to Multimodal AI in E-commerce

Explore Shopify's implementation of multimodal LLMs at scale, focusing on Ray's integration for fine-tuning and deploying vision language models in e-commerce production environments.

• YouTube
• 31 minutes
• Self-Paced
• Free Video

Netflix's Ray Platform: From Deep Learning to GenAI

Explore Netflix's integration of Ray to enhance its machine learning platform for the generative AI era, covering data processing, LLM fine-tuning, and distributed inference strategies.

• YouTube
• 38 minutes
• Self-Paced
• Free Video

Enabling Multi-User Ray Clusters with Runhouse - Ray Summit 2024

Discover innovative approaches to enhance Ray's multi-user capabilities. Learn how to orchestrate remote Ray clusters across regions and clouds, enabling seamless collaboration and flexible resource utilization.

• YouTube
• 30 minutes
• Self-Paced
• Free Video

Optimizing GenAI with Intel Gaudi Accelerators on Ray

Discover how Intel Gaudi accelerators integrate with Ray to enhance GenAI workloads, improving performance and efficiency for LLMs. Gain insights into optimizing popular models and managing Ray clusters for advanced AI capabilities.

• YouTube
• 28 minutes
• Self-Paced
• Free Video

Anyscale's Vision and Ray AI Compute Engine - Future of AI Scaling

Discover Anyscale's vision for AI scaling with Ray, the AI Compute Engine. Explore cutting-edge solutions tackling AI workload management challenges, from compiled graphs to advanced governance suites.

• YouTube
• 1 hour 1 minute
• Self-Paced
• Free Video