Anyscale Courses and Certifications

Anyscale

Where AI Builders Shape What's Next - Ray Summit 2025 Keynote Day 1

Explore Ray's evolution, unified AI compute platforms, and major product updates including PyTorch Foundation integration, Azure partnership, and robotics advancements from industry leaders.

• YouTube
• 2 hours 20 minutes
• On-Demand
• Free Video

Anyscale

How the VAST AI Operating System Powers a Dynamic Data Plane for Ray

Discover how Ray's new Label Selector API simplifies scheduling on heterogeneous GPU clusters, eliminating workarounds and providing fine-grained control over resource placement.

• YouTube
• 13 minutes
• On-Demand
• Free Video

Anyscale

Optimizing LLM Inference with AWS Trainium, Ray, vLLM, and Anyscale

Explore cost-effective LLM inference scaling using AWS accelerators, Ray, vLLM, and Anyscale. Learn to build a complete stack on EKS and leverage advanced cluster management for enterprise-grade GenAI workloads.

• YouTube
• 46 minutes
• On-Demand
• Free Video

Anyscale

Scalable and Cost-Efficient AI Workloads with AWS and Anyscale

Learn to scale and productionize GenAI and LLM workloads cost-effectively using AWS compute instances and Anyscale's capabilities for ambitious AI projects.

• YouTube
• 35 minutes
• On-Demand
• Free Video

Anyscale

Easily Scale to Production-Ready Generative AI with NVIDIA and Anyscale

Scale generative AI to production with NVIDIA and Anyscale's partnership. Learn how their combined technologies optimize performance, lower costs, and enable secure deployment of AI services at scale.

• YouTube
• 30 minutes
• On-Demand
• Free Video

Anyscale

Real-Time Vectorization for Transactional Workloads with MongoDB Atlas and Anyscale

Explore real-time vectorization for transactional workloads using MongoDB Atlas and Anyscale, liberating data and enabling innovation with advanced models at scale.

• YouTube
• 13 minutes
• On-Demand
• Free Video

Anyscale

Faster Model Serving with Ray and Anyscale - Ray Summit 2024

Explore Ray Serve's capabilities for distributed model serving and deployment, focusing on Anyscale's solutions for large-scale AI models and the challenges of building AI applications in the era of generative AI.

• YouTube
• 31 minutes
• On-Demand
• Free Video

Anyscale

Handshake's Approach to Content Tagging with vLLM and Anyscale

Explore Handshake's journey in implementing vLLM-based content tagging using Anyscale, enhancing job feed performance and addressing growing LLM requirements through innovative internal tools and methodologies.

• YouTube
• 24 minutes
• On-Demand
• Free Video

Anyscale

Customizable Cluster Metrics Made Easy with Raydar and Anyscale

Unlock simplified Ray cluster monitoring with Raydar. Learn to set up, enable generic metrics, and create custom ML workflow visualizations for enhanced observability and scalability.

• YouTube
• 32 minutes
• On-Demand
• Free Video

Anyscale

MLOps with Ray on Anyscale

Discover how to streamline ML workflows using Ray on Anyscale for scalable data processing, distributed training, hyperparameter tuning, and production deployment.

• YouTube
• 21 minutes
• On-Demand
• Free Video

Anyscale

Building Fault-Tolerant Massive Ray Clusters on Anyscale

Discover how Ray's distributed runtime handles failures gracefully in 10,000+ node clusters, covering fault tolerance, state management, recovery, and workload-aware scheduling strategies.

• YouTube
• 31 minutes
• On-Demand
• Free Video

Anyscale

Building a Chat Assistant with Canopy and Anyscale Endpoints

Explore building RAG-based chat assistants using Canopy and Anyscale Endpoints. Learn architecture, see live examples, and get started with your own project using flexible frameworks and serverless LLM APIs.

• YouTube
• 45 minutes
• On-Demand
• Free Video

Anyscale

Developing and Serving RAG-Based LLM Applications in Production

Learn to develop, evaluate, and scale RAG-based LLM applications for production, including advanced topics like hybrid routing to bridge the gap between open-source and closed LLMs.

• YouTube
• 29 minutes
• On-Demand
• Free Video

Anyscale

Deploying Many Models Efficiently with Ray Serve

Explore efficient deployment of multiple models using Ray Serve's features: model composition, multi-application, and model multiplexing. Learn industry patterns and case studies for optimizing resource utilization.

• YouTube
• 26 minutes
• On-Demand
• Free Video

Anyscale

Lessons From Fine-Tuning Llama-2

Explore insights from fine-tuning Llama-2 for specialized applications. Learn setup, infrastructure, and efficiency techniques to outperform GPT-4 in specific scenarios using Anyscale and Ray.

• YouTube
• 29 minutes
• On-Demand
• Free Video