Anyscale Courses

Building Scalable Cross-Modal Search with Ray

Discover how to build a powerful fashion image retrieval system using Ray and Pinecone, enabling efficient text-to-image and image-to-image search with CLIP embeddings and vector similarity.

• YouTube
• 11 minutes
• Self-Paced
• Free Video

Model Training on Snowflake with Ray

Discover how to leverage Snowflake Container Runtime and Ray for efficient, scalable model training through a practical demonstration of performance optimization techniques.

• YouTube
• 14 minutes
• Self-Paced
• Free Video

Scaling LLM Inference - AWS Inferentia Meets Ray Serve on EKS

Discover how to build scalable, cost-effective LLM inference infrastructure using Ray Serve and AWS Inferentia on Amazon EKS, optimizing deployment of models like Llama2 and Mistral-7B.

• YouTube
• 13 minutes
• Self-Paced
• Free Video

Ray on Kubernetes - Powering Quantitative Research at Scale

Discover how Ray on Kubernetes revolutionizes quantitative research with scalable infrastructure supporting 100,000 CPU cores, spot instances, and seamless GPU integration for high-performance trading operations.

• YouTube
• 13 minutes
• Self-Paced
• Free Video

Akash Network - Powering Ray on an Open Source Super Cloud

Discover how Akash Network's open-source super cloud platform revolutionizes distributed computing and AI workloads, featuring real-world applications and live demonstrations of Ray clusters with vLLM and Llama-3.1.

• YouTube
• 16 minutes
• Self-Paced
• Free Video

Accelerating Princeton's Computational Science with Ray

Discover how Princeton University revolutionizes academic research computing by implementing Ray across campus clusters, multi-institutional systems, and hybrid cloud environments for enhanced ML and HPC capabilities.

• YouTube
• 13 minutes
• Self-Paced
• Free Video

LLMs on Ray and LanceDB - Scaling Multimodal Pipelines and Native Ray APIs for LLM Inference

Explore how LanceDB and Ray combine to scale multimodal data pipelines and LLM inference, featuring insights on zero-cost schema evolution, batch processing, and online inference with Ray Serve LLM.

• YouTube
• 56 minutes
• Self-Paced
• Free Video

Introduction to Anyscale and Ray AI Libraries for Distributed Machine Learning

Discover how to scale AI workflows using Ray and Anyscale, from fundamental concepts to hands-on implementation with distributed machine learning libraries and practical notebooks.

• YouTube
• 1 hour
• Self-Paced
• Free Video

Best Practices for Ray in Production

Discover reference architectures, stability practices, and infrastructure solutions for deploying Ray at scale, plus learn how RayTurbo accelerates production performance.

• YouTube
• 58 minutes
• Self-Paced
• Free Video

Practical AI Applications in Finance - Two Sigma's Approach to Production-Grade Systems

Discover how Two Sigma transforms academic AI breakthroughs into production-grade systems for quantitative finance, separating real value from industry buzz.

• YouTube
• 32 minutes
• Self-Paced
• Free Video

Optimizing LLM Inference with AWS Trainium, Ray, vLLM, and Anyscale

Explore cost-effective LLM inference scaling using AWS accelerators, Ray, vLLM, and Anyscale. Learn to build a complete stack on EKS and leverage advanced cluster management for enterprise-grade GenAI workloads.

• YouTube
• 46 minutes
• Self-Paced
• Free Video

Scalable and Cost-Efficient AI Workloads with AWS and Anyscale

Learn to scale and productionize GenAI and LLM workloads cost-effectively using AWS compute instances and Anyscale's capabilities for ambitious AI projects.

• YouTube
• 35 minutes
• Self-Paced
• Free Video

Fast and Scalable Model Training with PyTorch and Ray

Learn distributed model training with PyTorch and Ray. Migrate code, scale AI workflows, and optimize performance for large-scale training and fine-tuning on Anyscale.

• YouTube
• 58 minutes
• Self-Paced
• Free Video

End-to-End LLM Workflows with Anyscale

Explore building and scaling end-to-end LLM workflows, covering data processing, model fine-tuning, evaluations, and production inference with Anyscale's modern platform.

• YouTube
• 46 minutes
• Self-Paced
• Free Video

Building a Chat Assistant with Canopy and Anyscale Endpoints

Explore building RAG-based chat assistants using Canopy and Anyscale Endpoints. Learn architecture, see live examples, and get started with your own project using flexible frameworks and serverless LLM APIs.

• YouTube
• 45 minutes
• Self-Paced
• Free Video