Anyscale Courses

Running a Question-Answering System on Ray Serve at Deepset

Learn to deploy a GPU-powered question-answering system using Ray Serve, covering key components, NLP model pipelines, and integration with Hugging Face and persistent storage.

• YouTube
• 31 minutes
• Self-Paced
• Free Video

Ray Observability - Present and Future

Explore Ray 2.0's observability architecture, learn debugging techniques, and discover future plans for a unified data model in this insightful presentation.

• YouTube
• 32 minutes
• Self-Paced
• Free Video

Scalable Training of Language Models Using Ray, JAX, and TPUv4

Explore challenges and design decisions for scalable language model training, with quantitative analysis of efficiency improvements using Ray, JAX pjit, and TPUv4.

• YouTube
• 34 minutes
• Self-Paced
• Free Video

Predibase: A Low-Code Deep Learning Platform Built for Scale

Explore Predibase: a low-code deep learning platform combining large-scale ML with state-of-the-art architectures for NLP, computer vision, and tabular data, built on Ludwig and Ray for scalable, end-to-end solutions.

• YouTube
• 32 minutes
• Self-Paced
• Free Video

The Magic of Merlin - Shopify's New Machine Learning Platform

Explore Shopify's Merlin ML platform, its open-source stack, architecture, and how it scales ML work using Ray.

• YouTube
• 31 minutes
• Self-Paced
• Free Video

Tend and Tune Your MARL Experiments with Ray and Weights & Biases

Optimize multi-agent reinforcement learning experiments using Ray and Weights & Biases. Automate tuning, trace experiments, and centralize data for faster, more efficient results in scenarios like autonomous driving and drone flying.

• YouTube
• 14 minutes
• Self-Paced
• Free Video

How to Simplify Cloud-Native Model Training and Validation with CodeFlare - A Hands-On Demo

Simplify cloud-native model training and validation with CodeFlare-SDK. Learn to manage resources, submit jobs, and monitor status using an intuitive Python interface for Ray, PyTorch/TorchX, and Kubernetes.

• YouTube
• 15 minutes
• Self-Paced
• Free Video

Running ML Workloads with AWS Purpose-Built ML Accelerators and Ray

Discover AWS Trainium and Inferentia ML accelerators for high-performance, cost-effective Generative AI in the cloud. Explore native support for these accelerators in Ray.

• YouTube
• 13 minutes
• Self-Paced
• Free Video

On-Demand Ray Clusters in ML Workflows via KubeRay and Sematic

Leverage short-lived Ray clusters in ML workflows using KubeRay and Sematic for improved reproducibility, efficiency, and observability. Learn to manage ephemeral Ray clusters on Kubernetes.

• YouTube
• 13 minutes
• Self-Paced
• Free Video

Bridging MLOps and LLMOps: Integrating Governed Generative AI into Enterprise Systems

Explore MLOps and LLMOps integration for enterprise Generative AI, addressing risk and compliance. Learn to adapt existing frameworks and build efficient LLM-based applications.

• YouTube
• 14 minutes
• Self-Paced
• Free Video

Efficient Expert Witness Profiling with Ray: Automated Key Phrase Extraction from Legal Documents

Automate key phrase extraction from legal documents to efficiently profile expert witnesses using Ray, reducing processing time and improving information retrieval for the legal industry.

• YouTube
• 14 minutes
• Self-Paced
• Free Video

Ray Serve for IoT at Samsara: Scaling Cloud Inference for Computer Vision and Sensor Fusion

Scale cloud IOT inference platform using Ray Serve. Learn best practices for production clusters, customization for IOT use-cases, and pragmatic tips for deployment, monitoring, and maintenance.

• YouTube
• 11 minutes
• Self-Paced
• Free Video

50x Faster Fine-Tuning in 10 Lines of YAML with Ludwig and Ray

Explore efficient fine-tuning of foundation models using Ludwig and Ray. Learn to adapt pretrained models, train dense layers, and use embeddings for tree-based models in just 10 lines of YAML.

• YouTube
• 12 minutes
• Self-Paced
• Free Video

GenAI for Enterprises - Practical Considerations From Pilot to Scale

Explore practical considerations for implementing GenAI in enterprises, from pilot to scale. Address challenges and learn successful approaches for large-scale AI deployment.

• YouTube
• 12 minutes
• Self-Paced
• Free Video

Standing Up Ray Clusters for Private AI Deployment

Discover how VMware enhances Ray deployments on-premise, improving performance and aligning with enterprise AI needs for data privacy, control, and service choice.

• YouTube
• 11 minutes
• Self-Paced
• Free Video