Anyscale Courses

Fast LLM Serving with vLLM and PagedAttention

Explore vLLM, an open-source library for fast LLM inference using PagedAttention. Learn how it achieves higher throughput and its implementation for efficient AI model serving.

• YouTube
• 32 minutes
• Self-Paced
• Free Video

Managed Cloud Infrastructure for LLMs

Explore solutions for LLM infrastructure challenges, including cost reduction, GPU availability, scalability, and cloud resource management. Learn to accelerate AI development and deployment.

• YouTube
• 21 minutes
• Self-Paced
• Free Video

Serving Large Language Models with KubeRay on TPUs

Learn to serve large language models efficiently using KubeRay on TPUs. Explore increased performance, improved scalability, reduced costs, and enhanced monitoring for AI workloads.

• YouTube
• 25 minutes
• Self-Paced
• Free Video

Automatically Scaling Foundation Models Workflows: Ray with CodeFlare and Red Hat OpenShift

Explore integrating Ray with CodeFlare and RHODS Pipelines to automatically scale foundation model workflows on OpenShift, enabling efficient parallel execution and management of compute-intensive tasks.

• YouTube
• 30 minutes
• Self-Paced
• Free Video

Optimizing LLM Training with Airbnb's Next-Gen ML Platform

Explore Airbnb's ML platform upgrade for efficient LLM use, featuring Ray integration for improved developer productivity, performance, and cost-effective GPU utilization on AWS.

• YouTube
• 28 minutes
• Self-Paced
• Free Video

Building Context-Aware Reasoning Applications with LangChain and LangSmith

Explore context-aware reasoning in LLM applications. Learn about cognitive architectures, LangChain, and LangSmith for building differentiated AI products. Gain insights on evaluation and practical techniques.

• YouTube
• 31 minutes
• Self-Paced
• Free Video

Llama - Scaling Up LLMs in an Open Ecosystem

Explore Llama's evolution, its impact on Generative AI, and learn how to leverage state-of-the-art performance using Ray-based platforms for building with open-source large language models.

• YouTube
• 28 minutes
• Self-Paced
• Free Video

Enterprise Vector-based Information Retrieval and Prompt Engineering at Scale Using Open Source on AWS

Build enterprise-scale vector-based information retrieval systems using open source technologies on AWS, addressing challenges in Retrieval Augmented Generation for accurate, hallucination-free results.

• YouTube
• 31 minutes
• Self-Paced
• Free Video

Making Your Enterprise GenAI Ready and GenAI Enterprise Ready

Prepare your organization for GenAI challenges and opportunities. Learn best practices for integrating GenAI capabilities with enterprise security, privacy, and guardrails. Explore Google Cloud's innovative GenAI solutions for enterprise environments.

• YouTube
• 30 minutes
• Self-Paced
• Free Video

Practical Data Considerations for Building Production-Ready LLM Applications

Discover practical tips for managing data in scalable LLM systems. Learn how LlamaIndex and Ray provide tools for building robust, production-ready AI applications using private data.

• YouTube
• 29 minutes
• Self-Paced
• Free Video

Integrating Ray.io into the Google Cloud Ecosystem for Enterprise - Best Practices and Enhancements

Explore best practices for adapting Ray.io to meet Enterprise requirements in Google Cloud, focusing on security, networking, and integration with GKE for scalable AI/ML workloads.

• YouTube
• 28 minutes
• Self-Paced
• Free Video

Ray/RLLib-Empowered Reinforcement Learning Based Recommender Systems in NetEase Game

Explore how Ray/RLLib enhances reinforcement learning-based recommender systems in NetEase Games, improving user experience and profitability. Learn about the open-source RL4RS dataset for training and evaluating RL algorithms.

• YouTube
• 30 minutes
• Self-Paced
• Free Video

Forecasting at Scale and Distributed Data Processing with Ray

Explore time-series forecasting at scale and distributed data processing with Ray. Learn from Nixtla and Daft experts about leveraging Ray for massive data crunching and complex DataFrame operations.

• YouTube
• 1 hour 16 minutes
• Self-Paced
• Free Video

Ray Community European Meetup - Serve, Scaling, and NLP Innovations

Explore Ray Serve, on-demand scaling, and NLP project bootstrapping techniques. Learn about model serving, API controllers, and leveraging shortcuts for efficient NLP development.

• YouTube
• 1 hour 37 minutes
• Self-Paced
• Free Video

Large-Scale Deep Learning Training and Tuning with Ray at Uber

Explore large-scale deep learning challenges at Uber and learn how Ray addresses infrastructure hurdles in compute, network, and storage for ML applications.

• YouTube
• 33 minutes
• Self-Paced
• Free Video