Anyscale Courses

Perplexity AI: Building the World's Best LLM-Powered Search Engine in 6 Months

Explore the engineering challenges and opportunities in building Perplexity.ai, an LLM-powered answer engine, with insights from founder Aravind Srinivas on rapid development and resource optimization.

• YouTube
• 33 minutes
• Self-Paced
• Free Video

Gorilla: Large Language Models Connected with Massive APIs

Explore Gorilla LLM's advanced capabilities in API call generation, adaptation to document changes, and hallucination mitigation. Learn about this open-source project's impact on AI development.

• YouTube
• 31 minutes
• Self-Paced
• Free Video

Large Language-Style Universal Models for Short Video Recommendations

Explore a ray-based solution for large-scale video recommendations, featuring a single big model with sparse inputs/outputs and universal graph search algorithm. Learn about its advantages and empirical results.

• YouTube
• 30 minutes
• Self-Paced
• Free Video

Fast LLM Serving with vLLM and PagedAttention

Explore vLLM, an open-source library for fast LLM inference using PagedAttention. Learn how it achieves higher throughput and its implementation for efficient AI model serving.

• YouTube
• 32 minutes
• Self-Paced
• Free Video

Serving Large Language Models with KubeRay on TPUs

Learn to serve large language models efficiently using KubeRay on TPUs. Explore increased performance, improved scalability, reduced costs, and enhanced monitoring for AI workloads.

• YouTube
• 25 minutes
• Self-Paced
• Free Video

Optimizing LLM Training with Airbnb's Next-Gen ML Platform

Explore Airbnb's ML platform upgrade for efficient LLM use, featuring Ray integration for improved developer productivity, performance, and cost-effective GPU utilization on AWS.

• YouTube
• 28 minutes
• Self-Paced
• Free Video

Building Context-Aware Reasoning Applications with LangChain and LangSmith

Explore context-aware reasoning in LLM applications. Learn about cognitive architectures, LangChain, and LangSmith for building differentiated AI products. Gain insights on evaluation and practical techniques.

• YouTube
• 31 minutes
• Self-Paced
• Free Video

Llama - Scaling Up LLMs in an Open Ecosystem

Explore Llama's evolution, its impact on Generative AI, and learn how to leverage state-of-the-art performance using Ray-based platforms for building with open-source large language models.

• YouTube
• 28 minutes
• Self-Paced
• Free Video

Enterprise Vector-based Information Retrieval and Prompt Engineering at Scale Using Open Source on AWS

Build enterprise-scale vector-based information retrieval systems using open source technologies on AWS, addressing challenges in Retrieval Augmented Generation for accurate, hallucination-free results.

• YouTube
• 31 minutes
• Self-Paced
• Free Video

Making Your Enterprise GenAI Ready and GenAI Enterprise Ready

Prepare your organization for GenAI challenges and opportunities. Learn best practices for integrating GenAI capabilities with enterprise security, privacy, and guardrails. Explore Google Cloud's innovative GenAI solutions for enterprise environments.

• YouTube
• 30 minutes
• Self-Paced
• Free Video

Practical Data Considerations for Building Production-Ready LLM Applications

Discover practical tips for managing data in scalable LLM systems. Learn how LlamaIndex and Ray provide tools for building robust, production-ready AI applications using private data.

• YouTube
• 29 minutes
• Self-Paced
• Free Video

Ray/RLLib-Empowered Reinforcement Learning Based Recommender Systems in NetEase Game

Explore how Ray/RLLib enhances reinforcement learning-based recommender systems in NetEase Games, improving user experience and profitability. Learn about the open-source RL4RS dataset for training and evaluating RL algorithms.

• YouTube
• 30 minutes
• Self-Paced
• Free Video

Ray Community European Meetup - Serve, Scaling, and NLP Innovations

Explore Ray Serve, on-demand scaling, and NLP project bootstrapping techniques. Learn about model serving, API controllers, and leveraging shortcuts for efficient NLP development.

• YouTube
• 1 hour 37 minutes
• Self-Paced
• Free Video

A Cross-Platform, Cross-Tool Ray on Kubernetes Deployment

Deploy Ray, Spark, Dask, and Jupyter on mixed-architecture Kubernetes clusters. Learn cross-building containers, handling Ubuntu versions, and glibc versioning for heterogeneous Ray clusters.

• YouTube
• 31 minutes
• Self-Paced
• Free Video

Graphs at Scale with Ray for AI in Manufacturing

Explore graph technologies for AI in manufacturing, leveraging Ray for scalable solutions. Learn integration of graph models, NLP, and deep learning for industrial applications.

• YouTube
• 33 minutes
• Self-Paced
• Free Video