Efficient LLM Deployment: A Unified Approach with Ray, VLLM, and Kubernetes
CNCF [Cloud Native Computing Foundation] via YouTube
PowerBI Data Analyst - Create visualizations and dashboards from scratch
Learn AI, Data Science & Business — Earn Certificates That Get You Hired
Overview
Google, IBM & Meta Certificates – 40% Off
One plan covers every Professional Certificate on Coursera.
Unlock All Certificates
Explore a comprehensive conference talk that dives deep into deploying Large Language Models (LLMs) efficiently using an integrated approach combining Ray, VLLM, and Kubernetes. Learn how to leverage cloud-native orchestration, distributed computing, and advanced LLMOps in the wake of ChatGPT's transformative impact on AI applications. Master the fundamentals of Kubernetes for managing AI workloads across cloud environments, understand Ray's capabilities as an open-source framework for scaling distributed applications, and discover VLLM's innovative features for high-performance, memory-efficient inference and serving of large language models. Gain practical insights into integrating these powerful tools to enhance AI solution deployment efficiency and drive technological innovation in the field of artificial intelligence.
Syllabus
Efficient LLM Deployment: A Unified Approach with Ray, VLLM, and Kubernetes - Lily (Xiaoxuan) Liu
Taught by
CNCF [Cloud Native Computing Foundation]