Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

CNCF [Cloud Native Computing Foundation]

Taming Dependency Chaos for LLM in Kubernetes

CNCF [Cloud Native Computing Foundation] via YouTube

Overview

Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
Learn how to solve Python dependency management challenges when deploying Large Language Models (LLMs) in Kubernetes environments in this conference talk from KubeCon + CloudNativeCon. Discover the common pain points AI developers face, including the nightmare of maintaining base images with rapidly evolving AI packages, productivity blocks from manual pip installations, and costly GPU time wasted on package downloads. Explore a comprehensive solution using the BaizeAI dataset project that introduces a Custom Resource Definition (CRD) to describe dependencies and environments, Kubernetes Jobs for pre-loading packages, Persistent Volume Claims (PVC) for storage and mounting, conda for environment switching, and cross-namespace sharing capabilities. Gain practical insights into streamlining your AI development workflow and eliminating dependency chaos in cloud-native LLM deployments.

Syllabus

Taming Dependency Chaos for LLM in K8s - Peter Pan, Neko Ayaka & Kebe Liu, DaoCloud

Taught by

CNCF [Cloud Native Computing Foundation]

Reviews

Start your review of Taming Dependency Chaos for LLM in Kubernetes

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.