Run LLMs with Docker Model Runner - No Python, PyTorch, or CUDA Required
Kode Kloud via YouTube
Build the Finance Skills That Lead to Promotions, Not Just Certificates
AI, Data Science & Cloud Certificates from Google, IBM & Meta
Overview
Syllabus
- Introduction: The LLM Dependency Challenge
- Dependency Hell Explained
- How Docker Solves Dependency Management
- Understanding Inference Engines
- DevOps and MLOps Benefits
- Free Lab Introduction
- Task 1: Installing Docker Model Plugin
- Task 2: Pulling AI Models as OCI Artifacts
- Task 3: Testing Models Interactively
- Task 4: Starting Background Inference Service
- Task 5: Querying via OpenAI API
- Task 6: Creating Custom Personas
- Task 7: Packaging for Offline Deployment
- Conclusion and Next Steps
Taught by
KodeKloud