Run LLMs with Docker Model Runner - No Python, PyTorch, or CUDA Required
Kode Kloud via YouTube
Learn AI, Data Science & Business — Earn Certificates That Get You Hired
Master AI and Machine Learning: From Neural Networks to Applications
Overview
Syllabus
- Introduction: The LLM Dependency Challenge
- Dependency Hell Explained
- How Docker Solves Dependency Management
- Understanding Inference Engines
- DevOps and MLOps Benefits
- Free Lab Introduction
- Task 1: Installing Docker Model Plugin
- Task 2: Pulling AI Models as OCI Artifacts
- Task 3: Testing Models Interactively
- Task 4: Starting Background Inference Service
- Task 5: Querying via OpenAI API
- Task 6: Creating Custom Personas
- Task 7: Packaging for Offline Deployment
- Conclusion and Next Steps
Taught by
KodeKloud