Overview
Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Discover how to run AI models locally using Docker Model Runner, Docker Desktop's revolutionary new beta feature that eliminates cloud dependencies and expensive API costs. Learn what Docker Model Runner is and how it works, then follow a comprehensive step-by-step setup process on Windows 11 with WSL2. Master the techniques for pulling and running AI models locally while integrating OpenAI-compatible APIs through hands-on demonstrations with real commands. Explore the key features and benefits of local AI model execution, including GPU acceleration support for NVIDIA graphics cards. Navigate through interactive chat mode functionality and discover the variety of available models on Docker Hub. Understand the system requirements including Docker Desktop 4.40+, Windows 11/Mac with GPU support, and NVIDIA GPU configuration for Windows acceleration. Gain practical experience with local AI development while maintaining privacy and reducing operational costs through this comprehensive technical demonstration.
Syllabus
00:00 - Introduction to Docker Model Runner
01:14 - What is Docker Model Runner?
01:46 - Key Features Overview
05:52 - Demo Setup & Requirements
08:58 - Interactive Chat Mode
12:24 - Available Models on Docker Hub
13:23 - Summary
Taught by
KodeKloud