Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Docker Model Runner - Run AI Models Locally with Docker Desktop

Kode Kloud via YouTube

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Discover how to run AI models locally using Docker Model Runner, Docker Desktop's revolutionary new beta feature that eliminates cloud dependencies and expensive API costs. Learn what Docker Model Runner is and how it works, then follow a comprehensive step-by-step setup process on Windows 11 with WSL2. Master the techniques for pulling and running AI models locally while integrating OpenAI-compatible APIs through hands-on demonstrations with real commands. Explore the key features and benefits of local AI model execution, including GPU acceleration support for NVIDIA graphics cards. Navigate through interactive chat mode functionality and discover the variety of available models on Docker Hub. Understand the system requirements including Docker Desktop 4.40+, Windows 11/Mac with GPU support, and NVIDIA GPU configuration for Windows acceleration. Gain practical experience with local AI development while maintaining privacy and reducing operational costs through this comprehensive technical demonstration.

Syllabus

00:00 - Introduction to Docker Model Runner
01:14 - What is Docker Model Runner?
01:46 - Key Features Overview
05:52 - Demo Setup & Requirements
08:58 - Interactive Chat Mode
12:24 - Available Models on Docker Hub
13:23 - Summary

Taught by

KodeKloud

Reviews

Start your review of Docker Model Runner - Run AI Models Locally with Docker Desktop

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.