Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Microsoft

Deploy Local AI Models in Enterprise with Windows ML

Microsoft via YouTube

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore Windows ML, Microsoft's performance-first AI framework that enables secure, on-device inferencing across CPU, GPU, and NPU without requiring cloud infrastructure or additional dependencies. Discover how to deploy various AI models locally in enterprise environments while maintaining privacy, security, and optimal performance. Learn to register execution providers with ONNX Runtime, select appropriate hardware acceleration options including QNN NPU execution providers, and debug device readiness for seamless deployment. Master the process of encoding prompts, setting up local model generators, and implementing GPU-based image generation using Windows ML's streamlined approach. Understand how Windows ML abstracts complex model-to-hardware operations, allowing developers to focus on application logic while ensuring efficient resource utilization across diverse hardware tiers. Compare CPU-based inference performance and explore lightweight deployment strategies that reduce application size while delivering fast, private, and scalable AI experiences in enterprise settings.

Syllabus

0:00 - Session Introduction and Welcome to BRK329: Deploying Local AI Models with Windows ML
00:02:35 - Why Local AI Matters – Privacy, Security, and Performance Benefits
00:12:19 - Registering Execution Providers with ONNX Runtime
00:12:33 - Selecting QNN NPU Execution Provider
00:14:05 - Debugging Execution Provider Registration and Device Readiness
00:23:50 - Encoding Prompts and Setting Up Local Model Generator
00:25:01 - Live GPU Image Generation Demo Using Windows ML
00:34:16 - Developers can focus on app logic while Windows ML abstracts model-to-hardware operations
00:38:44 - CPU-based inference comparison and lightweight deployment flexibility

Taught by

Microsoft Ignite

Reviews

Start your review of Deploy Local AI Models in Enterprise with Windows ML

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.