Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

CNCF [Cloud Native Computing Foundation]

Model Serving at the Edge - Challenges and Solutions with ModelMesh

CNCF [Cloud Native Computing Foundation] via YouTube

Start learning Write review
DataCamp Ad

Power BI Fundamentals - Create visualizations and dashboards from scratch

Learn More → Scrimba Ad

Get 20% off all career paths from fullstack to AI

Learn More →

Overview

Google, IBM & Meta Certificates – 40% Off
One Coursera Plus subscription covers most Professional Certificates on Coursera.
Unlock All Certificates
This talk explains how ModelMesh supports multi-model inference on resource-constrained edge hosts, including its architecture, serving runtimes, and an example deployment. It also introduces KServe and discusses using K3s and MicroShift at the edge.

Syllabus

Intro
Outline
Generations of Computing
Machine Learning Lifecycle
Complexities of Model Serving
Kubernetes at the Edge
Introducing KServe
Easy to Use Interfaces
Kserve Standardized Inference Protocol
Enter ModelMesh
ModelMesh Architecture
ModelMesh Serving Runtimes
ModelMesh On Edge?
Example Deployment
Higher Density Deployment
Challenges

Taught by

CNCF [Cloud Native Computing Foundation]

Reviews

Start your review of Model Serving at the Edge - Challenges and Solutions with ModelMesh

Start learning

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free
Someone learning on their laptop while sitting on the floor.