Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Linux Foundation

Creating a Custom Serving Runtime in KServe ModelMesh - Hands-On Experience

Linux Foundation via YouTube

Start learning Write review
DataCamp Ad

Power BI Fundamentals - Create visualizations and dashboards from scratch

Learn More → CodeSignal Ad

Learn Generative AI, Prompt Engineering, and LLMs for Free

Learn More →

Overview

Google, IBM & Meta Certificates – 40% Off
One Coursera Plus subscription covers most Professional Certificates on Coursera.
Unlock All Certificates
This talk introduces KServe ModelMesh and demonstrates loading models into an existing server, building a container image for a custom serving runtime, and running predictions with it. It also covers ModelMesh architecture and monitoring with Prometheus metrics and Grafana dashboards.

Syllabus

Introduction
Agenda
What is ModelServing
Deployment Strategy
KServe
Pod Per Model
ModelMesh
ModelMesh Features
ModelMesh Architecture
Monitoring
Prometheus
Grafana Dashboard
Model Loading
Serving Runtime
Why KServe
Step by Step
Example
Model Mesh Example
In Practice

Taught by

Linux Foundation

Tags

Reviews

Start your review of Creating a Custom Serving Runtime in KServe ModelMesh - Hands-On Experience

Start learning

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free
Someone learning on their laptop while sitting on the floor.