Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

CNCF [Cloud Native Computing Foundation]

Serving Machine Learning Models at Scale Using KServe

CNCF [Cloud Native Computing Foundation] via YouTube

Start learning Write review
Train in Data Ad

Master Production-Ready Machine Learning, Step by Step

Learn More → Corporate Finance Institute Ad

Learn Excel and Financial Modeling the Way Finance Teams Actually Use Them

Learn More →

Overview

Google, IBM & Meta Certificates – 40% Off
One Coursera Plus subscription covers most Professional Certificates on Coursera.
Unlock All Certificates
This talk presents KServe’s Multi-Model Serving design for scaling model serving in Kubernetes. It explains how the solution serves models from different frameworks and shares benchmark results.

Syllabus

Introduction
Background about KServe
Milestones
Model Development
Challenges
KServe
KServe Components
Standard Inference Protocol
HTTP Protocol
GRPC Protocol
New Scalability Problem
Current Approach
Problem
Compute resource limitations
Maximum pod limitations
Maximum IP address limitations
Model Mesh Solution
Performance Test
Latency Test
Model Mesh
Roadmap
Questions
Original Design

Taught by

CNCF [Cloud Native Computing Foundation]

Reviews

Start your review of Serving Machine Learning Models at Scale Using KServe

Start learning

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free
Someone learning on their laptop while sitting on the floor.