Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

CNCF [Cloud Native Computing Foundation]

Enhancing the Performance Testing Process for gRPC Model Inferencing at Scale

CNCF [Cloud Native Computing Foundation] via YouTube

Start learning Write review
Corporate Finance Institute Ad

Finance Certifications Goldman Sachs and Amazon Teams Trust

Learn More → CodeSignal Ad

2,000+ Free Courses with Certificates: Coding, AI, SQL, and More

Learn More →

Overview

Google, IBM & Meta Certificates – 40% Off
One Coursera Plus subscription covers most Professional Certificates on Coursera.
Unlock All Certificates
The session demonstrates setting up a Kubernetes cluster with KServe ModelMesh for high-density gRPC model inference, then load testing thousands of models and monitoring performance metrics with Prometheus and Grafana.

Syllabus

Introduction
Model Deployment
Kubernetes
Complexities
Kserve
Scalability
Model Mesh
Model Mesh Features
Performance Testing Automation
Performance Testing Setup
Performance Testing Environment
QFlow Pipeline
K6 Load Tools
GRPC
Prometheus
Demo
Testing
Testing Log
Testing Results
Cashmiss Action
Should I use Model Mesh

Taught by

CNCF [Cloud Native Computing Foundation]

Reviews

Start your review of Enhancing the Performance Testing Process for gRPC Model Inferencing at Scale

Start learning

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free
Someone learning on their laptop while sitting on the floor.