Building an ML Inference Platform with Knative - Serverless Containers on Kubernetes

The talk explains how teams built ML inference platforms with Knative and how those efforts led to KServe. It covers scale-to-zero for GPU utilization, safe model rollouts, Kafka-based inference pipelines, and performance optimization for large clusters.