Cloud Native Sustainable LLM Inference in Action
CNCF [Cloud Native Computing Foundation] via YouTube
Learn AI, Data Science & Business — Earn Certificates That Get You Hired
Learn Excel and Financial Modeling the Way Finance Teams Actually Use Them
Overview
Google, IBM & Meta Certificates – 40% Off
One Coursera Plus subscription covers most Professional Certificates on Coursera.
Unlock All Certificates
This tutorial demonstrates sustainable LLM inference using cloud-native technology. It covers energy monitoring with Kepler and accelerator frequency adjustments in a Kubernetes cluster, with a live vLLM demonstration.
Syllabus
Tutorial: Cloud Native Sustainable LLM Inference in Action
Taught by
CNCF [Cloud Native Computing Foundation]