Empower Heterogeneous Edge AI Acceleration with Kubernetes
CNCF [Cloud Native Computing Foundation] via YouTube
Build GenAI Apps from Scratch — UCSB PaCE Certificate Program
Learn Generative AI, Prompt Engineering, and LLMs for Free
Overview
AI, Data Science & Cloud Certificates from Google, IBM & Meta — 40% Off
One plan covers every Professional Certificate on Coursera. 40% off Coursera Plus Annual.
Unlock All Certificates
Explore a unified framework for empowering heterogeneous edge AI acceleration with Kubernetes in this conference talk by VMware experts. Delve into the challenges of managing diverse edge AI accelerators from various vendors, including Nvidia edge GPUs, Intel Movidius VPUs, and Google edge TPUs. Learn about key mechanisms such as extending Node Feature Discovery for automatic detection of edge AI accelerators, unifying device plugins for provisioning work nodes, introducing transparent backend accelerations to boost ML upstream frameworks, and attaching remote GPUs to edge devices. Gain insights into how this unified edge AI framework helps Kubernetes empower heterogeneous AI acceleration on the edge, addressing the emerging trends in edge computing and workload management.
Syllabus
Empower Heterogeneous Edge AI Acceleration with K8s - Tiejun Chen & Zitong Xu, VMware
Taught by
CNCF [Cloud Native Computing Foundation]