From Models to Market: What's the Missing Link in Scaling Open Source Models on Cloud?
CNCF [Cloud Native Computing Foundation] via YouTube
Learn AI, Data Science & Business — Earn Certificates That Get You Hired
Learn Backend Development Part-Time, Online
Overview
Google, IBM & Meta Certificates – 40% Off
One Coursera Plus subscription covers most Professional Certificates on Coursera.
Unlock All Certificates
本课程以 OpenLLM 为例,介绍使用 BentoML 将开源大语言模型封装为微服务,并在云端部署、提供服务和扩展。内容涵盖模型服务的速度、效率、成本及硬件选择等挑战。
Syllabus
Keynote: From Models to Market: What's the Missing Link in Scaling Open Source Models on... Fog Dong
Taught by
CNCF [Cloud Native Computing Foundation]