Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

LLMOps for Eval-Driven Development at Scale

Weights & Biases via YouTube

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Learn how Mercari implemented LLMOps practices to scale evaluation-driven development for their LLM applications serving over 23 million users on Japan's largest C2C e-commerce marketplace in this 20-minute conference talk. Discover how strategic investments in DevOps, MLOps, and LLMOps significantly improved developer speed and quality while enhancing both software quality and developer quality of life. Explore key LLMOps focus areas including prompt management, comprehensive evaluation frameworks, and LLM application observability that enabled successful deployment of ambitious AI projects. Gain insights into the open-source software tools and methodologies that were instrumental in delivering unparalleled customer value at scale, and understand how proper LLMOps implementation can transform the development lifecycle for large-scale AI applications in production environments.

Syllabus

LLMOps for eval-driven development at scale

Taught by

Weights & Biases

Reviews

Start your review of LLMOps for Eval-Driven Development at Scale

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.