Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Iterating on Your AI Evals - Agents in Production 2025

MLOps.community via YouTube

Overview

Coursera Spring Sale
40% Off Coursera Plus Annual!
Grab it
Learn how to transform AI agent demos into consistently performing production systems through a startup-friendly evaluation iteration process in this 14-minute lightning talk. Discover how to define success metrics by creating comprehensive evaluation datasets, leverage LLM-as-a-judge techniques for rapid iteration cycles, and understand why iterating on evaluations is as crucial as refining prompts and models. Gain practical insights from an expert who specializes in helping early-stage teams build robust AI evaluation systems, drawing from experience in product startups and deep learning research.

Syllabus

Iterating on Your AI Evals // Mariana Prazeres // Agents in Production 2025

Taught by

MLOps.community

Reviews

Start your review of Iterating on Your AI Evals - Agents in Production 2025

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.