Learn Generative AI, Prompt Engineering, and LLMs for Free
Learn AI, Data Science & Business — Earn Certificates That Get You Hired
Overview
AI, Data Science & Cloud Certificates from Google, IBM & Meta — 40% Off
One plan covers every Professional Certificate on Coursera. 40% off Coursera Plus Annual.
Unlock All Certificates
Learn how to transform AI agent demos into consistently performing production systems through a startup-friendly evaluation iteration process in this 14-minute lightning talk. Discover how to define success metrics by creating comprehensive evaluation datasets, leverage LLM-as-a-judge techniques for rapid iteration cycles, and understand why iterating on evaluations is as crucial as refining prompts and models. Gain practical insights from an expert who specializes in helping early-stage teams build robust AI evaluation systems, drawing from experience in product startups and deep learning research.
Syllabus
Iterating on Your AI Evals // Mariana Prazeres // Agents in Production 2025
Taught by
MLOps.community