AI Agent Evals - From Testing to Trust
MLOps World: Machine Learning in Production via YouTube
-
34
-
- Write review
Free AI-powered learning to build in-demand skills
Learn EDR Internals: Research & Development From The Masters
Overview
Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Discover how to build reliable AI systems that transition successfully from demo environments to production through comprehensive evaluation strategies in this 27-minute conference talk. Learn why evaluation serves as the foundation of trust in AI agents and explore how leading teams integrate testing and monitoring throughout the entire product development lifecycle. Understand practical approaches to optimize context using write, select, compress, and isolate strategies while examining real-world case studies from both startups and enterprises. Gain insights into designing scalable LLM evaluation workflows that maintain quality and reliability across different environments, and discover what actually works when implementing evaluation pipelines in production settings versus what commonly fails.
Syllabus
AI Agent Evals: From Testing to Trust | Vaibhavi Gangwar, Maxim AI
Taught by
MLOps World: Machine Learning in Production