Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Taming Rogue AI Agents with Observability-Driven Evaluation

AI Engineer via YouTube

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Learn to control unpredictable AI agent behavior through a systematic observability-driven evaluation framework in this 16-minute conference talk. Discover how LLM agents can drift into failure modes when prompts, retrieval systems, external data sources, and policies interact in unexpected ways. Explore a repeatable, metric-driven methodology for detecting problematic behaviors in production agentic systems, diagnosing the root causes of these issues, and implementing effective corrections at scale. Gain practical insights into monitoring and evaluating LLMs and AI agents to prevent costly failures and maintain reliable performance in real-world deployments.

Syllabus

Taming Rogue AI Agents with Observability-Driven Evaluation — Jim Bennett, Galileo

Taught by

AI Engineer

Reviews

Start your review of Taming Rogue AI Agents with Observability-Driven Evaluation

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.