Agent Evaluation Courses and Certifications

Google Cloud Tech

The Agent Factory - Agent Evaluation with ADK and Vertex AI - Episode 9

Master AI agent evaluation from local testing with ADK to enterprise-scale assessment using Vertex AI's GenAI Evaluation service for production-ready agents.

• YouTube
• 21 minutes
• Self-Paced
• Free Video

Open Data Science

AI Agent Design, Grounding, and Evaluation

Explore AI agent lifecycle from use case identification to production evaluation, covering Google's Agent Development Kit and Agent-to-Agent framework for enterprise applications.

• YouTube
• 55 minutes
• Self-Paced
• Free Video

Databricks

Self-Improving Agents and Agent Evaluation With Arize and Databricks MLflow

Explore building resilient autonomous agents that self-evaluate and continuously improve using Arize and Databricks MLflow tools for production deployment.

• YouTube
• 28 minutes
• Self-Paced
• Free Video

AI Engineer

Will Agent Evaluation via MCP Stabilize Agent Networks?

Explore how MCP-enabled evaluation frameworks allow AI agents to self-improve in a stable, controllable manner, moving beyond unstable self-criticism loops to standardized progress measurement.

• YouTube
• 14 minutes
• Self-Paced
• Free Video

DeepLearning.AI;  Snowflake

Building and Evaluating Data Agents

Master multi-agent workflows with LangGraph and Snowflake to create trustworthy data agents that plan, search, retrieve, and evaluate responses with proper goal-plan-action alignment.

• Coursera
• 2 hours 30 minutes
• Self-Paced
• Paid Course

James Briggs

AI Agent Evaluation with RAGAS Using LangChain, Claude 3, and Pinecone

Learn to evaluate AI agents using RAGAS, covering metrics like context recall, precision, faithfulness, and answer relevancy for improved RAG pipeline performance.

• YouTube
• 20 minutes
• Self-Paced
• Free Video

Elvis Saravia

AI Agent Evaluation - Methods and Best Practices for Measuring Agent Performance

Discover comprehensive strategies for evaluating AI agents, from creating metrics and optimizing instructions to building evaluation systems and monitoring performance.

• YouTube
• 1 hour 19 minutes
• Self-Paced
• Free Video

AI Engineer

Agentic Excellence - Mastering AI Agent Evaluations with Azure AI Evaluation SDK

Master systematic AI agent evaluation using Azure AI Evaluation SDK to assess performance, reliability, and trustworthiness across diverse enterprise scenarios and workflows.

• YouTube
• 20 minutes
• Self-Paced
• Free Video

USENIX

Design and Evaluation of Privacy-Preserving Protocols for Agent-Facilitated Mobile Money Services in Kenya

Explore privacy-preserving protocols for mobile money services in Kenya, addressing security risks in agent-facilitated transactions through innovative KYC solutions.

• YouTube
• 13 minutes
• Self-Paced
• Conference Talk

Amazon Web Services;  Amazon

Amazon Connect Contact Lens Fundamentals

Analyze customer conversations, evaluate agent performance, and improve customer experience with Amazon Connect Contact Lens. Learn implementation, trends analysis, and efficient interaction review techniques.

• AWS Skill Builder
• 55 minutes
• Self-Paced
• Free Certificate

AI Engineer

Building and Evaluating AI Agents

Explore the reality behind AI agent hype and learn best practices for building effective agents that overcome current limitations and deliver real-world value.

• YouTube
• 20 minutes
• Self-Paced
• Free Video

1littlecoder

Evaluating AI Agents - The Right Approach with TOOLSANDBOX

Explore TOOLSANDBOX: a comprehensive framework for evaluating AI agents with stateful tools, user simulation, and dynamic assessment strategies for enhanced performance analysis.

• YouTube
• 16 minutes
• Self-Paced
• Free Video

Google Cloud Tech

AgentOps - Operationalize AI Agents

Master AgentOps fundamentals for deploying AI agents effectively, covering evaluation, optimization, tool management, CI/CD pipelines, and robust architecture design strategies.

• YouTube
• 1 hour 5 minutes
• Self-Paced
• Free Video

Redefining Workforce Engagement with Contact Center AI

Explore how Contact Center AI revolutionizes customer service, enhancing workforce engagement through efficient processes, sentiment insights, data-driven evaluations, and augmented coaching workflows.

• YouTube
• 21 minutes
• Self-Paced
• Free Video

MLOps.community

Navigating the AI Frontier: The Power of Synthetic Data and Agent Evaluations in LLM Development

Explore synthetic data and agent evaluations in LLM development. Learn strategies for enhancing model behavior, prototyping, testing, and fine-tuning to build robust AI applications.

• YouTube
• 57 minutes
• Self-Paced
• Free Video