Complete Beginner's Course on AI Evaluations in 50 Minutes - 2025

Complete Beginner's Course on AI Evaluations in 50 Minutes - 2025

Peter Yang via YouTube Direct link

02:52 The 4 types of AI evaluations everyone should know

2 of 8

2 of 8

02:52 The 4 types of AI evaluations everyone should know

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Complete Beginner's Course on AI Evaluations in 50 Minutes - 2025

Automatically move to the next video in the Classroom when playback concludes

  1. 1 00:00 What are AI evals and how to get good at them
  2. 2 02:52 The 4 types of AI evaluations everyone should know
  3. 3 06:08 Live demo: Building evals for a customer support agent
  4. 4 10:29 Using Anthropic's console to generate great prompts
  5. 5 15:13 Creating the evaluation criteria
  6. 6 17:40 Adding human labels to the golden dataset
  7. 7 31:05 Scaling evals with LLM-judge prompts
  8. 8 38:21 How to align LLM judges with human judgment

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.