Completed
38:21 How to align LLM judges with human judgment
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
Complete Beginner's Course on AI Evaluations in 50 Minutes - 2025
Automatically move to the next video in the Classroom when playback concludes
- 1 00:00 What are AI evals and how to get good at them
- 2 02:52 The 4 types of AI evaluations everyone should know
- 3 06:08 Live demo: Building evals for a customer support agent
- 4 10:29 Using Anthropic's console to generate great prompts
- 5 15:13 Creating the evaluation criteria
- 6 17:40 Adding human labels to the golden dataset
- 7 31:05 Scaling evals with LLM-judge prompts
- 8 38:21 How to align LLM judges with human judgment