Completed
28:52 The agreement metric trap that fools most PMs
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
AI Evaluations Clearly Explained in 50 Minutes - Real Example
Automatically move to the next video in the Classroom when playback concludes
- 1 00:00 What the most valuable part of evals is
- 2 01:25 Live walkthrough: Analyzing 100 real production traces
- 3 09:50 Creating the eval criteria using a simple spreadsheet
- 4 24:44 Why binary pass/fail ratings beat 1-5 scores every time
- 5 28:52 The agreement metric trap that fools most PMs
- 6 30:08 True positive and negative rates explained
- 7 36:00 How to set up continuous evals in production
