Completed
00:00 Introduction to Arthur AI and Mozilla AI
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
2025 is the Year of Evals! Just like 2024, and 2023, and … - Enterprise AI/ML Evaluation and Monitoring
Automatically move to the next video in the Classroom when playback concludes
- 1 00:00 Introduction to Arthur AI and Mozilla AI
- 2 00:46 2025: The Year of Evals
- 3 01:15 AI/ML monitoring and evaluation
- 4 02:48 The Year of the Agent
- 5 03:26 The need for 'evals' wasn't obvious to the C-suite
- 6 04:15 Pre-ChatGPT launch
- 7 06:06 Venture capitalists' predictions
- 8 07:03 Macroeconomic side of things
- 9 08:06 OpenAI launching ChatGPT
- 10 09:15 2023: The Year of GenAI
- 11 09:39 2024: GenAI applications in production
- 12 10:22 2025: Scaling and autonomy
- 13 11:35 Definition of an agent
- 14 12:06 Connecting to downstream business KPIs
- 15 14:40 Shift to multi-agent systems monitoring
- 16 15:42 Q&A
- 17 16:16 Discussion on domain expertise in evaluations
- 18 18:13 Discussion on LLMs as judges
