LLM in a Loop: Automating Feedback with Evaluations

LLM in a Loop: Automating Feedback with Evaluations

Shaw Talebi via YouTube Direct link

Intro - 0:00

1 of 9

1 of 9

Intro - 0:00

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

LLM in a Loop: Automating Feedback with Evaluations

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Intro - 0:00
  2. 2 Motivation - 0:16
  3. 3 LLM in a Loop - 1:57
  4. 4 3 Types of Evals - 4:42
  5. 5 Type 1: Rule-based - 5:32
  6. 6 Type 2: LLM-based - 7:32
  7. 7 Type 3: Real-world - 9:00
  8. 8 Example: Upwork Profile Rewriter - 10:38
  9. 9 Limitations - 22:59

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.