Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Evaluate and Choose the Best LLM Using Automatic Metrics on Custom Datasets

Venelin Valkov via YouTube

Start learning Write review
Corporate Finance Institute Ad

Build the Finance Skills That Lead to Promotions, Not Just Certificates

Learn More → Boot.dev Ad

Learn Backend Development Part-Time, Online

Learn More →

Overview

Google, IBM & Meta Certificates – 40% Off
One Coursera Plus subscription covers most Professional Certificates on Coursera.
Unlock All Certificates
This tutorial demonstrates how to compare large language models on a custom dataset using automated metrics. It covers generating model predictions, AI-based evaluation, and producing an evaluation report.

Syllabus

- Intro
- Text tutorial on MLExpert.io
- LLM evaluation approaches
- Available tools & metrics
- Evaluation process
- Google Colab setup
- Dataset
- Generate model predictions
- Naive evaluation
- Use AI to evaluate AI
- Evaluation report
- Conclusion

Taught by

Venelin Valkov

Reviews

Start your review of Evaluate and Choose the Best LLM Using Automatic Metrics on Custom Datasets

Start learning

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free
Someone learning on their laptop while sitting on the floor.