Automated Evaluation for RAG Chatbot or Other Generative Tool - Conf42 LLMs 2024

Automated Evaluation for RAG Chatbot or Other Generative Tool - Conf42 LLMs 2024

Conf42 via YouTube Direct link

how to automate testing?

4 of 12

4 of 12

how to automate testing?

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Automated Evaluation for RAG Chatbot or Other Generative Tool - Conf42 LLMs 2024

Automatically move to the next video in the Classroom when playback concludes

  1. 1 intro
  2. 2 preamble
  3. 3 why to automate testing?
  4. 4 how to automate testing?
  5. 5 testing generative models is hard!
  6. 6 string matching
  7. 7 semantic similarity
  8. 8 llm-led evals
  9. 9 closeness between target, actual
  10. 10 using a grading rubric with marvin ai
  11. 11 a couple of other ideas
  12. 12 thank you!

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.