Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

CodeSignal

Evaluation in DSPy

via CodeSignal

Go to class Write review

Overview

You will learn the evaluation steps — collecting development data, defining DSPy metrics, and running evaluations — while become proficient in data handling with Example objects and creating metrics to assess output quality.

Syllabus

  • Unit 1: Steps in Evaluation
    • DSPy Evaluation Steps Quiz
  • Unit 2: Data Handling with Example Objects in DSPy
    • Creating and Exploring Example Objects
    • Building a Mini Dataset with Examples
    • Separating Inputs and Labels Programmatically
    • Filtering Example Data by Specific Criteria
    • Transforming Example Data While Preserving Structure
  • Unit 3: Creating Metrics in DSPy
    • Implementing a Case Insensitive Metric
    • Flexible Answer Matching for Multiple Formats
    • Passage Matching for Retrieval Systems
    • Building a Holistic QA Evaluation Metric
    • Semantic Evaluation with F1 Score

Reviews

Start your review of Evaluation in DSPy

Go to class

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free
Someone learning on their laptop while sitting on the floor.