Evaluation Engineering: Iterative Strategies to Testing Prompts
MLOps World: Machine Learning in Production via YouTube
PowerBI Data Analyst - Create visualizations and dashboards from scratch
Free courses from frontend to fullstack and AI
Overview
Google, IBM & Meta Certificates – 40% Off
One plan covers every Professional Certificate on Coursera.
Unlock All Certificates
Explore strategies and real-world examples of prompt evaluation in this 29-minute conference talk from MLOps World: Machine Learning in Production. Delve into the key aspects of Evaluation Engineering as part of the prompt engineering iteration cycle. Learn about backtesting, regression testing, and test-driven prompt engineering techniques. Examine case studies of team evaluations to understand why there is no universal evaluation metric and how evals must be developed iteratively alongside prompts. Gain valuable insights from speaker Jared Zoneraich, Founder of PromptLayer, on improving your prompt testing and evaluation processes.
Syllabus
Evaluation Engineering: Iterative Strategies to Testing Prompts
Taught by
MLOps World: Machine Learning in Production