Are Large Language Models Good at Utility Judgments? - Evaluation Study
Association for Computing Machinery (ACM) via YouTube
Build with Azure OpenAI, Copilot Studio & Agentic Frameworks — Microsoft Certified
Earn Your Business Degree, Tuition-Free, 100% Online!
Overview
AI, Data Science & Cloud Certificates from Google, IBM & Meta — 40% Off
One plan covers every Professional Certificate on Coursera. 40% off Coursera Plus Annual.
Unlock All Certificates
Explore a 14-minute conference presentation from SIGIR 2024 that investigates the capabilities of Large Language Models (LLMs) in making utility judgments. Learn from researchers Hengran Zhang, Ruqing Zhang, Jiafeng Guo, Maarten de Rijke, Yixing Fan, and Xueqi Cheng as they present their findings on evaluating LLMs' ability to assess and determine the usefulness of information, a critical aspect in information retrieval and content evaluation systems.
Syllabus
SIGIR 2024 W1.3 [fp] Are Large Language Models Good at Utility Judgments?
Taught by
Association for Computing Machinery (ACM)