Are Large Language Models Good at Utility Judgments? - Evaluation Study
Association for Computing Machinery (ACM) via YouTube
Finance Certifications Goldman Sachs & Amazon Teams Trust
Python, Prompt Engineering, Data Science — Build the Skills Employers Want Now
Overview
Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
Explore a 14-minute conference presentation from SIGIR 2024 that investigates the capabilities of Large Language Models (LLMs) in making utility judgments. Learn from researchers Hengran Zhang, Ruqing Zhang, Jiafeng Guo, Maarten de Rijke, Yixing Fan, and Xueqi Cheng as they present their findings on evaluating LLMs' ability to assess and determine the usefulness of information, a critical aspect in information retrieval and content evaluation systems.
Syllabus
SIGIR 2024 W1.3 [fp] Are Large Language Models Good at Utility Judgments?
Taught by
Association for Computing Machinery (ACM)