Learn Generative AI, Prompt Engineering, and LLMs for Free
Launch Your Cybersecurity Career in 6 Months
Overview
AI, Data Science & Cloud Certificates from Google, IBM & Meta — 40% Off
One plan covers every Professional Certificate on Coursera. 40% off Coursera Plus Annual.
Unlock All Certificates
Explore a critical examination of AI evaluation methodologies in this 25-minute conference talk that challenges the conventional reliance on single "gold standard" truths in artificial intelligence safety. Discover how AI's massive scaling over the past two decades has amplified unintended behaviors and learn why moving beyond monolithic evaluation standards is essential for responsible AI development. Delve into the concept of "Data Cascades" and understand how this phenomenon impacts AI systems at scale. Gain insights into reframing human variation and bias as meaningful signals rather than noise to be eliminated, fundamentally shifting how we approach AI evaluation and safety. Learn practical approaches for embracing real-world pluralism in AI systems and understand the implications for creating more robust and inclusive artificial intelligence technologies.
Syllabus
Embracing Real-World Pluralism: Moving beyond "gold standard" truth in AI evaluation by Lora Aroyo
Taught by
Open Data Science