Pass the PMP® Exam on Your First Try — Expert-Led Training
2,000+ Free Courses with Certificates: Coding, AI, SQL, and More
Overview
Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
Explore a 32-minute conference talk from Ray Summit 2024 where Wei-Lin Chiang from UC Berkeley presents Chatbot Arena, an innovative open platform for evaluating AI models through human preferences. Learn about the platform's methodology of using pairwise comparisons and crowdsourced feedback from diverse users to assess Large Language Model (LLM) performance. Discover how Chatbot Arena has evolved into a prominent LLM leaderboard over the past year, accumulating more than 1.7 million user votes and gaining recognition from leading AI developers and companies. Gain practical insights into the complexities of AI evaluation and understand how this platform serves as a benchmark tool for cutting-edge AI technologies.
Syllabus
Chatbot Arena: UC Berkeley's Open AI Evaluation Platform | Ray Summit 2024
Taught by
Anyscale