Most AI Pilots Fail to Scale. MIT Sloan Teaches You Why — and How to Fix It
Python, Prompt Engineering, Data Science — Build the Skills Employers Want Now
Overview
Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
Explore the latest advancements in large language models and their application to quantitative reasoning in this Stanford Physics colloquium talk. Delve into the impressive capabilities of these models in natural language tasks, often rivaling or surpassing human performance. Examine the robust power-law improvements observed across various scales of datasets, models, and computational resources. Investigate the challenges faced in extrapolating certain capabilities, particularly in the domain of multi-step quantitative reasoning for mathematics and science. Learn about recent progress in understanding and predicting model capabilities as they scale, with a focus on Minerva, a large language model specifically designed for multi-step STEM problem-solving. Gain insights into the potential future developments and applications of these powerful AI models in scientific and mathematical fields.
Syllabus
Ethan Dyer - “Lessons from scale for large language models and quantitative reasoning”
Taught by
Stanford Physics