Scaling Unlocks Emergent Abilities in Language Models
USC Information Sciences Institute via YouTube
AI, Data Science & Cloud Certificates from Google, IBM & Meta
NY State-Licensed Certificates in Design, Coding & AI — Online
Overview
Google, IBM & Meta Certificates – 40% Off
One plan covers every Professional Certificate on Coursera.
Unlock All Certificates
Explore the unpredictable phenomenon of emergent abilities in large language models through this informative one-hour talk presented by Jason Wei from Google Brain. Delve into the concept of emergent abilities, which are capabilities not present in smaller models but arise in larger ones, defying simple performance extrapolation. Discover how scaling up language models has led to breakthroughs like chain-of-thought prompting for advanced mathematical reasoning and instruction finetuning for broader accessibility. Examine the implications of these emergent phenomena on the potential future capabilities of language models as they continue to scale. Learn from Jason Wei, a senior research scientist at Google Brain, whose work on large language models has been prominently featured in Google AI blog posts and presented at Google I/O 2022.
Syllabus
Scaling unlocks emergent abilities in language models
Taught by
USC Information Sciences Institute