Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Galactica - A Large Language Model for Science - Drama & Paper Review

Yannic Kilcher via YouTube

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore a comprehensive video analysis of Galactica, a large language model designed for scientific applications. Delve into the controversy surrounding its public demo release and examine the research paper in detail. Learn about the model's unique dataset construction, innovative step-by-step reasoning encoding, and approach to modeling scientific references. Discover the architecture details, experimental results, and potential impact on scientific knowledge organization. Gain insights into the model's performance on various scientific tasks and its comparison with other language models like GPT-3, Chinchilla, and PaLM 540B.

Syllabus

- Introduction
- Drama around the public demo
- Start of paper review
- Dataset construction and encoding
- Encoding step-by-step reasoning using a scratchpad
- Modelling scientific references & citations
- Prompt Pre-Training
- Architecture details
- Experimental results
- Conclusion

Taught by

Yannic Kilcher

Reviews

Start your review of Galactica - A Large Language Model for Science - Drama & Paper Review

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.