Free courses from frontend to fullstack and AI
Google AI Professional Certificate - Learn AI Skills That Get You Hired
Overview
Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore a comprehensive video analysis of Galactica, a large language model designed for scientific applications. Delve into the controversy surrounding its public demo release and examine the research paper in detail. Learn about the model's unique dataset construction, innovative step-by-step reasoning encoding, and approach to modeling scientific references. Discover the architecture details, experimental results, and potential impact on scientific knowledge organization. Gain insights into the model's performance on various scientific tasks and its comparison with other language models like GPT-3, Chinchilla, and PaLM 540B.
Syllabus
- Introduction
- Drama around the public demo
- Start of paper review
- Dataset construction and encoding
- Encoding step-by-step reasoning using a scratchpad
- Modelling scientific references & citations
- Prompt Pre-Training
- Architecture details
- Experimental results
- Conclusion
Taught by
Yannic Kilcher