Training Large Language Models - GPT-NeoX-20B, BigScience BLOOM, OPT-175B Explained
Aleksa Gordić - The AI Epiphany via YouTube
Learn Backend Development Part-Time, Online
AI Engineer - Learn how to integrate AI into software applications
Overview
Google, IBM & Meta Certificates – 40% Off
One Coursera Plus subscription covers most Professional Certificates on Coursera.
Unlock All Certificates
This course explains the BLOOM, OPT-175B, and GPT-NeoX-20B large language models through their research papers and training chronicles. It focuses on the shared architectures, publicly released resources, and engineering challenges encountered during large-scale training.
Syllabus
Intro
sponsored Weights & Biases
BLOOM paper
BLOOM chronicles
OPT paper
OPT chronicles
GPT-NeoX-20B paper
Outro
Taught by
Aleksa Gordić - The AI Epiphany