Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Training Large Language Models - GPT-NeoX-20B, BigScience BLOOM, OPT-175B Explained

Aleksa Gordić - The AI Epiphany via YouTube

Overview

Google, IBM & Meta Certificates – 40% Off
One Coursera Plus subscription covers most Professional Certificates on Coursera.
Unlock All Certificates
This course explains the BLOOM, OPT-175B, and GPT-NeoX-20B large language models through their research papers and training chronicles. It focuses on the shared architectures, publicly released resources, and engineering challenges encountered during large-scale training.

Syllabus

Intro
sponsored Weights & Biases
BLOOM paper
BLOOM chronicles
OPT paper
OPT chronicles
GPT-NeoX-20B paper
Outro

Taught by

Aleksa Gordić - The AI Epiphany

Reviews

Start your review of Training Large Language Models - GPT-NeoX-20B, BigScience BLOOM, OPT-175B Explained

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.