Completed
4:59:55 Part 8 — RLHF with PPO
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
LLMs from Scratch - Practical Engineering from Base Model to PPO RLHF
Automatically move to the next video in the Classroom when playback concludes
- 1 0:00:00 Part 0 - Introduction
- 2 0:05:43 Part 1 - Core Transformer Architecture
- 3 0:40:24 Part 2 — Training a Tiny LLM
- 4 1:30:27 Part 3 — Modernizing the Architecture
- 5 2:33:53 Part 4 — Scaling Up
- 6 3:17:22 Part 5 — Mixture-of-Experts MoE
- 7 3:44:19 Part 6 — Supervised Fine-Tuning SFT
- 8 4:23:44 Part 7 — Reward Modeling
- 9 4:59:55 Part 8 — RLHF with PPO
