Learn Generative AI, Prompt Engineering, and LLMs for Free
The Most Addictive Python and SQL Courses
Overview
Google, IBM & Meta Certificates – 40% Off
One Coursera Plus subscription covers most Professional Certificates on Coursera.
Unlock All Certificates
This course presents a practical engineering path for building and training language models from core Transformer architecture through scaling, mixture-of-experts, supervised fine-tuning, reward modeling, and PPO-based RLHF.
Syllabus
0:00:00 Part 0 - Introduction
0:05:43 Part 1 - Core Transformer Architecture
0:40:24 Part 2 — Training a Tiny LLM
1:30:27 Part 3 — Modernizing the Architecture
2:33:53 Part 4 — Scaling Up
3:17:22 Part 5 — Mixture-of-Experts MoE
3:44:19 Part 6 — Supervised Fine-Tuning SFT
4:23:44 Part 7 — Reward Modeling
4:59:55 Part 8 — RLHF with PPO
Taught by
freeCodeCamp.org