Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

freeCodeCamp

LLMs from Scratch - Practical Engineering from Base Model to PPO RLHF

via freeCodeCamp

Overview

Google, IBM & Meta Certificates – 40% Off
One Coursera Plus subscription covers most Professional Certificates on Coursera.
Unlock All Certificates
This course presents a practical engineering path for building and training language models from core Transformer architecture through scaling, mixture-of-experts, supervised fine-tuning, reward modeling, and PPO-based RLHF.

Syllabus

0:00:00 Part 0 - Introduction
0:05:43 Part 1 - Core Transformer Architecture
0:40:24 Part 2 — Training a Tiny LLM
1:30:27 Part 3 — Modernizing the Architecture
2:33:53 Part 4 — Scaling Up
3:17:22 Part 5 — Mixture-of-Experts MoE
3:44:19 Part 6 — Supervised Fine-Tuning SFT
4:23:44 Part 7 — Reward Modeling
4:59:55 Part 8 — RLHF with PPO

Taught by

freeCodeCamp.org

Reviews

Start your review of LLMs from Scratch - Practical Engineering from Base Model to PPO RLHF

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.