Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Zero To Mastery

AI for Beginners: Reasoning Models

via Zero To Mastery Path

Go to class Write review

Overview

Understand how Reasoning Models actually work from scratch with practical and fun lessons. You’ll go behind the curtain on one of the biggest breakthroughs in AI and learn how reasoning models "think", how they're trained with reinforcement learning and dive deep into datasets like PRM800K, and why reasoning models may be full of secrets and lies...
  • What “reasoning models” really are (and aren’t)
  • Compare reasoning styles across models
  • The PRM800K dataset that powered this breakthrough
  • Prompt and context engineering built for reasoning models
  • The importance of the Generator–Verifier Gap (GVG)
  • How Reinforcement Learning + Process Reward Models shape reasoning
  • Dive deep into AI research papers
  • Why reasoning models may be lying to you...

Syllabus

  •   Introduction
    • Introduction
    • Exercise: Meet Your Classmates and Instructor
    • A Note On The Next Two Lessons
    • Replay: Chain-of-Thought Prompting - Part 1
    • Replay: Chain-of-Thought Prompting - Part 2
    • Course Resources
  •   Inside Reasoning Models
    • Introduction to Reasoning Models
    • First Contact with Reasoning
    • Secrets and Lies!
    • Setting Up Our Open Source Reasoning Model
    • A Reasoning Model's Real Thoughts - Part 1
    • A Reasoning Model's Real Thoughts - Part 2
    • Exercise: Compare Reasoning Style of Different Models
    • Reasoning & The Context Window
    • Thinking Like LLMs - Breaking The Chains
    • What Are Reasoning Models Good For? (The Generator-Verifier Gap)
    • Exercise: Determine GVG
    • Prompt Engineering for Reasoning Models
    • Context Engineering
    • Thinking Like LLMs: Cats Are...Confusing? - Part 1
    • Thinking Like LLMs: Cats Are...Confusing? - Part 2
    • Reinforcement Learning - The Problem
    • Reinforcement Learning - How It Works
    • Exercise: Code Your Own Maze Game
    • RL Environments (Soccer)
    • RL Environments (Go)
    • Reinforcement Learning from Human Feedback (RLHF)
    • Reinforcement Learning for Reasoning Models - Let's Verify Step-By-Step
    • Reinforcement Learning for Reasoning Models - Process Reward Model
    • PRM800K Introduction
    • PRM800K Deep Dive
    • Test-Time Compute
    • Are Reasoning Models Lying To You? - Part 1
    • Are Reasoning Models Lying To You? - Part 2
    • Are Reasoning Models Lying To You? - Part 3
    • Are Reasoning Models Lying To You? - Part 4
    • Mandatory Homework: The Thinking Game
  •   Where To Go From Here?
    • Let's Keep Learning Together!
    • Review This Byte!

Taught by

Scott Kerr

Reviews

Start your review of AI for Beginners: Reasoning Models

Go to class

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free
Someone learning on their laptop while sitting on the floor.