GRPO Courses and Certifications

LLM Reinforcement Learning Fine-Tuning DeepSeek Method GRPO

114 ratings at Udemy

[EN] LLM Fine-Tuning and Reinforcement Learning with SFT, LoRA, DPO, and GRPO Custom Data HuggingFace

• Udemy
• 3 hours 46 minutes
• On-Demand
• Paid Course

Yacine Mahdid

Understanding R1-Zero-Like Training with Dr. GRPO Algorithm

Explore R1-Zero-like training mysteries with Dr. GRPO algorithm's first author, covering LLM post-training, self-reflection detection, and algorithmic improvements in this deep-dive interview.

• YouTube
• 1 hour 9 minutes
• On-Demand
• Free Video

Machine Learning With Hamza

Interesting Experimentation With GRPO on Small LLMs

Explore GRPO training experiments on small Gemma language models with practical implementations and hands-on demonstrations in this focused machine learning tutorial.

• YouTube
• 18 minutes
• On-Demand
• Free Video

Yacine Mahdid

Exploring GRPO Through the RAFT Algorithm - RLHF and RLVR

Dive into GRPO's mechanics through RAFT algorithm analysis, comparing RLHF and RLVR paradigms from 2023-2025 studies to develop simplified reinforcement learning approaches for LLMs.

• YouTube
• 1 hour 4 minutes
• On-Demand
• Free Video

DeepSeek R1 Theory Tutorial - Architecture, GRPO, KL Divergence

Dive into DeepSeek R1's innovative architecture, exploring Group Relative Policy Optimization (GRPO), KL divergence, and reinforcement learning techniques with practical code examples and mathematical explanations.

• freeCodeCamp
• 1 hour 8 minutes
• On-Demand
• Free Video

Discover AI

RLHF's Missing Piece: Qwen's World Model Aligns AI with Human Values - GRPO

Explore Qwen's new WorldPM model that encodes human preferences at scale, solving key RLHF challenges by creating a world model that better aligns AI with human values.

• YouTube
• 21 minutes
• On-Demand
• Free Video

Trelis Research

Comparing SFT and GRPO Methods for AI Model Fine-Tuning

Master advanced AI fine-tuning techniques through a detailed comparison of Supervised Fine-Tuning (SFT) and Group Relative Policy Optimization (GRPO), including implementation strategies and practical applications.

• YouTube
• 55 minutes
• On-Demand
• Free Video

1littlecoder

Building a DeepSeek R1-Style Reasoning LLM with GRPO Fine-Tuning

Master the process of fine-tuning language models using GRPO to create a Deepseek R1-style reasoning system, with practical implementation in Google Colab and insights into math reasoning reward functions.

• YouTube
• 16 minutes
• On-Demand
• Free Video

Yacine Mahdid

Group Relative Policy Optimization (GRPO) - Formula and Implementation Tutorial

Dive into Group Relative Policy Optimization (GRPO) with a detailed walkthrough of formulas and code implementation, focusing on DeepSeek R1 architecture and HuggingFace post-training techniques.

• YouTube
• 24 minutes
• On-Demand
• Free Video

Serrano.Academy

GRPO - Group Relative Policy Optimization: How DeepSeek Trains Reasoning Models

Discover how DeepSeek trains reasoning models using Group Relative Policy Optimization (GRPO), a reinforcement learning approach that enables self-improvement, with comparisons to ChatGPT and detailed explanations of the GRPO methodology.

• YouTube
• 22 minutes
• On-Demand
• Free Video

Oxen

How DeepSeek R1's Reinforcement Learning Works Through GRPO

Delve into the mechanics of DeepSeek R1's reinforcement learning, exploring GRPO's memory optimization, group advantages, and practical applications in AI model training.

• YouTube
• 35 minutes
• On-Demand
• Free Video

Trelis Research

Understanding GRPO: Group Relative Policy Optimization in Reinforcement Learning

Explore the evolution and implementation of Group Relative Policy Optimization (GRPO) in reinforcement learning, from basic concepts to advanced applications, including comparisons with TRPO and PPO methods.

• YouTube
• 33 minutes
• On-Demand
• Free Video

Oxen

Understanding DeepSeek R1 and GRPO - A Technical Deep Dive

Dive into the technical architecture and development process of DeepSeek's R1 model, exploring GRPO implementation, reasoning capabilities, and model optimization techniques through detailed examples.

• YouTube
• 45 minutes
• On-Demand
• Free Video

Serrano.Academy

Reinforcement Learning for Large Language Models - RLHF, PPO, DPO, and GRPO

Discover how to fine-tune LLMs using RLHF, PPO, DPO, and GRPO techniques with practical deep reinforcement learning methods for transformer models.

• YouTube
• 2 hours 28 minutes
• On-Demand
• Free Video

Yacine Mahdid

DeepSeek R1 Theory Overview - From GRPO to Reinforcement Learning and Supervised Fine-Tuning

Dive into a comprehensive breakdown of DeepSeek R1's architecture, exploring its training pipeline from GRPO and reinforcement learning to supervised fine-tuning and neural reward modeling.

• YouTube
• 26 minutes
• On-Demand
• Free Video