Backpropagation Courses and Certifications

Training Neural Networks: the Backpropagation Algorithm

Implement loss functions, gradient descent, backpropagation, and stochastic gradient descent to train a small multilayer perceptron.

• CodeSignal
• 3 hours
• Self-Paced
• Free Certificate

Training Neural Networks: the Backpropagation Algorithm

Implement neural-network learning from scratch in R, from MSE loss and gradient descent through multilayer backpropagation and mini-batch SGD.

• CodeSignal
• 3 hours
• Self-Paced
• Free Certificate

Training Neural Networks: the Backpropagation Algorithm

Implement neural network training from scratch using loss functions, gradient descent, backpropagation, and mini-batch SGD.

• CodeSignal
• 3 hours
• Self-Paced
• Free Certificate

Training Neural Networks: the Backpropagation Algorithm

Implement neural-network training from scratch by coding MSE loss, gradient descent, backpropagation, and mini-batch SGD updates.

• CodeSignal
• 3 hours
• Self-Paced
• Free Certificate

Packt

Mathematics Behind Backpropagation | Theory and Python Code

Build a neural network from scratch in Python, using derivatives, the chain rule, computational graphs, and gradient descent for forward and backward propagation.

• Coursera
• 3 weeks, 2 hours a week
• Self-Paced
• Paid Course

Andrej Karpathy

Intro to Neural Networks and Backpropagation - Building Micrograd

Builds a minimal neural-network library from scratch to reveal backpropagation, gradient descent, and training under the hood.

• YouTube
• 2 hours 26 minutes
• Self-Paced
• Free Video

Build a Simple Neural Network & Learn Backpropagation

Code a simple and an advanced neural network from scratch in Python, deriving gradients with the chain rule and training with backpropagation and gradient descent.

• Zero To Mastery
• 5 hours
• Self-Paced
• Paid Course

StatQuest with Josh Starmer

Neural Networks Part 7 - Cross Entropy Derivatives and Backpropagation

Derive cross-entropy gradients and apply them to backpropagation in a softmax neural network.

• YouTube
• 22 minutes
• Self-Paced
• Free Video

Alfredo Canziani

Gradient Descent and the Backpropagation Algorithm

Explore how gradient descent and backpropagation train neural networks, with step-by-step derivations and a PyTorch implementation.

• YouTube
• 1 hour 51 minutes
• Self-Paced
• Free Video

Alfredo Canziani

Stochastic Gradient Descent and Backpropagation

Learn gradient-based optimization and backpropagation through neural network examples, Jacobian gradients, practical techniques, and a PyTorch implementation.

• YouTube
• 1 hour 43 minutes
• Self-Paced
• Free Video

Valerio Velardo - The Sound of AI

Training a Neural Network - Implementing Backpropagation and Gradient Descent from Scratch

Implement backpropagation and gradient descent from scratch in Python, then train a multilayer perceptron to perform arithmetic addition.

• YouTube
• 1 hour 3 minutes
• Self-Paced
• Free Video

NPTEL-NOC IITM

Backpropagation in Recurrent Neural Networks (RNNs)

Understand the principles and implementation of backpropagation algorithms in Recurrent Neural Networks (RNNs).

• YouTube
• 18 minutes
• Self-Paced
• Free Video

Stanford Seminar - Can the Brain Do Back-Propagation?

A research seminar on how biological neural systems might overcome objections to using backpropagation, including supervision, temporal derivatives, STDP, and feedback alignment.

• YouTube
• 1 hour 25 minutes
• Self-Paced
• Free Online Course

Andrej Karpathy

Building Makemore - Becoming a Backprop Ninja

Manually backpropagate through a batch-normalized MLP to understand tensor-level gradient flow, optimize neural networks, and debug their implementations.

• YouTube
• 1 hour 55 minutes
• Self-Paced
• Free Video

Edan Meyer

Learning Forever, Backprop Is Insufficient

Explores why backpropagation loses learning ability over time and how Continual Backprop uses persistent randomness to restore adaptation.

• YouTube
• 26 minutes
• Self-Paced
• Free Video