Overview
Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Learn the mathematical foundations of backpropagation through detailed hand calculations and step-by-step derivations in this comprehensive 37-minute tutorial. Master the high-level concepts of backpropagation before diving deep into the essential mathematical prerequisites including the multivariate chain rule. Work through a complete forward pass with detailed calculations, then explore the backward pass mechanics where gradients are computed manually for each layer. Discover how to use calculated gradients to update network weights and verify your hand calculations using PyTorch code. Test your understanding with a quiz section and reinforce key concepts through a comprehensive summary, with additional resources including GitHub code for intermediate weight verification and mathematical proofs for the multivariate chain rule.
Syllabus
00:00 What & Why back propagation?
01:50 Back propagation: High Level
05:39 Useful Math
07:12 Forward pass details
11:25 Backward pass details
30:37 Using gradients to update weights
33:12 PyTorch Code to verify results
34:25 Quiz Time
35:19 Summary
Taught by
CodeEmporium