Gradient Descent Courses and Certifications

Regression and Gradient Descent

Master regression algorithms from scratch, implementing linear and logistic regression using gradient descent. Build predictive models without relying on high-level libraries for deep mathematical understanding.

• CodeSignal
• 3 hours
• On-Demand
• Free Certificate

Gradient Descent: Building Optimization Algorithms from Scratch

Master optimization algorithms by implementing Gradient Descent variants from scratch, including Stochastic, Mini-Batch, Momentum, RMSProp, and Adam methods, with hands-on Python implementation and practical applications.

• CodeSignal
• 4 hours
• On-Demand
• Free Certificate

Gradient Descent: Building Optimization Algorithms from Scratch

Master optimization algorithms by implementing SGD, Mini-Batch GD, Momentum, RMSProp, and Adam from scratch in C++ without relying on high-level libraries for deep understanding.

• CodeSignal
• 4 hours
• On-Demand
• Free Certificate

3Blue1Brown

Gradient Descent, How Neural Networks Learn

Explore gradient descent and neural network learning through animations, examples, and expert insights. Gain a deeper understanding of cost functions, network analysis, and cutting-edge research in machine learning.

• YouTube
• 21 minutes
• On-Demand
• Free Video

StatQuest with Josh Starmer

Gradient Descent, Step-by-Step

Comprehensive step-by-step explanation of Gradient Descent, covering its application in Machine Learning, optimization techniques, and variations like Stochastic Gradient Descent.

• YouTube
• 24 minutes
• On-Demand
• Free Video

Nicholas Renotte

Building the Gradient Descent Algorithm - Coding Challenge

Hands-on tutorial for building a gradient descent algorithm from scratch in Python, implementing a regression machine learning model using only NumPy.

• YouTube
• 22 minutes
• On-Demand
• Free Video

Alfredo Canziani

Gradient Descent and the Backpropagation Algorithm

Explore gradient descent and backpropagation algorithms, covering supervised learning, parametrized models, loss functions, and neural network architectures with PyTorch implementation.

• YouTube
• 1 hour 51 minutes
• On-Demand
• Free Video

Great Learning

Stochastic Gradient Descent

Explore stochastic gradient descent, its advantages, and implementation. Learn about mini-batches, momentum, and convergence in this optimization algorithm for machine learning models.

• YouTube
• 1 hour 37 minutes
• On-Demand
• Free Video

Simons Institute

Analyzing Optimization and Generalization in Deep Learning via Trajectories of Gradient Descent

Explore deep learning optimization and generalization through gradient descent trajectories, uncovering insights into neural network behavior and performance.

• YouTube
• 46 minutes
• On-Demand
• Free Video

International Mathematical Union

Gradient Descent on Infinitely Wide Neural Networks - Global Convergence and

Explore gradient descent on infinitely wide neural networks, examining global convergence and optimization techniques for non-convex problems in machine learning.

• YouTube
• 45 minutes
• On-Demand
• Free Video

Paul Hand

Gradient Descent and Stochastic Gradient Descent

Explore gradient descent and stochastic gradient descent in deep neural networks, covering convergence rates, learning rate effects, and challenges in optimization algorithms.

• YouTube
• 57 minutes
• On-Demand
• Free Video

Institute for Advanced Study

Geodesically Convex Optimization - Can We Prove P!=NP Using Gradient Descent - Avi Wigderson

Explore geodesically convex optimization and its potential to prove P≠NP using gradient descent in this advanced seminar by renowned mathematician Avi Wigderson.

• YouTube
• 1 hour 58 minutes
• On-Demand
• Free Video

Institute for Pure & Applied Mathematics (IPAM)

Gradient Descent, Stochastic Gradient Descent, and Acceleration - Part 2

Explore advanced gradient-based optimization methods for large-scale machine learning, including stochastic gradient descent and accelerated versions, with convergence analysis and ODE connections.

• YouTube
• 1 hour 2 minutes
• On-Demand
• Free Video

Code With Aarohi

Explained Gradient Descent Optimizer

Comprehensive explanation of gradient descent optimization, covering mathematical foundations, weight updates, and backpropagation for machine learning and deep learning applications.

• YouTube
• 26 minutes
• On-Demand
• Free Video

VinAI

Functional Gradient Descent Methods for Optimization and Sampling

Explore advanced gradient descent techniques for complex optimization and sampling problems in machine learning, including Stein variational gradient descent and neural architecture optimization.

• YouTube
• 1 hour 3 minutes
• On-Demand
• Free Video