Get 20% off all career paths from fullstack to AI
AI Engineer - Learn how to integrate AI into software applications
Overview
Google, IBM & Meta Certificates – 40% Off
One plan covers every Professional Certificate on Coursera.
Unlock All Certificates
Explore a comprehensive lecture on optimization techniques in deep learning, covering gradient descent, stochastic gradient descent (SGD), and momentum updates. Delve into adaptive methods like RMSprop and ADAM, and understand the impact of normalization layers on neural network training. Learn about the intuition behind these concepts, their performance comparisons, and their effects on convergence. Discover a real-world application of neural networks in accelerating MRI scans, demonstrating the practical implications of optimization in industry.
Syllabus
– Week 5 – Lecture
– Gradient Descent
– Stochastic Gradient Descent
– Momentum
– Adaptive Methods
– Normalization Layers
– The Death of Optimization
Taught by
Alfredo Canziani