AdamW Optimizer from Scratch in Python

AdamW Optimizer from Scratch in Python

Yacine Mahdid via YouTube Direct link

- Isn't L2 and Weight Decay the same?: 5:48

5 of 8
Previous
Next

5 of 8

- Isn't L2 and Weight Decay the same?: 5:48

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

AdamW Optimizer from Scratch in Python

Automatically move to the next video in the Classroom when playback concludes
  1. 1 - Introduction: 0:00
  2. 2 - Where does AdamW fit?: 2:30
  3. 3 - What type of regularization does AdamW apply?: 3:25
  4. 4 - Why Adam with L2 sucked?: 4:49
  5. 5 - Isn't L2 and Weight Decay the same?: 5:48
  6. 6 - AdamW formula breakdown: 6:19
  7. 7 - AdamW code implementation lol: 14:32
  8. 8 - AdamW Recap: 19:34

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free
Someone learning on their laptop while sitting on the floor.