Stuck in Tutorial Hell? Learn Backend Dev the Right Way
Pass the PMP® Exam on Your First Try — Expert-Led Training
Overview
AI, Data Science & Cloud Certificates from Google, IBM & Meta — 40% Off
One plan covers every Professional Certificate on Coursera. 40% off Coursera Plus Annual.
Unlock All Certificates
Explore the intricacies of the Lottery Ticket Hypothesis in this in-depth video analysis. Delve into the paper "Deconstructing Lottery Tickets: Zeros, Signs, and the Supermask" to uncover key insights about creating sparse networks. Learn why setting weights to zero is crucial, how signs alone can enable reinitialized network training, and the relationship between masking and training. Discover the concept of Supermasks and their potential to significantly improve performance in untrained, randomly initialized networks. Gain a deeper understanding of neural network sparsity, weight initialization, and the factors contributing to the success of Lottery Ticket networks.
Syllabus
Deconstructing Lottery Tickets: Zeros, Signs, and the Supermask (Paper Explained)
Taught by
Yannic Kilcher