Stephen Wright: Fundamentals of Optimization in Signal Processing
Hausdorff Center for Mathematics via YouTube
Learn Generative AI, Prompt Engineering, and LLMs for Free
The Most Addictive Python and SQL Courses
Overview
Syllabus
Group Sparsity
Three Scenarios
Non-overlapping Groups
Tree-Structured Groups
Matrix Inference Problems
Nuclear Norm Regularization
Another Matrix Inference Problem: Inverse Covariance
Atomic-Norm Regularization
References
Steepest Descent
Backtracking
Weakly convex: 1/k sublinear rate
Linear convergence without strong convexity
The slow linear rate is typical!
Multistep Methods: The Heavy-Ball
Conjugate Gradient
Accelerated First-Order Methods
Taught by
Hausdorff Center for Mathematics