Generative AI and Diffusion Models - A Statistical Physics Analysis - 1/3
Institut des Hautes Etudes Scientifiques (IHES) via YouTube
Gain a Splash of New Skills - Coursera+ Annual Nearly 45% Off
Get 35% Off CFI Certifications - Code CFI35
Overview
Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore the intersection of generative artificial intelligence and statistical physics through this comprehensive lecture that examines diffusion models from a theoretical physics perspective. Delve into the state-of-the-art methods currently used to generate images, videos, and sounds, discovering their deep connections to stochastic thermodynamics and time-reversing stochastic processes. Learn how these methods produce Langevin processes that transform white noise into new multimedia content through sophisticated mathematical frameworks. Investigate two critical phenomena that emerge during the Langevin generative diffusion process: the 'speciation' transition, where data's gross structure unfolds through mechanisms analogous to symmetry breaking in phase transitions, and the generalization-memorization transition, which relates to the glass transition of Derrida's random energy model. Examine analytical solutions for simplified models and review numerical experiments conducted on real datasets that validate the theoretical analysis, gaining insights into how statistical physics tools can characterize and understand the fundamental mechanisms underlying modern generative AI systems.
Syllabus
Giulio Biroli - 1/3 Generative AI and Diffusion Models: a Statistical Physics Analysis
Taught by
Institut des Hautes Etudes Scientifiques (IHES)