Generative AI and Diffusion Models - A Statistical Physics Analysis - 1/3
Institut des Hautes Etudes Scientifiques (IHES) via YouTube
PowerBI Data Analyst - Create visualizations and dashboards from scratch
AI, Data Science & Cloud Certificates from Google, IBM & Meta
Overview
Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
Explore the intersection of generative artificial intelligence and statistical physics through this comprehensive lecture that examines diffusion models from a theoretical physics perspective. Delve into the state-of-the-art methods currently used to generate images, videos, and sounds, discovering their deep connections to stochastic thermodynamics and time-reversing stochastic processes. Learn how these methods produce Langevin processes that transform white noise into new multimedia content through sophisticated mathematical frameworks. Investigate two critical phenomena that emerge during the Langevin generative diffusion process: the 'speciation' transition, where data's gross structure unfolds through mechanisms analogous to symmetry breaking in phase transitions, and the generalization-memorization transition, which relates to the glass transition of Derrida's random energy model. Examine analytical solutions for simplified models and review numerical experiments conducted on real datasets that validate the theoretical analysis, gaining insights into how statistical physics tools can characterize and understand the fundamental mechanisms underlying modern generative AI systems.
Syllabus
Giulio Biroli - 1/3 Generative AI and Diffusion Models: a Statistical Physics Analysis
Taught by
Institut des Hautes Etudes Scientifiques (IHES)