Institute for Advanced Study Courses

Learning Representations Using Causal Invariance - Leon Bottou

Explore causal invariance in machine learning representations, focusing on stable properties, extrapolation, and robust supervised learning techniques for improved model performance and generalization.

• YouTube
• 33 minutes
• Self-Paced
• Free Video

From Classical Statistics to Modern ML - The Lessons of Deep Learning - Mikhail Belkin

Explore the transition from classical statistics to modern machine learning, focusing on deep learning's impact, interpolation methods, and the "double descent" phenomenon in generalization theory.

• YouTube
• 37 minutes
• Self-Paced
• Free Video

On the Connection Between Neural Networks and Kernels: A Modern Perspective - Simon Du

Explore connections between neural networks and kernels, focusing on over-parameterization, generalization, and neural tangent kernels. Insights on training dynamics and applications to various learning tasks.

• YouTube
• 31 minutes
• Self-Paced
• Free Video

Energy-Based Approaches to Representation Learning - Yann LeCun

Explore energy-based approaches to representation learning with Yann LeCun, covering self-supervised learning, video prediction, and sparse modeling in high-dimensional spaces.

• YouTube
• 40 minutes
• Self-Paced
• Free Video

Are All Features Created Equal? - Aleksander Madry

Explore machine learning's success, deep learning's appeal, and adversarial perturbations. Examine robust features, human vs. ML perspectives, and implications for data efficiency and image synthesis.

• YouTube
• 37 minutes
• Self-Paced
• Free Video

Overcoming the Curse of Dimensionality and Mode Collapse - Ke Li

Explore techniques to overcome dimensionality challenges and mode collapse in deep learning, focusing on GANs, maximum likelihood estimation, and efficient algorithms for high-dimensional spaces.

• YouTube
• 33 minutes
• Self-Paced
• Free Video

PAC-Bayesian Approaches to Understanding Generalization in Deep Learning - Gintare Dziugaite

Explore PAC-Bayesian approaches for understanding generalization in deep learning, covering risk bounds, optimal priors, and data-dependent techniques for neural networks.

• YouTube
• 32 minutes
• Self-Paced
• Free Video

Is Optimization the Right Language to Understand Deep Learning? - Sanjeev Arora

Explore deep learning optimization, generalization, and neural tangent kernels with Sanjeev Arora. Gain insights into training wide networks and matrix completion techniques.

• YouTube
• 33 minutes
• Self-Paced
• Free Video

Tightening Information-Theoretic Generalization Bounds with Data-Dependent Estimates with an Application to SGLD - Daniel Roy

Explore information-theoretic generalization bounds and their application to stochastic gradient Langevin dynamics, focusing on tightening bounds with data-dependent estimates.

• YouTube
• 28 minutes
• Self-Paced
• Free Video

Fixing GAN Optimization Through Competitive Gradient Descent - Anima Anandkumar

Explore competitive gradient descent for optimizing GANs, covering strategic equilibria, applications in ML, and numerical results. Gain insights into modeling competing agents and solving GANs.

• YouTube
• 35 minutes
• Self-Paced
• Free Video

Emergent Linguistic Structure in Deep Contextual Neural Word Representations - Chris Manning

Explore emergent linguistic structures in deep neural word representations with Stanford's Chris Manning, examining language models, attention mechanisms, and vector space analysis.

• YouTube
• 43 minutes
• Self-Paced
• Free Video

Entanglement Wedge Reconstruction and the Information Paradox - Geoff Penington

Explore quantum information in black holes, entanglement wedge reconstruction, and the resolution of the information paradox through advanced theoretical physics concepts.

• YouTube
• 1 hour 5 minutes
• Self-Paced
• Free Video

Cosmic Collisions – Progress in Gravitational-Wave Astronomy

Explore gravitational-wave astronomy, black hole mergers, and neutron stars. Learn about LIGO and Virgo collaborations, merger rates, mass distributions, and future observations in this engaging talk.

• YouTube
• 53 minutes
• Self-Paced
• Free Video

History of Science Lecture - Adelheid Voskuhl

Explore the historical interplay between technology, society, and politics, from medieval Europe to the Industrial Revolution and beyond, with insights on engineering and civil service.

• YouTube
• 55 minutes
• Self-Paced
• Free Video

Proof and Circuit Complexity - Robert Robere

Explore proof and circuit complexity with Robert Robere, delving into Boolean circuits, monotone circuits, slice functions, and the Click function to understand computational limitations.

• YouTube
• 24 minutes
• Self-Paced
• Free Video