Yannic Kilcher Courses

Implicit MLE- Backpropagating Through Discrete Exponential Family Distributions

Explore backpropagation through discrete exponential family distributions, enabling integration of combinatorial optimizers in neural networks for enhanced learning capabilities.

• YouTube
• 59 minutes
• Self-Paced
• Free Video

Grokking - Generalization Beyond Overfitting on Small Algorithmic Datasets

Explore the fascinating "grokking" phenomenon in neural networks, where sudden pattern recognition leads to perfect generalization. Discover its implications for deep learning and algorithmic datasets.

• YouTube
• 30 minutes
• Self-Paced
• Free Video

How Far Can We Scale Up? Deep Learning's Diminishing Returns

Explores the limits of scaling up deep learning, discussing computational costs, CO2 emissions, and potential solutions to overcome diminishing returns in AI model performance.

• YouTube
• 20 minutes
• Self-Paced
• Free Video

Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment

Análisis detallado del experimento de revisión por pares de NeurIPS 2014, examinando la subjetividad en las evaluaciones y la capacidad de los revisores para predecir el impacto futuro de los artículos.

• YouTube
• 26 minutes
• Self-Paced
• Free Video

Self-Driving from Vision Only - Tesla's Self-Driving Progress by Andrej Karpathy - Talk Analysis

Analysis of Tesla's vision-only self-driving progress, discussing data labeling, edge-case sampling, neural network training, and the advantages of camera-only systems over multi-sensor approaches.

• YouTube
• 24 minutes
• Self-Paced
• Free Video

Decision Transformer - Reinforcement Learning via Sequence Modeling

Explore how Decision Transformer reframes offline reinforcement learning as sequence modeling, leveraging Transformer architecture to generate optimal actions based on desired returns, past states, and actions.

• YouTube
• 57 minutes
• Self-Paced
• Free Video

Why AI Is Harder Than We Think

Explores four fallacies in AI research leading to overconfident predictions, examining the complexity of intelligence and challenges in developing advanced AI technologies like self-driving cars and conversational companions.

• YouTube
• 37 minutes
• Self-Paced
• Free Video

I Built a Neural Network in Minecraft - Analog Redstone Network with Backprop and Optimizer (No Mods)

Explore the creation of an analog neural network in Minecraft using redstone, featuring backpropagation and weight updates. Learn about innovative applications of game mechanics in machine learning.

• YouTube
• 22 minutes
• Self-Paced
• Free Video

Is the Problem in the Data? Examples on Fairness, Diversity, and Bias

Exploring AI bias through interactive examples on fairness, diversity, and hidden biases. Examines whether bias issues stem from data or other factors in machine learning models.

• YouTube
• 24 minutes
• Self-Paced
• Free Video

Linear Transformers Are Secretly Fast Weight Memory Systems - Machine Learning Paper Explained

Explore the connection between linear transformers and fast weight memory systems, uncovering limitations and proposing improvements for more efficient deep learning models.

• YouTube
• 52 minutes
• Self-Paced
• Free Video

Deep Networks Are Kernel Machines

Explores the theory that deep neural networks function as kernel machines, challenging the view that they discover new data representations. Discusses implications for interpretability and algorithm development.

• YouTube
• 43 minutes
• Self-Paced
• Free Video

Extracting Training Data from Large Language Models - Paper Explained

Explores a method to extract training data from large language models, discussing security implications, risks, and mitigation strategies for models like GPT-3. Covers technical aspects and ethical considerations.

• YouTube
• 1 hour 3 minutes
• Self-Paced
• Free Video

Daniel Negreanu's No-Limit Hold'em Challenge - Poker Hand Analysis

Analysis of poker situations from Daniel Negreanu's Twitter challenge, exploring AI bot strategies and Nash equilibria in No-Limit Hold'em. Insights into advanced poker decision-making and game theory.

• YouTube
• 28 minutes
• Self-Paced
• Free Video

DeepMind's AlphaFold 2 Explained - AI Breakthrough in Protein Folding - What We Know and What We Don't

Comprehensive exploration of DeepMind's AlphaFold 2, a groundbreaking AI system that solved the protein folding problem. Covers the science, previous approaches, and potential implications for biology and medicine.

• YouTube
• 55 minutes
• Self-Paced
• Free Video

What Matters in On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Comprehensive study on on-policy reinforcement learning, examining 50+ design choices across 5 environments. Provides insights and recommendations for practitioners to optimize agent performance in continuous control tasks.

• YouTube
• 38 minutes
• Self-Paced
• Free Video