Yannic Kilcher Courses

Decision Transformer - Reinforcement Learning via Sequence Modeling

Explore how Decision Transformer reframes offline reinforcement learning as sequence modeling, leveraging Transformer architecture to generate optimal actions based on desired returns, past states, and actions.

• YouTube
• 57 minutes
• On-Demand
• Free Video

Why AI Is Harder Than We Think

Explores four fallacies in AI research leading to overconfident predictions, examining the complexity of intelligence and challenges in developing advanced AI technologies like self-driving cars and conversational companions.

• YouTube
• 37 minutes
• On-Demand
• Free Video

I Built a Neural Network in Minecraft - Analog Redstone Network with Backprop and Optimizer (No Mods)

Explore the creation of an analog neural network in Minecraft using redstone, featuring backpropagation and weight updates. Learn about innovative applications of game mechanics in machine learning.

• YouTube
• 22 minutes
• On-Demand
• Free Video

Is the Problem in the Data? Examples on Fairness, Diversity, and Bias

Exploring AI bias through interactive examples on fairness, diversity, and hidden biases. Examines whether bias issues stem from data or other factors in machine learning models.

• YouTube
• 24 minutes
• On-Demand
• Free Video

Linear Transformers Are Secretly Fast Weight Memory Systems - Machine Learning Paper Explained

Explore the connection between linear transformers and fast weight memory systems, uncovering limitations and proposing improvements for more efficient deep learning models.

• YouTube
• 52 minutes
• On-Demand
• Free Video

Deep Networks Are Kernel Machines

Explores the theory that deep neural networks function as kernel machines, challenging the view that they discover new data representations. Discusses implications for interpretability and algorithm development.

• YouTube
• 43 minutes
• On-Demand
• Free Video

Extracting Training Data from Large Language Models - Paper Explained

Explores a method to extract training data from large language models, discussing security implications, risks, and mitigation strategies for models like GPT-3. Covers technical aspects and ethical considerations.

• YouTube
• 1 hour 3 minutes
• On-Demand
• Free Video

Daniel Negreanu's No-Limit Hold'em Challenge - Poker Hand Analysis

Analysis of poker situations from Daniel Negreanu's Twitter challenge, exploring AI bot strategies and Nash equilibria in No-Limit Hold'em. Insights into advanced poker decision-making and game theory.

• YouTube
• 28 minutes
• On-Demand
• Free Video

DeepMind's AlphaFold 2 Explained - AI Breakthrough in Protein Folding - What We Know and What We Don't

Comprehensive exploration of DeepMind's AlphaFold 2, a groundbreaking AI system that solved the protein folding problem. Covers the science, previous approaches, and potential implications for biology and medicine.

• YouTube
• 55 minutes
• On-Demand
• Free Video

What Matters in On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Comprehensive study on on-policy reinforcement learning, examining 50+ design choices across 5 environments. Provides insights and recommendations for practitioners to optimize agent performance in continuous control tasks.

• YouTube
• 38 minutes
• On-Demand
• Free Video

PCGRL - Procedural Content Generation via Reinforcement Learning - Paper Explained

Explore how reinforcement learning can be applied to game level design, framing it as a sequential decision-making process for fast and diverse level generation.

• YouTube
• 25 minutes
• On-Demand
• Free Video

Self-Training With Noisy Student Improves ImageNet Classification - Paper Explained

Explore a novel semi-supervised learning approach for image classification using unlabeled data, improving model performance and robustness through iterative self-training and noise injection techniques.

• YouTube
• 41 minutes
• On-Demand
• Free Video

Playing Atari with Deep Reinforcement Learning - Paper Explained

Explore deep reinforcement learning's breakthrough in Atari game mastery using convolutional neural networks, revolutionizing AI with pixel-based control policies and outperforming human experts.

• YouTube
• 39 minutes
• On-Demand
• Free Video

Neural Architecture Search Without Training - Paper Explained

Explores a novel approach to Neural Architecture Search using statistics of the Jacobian around data points, enabling rapid architecture evaluation without training and significantly accelerating the search process.

• YouTube
• 35 minutes
• On-Demand
• Free Video

Gradient Origin Networks - Paper Explained with Live Coding

Explore Gradient Origin Networks: a novel implicit generative model for efficient latent representation learning, with live coding demonstration and in-depth explanation of the paper's key concepts.

• YouTube
• 42 minutes
• On-Demand
• Free Video