Yannic Kilcher Courses

Reinforcement Learning with Augmented Data

Explore how data augmentation enhances reinforcement learning algorithms, improving efficiency and generalization across visual observation tasks without modifying core RL methods.

• YouTube
• 22 minutes
• Self-Paced
• Free Video

TAPAS - Weakly Supervised Table Parsing via Pre-training

Explore TAPAS, an innovative approach to table parsing and question answering using pre-training and weak supervision, outperforming traditional semantic parsing models with a simpler architecture.

• YouTube
• 32 minutes
• Self-Paced
• Free Video

Chip Placement with Deep Reinforcement Learning

Deep reinforcement learning optimizes chip placement, outperforming human experts in speed and efficiency. This AI-driven approach learns from experience, generalizes to new designs, and minimizes power, performance, and area constraints.

• YouTube
• 27 minutes
• Self-Paced
• Free Video

Jukebox - A Generative Model for Music

Explore OpenAI's Jukebox, a groundbreaking AI model generating high-fidelity music with vocals, controllable by genre, artist, and lyrics. Learn about its architecture and capabilities.

• YouTube
• 34 minutes
• Self-Paced
• Free Video

The AI Economist - Improving Equality and Productivity with AI-Driven Tax Policies

Explore AI-driven tax policies that balance equality and productivity through reinforcement learning, revealing emergent strategies and outperforming traditional economic models in simulations and human experiments.

• YouTube
• 35 minutes
• Self-Paced
• Free Video

Deconstructing Lottery Tickets - Zeros, Signs, and the Supermask

Explores the Lottery Ticket Hypothesis, analyzing key components of sparse networks and uncovering insights on weight initialization, sign importance, and the concept of Supermasks in neural network training.

• YouTube
• 36 minutes
• Self-Paced
• Free Video

Do ImageNet Classifiers Generalize to ImageNet? - Paper Explained

Exploring ImageNet classifiers' generalization capabilities through new test datasets, revealing surprising accuracy drops and insights into model performance on slightly "harder" images.

• YouTube
• 26 minutes
• Self-Paced
• Free Video

Supervised Contrastive Learning

Explore a novel supervised learning approach that outperforms cross-entropy loss, improving image classification models' performance and robustness across various architectures and data augmentations.

• YouTube
• 30 minutes
• Self-Paced
• Free Video

Thinking While Moving - Deep Reinforcement Learning with Concurrent Control

Explore concurrent control in reinforcement learning, where agents make decisions while executing actions, revolutionizing robotic movement and decision-making processes.

• YouTube
• 30 minutes
• Self-Paced
• Free Video

Gradient Surgery for Multi-Task Learning

Explore PCGrad, a technique addressing gradient conflicts in multi-task learning, enhancing efficiency and performance in supervised and reinforcement learning scenarios.

• YouTube
• 32 minutes
• Self-Paced
• Free Video

Longformer - The Long-Document Transformer

Explore Longformer's innovative attention mechanism for processing lengthy documents, combining local windowed and global attention to overcome Transformer limitations in handling long sequences.

• YouTube
• 27 minutes
• Self-Paced
• Free Video

Backpropagation and the Brain

Explore a biologically plausible variant of backpropagation and its potential role in brain learning, discussing feedback connections and error signal approximation in cortical networks.

• YouTube
• 32 minutes
• Self-Paced
• Free Video

Shortcut Learning in Deep Neural Networks

Explore deep neural networks' shortcut learning, its impact on AI generalization, and strategies to improve model robustness and real-world applicability.

• YouTube
• 49 minutes
• Self-Paced
• Free Video

Feature Visualization and the OpenAI Microscope

Explore neural network visualizations using OpenAI Microscope, understanding feature extraction in ImageNet classifiers and techniques for visualizing internal model workings.

• YouTube
• 21 minutes
• Self-Paced
• Free Video

FixMatch - Simplifying Semi-Supervised Learning with Consistency and Confidence

Explore FixMatch, a powerful semi-supervised learning approach combining consistency regularization and pseudo-labeling for improved model performance with limited labeled data.

• YouTube
• 20 minutes
• Self-Paced
• Free Video