Pascal Poupart Courses

Inverse RL

Explore inverse reinforcement learning, its applications, and key concepts like feature matching and maximizing margins. Learn implementation techniques and policy induction.

• YouTube
• 38 minutes
• Self-Paced
• Free Video

Distributional RL

Explore distributional reinforcement learning, covering return distribution, policy evaluation, and the C51 algorithm, with insights into its advantages and applications in Atari games.

• YouTube
• 23 minutes
• Self-Paced
• Free Video

Partially Observable Reinforcement Learning

Explore partially observable reinforcement learning, covering Markov processes, hidden models, and recurrent neural networks for decision-making in uncertain environments.

• YouTube
• 29 minutes
• Self-Paced
• Free Video

Imitation Learning

Explore imitation learning techniques, from behavioral cloning to generative adversarial methods, with applications in autonomous driving and conversational agents.

• YouTube
• 30 minutes
• Self-Paced
• Free Video

Maximum Entropy Reinforcement Learning

Explore maximum entropy reinforcement learning, covering key concepts like soft Q-learning and soft actor-critic algorithms, with a focus on encouraging stochasticity in optimal policies.

• YouTube
• 42 minutes
• Self-Paced
• Free Video

Trust Region & Proximal Policy Optimization

Explore trust region methods and proximal policy optimization in reinforcement learning, focusing on policy gradients, KL divergence, and practical implementations like TRPO and PPO.

• YouTube
• 22 minutes
• Self-Paced
• Free Video

Normalizing Flows - Priyank Jaini

Explore normalizing flows, density estimation, and autoregressive models. Learn about change of variables, increasing triangular maps, and neural autoregressive flows.

• YouTube
• 1 hour 5 minutes
• Self-Paced
• Free Video

Autoencoders

Explore autoencoders, from basic concepts to advanced applications, covering compression, PCA, deep architectures, sparse representations, and denoising techniques.

• YouTube
• 39 minutes
• Self-Paced
• Free Video

CS480-680 Lecture 19 - Attention and Transformer Networks

Explore attention mechanisms, transformer networks, and their applications in machine learning, including multihead attention and normalization techniques.

• YouTube
• 1 hour 23 minutes
• Self-Paced
• Free Video

CS480-680 - Hidden Markov Models

Explore Hidden Markov Models, their assumptions, and applications in robot localization. Learn about monitoring tasks, hindsight reasoning, and finding the most likely explanation.

• YouTube
• 1 hour 2 minutes
• Self-Paced
• Free Video

Convolutional Neural Networks

Explore convolutional neural networks, from basic concepts to advanced architectures, including edge detection, pooling, and feature maps for image recognition tasks.

• YouTube
• 1 hour 15 minutes
• Self-Paced
• Free Video

Support Vector Machines - Continued

Explore advanced concepts of support vector machines, including soft margins, slack variables, and multi-class classification techniques.

• YouTube
• 29 minutes
• Self-Paced
• Free Video

Support Vector Machines

Learn about support vector machines, margin classifiers, and linear separators. Explore dual representation, Lagrangian optimization, and practical applications in classification problems.

• YouTube
• 1 hour 18 minutes
• Self-Paced
• Free Video

Logistic Regression and Generalized Linear Models

Explore exponential family models, logistic regression, and Newton's method for classification tasks, with applications in app recommendation and sparse data analysis.

• YouTube
• 1 hour 35 minutes
• Self-Paced
• Free Video

CS480-680 - K-Nearest Neighbours

Learn about k-nearest neighbours algorithm for classification and regression, including examples, machine learning concepts, and accuracy considerations.

• YouTube
• 1 hour 29 minutes
• Self-Paced
• Free Video