Markov Decision Processes Courses and Certifications

GERAD Research Center

Hindsight Learning for MDPs with Exogenous Inputs

Explore data-efficient algorithms for resource management problems using Hindsight Learning in Exo-MDPs, outperforming traditional methods in various applications including cloud resource allocation.

• YouTube
• 51 minutes
• Self-Paced
• Free Video

Dave Churchill

Intro to Artificial Intelligence - Markov Decision Process (MDP) - Lecture 17

Explore Markov Decision Processes (MDPs) in AI, learning algorithmic techniques for modern problem-solving in uncertain environments.

• YouTube
• 45 minutes
• Self-Paced
• Free Video

Dave Churchill

COMP3200 - Introduction to Artificial Intelligence - MDP and Dynamic Programming - Lecture 16

Explore Markov Decision Processes and Dynamic Programming in AI, learning algorithmic techniques for modern problem-solving in game environments.

• YouTube
• 52 minutes
• Self-Paced
• Free Video

Dave Churchill

Intro to Artificial Intelligence - MDP and Dynamic Programming - Lecture 15

Explore Markov Decision Processes and Dynamic Programming in AI, learning algorithmic techniques for modern problem-solving in game environments.

• YouTube
• 43 minutes
• Self-Paced
• Free Video

Dave Churchill

Introduction to Artificial Intelligence - Lecture 17 - MDP / Dynamic Programming

Explore Markov Decision Processes and Dynamic Programming techniques for AI problem-solving, with applications to game environments.

• YouTube
• 52 minutes
• Self-Paced
• Free Video

Centre for Networked Intelligence, IISc

Average Reward Markov Decision Process - Policy Gradient Algorithms and Regret Analysis

Delve into infinite horizon average reward Markov Decision Process (MDP), exploring policy gradient algorithms, gradient estimation techniques, and innovative approaches to reduce mixing time dependencies.

• YouTube
• 1 hour 3 minutes
• Self-Paced
• Free Video

Centre for Networked Intelligence, IISc

Almost-Optimal Best Restless Markov Arm Identification with Fixed Confidence

Delve into advanced multi-armed bandit theory, focusing on identifying optimal arms in restless Markov chains through asymptotic analysis and policy optimization for distributed learning systems.

• YouTube
• 1 hour 18 minutes
• Self-Paced
• Free Video

Centre for Networked Intelligence, IISc

Mean-Field Control for Restless Bandits and Weakly Coupled MDPs

Explore optimization methods and stochastic models for large-scale system control, focusing on mean-field approaches to overcome dimensionality challenges in reinforcement learning and resource allocation.

• YouTube
• 1 hour 18 minutes
• Self-Paced
• Free Video

Fields Institute

Algorithmic Learning Theory Research Presentations - Session 5

Explore cutting-edge research in algorithmic learning theory covering MDPs, vector prediction, online optimization, ranking systems, and contextual bandits from ALT 2026.

• YouTube
• 55 minutes
• Self-Paced
• Free Video

ACM SIGPLAN

Structural Abstraction and Refinement for Probabilistic Programs

Discover a novel framework for verifying probabilistic programs using structural abstraction that separates probability from computational semantics for enhanced verification.

• YouTube
• 15 minutes
• Self-Paced
• Free Video

Reinforcement Learning with Gymnasium in Python

Start your reinforcement learning journey! Learn how agents can learn to solve environments through interactions.

• DataCamp
• 4 hours
• Self-Paced
• Free Trial Available

Reinforcement Learning in Python

Master the fundamentals of reinforcement learning (RL) to create models that can navigate complex real-world environments and train LLMs.

• DataCamp
• 12 hours
• Self-Paced
• Free Trial Available

Simons Institute

Online Learning in Markov Decision Processes - Part 2

Explore advanced concepts in Markov Decision Processes, including adversarial scenarios, regret analysis, and algorithms for online learning in dynamic environments.

• YouTube
• 1 hour 13 minutes
• Self-Paced
• Free Video

Simons Institute

Online Learning in Markov Decision Processes - Part 1

Explore online learning in Markov Decision Processes, covering theory, algorithms, and optimal strategies for reinforcement learning in dynamic environments.

• YouTube
• 1 hour 26 minutes
• Self-Paced
• Free Video

Simons Institute

Optimality and Approximation with Policy Gradient Methods in Markov Decision Processes

Explore policy gradient methods in Markov Decision Processes, covering optimality, approximation, and key concepts like entropy regularization and natural policy gradient.

• YouTube
• 55 minutes
• Self-Paced
• Free Video