Markov Decision Processes Courses and Certifications

GERAD Research Center

Hindsight Learning for MDPs with Exogenous Inputs

Explore data-efficient algorithms for resource management problems using Hindsight Learning in Exo-MDPs, outperforming traditional methods in various applications including cloud resource allocation.

• YouTube
• 51 minutes
• On-Demand
• Free Video

Dave Churchill

Intro to Artificial Intelligence - Markov Decision Process (MDP) - Lecture 17

Explore Markov Decision Processes (MDPs) in AI, learning algorithmic techniques for modern problem-solving in uncertain environments.

• YouTube
• 45 minutes
• On-Demand
• Free Video

Dave Churchill

COMP3200 - Introduction to Artificial Intelligence - MDP and Dynamic Programming - Lecture 16

Explore Markov Decision Processes and Dynamic Programming in AI, learning algorithmic techniques for modern problem-solving in game environments.

• YouTube
• 52 minutes
• On-Demand
• Free Video

Dave Churchill

Intro to Artificial Intelligence - MDP and Dynamic Programming - Lecture 15

Explore Markov Decision Processes and Dynamic Programming in AI, learning algorithmic techniques for modern problem-solving in game environments.

• YouTube
• 43 minutes
• On-Demand
• Free Video

Centre for Networked Intelligence, IISc

Average Reward Markov Decision Process - Policy Gradient Algorithms and Regret Analysis

Delve into infinite horizon average reward Markov Decision Process (MDP), exploring policy gradient algorithms, gradient estimation techniques, and innovative approaches to reduce mixing time dependencies.

• YouTube
• 1 hour 3 minutes
• On-Demand
• Free Video

Centre for Networked Intelligence, IISc

Almost-Optimal Best Restless Markov Arm Identification with Fixed Confidence

Delve into advanced multi-armed bandit theory, focusing on identifying optimal arms in restless Markov chains through asymptotic analysis and policy optimization for distributed learning systems.

• YouTube
• 1 hour 18 minutes
• On-Demand
• Free Video

Centre for Networked Intelligence, IISc

Mean-Field Control for Restless Bandits and Weakly Coupled MDPs

Explore optimization methods and stochastic models for large-scale system control, focusing on mean-field approaches to overcome dimensionality challenges in reinforcement learning and resource allocation.

• YouTube
• 1 hour 18 minutes
• On-Demand
• Free Video

Dave Churchill

Introduction to Artificial Intelligence - Lecture 17 - MDP / Dynamic Programming

Explore Markov Decision Processes and Dynamic Programming techniques for AI problem-solving, with applications to game environments.

• YouTube
• 52 minutes
• On-Demand
• Free Video

ACM SIGPLAN

Structural Abstraction and Refinement for Probabilistic Programs

Discover a novel framework for verifying probabilistic programs using structural abstraction that separates probability from computational semantics for enhanced verification.

• YouTube
• 15 minutes
• On-Demand
• Free Video

Fields Institute

Algorithmic Learning Theory Research Presentations - Session 5

Explore cutting-edge research in algorithmic learning theory covering MDPs, vector prediction, online optimization, ranking systems, and contextual bandits from ALT 2026.

• YouTube
• 55 minutes
• On-Demand
• Free Video

Artificial Intelligence: Reinforcement Learning in Python

10799 ratings at Udemy

Complete guide to Reinforcement Learning, with Stock Trading and Online Advertising Applications

• Udemy
• 14 hours 43 minutes
• On-Demand
• Paid Course

Nvidia Deep Learning Institute;  Unity Microcredential

Deep Reinforcement Learning

357 ratings at Udacity

Master deep reinforcement learning techniques to train AI agents for navigation, financial trading, and multi-agent systems. Implement classical and modern RL algorithms using PyTorch.

• Udacity
• 83 hours
• On-Demand
• Paid Course

Reinforcement Learning with Gymnasium in Python

Start your reinforcement learning journey! Learn how agents can learn to solve environments through interactions.

• DataCamp
• 4 hours
• On-Demand
• Free Trial Available

Reinforcement Learning in Python

Master the fundamentals of reinforcement learning (RL) to create models that can navigate complex real-world environments and train LLMs.

• DataCamp
• 12 hours
• On-Demand
• Free Trial Available

The Julia Programming Language

MDPs - Markov Decision Processes - Decision Making Under Uncertainty Using POMDPs.jl

Explore Markov Decision Processes and decision-making under uncertainty using POMDPs.jl. Learn about MDPs, Grid World, solvers, reinforcement learning, and visualization techniques in Julia.

• YouTube
• 49 minutes
• On-Demand
• Free Video