Multi-Agent Reinforcement Learning - AI Navigation in Obstacle Courses
Neural Breakdown with AVB via YouTube
Overview
Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Learn to train multi-agent reinforcement learning systems where AI agents collaborate to navigate complex obstacle courses in this 22-minute tutorial. Explore the fundamentals of creating custom reinforcement learning environments, including designing observation spaces, action spaces, and reward systems, while understanding local coordinate systems (LCS) in agentic frameworks. Master Actor-Critic methods such as A2C and PPO for training individual agents, then advance to multi-agent algorithms including Independent PPO (I-PPO) and the sophisticated Multi-Agent PPO (MA-PPO). Discover how MA-PPO draws inspiration from MA-DDPG and implements Centralized Training Decentralized Execution (CTDE) methodology to promote cooperative and emergent behaviors among RL agents. Understand why CTDE methods excel in multi-agent environments and observe practical results demonstrating successful collaborative navigation through challenging obstacle courses.
Syllabus
0:00 - Intro
2:17 - Creating RL environments
6:23 - Local Coordinate Systems
8:30 - Rewards
10:24 - Actor Critic Methods
12:36 - Training single agent RL
13:38 - Independent PPO
15:40 - Non stationary environments
16:40 - Centralized Training Decentraized Execution CTDE
17:36 - Multi agent PPO MA-PPO
19:25 - Results!
Taught by
Neural Breakdown with AVB