Google Data Analytics, IBM AI & Meta Marketing — All in One Subscription
Build GenAI Apps from Scratch — UCSB PaCE Certificate Program
Overview
Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
Explore the Trust Region Policy Optimization (TRPO) algorithm in this 23-minute lecture presented by Shivam Kalra. Delve into reinforcement learning concepts, addressing policy gradient challenges and optimization techniques. Learn about the KL-penalized problem, the Minorization Maximization (MM) algorithm, and the Conjugate Gradient (CG) method. Gain insights into the TRPO algorithm, including its KL-constrained approach and implementation details. Enhance your understanding of advanced reinforcement learning techniques and their applications in solving complex optimization problems.
Syllabus
Intro
Reinforcement Learning
Problems of Policy Gradient
RL to Optimization
What loss to optimize?
New State Visitation is Difficult
Minorization Maximization (MM) algorithm
Solving KL-Penalized Problem
Conjugate Gradient (CG)
TRPO: KL-Constrained
TRPO Algorithm
Taught by
Pascal Poupart