AI, Data Science & Cloud Certificates from Google, IBM & Meta
Build GenAI Apps from Scratch — UCSB PaCE Certificate Program
Overview
AI, Data Science & Cloud Certificates from Google, IBM & Meta — 40% Off
One plan covers every Professional Certificate on Coursera. 40% off Coursera Plus Annual.
Unlock All Certificates
Explore groundbreaking AI research that reveals how reinforcement learning fundamentally transforms large language models through a counterintuitive geometric optimization process. Discover why RLVR (Reinforcement Learning from Human Feedback) achieves dramatic reasoning improvements despite appearing to make only sparse parameter updates, resolving a major paradox in modern AI training. Learn about the revolutionary "Three-Gate Theory" that demonstrates how pre-trained models guide optimizers into low-curvature, off-principal subspaces rather than overwriting critical parameters. Understand the geometric principles underlying how advanced AI models truly learn and why traditional parameter-efficient fine-tuning methods often fail in reinforcement learning contexts. Examine research from Meta AI and the University of Texas at Austin that fundamentally challenges conventional understanding of neural network optimization and provides new insights into the physics of machine learning at scale.
Syllabus
AI Learns in Low-Curvature Subspaces (RLVR)
Taught by
Discover AI