Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

AI Inside an AI - Internal RL with Temporal Abstraction

Discover AI via YouTube

Overview

Google, IBM & Meta Certificates – 40% Off
One plan covers every Professional Certificate on Coursera.
Unlock All Certificates
Explore Google's groundbreaking transformer architecture featuring an internal metacontroller that implements hierarchical reinforcement learning through temporal abstraction. Discover how this innovative "AI inside an AI" design represents a paradigm shift from traditional approaches like agents or RAG systems toward more intelligent AI architectures. Learn about the research findings from Google's Paradigms of Intelligence Team that demonstrate how emergent temporal abstractions in autoregressive models enable sophisticated reasoning capabilities. Understand the concept of Latent Space Steering and how integrating a smaller 'System 2' brain within the massive 'System 1' body of large language models could shape the future of AI reasoning beyond simply scaling context windows or chain-of-thought tokens. Examine the technical details and implications of this pre-print research that suggests new directions for developing more capable AI systems through internal hierarchical control mechanisms.

Syllabus

AI Inside an AI: Internal RL w/ Temporal Abstraction

Taught by

Discover AI

Reviews

Start your review of AI Inside an AI - Internal RL with Temporal Abstraction

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.