Learn Generative AI, Prompt Engineering, and LLMs for Free
Get 20% off all career paths from fullstack to AI
Overview
Google, IBM & Meta Certificates – 40% Off
One plan covers every Professional Certificate on Coursera.
Unlock All Certificates
Explore Google's groundbreaking transformer architecture featuring an internal metacontroller that implements hierarchical reinforcement learning through temporal abstraction. Discover how this innovative "AI inside an AI" design represents a paradigm shift from traditional approaches like agents or RAG systems toward more intelligent AI architectures. Learn about the research findings from Google's Paradigms of Intelligence Team that demonstrate how emergent temporal abstractions in autoregressive models enable sophisticated reasoning capabilities. Understand the concept of Latent Space Steering and how integrating a smaller 'System 2' brain within the massive 'System 1' body of large language models could shape the future of AI reasoning beyond simply scaling context windows or chain-of-thought tokens. Examine the technical details and implications of this pre-print research that suggests new directions for developing more capable AI systems through internal hierarchical control mechanisms.
Syllabus
AI Inside an AI: Internal RL w/ Temporal Abstraction
Taught by
Discover AI