Overview
Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore the concept of gradual disempowerment in AI systems through this 57-minute lecture delivered at the 2025 Cooperative AI Summer School by Nora Ammann, Technical Specialist at the UK's Advanced Research & Invention Agency. Examine how transformative AI systems might gradually reduce human agency and control over time, drawing from Ammann's interdisciplinary expertise spanning complex systems, political theory, philosophy of science, and AI safety. Learn about systemic AI risks and the mechanisms through which advanced AI could incrementally shift power dynamics away from human oversight. Discover insights from someone actively managing a £59m-backed programme developing provable guarantees for safety-critical AI applications, while gaining perspective on hardware-enabled mechanisms for AI security and verification. Understand the theoretical foundations and practical implications of gradual disempowerment as a framework for analyzing long-term AI safety challenges, presented by a researcher who has contributed significantly to interdisciplinary AI safety research through organizations like PIBBSS and the Future of Humanity Institute.
Syllabus
Gradual Disempowerment by Nora Ammann
Taught by
Cooperative AI Foundation