Shipping Products When You Don't Know What They Can Do - Product Management for AI Agents
AI Engineer via YouTube
Overview
Coursera Spring Sale
40% Off Coursera Plus Annual!
Grab it
Explore the unique challenges of product management for AI agents in this conference talk that addresses the fundamental shift from traditional software development to managing products with emergent, unpredictable capabilities. Learn how to navigate the uncertainty inherent in AI-native products where agents can perform tasks they weren't explicitly designed for, requiring product managers to abandon traditional control mechanisms and embrace experimentation. Discover practical strategies for writing specifications that focus on affordances rather than rigid features, utilizing AI evaluations as development tools, and conducting user acceptance testing on behaviors that emerge spontaneously. Gain insights into building customer trust when honest answers often include "I don't know," and understand why managing AI products in 2025 requires fundamentally different approaches than traditional web applications. The presentation draws from real-world experiences with AI agents that surprise both creators and users with their capabilities, offering a field guide for product and engineering teams adapting to this new paradigm where roadmaps become fluid and product boundaries are discovered post-release rather than predetermined.
Syllabus
Shipping Products When You Don't Know What they Can Do — Ben Stein, Teammates
Taught by
AI Engineer