Overview
Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore the evolution from manually managed systems to autonomous, self-optimizing platforms in this 34-minute conference talk from Conf42 ML 2025. Madhuri Koripalli addresses the growing challenges of data explosion and presents a comprehensive framework built on four essential pillars: Metadata Intelligence (functioning as the system's nervous system), Self-Healing Data Pipelines, Predictive Resource Optimization, and Embedded Governance with Ethical AI considerations. The presentation progresses from explaining fundamental concepts to demonstrating practical applications, concluding with a forward-looking perspective on fully autonomous data platforms. Perfect for data engineers, ML practitioners, and technology leaders seeking to implement more efficient, resilient, and ethical data management systems.
Syllabus
00:00 Introduction to AI-Driven Data Platforms
01:00 The Data Explosion Challenge
02:45 Four Pillars of AI-Driven Data Platforms
04:49 Metadata Intelligence: The Nervous System
09:57 Self-Healing Data Pipelines
15:28 Predictive Resource Optimization
21:55 Embedded Governance and Ethical AI
29:47 Conclusion: The Future of Autonomous Data Platforms
Taught by
Conf42