Tracking Data and AI Lineage - Ensuring Transparency and Compliance

Explore the critical importance of data and AI lineage tracking in modern data platforms through this 33-minute conference talk from Databricks. Discover how understanding data origins and destinations becomes essential for maintaining transparency, ensuring compliance, and building trust as AI integration deepens across data ecosystems. Learn about the latest advancements in data and AI lineage capabilities within the Databricks Platform, covering comprehensive tracking throughout model training, evaluation, and inference processes. Examine how lineage system tables enable powerful impact analysis and provide valuable usage insights across your entire data estate. Understand newly released features including the Bring Your Own Lineage capability that creates end-to-end visibility of data and AI assets within Unity Catalog. Gain insights into upcoming developments on the lineage roadmap and see how these tools support unified governance for both data and AI workflows. Presented by Murt Neemuchwala, Product Manager at Databricks, and Prithvi Kannan, Software Engineer at Databricks, during the Data + AI Summit.