Introduction to Modern Open Table Formats and Catalogs

Explore the fundamentals of modern open table formats like Delta and Iceberg in this comprehensive conference talk from Databricks. Discover the key motivations behind the creation of these innovative data formats and understand how they integrate with catalogs to enhance data management capabilities. Learn about the significant benefits these formats can bring to your data and AI platform, including improved performance, reliability, and scalability. Gain insights into the growing interoperability between different table formats and understand Databricks' vision for the future evolution of open table formats. The session covers practical applications and real-world use cases, helping you understand when and how to implement these technologies in your data architecture. Presented by Bart Samwel, Principal Software Engineer at Databricks, and Sirui Sun, Senior Manager of Product Management at Databricks, this talk provides both technical depth and strategic perspective on the role of modern table formats in contemporary data engineering and analytics workflows.