Apache Iceberg with Unity Catalog at HelloFresh - Building Lakehouse Architecture with Cross-Platform Integration
Databricks via YouTube
Free courses from frontend to fullstack and AI
Google, IBM & Microsoft Certificates — All in One Plan
Overview
Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
Learn how HelloFresh implements Apache Iceberg with Unity Catalog to build a comprehensive lakehouse architecture in this 37-minute conference talk. Discover the strategic decision to choose Iceberg as the table format for bridging gaps in a decentralized managed technology landscape, and explore how Unity Catalog serves as the Iceberg REST catalog for metadata storage and table management. Examine the architectural integration between Databricks, Spark, Flink, and Snowflake, with detailed explanations of the native Unity Iceberg REST catalog and catalog federation towards connected engines. Gain insights into the business impact of this implementation and understand the advantages and lessons learned from HelloFresh's early adopter experience with this modern data architecture approach. The presentation is delivered by Adam Komisarek, Senior Staff Data Engineer, and Max Schultze, Director of Data Engineering, both from HelloFresh, providing real-world expertise on implementing table formats in enterprise lakehouse environments.
Syllabus
Apache Iceberg with Unity Catalog at HelloFresh
Taught by
Databricks