Apache Iceberg with Unity Catalog at HelloFresh - Building Lakehouse Architecture with Cross-Platform Integration
Databricks via YouTube
Earn Your Business Degree, Tuition-Free, 100% Online!
Power BI Fundamentals - Create visualizations and dashboards from scratch
Overview
Google, IBM & Meta Certificates – 40% Off
One plan covers every Professional Certificate on Coursera.
Unlock All Certificates
Learn how HelloFresh implements Apache Iceberg with Unity Catalog to build a comprehensive lakehouse architecture in this 37-minute conference talk. Discover the strategic decision to choose Iceberg as the table format for bridging gaps in a decentralized managed technology landscape, and explore how Unity Catalog serves as the Iceberg REST catalog for metadata storage and table management. Examine the architectural integration between Databricks, Spark, Flink, and Snowflake, with detailed explanations of the native Unity Iceberg REST catalog and catalog federation towards connected engines. Gain insights into the business impact of this implementation and understand the advantages and lessons learned from HelloFresh's early adopter experience with this modern data architecture approach. The presentation is delivered by Adam Komisarek, Senior Staff Data Engineer, and Max Schultze, Director of Data Engineering, both from HelloFresh, providing real-world expertise on implementing table formats in enterprise lakehouse environments.
Syllabus
Apache Iceberg with Unity Catalog at HelloFresh
Taught by
Databricks