How HMS Federation Powered Nationwide's Seamless and Efficient Unity Catalog Migration
Databricks via YouTube
Overview
AI, Data Science & Cloud Certificates from Google, IBM & Meta — 40% Off
One plan covers every Professional Certificate on Coursera. 40% off Coursera Plus Annual.
Unlock All Certificates
Learn how Nationwide's Security and Infrastructure data team successfully migrated from Hive Metastore (HMS) to Unity Catalog through this 15-minute conference talk by Lead Data Engineer Praveena Edward Panneer Selvam. Discover the strategic use of HMS federation to enable an incremental migration approach that minimized disruption to data consumers while optimizing data layout throughout the transition process. Explore the key technical decisions made during planning, the challenges encountered during execution, and the comprehensive validation steps implemented to ensure migration success. Gain insights into the detailed, step-by-step methodology covering all phases from initial planning through final implementation, including how the team navigated various hurdles along the way. Understand the significant benefits realized post-migration, including enhanced data governance capabilities, more efficient data access patterns, and improved operational performance metrics. Acquire practical knowledge for executing complex data migrations with emphasis on maintaining security standards, ensuring flexibility during transition, and building for long-term scalability in enterprise data environments.
Syllabus
How HMS Federation Powered Nationwide’s Seamless and Efficient Unity Catalog Migration
Taught by
Databricks