How HMS Federation Powered Nationwide's Seamless and Efficient Unity Catalog Migration
Databricks via YouTube
AI Engineer - Learn how to integrate AI into software applications
Get 35% Off CFI Certifications - Code CFI35
Overview
Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Learn how Nationwide's Security and Infrastructure data team successfully migrated from Hive Metastore (HMS) to Unity Catalog through this 15-minute conference talk by Lead Data Engineer Praveena Edward Panneer Selvam. Discover the strategic use of HMS federation to enable an incremental migration approach that minimized disruption to data consumers while optimizing data layout throughout the transition process. Explore the key technical decisions made during planning, the challenges encountered during execution, and the comprehensive validation steps implemented to ensure migration success. Gain insights into the detailed, step-by-step methodology covering all phases from initial planning through final implementation, including how the team navigated various hurdles along the way. Understand the significant benefits realized post-migration, including enhanced data governance capabilities, more efficient data access patterns, and improved operational performance metrics. Acquire practical knowledge for executing complex data migrations with emphasis on maintaining security standards, ensuring flexibility during transition, and building for long-term scalability in enterprise data environments.
Syllabus
How HMS Federation Powered Nationwide’s Seamless and Efficient Unity Catalog Migration
Taught by
Databricks