Automating Unity Catalog Migration with UCX - Building Robust Python Applications on Databricks
Databricks via YouTube
Coursera Plus Annual Nearly 45% Off
AI Engineer - Learn how to integrate AI into software applications
Overview
Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore the intricacies of developing resilient Python applications on Databricks in this 42-minute conference talk. Learn how to leverage the Databricks Labs UCX application to identify code incompatibilities with Unity Catalog, implement automatic fixes, and migrate vast numbers of Hive Metastore Tables to Unity Catalog while managing permissions and updating cluster settings. Gain insights into failure recovery, rate limits, logging, multithreading, and unified client authentication through real-world examples. Discover strategies for graceful error handling at various levels, from API calls to entire Databricks Workflows. Understand how PyTest facilitates writing reproducible sandbox scenarios in shared workspaces, enabling simultaneous verification by multiple developers. Delve into the complexities of Databricks Labs toolkits and their practical applications for robust Python development.
Syllabus
Automating Unity Catalog Migration with UCX: Building Robust Python Applications on Databricks
Taught by
Databricks