Automating Unity Catalog Migration with UCX - Building Robust Python Applications on Databricks
Databricks via YouTube
Finance Certifications Goldman Sachs and Amazon Teams Trust
PowerBI Data Analyst - Create visualizations and dashboards from scratch
Overview
Google, IBM & Meta Certificates – 40% Off
One plan covers every Professional Certificate on Coursera.
Unlock All Certificates
Explore the intricacies of developing resilient Python applications on Databricks in this 42-minute conference talk. Learn how to leverage the Databricks Labs UCX application to identify code incompatibilities with Unity Catalog, implement automatic fixes, and migrate vast numbers of Hive Metastore Tables to Unity Catalog while managing permissions and updating cluster settings. Gain insights into failure recovery, rate limits, logging, multithreading, and unified client authentication through real-world examples. Discover strategies for graceful error handling at various levels, from API calls to entire Databricks Workflows. Understand how PyTest facilitates writing reproducible sandbox scenarios in shared workspaces, enabling simultaneous verification by multiple developers. Delve into the complexities of Databricks Labs toolkits and their practical applications for robust Python development.
Syllabus
Automating Unity Catalog Migration with UCX: Building Robust Python Applications on Databricks
Taught by
Databricks