Google AI Professional Certificate - Learn AI Skills That Get You Hired
AI Adoption - Drive Business Value and Organizational Impact
Overview
Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore the Australian Red Cross Lifeblood's comprehensive approach to synchronizing an Azure SQL Datavault 2.0 implementation with Unity Catalog using Lakeflow Connect in this 34-minute conference talk. Learn how Lifeblood tackled the complex challenge of migrating their data warehouse, which includes raw vault and business vault tables plus information marts defined as views, through a multi-step synchronization process. Discover the technical implementation that involved using Lakeflow Connect for ingesting raw vault and business vault data, followed by a custom JDBC-based process for ingesting view definitions, and the automated and manual conversion of T-SQL to Databricks SQL views with Lakehouse Monitoring for validation. Gain insights into the design decisions, architectural choices, and practical challenges encountered during this data modernization journey, and understand how the resulting solution now effectively supports analytics workloads, analysts, and data scientists at Lifeblood. The session is presented by Andrew Clarke, Senior AI/ML Engineer at Australian Red Cross Lifeblood, and Olivia Ren, Solution Architect at Databricks, who share real-world experiences and lessons learned from this enterprise-scale data synchronization project.
Syllabus
From Datavault to Delta Lake: Streamlining Data Sync with Lakeflow Connect
Taught by
Databricks