Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

From Datavault to Delta Lake - Streamlining Data Sync with Lakeflow Connect

Databricks via YouTube

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore the Australian Red Cross Lifeblood's comprehensive approach to synchronizing an Azure SQL Datavault 2.0 implementation with Unity Catalog using Lakeflow Connect in this 34-minute conference talk. Learn how Lifeblood tackled the complex challenge of migrating their data warehouse, which includes raw vault and business vault tables plus information marts defined as views, through a multi-step synchronization process. Discover the technical implementation that involved using Lakeflow Connect for ingesting raw vault and business vault data, followed by a custom JDBC-based process for ingesting view definitions, and the automated and manual conversion of T-SQL to Databricks SQL views with Lakehouse Monitoring for validation. Gain insights into the design decisions, architectural choices, and practical challenges encountered during this data modernization journey, and understand how the resulting solution now effectively supports analytics workloads, analysts, and data scientists at Lifeblood. The session is presented by Andrew Clarke, Senior AI/ML Engineer at Australian Red Cross Lifeblood, and Olivia Ren, Solution Architect at Databricks, who share real-world experiences and lessons learned from this enterprise-scale data synchronization project.

Syllabus

From Datavault to Delta Lake: Streamlining Data Sync with Lakeflow Connect

Taught by

Databricks

Reviews

Start your review of From Datavault to Delta Lake - Streamlining Data Sync with Lakeflow Connect

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.