Free courses from frontend to fullstack and AI
Lead AI Strategy with UCSB's Agentic AI Program — Microsoft Certified
Overview
Google, IBM & Meta Certificates – 40% Off
One plan covers every Professional Certificate on Coursera.
Unlock All Certificates
Explore the transformation of complex, messy data workflows into clean and efficient Delta Live Tables (DLT) pipelines through a real-world case study from Intermountain Health, a large integrated health system. Learn how to identify and address common pain points in legacy data workflows, including tangled logic, performance bottlenecks, and maintenance challenges that plague traditional data preparation tools like Alteryx as they scale. Discover the advantages of DLT's democratized and streamlined approach to data engineering, which leverages Apache Spark and Delta Lake for improved scalability and maintainability. Follow the step-by-step process of translating complex legacy workflows into modern DLT pipelines, with emphasis on key components such as data transformation, validation, and delivery mechanisms. Gain practical insights from Peter Jones, Analytics Engineer at Intermountain Healthcare, as he demonstrates how organizations can modernize their data infrastructure to achieve better performance, easier maintenance, and more reliable data processing at scale.
Syllabus
From Spaghetti Bowl Pipeline to DLT Efficiency
Taught by
Databricks