Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore the transformation of complex, messy data workflows into clean and efficient Delta Live Tables (DLT) pipelines through a real-world case study from Intermountain Health, a large integrated health system. Learn how to identify and address common pain points in legacy data workflows, including tangled logic, performance bottlenecks, and maintenance challenges that plague traditional data preparation tools like Alteryx as they scale. Discover the advantages of DLT's democratized and streamlined approach to data engineering, which leverages Apache Spark and Delta Lake for improved scalability and maintainability. Follow the step-by-step process of translating complex legacy workflows into modern DLT pipelines, with emphasis on key components such as data transformation, validation, and delivery mechanisms. Gain practical insights from Peter Jones, Analytics Engineer at Intermountain Healthcare, as he demonstrates how organizations can modernize their data infrastructure to achieve better performance, easier maintenance, and more reliable data processing at scale.
