Disney's Foundational Medallion - A Journey Into Next-Generation Data Architecture
Databricks via YouTube
Overview
Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Discover how Disney Streaming revolutionized their data architecture through the creation of their Foundational Medallion in this 18-minute conference talk. Explore the multi-faceted challenges of building a consistent, self-service surrogate key architecture that serves as a foundational dataset for every ingested stream powering Disney Streaming's data-driven decisions. Learn how the team streamlined their architecture and unlocked new efficiencies by leveraging cutting-edge Databricks features including liquid clustering, Photon with dynamic file pruning, Delta's identity column, and Unity Catalog to transform their implementation into a simpler, more scalable solution. Navigate through the design and implementation process of creating a new Medallion architecture at scale that serves as the heartbeat of Disney's streaming business, gaining insights into managing data at enterprise scale while maintaining consistency and enabling self-service capabilities across the organization.
Syllabus
Disney's Foundational Medallion: A Journey Into Next-Generation Data Architecture
Taught by
Databricks