Free AI-powered learning to build in-demand skills
Power BI Fundamentals - Create visualizations and dashboards from scratch
Overview
Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Learn about HP Print's comprehensive data platform migration from AWS Redshift to Databricks lakehouse architecture in this 32-minute conference talk. Discover how HP's data platform team successfully transitioned from a monolithic, shared resource system to a modular and scalable data ecosystem, achieving 30-40% cost savings while providing scalable and isolated resources for different data consumers and ETL workloads. Explore the technical challenges and solutions encountered during ETL migrations using DBT, and gain insights into leveraging new Databricks features including Liquid Clustering, predictive optimization, Photon, SQL serverless warehouses, and Unity Catalog for managing multiple teams. Understand both the business rationale and technical implementation details of this large-scale migration project, including performance optimization strategies for various query types and key lessons learned throughout the transformation process. Presented by Isaac Chan, Data Engineer at HP Inc., and Kavya Atmakuri, Lead Data Engineer at HP Inc., this talk provides practical insights for organizations considering similar data platform modernization initiatives.
Syllabus
HP's Data Platform Migration Journey: Redshift to Lakehouse
Taught by
Databricks