AI, Data Science & Cloud Certificates from Google, IBM & Meta — 40% Off
One plan covers every Professional Certificate on Coursera. 40% off Coursera Plus Annual.
Unlock All Certificates
Explore the intricacies of Delta Lake in this informative interview with Michael Armbrust, the original creator of Spark SQL and a key figure in Apache Spark development. Dive into the world of reliable data lakes as Armbrust explains how Delta Lake brings ACID transactions, scalable metadata handling, and unified streaming and batch data processing to existing data lakes. Learn about the compatibility with Apache Spark APIs and discover the reasons behind Delta Lake's creation. Gain insights into making streaming first-class, automatic schema migration, multi-version concurrency control, and troubleshooting slow queries. Understand the differences between vacuum and optimize operations, explore GDPR and COPPA compliance, and compare Z-Ordering with partitioning. Get a glimpse of the Delta Lake roadmap and its future developments in this 26-minute episode of Data Brew, a series that offers straight-talking discussions on Data + AI evolution.
