Coursera Spring Sale
40% Off Coursera Plus Annual!
Grab it
Learn advanced Delta Lake streaming techniques and best practices for building future-ready data engineering pipelines in this 42-minute conference talk from Databricks. Explore the evolution from batch-oriented to streaming-first data processing while preparing for AI-driven automation and agentic workflows. Discover proven strategies for writing generic applications as reusable components, master workflow automation techniques, and implement effective Delta clustering methods including liquid clustering, z-order optimization, and classic approaches. Gain insights into leveraging metadata for agentic pipelines and workflow automation from Scott Haines, Distinguished Software Engineer at Nike and co-author of The Delta Lake Definitive Guide. Understand how Delta Lake serves as a critical foundation for consistent, just-in-time data delivery that powers the future of AI applications and automated systems.
