Everything Spark, Lakeflow Declarative Pipelines, and Open Source

Explore the latest developments in Apache Spark, Lakeflow Declarative Pipelines, and open source technologies in this 14-minute conference talk from Databricks Summit Live. Learn directly from Michael Armbrust, creator of Spark SQL and leader of Databricks Delta, as he shares insights about the evolution of Spark since its creation in 2009 by Databricks co-founders. Discover current advancements in the wildly popular open source foundation that powers Databricks, understand the capabilities of Lakeflow Declarative Pipelines, and gain perspective on the broader open source ecosystem from one of the key architects behind these transformative data processing technologies.