A Story of Unification from Apache Spark to MLflow

Explore the journey of unification from Apache Spark to MLflow in this 42-minute conference talk delivered at Scala Days Lausanne 2019. Delve into the evolution of big data processing and machine learning frameworks as Reynold Xin shares insights on the development and integration of these powerful tools. Gain a deeper understanding of how Apache Spark's unified analytics engine paved the way for MLflow, an open-source platform designed to manage the complete machine learning lifecycle. Learn about the challenges faced, solutions implemented, and the impact of these unified approaches on data science and engineering workflows.