AI, Data Science & Cloud Certificates from Google, IBM & Meta — 40% Off
One plan covers every Professional Certificate on Coursera. 40% off Coursera Plus Annual.
Unlock All Certificates
Learn how to orchestrate data pipelines on Databricks using Lakeflow Jobs (formerly Databricks Workflows) in this 31-minute beginner-friendly talk. Discover the fundamentals of this easy-to-use orchestration service built into the Databricks Data Intelligence Platform that simplifies automating data and AI workflows, from ETL pipelines to machine learning model training. Master building and managing pipelines using a visual approach, monitoring workflows and rerunning failures with repair runs, and automating tasks like publishing dashboards or ingesting data using Lakeflow Connect. Explore how to add smart triggers that respond to new files or table updates and use built-in loops and conditions to reduce manual work and make workflows more dynamic. Follow along with practical demos and common use cases while receiving expert tips from Databricks Product Managers Anthony Podgorsak and Saad Ansari to help you get started quickly with orchestration on the Databricks platform.
