Unlocking the Future of Data Orchestration - Introducing Apache Airflow 3
Databricks via YouTube
-
10
-
- Write review
MIT Sloan AI Adoption: Build a Playbook That Drives Real Business ROI
Lead AI Strategy with UCSB's Agentic AI Program — Microsoft Certified
Overview
Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
Explore the revolutionary capabilities of Apache Airflow® 3 in this 40-minute conference talk that unveils the latest advancements in data orchestration technology. Discover how this major release transforms the landscape of building, running, and managing data pipelines through three core pillars of innovation. Learn about the enhanced ease of use featuring an intuitive, upgraded user interface, DAG versioning capabilities, and scheduler-integrated backfills that empower teams to manage pipelines more effectively than ever before. Understand the strengthened security architecture that decouples task execution from direct database connections, enforcing task isolation and minimal-privilege access to meet stringent compliance standards while reducing unauthorized data exposure risks. Examine the ultimate flexibility offered through remote execution capabilities and event-driven scheduling designed for global, heterogeneous modern data environments with architecture supporting edge computing, hybrid-cloud deployments, and GPU-based implementations. Gain insights from Vikram Koka, Chief Strategy Officer at Astronomer, as he demonstrates how Airflow 3 represents a new era of flexibility, scalability, and security in data orchestration, making pipeline management more accessible and powerful for modern data teams across diverse deployment scenarios.
Syllabus
Sponsored by: Astronomer | Unlocking the Future of Data Orchestration: Introducing Apache Airflow® 3
Taught by
Databricks