Comparing Argo Workflows and Airflow in Distributed Environments
CNCF [Cloud Native Computing Foundation] via YouTube
Learn AI, Data Science & Business — Earn Certificates That Get You Hired
Stuck in Tutorial Hell? Learn Backend Dev the Right Way
Overview
Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
Explore the advantages of Argo Workflows over Apache Airflow for orchestrating pipeline jobs in distributed environments in this 26-minute conference talk from the Cloud Native Computing Foundation (CNCF). Dive into the architecture, resource management, and workflow definitions of Argo Workflows, and discover how it leverages Kubernetes to provide superior scaling capabilities for data pipelines. Learn why Argo Workflows is the preferred choice for expanding teams distributed across multiple regions and zones, eliminating dependencies on specific tech stacks. Gain insights into running example jobs and understand how Argo Workflows and Kubernetes offer distinct scaling advantages for any data pipeline user.
Syllabus
Comparing Argo Workflows and Airflow in a Distributed Environment
Taught by
CNCF [Cloud Native Computing Foundation]