Comparing Argo Workflows and Airflow in Distributed Environments

Offered By: CNCF [Cloud Native Computing Foundation] via YouTube

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!

Explore the advantages of Argo Workflows over Apache Airflow for orchestrating pipeline jobs in distributed environments in this 26-minute conference talk from the Cloud Native Computing Foundation (CNCF). Dive into the architecture, resource management, and workflow definitions of Argo Workflows, and discover how it leverages Kubernetes to provide superior scaling capabilities for data pipelines. Learn why Argo Workflows is the preferred choice for expanding teams distributed across multiple regions and zones, eliminating dependencies on specific tech stacks. Gain insights into running example jobs and understand how Argo Workflows and Kubernetes offer distinct scaling advantages for any data pipeline user.

Syllabus

Comparing Argo Workflows and Airflow in a Distributed Environment

Taught by

CNCF [Cloud Native Computing Foundation]

Related Courses

Cloud Computing Concepts, Part 1
University of Illinois at Urbana-Champaign via Coursera Cloud Computing Concepts: Part 2
University of Illinois at Urbana-Champaign via Coursera Reliable Distributed Algorithms - Part 1
KTH Royal Institute of Technology via edX Introduction to Apache Spark and AWS
University of London International Programmes via Coursera Réalisez des calculs distribués sur des données massives
CentraleSupélec via OpenClassrooms