Too Big for DAG Factories?

Offered By: EuroPython Conference via YouTube

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!

Discover how to dynamically generate thousands of DAGs (Directed Acyclic Graphs) with Airflow in this 29-minute conference talk from EuroPython 2023. Explore use cases for transforming, optimizing, and scaling data workflows. Learn valuable techniques to enhance your data processing capabilities and streamline complex operations. Gain insights into advanced Airflow functionalities and best practices for managing large-scale data pipelines.

Syllabus

Too Big for DAG Factories? — Calvin Hendryx-Parker

Taught by

EuroPython Conference

Related Courses

A Brief History of Data Storage
EuroPython Conference via YouTube Breaking the Stereotype - Evolution & Persistence of Gender Bias in Tech
EuroPython Conference via YouTube We Can Get More from Spatial, GIS, and Public Domain Datasets
EuroPython Conference via YouTube Using NLP to Detect Knots in Protein Structures
EuroPython Conference via YouTube The Challenges of Doing Infra-As-Code Without "The Cloud"
EuroPython Conference via YouTube