Too Big for DAG Factories?
Offered By: EuroPython Conference via YouTube
Course Description
Overview
Discover how to dynamically generate thousands of DAGs (Directed Acyclic Graphs) with Airflow in this 29-minute conference talk from EuroPython 2023. Explore use cases for transforming, optimizing, and scaling data workflows. Learn valuable techniques to enhance your data processing capabilities and streamline complex operations. Gain insights into advanced Airflow functionalities and best practices for managing large-scale data pipelines.
Syllabus
Too Big for DAG Factories? — Calvin Hendryx-Parker
Taught by
EuroPython Conference
Related Courses
Data AnalysisJohns Hopkins University via Coursera Computing for Data Analysis
Johns Hopkins University via Coursera Scientific Computing
University of Washington via Coursera Introduction to Data Science
University of Washington via Coursera Web Intelligence and Big Data
Indian Institute of Technology Delhi via Coursera