Too Big for DAG Factories?
Offered By: EuroPython Conference via YouTube
Course Description
Overview
Discover how to dynamically generate thousands of DAGs (Directed Acyclic Graphs) with Airflow in this 29-minute conference talk from EuroPython 2023. Explore use cases for transforming, optimizing, and scaling data workflows. Learn valuable techniques to enhance your data processing capabilities and streamline complex operations. Gain insights into advanced Airflow functionalities and best practices for managing large-scale data pipelines.
Syllabus
Too Big for DAG Factories? — Calvin Hendryx-Parker
Taught by
EuroPython Conference
Related Courses
内存数据库管理openHPI CS115x: Advanced Apache Spark for Data Science and Data Engineering
University of California, Berkeley via edX Processing Big Data with Azure Data Lake Analytics
Microsoft via edX Google Cloud Big Data and Machine Learning Fundamentals en Español
Google Cloud via Coursera Google Cloud Big Data and Machine Learning Fundamentals 日本語版
Google Cloud via Coursera