Create Dynamic DAGs with Apache Airflow
Offered By: Pluralsight
Course Description
Overview
Unlock the full potential of your data workflows and elevate your data engineering skills with dynamic DAGs in Apache Airflow. This course will teach you what a dynamic DAG is and how to build dynamic DAGs.
Data pipelines are a vital part of any data platform. Ensuring these pipelines perform well and are easy to maintain is crucial for a successful data platform. In this course, Create Dynamic DAGs with Apache Airflow, you’ll gain the ability to identify and build dynamic DAGs using Apache Airflow. First, you’ll explore how to define a dynamic DAG. Next, you’ll discover building dynamic DAGs using variables and macros. Finally, you’ll learn how to understand the difference between dynamic and static DAGs. When you’re finished with this course, you’ll have the skills and knowledge of dynamic DAGs in Apache Airflow needed to identify and build dynamic DAGs for your data platform.
Data pipelines are a vital part of any data platform. Ensuring these pipelines perform well and are easy to maintain is crucial for a successful data platform. In this course, Create Dynamic DAGs with Apache Airflow, you’ll gain the ability to identify and build dynamic DAGs using Apache Airflow. First, you’ll explore how to define a dynamic DAG. Next, you’ll discover building dynamic DAGs using variables and macros. Finally, you’ll learn how to understand the difference between dynamic and static DAGs. When you’re finished with this course, you’ll have the skills and knowledge of dynamic DAGs in Apache Airflow needed to identify and build dynamic DAGs for your data platform.
Syllabus
- Course Overview 2mins
- Understanding and Building Dynamic DAGs in Apache Airflow 14mins
Taught by
Matt Stenzel
Related Courses
Introduction to Airflow in PythonDataCamp Building Data Engineering Pipelines in Python
DataCamp The Complete Hands-On Introduction to Apache Airflow
Udemy Apache Airflow: The Hands-On Guide
Udemy ETL and Data Pipelines with Shell, Airflow and Kafka
IBM via Coursera