Create Dynamic DAGs with Apache Airflow
Offered By: Pluralsight
Course Description
Overview
Unlock the full potential of your data workflows and elevate your data engineering skills with dynamic DAGs in Apache Airflow. This course will teach you what a dynamic DAG is and how to build dynamic DAGs.
Data pipelines are a vital part of any data platform. Ensuring these pipelines perform well and are easy to maintain is crucial for a successful data platform. In this course, Create Dynamic DAGs with Apache Airflow, you’ll gain the ability to identify and build dynamic DAGs using Apache Airflow. First, you’ll explore how to define a dynamic DAG. Next, you’ll discover building dynamic DAGs using variables and macros. Finally, you’ll learn how to understand the difference between dynamic and static DAGs. When you’re finished with this course, you’ll have the skills and knowledge of dynamic DAGs in Apache Airflow needed to identify and build dynamic DAGs for your data platform.
Data pipelines are a vital part of any data platform. Ensuring these pipelines perform well and are easy to maintain is crucial for a successful data platform. In this course, Create Dynamic DAGs with Apache Airflow, you’ll gain the ability to identify and build dynamic DAGs using Apache Airflow. First, you’ll explore how to define a dynamic DAG. Next, you’ll discover building dynamic DAGs using variables and macros. Finally, you’ll learn how to understand the difference between dynamic and static DAGs. When you’re finished with this course, you’ll have the skills and knowledge of dynamic DAGs in Apache Airflow needed to identify and build dynamic DAGs for your data platform.
Syllabus
- Course Overview 2mins
- Understanding and Building Dynamic DAGs in Apache Airflow 14mins
Taught by
Matt Stenzel
Related Courses
内存数据库管理openHPI CS115x: Advanced Apache Spark for Data Science and Data Engineering
University of California, Berkeley via edX Processing Big Data with Azure Data Lake Analytics
Microsoft via edX Google Cloud Big Data and Machine Learning Fundamentals en Español
Google Cloud via Coursera Google Cloud Big Data and Machine Learning Fundamentals 日本語版
Google Cloud via Coursera