YoVDO

Build DAGs Using the Taskflow API in Apache Airflow

Offered By: Pluralsight

Tags

Apache Airflow Courses Data Processing Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Enhance your Airflow workflows using the Taskflow API. This course will teach you how to use the Taskflow API to construct DAGs and pass data between tasks.

Managing and optimizing workflows in Airflow can be challenging without a clear understanding of how to use operators and the Taskflow API effectively. In this course, Build DAGs Using the Taskflow API in Apache Airflow, you’ll gain the ability to create directed acyclic graphs (DAGs) for streamlined data validation, filtering, and passing. First, you’ll set up a simple DAG, with no conditional operations, using Airflow operators for data processing and validation and pass data using XComs. Next, you’ll convert the same DAG to use the Taskflow API using the @task and @dag decorators. You’ll learn how to perform data passing using the “return” keyword, and collect and access the data passed using input arguments. Finally you'll build a more complex DAG which includes conditional branching workflows first using operators and then using the Taskflow API. When you’re finished with this course, you’ll have the skills and knowledge needed to use the Taskflow API to enhance and optimize your workflows efficiently.

Syllabus

  • Course Overview 1min
  • Building DAGs Using the Taskflow API 23mins

Taught by

Janani Ravi

Related Courses

Coding the Matrix: Linear Algebra through Computer Science Applications
Brown University via Coursera
كيف تفكر الآلات - مقدمة في تقنيات الحوسبة
King Fahd University of Petroleum and Minerals via Rwaq (رواق)
Datascience et Analyse situationnelle : dans les coulisses du Big Data
IONIS via IONIS
Data Lakes for Big Data
EdCast
統計学Ⅰ:データ分析の基礎 (ga014)
University of Tokyo via gacco