Airflow - Zero to Hero

Learn the fundamentals of Apache Airflow in this comprehensive tutorial. Begin by installing and running Airflow using Docker and docker-compose. Explore core concepts and create your first Directed Acyclic Graph (DAG) using PythonOperator. Gain insights into task retries and learn how to pass metadata between tasks with XCOM. Discover the power of BranchPythonOperator for task branching and utilize sensors to detect files. Finally, master the use of hooks to connect to various file sources, equipping you with essential skills for efficient workflow management and automation.

[Getting started with Airflow - 1] Installing and running Airflow using docker and docker-compose.
[Getting started with Airflow - 2] Core concepts and creating your first DAG with PythonOperator.
[Getting started with Airflow - 3] Understanding task retries.
[Getting started with Airflow - 4] Passing metadata in between tasks with XCOM.
[Getting started with Airflow - 5] Using BranchPythonOperator to branch between tasks.
[Getting started with Airflow - 6] Using sensors to sense files.
[Getting started with Airflow - 7] Using hooks to connect to file sources.