Orchestrating Your Data Pipelines with Apache Airflow

Explore the world of data pipeline orchestration with Apache Airflow in this 32-minute conference talk from GOTO Amsterdam 2022. Dive into the key components of Apache Airflow and learn how to build simple pipelines to orchestrate your own data workflows. Follow along as Ricardo Sueiras, Principal Advocate in Open Source at AWS, demonstrates the tool's capabilities through practical examples. Discover how Apache Airflow allows you to configure data pipelines as scripts, monitor them with an intuitive user interface, and extend functionality through community-developed and custom plugins. Gain insights into Apache Airflow's evolution and learn how to contribute to this open-source project. Perfect for data engineers and professionals looking to streamline their data pipeline management processes.

Intro
What is in your data pipeline?
Introducing Apache Airflow
Demo
Building our data pipeline demo
Demo
Apache Airflow evolution
How to contribute
Outro