YoVDO

4 Tricks to Leverage Your Airflow Pipelines

Offered By: Conf42 via YouTube

Tags

Apache Airflow Courses DevOps Courses Configuration Management Courses Data Pipelines Courses Event-Driven Architecture Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Discover four powerful techniques to enhance your Airflow pipelines in this DevOps conference talk. Learn how to create typical DAGs using CSV files and sharable configs, autogenerate DAGs based on Airflow entities, and transform your pipelines into event-driven systems. Gain practical insights from Aliaksandr Sheliutsin's presentation at Conf42 DevOps 2024, covering topics such as CSV-based DAG creation, config-driven DAG generation, entity-based DAG autogeneration, and implementing event-driven pipelines in Airflow.

Syllabus

intro
preamble
about aliaksandr
1: you can create typical dags based on a csv file
2: you can create typical dags based on a sharable config
3: autogenerate dags based on the airflow entities
4: make your airflow pipeline event-driven
have questions?


Taught by

Conf42

Related Courses

Google Cloud Big Data and Machine Learning Fundamentals en Español
Google Cloud via Coursera
Data Analysis with Python
IBM via Coursera
Intro to TensorFlow 日本語版
Google Cloud via Coursera
TensorFlow on Google Cloud - Français
Google Cloud via Coursera
Freedom of Data with SAP Data Hub
SAP Learning