Orchestration of Data Pipelines Using Airflow
Offered By: NashKnolX via YouTube
Course Description
Overview
Learn to orchestrate data pipelines using Apache Airflow in this 44-minute tutorial. Explore various Airflow operators including Bash Operator for running bash scripts, PythonOperator for executing Python code, SparkOperator for managing Spark jobs, EmailOperator for sending email alerts, and SlackOperator for Slack notifications. Gain practical insights into integrating these operators to create efficient and automated data workflows.
Syllabus
Orchestration of data pipelines using airflow
Taught by
NashKnolX
Related Courses
内存数据库管理openHPI CS115x: Advanced Apache Spark for Data Science and Data Engineering
University of California, Berkeley via edX Processing Big Data with Azure Data Lake Analytics
Microsoft via edX Google Cloud Big Data and Machine Learning Fundamentals en Español
Google Cloud via Coursera Google Cloud Big Data and Machine Learning Fundamentals 日本語版
Google Cloud via Coursera