Dynamic Workflow Orchestration with Apache Airflow and CrateDB

Explore dynamic workflow orchestration using Apache Airflow and CrateDB in this 30-minute Devoxx conference talk. Learn how to automate and orchestrate complex database processes in the era of increasingly complex data solutions. Discover the power of Apache Airflow, a popular platform for programmatically creating, scheduling, and monitoring workflows using directed acyclic graphs (DAGs). Understand the benefits of Airflow's dynamic task mapping feature introduced in version 2.3, which enables building dynamic workflows. Get acquainted with CrateDB, an open-source distributed database designed for efficient storage and analysis of massive amounts of data, offering scalability, flexibility, and compatibility with various data engineering tools. Gain practical insights on setting up a new orchestration project and leveraging the combination of Airflow and CrateDB to orchestrate complex tasks, providing you with a scalable and easily manageable solution for your database orchestration needs.

Dynamic workflow orchestration with Apache Airflow and CrateDB by Marija Selakovic