YoVDO

ExoFlow - A Universal Workflow System for Exactly-Once DAGs

Offered By: USENIX via YouTube

Tags

USENIX Symposium on Operating Systems Design and Implementation (OSDI) Courses Distributed Systems Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore a groundbreaking universal workflow system in this conference talk from OSDI '23. Dive into ExoFlow, a system designed to provide flexible recovery and performance tradeoffs within the same application. Learn how ExoFlow decouples execution from recovery, offering exactly-once semantics as a separate layer. Discover the innovative use of task annotations to specify execution semantics, enabling the workflow system and end-users to control recovery processes. Understand how ExoFlow generalizes recovery for various workflow applications, from ETL pipelines to stateful serverless workflows, while introducing optimizations in task communication and recovery. Gain insights into the challenges of implementing interoperable recovery techniques in heterogeneous pipelines and how ExoFlow addresses these issues.

Syllabus

OSDI '23 - ExoFlow: A Universal Workflow System for Exactly-Once DAGs


Taught by

USENIX

Related Courses

Advanced Operating Systems
Georgia Institute of Technology via Udacity High Performance Computing
Georgia Institute of Technology via Udacity GT - Refresher - Advanced OS
Georgia Institute of Technology via Udacity Distributed Machine Learning with Apache Spark
University of California, Berkeley via edX CS125x: Advanced Distributed Machine Learning with Apache Spark
University of California, Berkeley via edX