ExoFlow - A Universal Workflow System for Exactly-Once DAGs

Offered By: USENIX via YouTube

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!

Explore a groundbreaking universal workflow system in this conference talk from OSDI '23. Dive into ExoFlow, a system designed to provide flexible recovery and performance tradeoffs within the same application. Learn how ExoFlow decouples execution from recovery, offering exactly-once semantics as a separate layer. Discover the innovative use of task annotations to specify execution semantics, enabling the workflow system and end-users to control recovery processes. Understand how ExoFlow generalizes recovery for various workflow applications, from ETL pipelines to stateful serverless workflows, while introducing optimizations in task communication and recovery. Gain insights into the challenges of implementing interoperable recovery techniques in heterogeneous pipelines and how ExoFlow addresses these issues.

Syllabus

OSDI '23 - ExoFlow: A Universal Workflow System for Exactly-Once DAGs

Taught by

USENIX

Related Courses

Online Master of Computer Science
Arizona State University via Coursera Blockchain Scalability and its Foundations in Distributed Systems
The University of Sydney via Coursera Blockchain Fundamentals: Understanding the Origins, Mechanisms, and Applications of Decentralized Systems
SDA Bocconi School of Management via edX Blockchain Technology
University of California, Berkeley via edX Building Globally Distributed Databases with Cosmos DB
Coursera Project Network via Coursera