YoVDO

CRaft - An Erasure-coding-supported Version of Raft for Reducing Storage Cost

Offered By: USENIX via YouTube

Tags

FAST (File and Storage Technologies) Courses Distributed Systems Courses Fault Tolerance Courses Consensus Protocol Courses Storage Optimization Courses Reed-Solomon Codes Courses Erasure Coding Courses

Course Description

Overview

Explore a 27-minute conference talk from USENIX FAST '20 that introduces CRaft, an innovative version of the Raft consensus protocol incorporating erasure coding to reduce storage and network costs. Delve into the challenges of combining erasure coding with crash tolerance in distributed systems, and learn how CRaft maintains the same liveness as Raft while achieving significant improvements in storage efficiency, write throughput, and latency. Examine the implementation of CRaft in a key-value store and analyze its performance compared to the original Raft protocol. Gain insights into the technical aspects of consensus protocols, data replication strategies, and the application of Reed-Solomon codes in distributed systems.

Syllabus

Intro
Data replication: when server crashes...
Raft: distributed consensus
Erasure Coding: Reed-Solomon Code
Combine erasure coding with crash tolerance?
CRaft: erasure coding + Raft
Challenge #1: liveness
Challenge #2: newly elected leader
Comparing consensus protocols
Evaluation highlights
Evaluation setup
Evaluation: read latency
Summary: Craft
Evaluation: liveness


Taught by

USENIX

Related Courses

Understanding the Robustness of SSDs under Power Fault
USENIX via YouTube
BetrFS - A Right-Optimized Write-Optimized File System
USENIX via YouTube
F2FS - A New File System for Flash Storage
USENIX via YouTube
DNA Data Storage and Near-Molecule Processing for the Yottabyte Era
USENIX via YouTube
FAST '21 Work-in-Progress Reports
USENIX via YouTube