Crimson - A New Ceph OSD for the Age of Persistent Memory and Fast NVMe Storage

Explore the Crimson project, a new Ceph OSD daemon designed for low latency, high throughput persistent memory and NVMe technologies, in this 27-minute conference talk from USENIX Vault '20. Dive into the design, current status, and future direction of Crimson, built on the seastar C++ framework to minimize latency, CPU overhead, and cross-core communication. Learn about the project's architecture, threading model, and performance improvements compared to classic OSD threads. Discover how Crimson aims to fully exploit modern storage devices and examine its components, including BlueStore, ObjectStore, and Seastore, with a focus on logical structure, LBA indirection, and persistent memory utilization.

Intro
Storage Keeps Getting Faster
CPUs, not so much
Ceph Architecture
RADOS
OSD Threading Architecture
Classic OSD Threads
Crimson!
Programming Model
Crimson Threading Architecture
Current Status
Performance
BlueStore - Alien
BlueStore - Seastar Native
ObiectStore
Seastore - Logical Structure
Seastore - Why use an LBA indirection?
Seastore - Layout
Seastore - Persistent Memory
Questions?