Caladan - Mitigating Interference at Microsecond Timescales

Explore a groundbreaking CPU scheduler called Caladan in this 20-minute conference talk from OSDI '20. Learn how Caladan achieves superior quality of service through fast core allocation instead of resource partitioning, outperforming state-of-the-art systems by 11,000x. Discover how it manages resource contention in the memory hierarchy and between hyperthreads, supporting microsecond-scale monitoring and task placement. Understand the challenges of balancing latency with efficiency, dealing with noisy neighbors, and handling constantly shifting resource usage in modern computing environments. Gain insights into Caladan's components, signal sources, and core allocation strategies, as well as its implementation and evaluation results when colocating memcached with garbage-collected workloads.

Intro
Must Balance Latency with Efficiency
Challenge: Noisy Neighbors
Challenge: Resource Usage Constantly Shifts
Interference Example
Existing Solutions
Challenges at the us-Timescale
Caladan's Contributions
Caladan's Components
Mitigating Interference
Signal Sources
Core Allocation
Example: Mitigating Memory Bandwidth
Implementation
Evaluation
Memcached and GC
Colocating Many Tasks
Requirements for Applications
Conclusion