Fair Scheduling for AVX2 and AVX-512 Workloads

Explore a conference talk from USENIX ATC '21 that addresses fair scheduling for AVX2 and AVX-512 workloads. Delve into the challenges posed by power-limited CPUs and their impact on performance isolation when executing complex SIMD instructions. Learn about a novel approach to modify existing schedulers, aiming to restore fairness in scenarios involving power-intensive tasks. Discover techniques for identifying AVX2/AVX-512 tasks responsible for frequency reduction and adjusting CPU time accounting to prioritize affected processes. Examine the effectiveness of this prototype in reducing performance disparities between non-AVX and AVX-512 tasks from 24.9% to 5.4% on average. Gain insights into power-limited computing, frequency reduction compensation, and methods for detecting AVX2/AVX-512 usage, along with an evaluation of the implementation's overhead and remaining challenges.

Intro
AVX2/AVX-512 and Fairness
Power-Limited Computing
Example: AVX2 AVX-512
Unfairness in Existing Schedulers
Rethinking Fairness
Frequency Reduction Compensation
Estimating the Frequency Drop
Detecting AVX2 AVX-512
Implementation
Evaluation Setup
Remaining Unfairness (AVX-512)
Overhead
Summary