Heterogeneous Memory Management

Explore heterogeneous memory management in this Linux Plumbers Conference talk. Delve into the challenges of memory management in heterogeneous computing, focusing on issues related to massively parallel devices like GPUs. Learn about unified address space solutions such as Share Virtual Memory (SVM) and Share Virtual Address (SVA), examining both hardware and software approaches. Discover how these solutions impact device memory usage and data sharing between devices and CPUs. Investigate memory placement considerations in a world encompassing both CPUs and devices like GPUs, and explore the complexities of memory hierarchy, from High Bandwidth Memory (HBM) to persistent memory. Gain insights into migrating memory, placing data structures, and navigating system memory topology in heterogeneous computing environments.

Intro
EVERYTHING IS A POINTER
SPLIT ADDRESS SPACE
SHARE VIRTUAL ADDRESS SPACE
SVA WITH HARDWARE
SVA WITH SOFTWARE
SVA: HARDWARE OR SOFTWARE ?
SVA: HARDWARE AND SOFTWARE
DEVICE MEMORY: YOU WANT IT!
MIGRATING MEMORY
PLACING DATA STRUCTURE
IT ALL GETS HARDER!
SYSTEM MEMORY TOPOLOGY
WHERE WE ARE. WHERE TO GO