In-Memory Key-Value Store Live Migration with NetMigrate

Explore an innovative approach to live migration for in-memory key-value stores in this 18-minute conference talk from FAST '24. Discover NetMigrate, a system that leverages programmable network data planes to enable seamless shard migration between nodes with zero service interruption and minimal performance impact. Learn how this technique monitors the migration process in real-time, directing client queries efficiently and eliminating the need for data pulling between nodes. Examine the implementation of a NetMigrate prototype on a testbed with a programmable switch and commodity servers running Redis. Analyze experimental results demonstrating significant improvements in query throughput and low access latency during migration compared to existing approaches. Gain insights into enhancing distributed key-value store performance for dynamic workload changes, load balancing, data locality, and service elasticity.

FAST '24 - In-Memory Key-Value Store Live Migration with NetMigrate