Skyplane - Optimizing Transfer Cost and Throughput Using Cloud-Aware Overlays

Explore a 16-minute conference talk from USENIX NSDI '23 that introduces Skyplane, an innovative system for optimizing bulk data transfers between cloud object stores. Learn how cloud-aware network overlays can significantly improve inter-region transfer throughput while managing cloud egress costs. Discover how Skyplane's planner utilizes mixed-integer linear programming to determine optimal overlay paths and resource allocation, balancing price and performance constraints. Gain insights into how this approach outperforms existing public cloud transfer services, achieving up to 4.6x improvement for intra-cloud transfers and 5.0x for cross-cloud transfers. Understand the growing importance of efficient data distribution across multiple regions and cloud providers in modern cloud applications.

NSDI '23 - Skyplane: Optimizing Transfer Cost and Throughput Using Cloud-Aware Overlays