RingLeader - Efficiently Offloading Intra-Server Orchestration to NICs
Offered By: USENIX via YouTube
Course Description
Overview
Explore a cutting-edge approach to intra-server orchestration in this conference talk from NSDI '23. Dive into RingLeader, a novel system that offloads orchestration tasks to Network Interface Cards (NICs) to improve datacenter server performance. Learn how this innovative solution addresses the challenges of load balancing, request scheduling, and CPU allocation in high-performance environments. Discover the architecture of RingLeader's programmable NIC, featuring new hardware units for software-informed load balancing and scheduling, as well as a lightweight OS-NIC interface for enhanced coordination. Examine the results of experiments conducted with a 100 Gbps FPGA-based prototype, demonstrating RingLeader's superior scalability, efficiency, latency, and throughput compared to state-of-the-art software-only orchestrators like Shinjuku and Caladan.
Syllabus
NSDI '23 - RingLeader: Efficiently Offloading Intra-Server Orchestration to NICs
Taught by
USENIX
Related Courses
Scaling Memcache at FacebookUSENIX via YouTube Multi-Person Localization via RF Body Reflections
USENIX via YouTube Opaque - An Oblivious and Encrypted Distributed Analytics Platform
USENIX via YouTube Live Video Analytics at Scale with Approximation and Delay-Tolerance
USENIX via YouTube Clipper - A Low-Latency Online Prediction Serving System
USENIX via YouTube