YoVDO

RingLeader - Efficiently Offloading Intra-Server Orchestration to NICs

Offered By: USENIX via YouTube

Tags

USENIX Symposium on Networked Systems Design and Implementation (NSDI) Courses Performance Tuning Courses Network Infrastructure Courses Load Balancing Courses

Course Description

Overview

Explore a cutting-edge approach to intra-server orchestration in this conference talk from NSDI '23. Dive into RingLeader, a novel system that offloads orchestration tasks to Network Interface Cards (NICs) to improve datacenter server performance. Learn how this innovative solution addresses the challenges of load balancing, request scheduling, and CPU allocation in high-performance environments. Discover the architecture of RingLeader's programmable NIC, featuring new hardware units for software-informed load balancing and scheduling, as well as a lightweight OS-NIC interface for enhanced coordination. Examine the results of experiments conducted with a 100 Gbps FPGA-based prototype, demonstrating RingLeader's superior scalability, efficiency, latency, and throughput compared to state-of-the-art software-only orchestrators like Shinjuku and Caladan.

Syllabus

NSDI '23 - RingLeader: Efficiently Offloading Intra-Server Orchestration to NICs


Taught by

USENIX

Related Courses

Scaling Memcache at Facebook
USENIX via YouTube
Multi-Person Localization via RF Body Reflections
USENIX via YouTube
Opaque - An Oblivious and Encrypted Distributed Analytics Platform
USENIX via YouTube
Live Video Analytics at Scale with Approximation and Delay-Tolerance
USENIX via YouTube
Clipper - A Low-Latency Online Prediction Serving System
USENIX via YouTube