AI, Data Science & Cloud Certificates from Google, IBM & Meta
Live Online Classes in Design, Coding & AI — Small Classes, Free Retakes
Overview
AI, Data Science & Cloud Certificates from Google, IBM & Meta — 40% Off
One plan covers every Professional Certificate on Coursera. 40% off Coursera Plus Annual.
Unlock All Certificates
Explore a cutting-edge approach to intra-server orchestration in this conference talk from NSDI '23. Dive into RingLeader, a novel system that offloads orchestration tasks to Network Interface Cards (NICs) to improve datacenter server performance. Learn how this innovative solution addresses the challenges of load balancing, request scheduling, and CPU allocation in high-performance environments. Discover the architecture of RingLeader's programmable NIC, featuring new hardware units for software-informed load balancing and scheduling, as well as a lightweight OS-NIC interface for enhanced coordination. Examine the results of experiments conducted with a 100 Gbps FPGA-based prototype, demonstrating RingLeader's superior scalability, efficiency, latency, and throughput compared to state-of-the-art software-only orchestrators like Shinjuku and Caladan.
Syllabus
NSDI '23 - RingLeader: Efficiently Offloading Intra-Server Orchestration to NICs
Taught by
USENIX