Pushing the Limits of In-Network Caching for Key-Value Stores

Explore a groundbreaking conference presentation that introduces OrbitCache, an innovative in-network caching architecture designed to revolutionize key-value store performance. Learn how this novel approach differs from traditional caching methods by avoiding the storage of hot items in switch memory, instead utilizing packet recirculation to make hot items continuously revisit the switch data plane. Discover how OrbitCache overcomes hardware constraints that typically limit item sizes in network caching systems, enabling the caching of variable-length items to effectively balance diverse key-value workloads. Examine the practical implementation of an OrbitCache prototype on an Intel Tofino switch and analyze experimental results demonstrating its capability to handle highly skewed workloads while maintaining robustness across various system conditions. Gain insights into cutting-edge networking research that pushes the boundaries of in-network computing and caching technologies, presented by Gyuyeong Kim from Sungshin Women's University at the USENIX Networked Systems Design and Implementation conference.