Tail Latency Courses and Certifications

USENIX

XRT - An Accelerator-Aware Runtime for Accelerated Chip Multiprocessors

Discover XRT, a runtime system designed for accelerated chip multiprocessors that optimizes on-chip accelerator usage to achieve up to 3.2× higher throughput in datacenter applications.

• YouTube
• 15 minutes
• On-Demand
• Free Video

USENIX

LDB: An Efficient Latency Profiling Tool for Multithreaded Applications

Efficient latency profiling tool for multithreaded applications, using stack sampling and event tagging to identify tail latency issues in datacenter systems with low overhead.

• YouTube
• 20 minutes
• On-Demand
• Free Video

Strange Loop Conference

Measuring and Optimizing Tail Latency

Explore techniques for measuring and optimizing tail latency in data centers, focusing on innovative tools, methodologies, and approaches to enhance server efficiency and user experience.

• YouTube
• 52 minutes
• On-Demand
• Conference Talk

USENIX

How to Trade off Server Utilization and Tail Latency

Explore the trade-offs between server utilization and tail latency in large-scale systems. Learn queueing theory basics, analyze typical outcomes, and gain practical insights for optimizing system performance.

• YouTube
• 28 minutes
• On-Demand
• Conference Talk

USENIX

AegonKV: A High Bandwidth, Low Tail Latency, and Low Storage Cost KV-Separated LSM Store

Discover AegonKV, a SmartSSD-based key-value store that significantly improves throughput, reduces tail latency, and minimizes storage costs through innovative garbage collection offloading for LSM-based systems.

• YouTube
• 16 minutes
• On-Demand
• Free Video

USENIX

Scalable Tail Latency Estimation for Data Center Networks

Innovative techniques for fast and accurate estimation of flow-level tail latency in large-scale data center networks, overcoming limitations of traditional simulators and recent machine learning approaches.

• YouTube
• 16 minutes
• On-Demand
• Conference Talk

USENIX

SKQ - Event Scheduling for Optimizing Tail Latency in a Traditional OS Kernel

Explore SKQ, a FreeBSD Kqueue redesign that significantly improves application tail latency and low-latency throughput through scalable architecture and event scheduling policies.

• YouTube
• 15 minutes
• On-Demand
• Conference Talk

USENIX

AUGUR: Practical Mobile Multipath Transport Service for Low Tail Latency in Real-Time Streaming

Innovative multipath transport service reducing latency and frame stalls in mobile real-time streaming while minimizing cellular data usage, demonstrated through cloud gaming deployment.

• YouTube
• 17 minutes
• On-Demand
• Free Video

Gopher Academy

Profiling Request Latency with Critical Path Analysis

Discover how to diagnose Go request latency issues using critical path analysis to identify Off-CPU bottlenecks without instrumentation overhead.

• YouTube
• 25 minutes
• On-Demand
• Free Video

USENIX

Hermit - Low-Latency, High-Throughput, and Transparent Remote Memory via Feedback-Directed Asynchrony

Innovative remote memory system using adaptive asynchrony to significantly improve latency and throughput in datacenters without modifying user code.

• YouTube
• 18 minutes
• On-Demand
• Conference Talk

USENIX

Gryff - Unifying Consensus and Shared Registers

Unifying consensus and shared registers for geo-replicated storage with linearizability and low tail latency. Introduces carstamps for efficient ordering of reads and writes in distributed systems.

• YouTube
• 20 minutes
• On-Demand
• Conference Talk

USENIX

Size-Aware Sharding for Improving Tail Latencies in In-Memory Key-Value Stores

Innovative size-aware sharding technique for in-memory key-value stores, reducing tail latencies and improving throughput by avoiding head-of-line blocking and optimizing request distribution across cores.

• YouTube
• 23 minutes
• On-Demand
• Conference Talk

USENIX

Caladan - Mitigating Interference at Microsecond Timescales

Explore a new CPU scheduler that achieves better quality of service through fast core allocation, outperforming resource partitioning systems in managing microsecond-scale interference between tasks.

• YouTube
• 20 minutes
• On-Demand
• Conference Talk

USENIX

PinK - High-speed In-storage Key-value Store with Bounded Tails

Explore high-speed in-storage key-value systems with PinK, an innovative LSM-tree-based design that significantly improves performance and reduces latency in resource-constrained environments.

• YouTube
• 22 minutes
• On-Demand
• Conference Talk

DevConf

UKELELE: Optimizing Event Handling for Modern Server Applications

Explore UKELELE, a high-performance event handling system for modern server applications. Learn about its optimizations, improved throughput, and reduced tail latency compared to current Linux solutions.

• YouTube
• 30 minutes
• On-Demand
• Free Video