The Koala Benchmarks for the Shell - Characterization and Implications

Learn about KOALA, a comprehensive benchmark suite designed for performance-oriented research targeting Unix and Linux shell environments in this 13-minute conference presentation from USENIX ATC '25. Discover how this award-winning research systematically collects diverse shell programs from real-world tasks, providing various inputs for both small and large deployments along with extensive analysis tools for better understanding. Explore how KOALA benchmarks perform common shell tasks while combining major POSIX shell language features and utilizing POSIX, GNU Coreutils, and third-party components across inputs of varying sizes and compositions. Examine the application of KOALA to four different systems designed to accelerate shell programs, gaining insights into their trade-offs and key results while contributing to a deeper understanding of shell acceleration systems. Access the benchmarks through both permanent archival storage and scalable cloud storage, with additional infrastructure and tooling designed for usability and reproducibility in systems research.