Tailbench: a benchmark suite and evaluation methodology for latency-critical applications
Name
Sanchez_Tailbench.pdf
Size
583.85 KB
Format
Adobe PDF
Checksum (MD5)
1d69b04c72e77b244d7f6b0d8c9d0e12
Author(s)
Kasture, Harshad
Sanchez, Daniel
Date Issued
September 2016
Journal
2016 IEEE International Symposium on Workload Characterization (IISWC)
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Citation
Kasture, Harshad, and Daniel Sanchez. “Tailbench: a Benchmark Suite and Evaluation Methodology for Latency-Critical Applications.” 2016 IEEE International Symposium on Workload Characterization (IISWC) (September 2016). IEEE, 2016, pp. 1–10.
Version
Author's final manuscript
Abstract
Latency-critical applications, common in datacenters, must achieve small and predictable tail (e.g., 95th or 99th percentile) latencies. Their strict performance requirements limit utilization and efficiency in current datacenters. These problems have sparked research in hardware and software techniques that target tail latency. However, research in this area is hampered by the lack of a comprehensive suite of latency-critical benchmarks. We present TailBench, a benchmark suite and evaluation methodology that makes latency-critical workloads as easy to run and characterize as conventional, throughput-oriented ones. TailBench includes eight applications that span a wide range of latency requirements and domains, and a harness that implements a robust and statistically sound load-testing methodology. The modular design of the TailBench harness facilitates multiple load-testing scenarios, ranging from multi-node configurations that capture network overheads, to simplified single-node configurations that allow measuring tail latency in simulation. Validation results show that the simplified configurations are accurate for most applications. This flexibility enables rapid prototyping of hardware and software techniques for latency-critical workloads.
MIT Department
Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Terms of Use
Creative Commons Attribution-Noncommercial-Share Alike
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1109/IISWC.2016.7581261
