Lmbench: An extensible micro-benchmark suite

Software - Practice and Experience

Volumn 35, Issue 11, 2005, Pages 1079-1105

  Staelin, Carl ^a  

^a HEWLETT PACKARD LABORATORIES   (United States)

Author keywords

Measurement; Micro benchmarking; Performance analysis

Indexed keywords

COMPUTER ARCHITECTURE; MEASUREMENTS; PERFORMANCE; USER INTERFACES;

MICRO-BENCHMARKING; PERFORMANCE ANALYSIS; SYSTEM PERFORMANCE;

BENCHMARKING;

EID: 25144461494     PISSN: 00380644     EISSN: None     Source Type: Journal    
DOI: 10.1002/spe.665     Document Type: Article

References (33)

1. Brown A, Seltzer M. Operating system benchmarking in the wake of lmbench: A case study of the performance of NetBSD on the Intel x86 architecture. Proceedings of the 1997 ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems, Seattle, WA, June 1997. Association for Computing Machinery, 1997; 214-224. Available at: http://www.eecs.harvard.edu/~vino/perf/hbench/ sigmetrics/hbench.html.
2. McCalpin JD. Memory bandwidth and machine balance in current high performance computers. IEEE Technical Committee on Computer Architecture Newsletter, December 1995. Available at: http://tab.computer.org/tcca/news/ dec95/dec95_mccalpin.ps.
3. Mogul JC. Brittle metrics in operating systems research. Proceedings of the 7th IEEE Workshop on Hot Topics in Operating Systems (HotOS-VII), Rio Rico, AZ, March 1999. USENIX Association, 1999; 90-95. Available at: http://research.compaq.com/wrl/people/mogul/mogulhotos7.ps.
4. Whaley RC, Dongarra J. Automatically tuned linear algebra software. UT-CS-97-366, Department of Computer Science, University of Tennessee, Knoxville, 1997. Available at: http://math-atlas.sourceforge.net/.
5. Standard Performance Evaluation Corporation, SPEC hpc96 benchmark, 1996. http://www.specbench.org/hpg/hpc96/ [10 February 2005].
6. Weicker RP. Dhrystone: A synthetic systems programming benchmark. Communications of the ACM 1984; 27(10):1013-1030.
7. Banga G, Druschel P. Measuring the capacity of a Web server. Proceedings of the USENIX Symposium on Internet Technologies and Systems, Monterey, CA, December 1997. USENIX Association, 1997; 61-71. Available at: http://www.usenix.org/publications//library/proceedings/usits97/full_papers/ banga/banga.pdf.
8. Banga G, Mogul JC. Scalable kernel performance for Internet servers under realistic loads. Proceedings of the 1998 USENIX Annual Technical Conference, New Orleans, LA, June 1998. USENIX Association, 1998; 69-83. Available at: http://www.usenix.org/publications//library/proceedings/usenix98/full_papers/ anga/anga.pdf.
9. Shein B, Callahan M, Woodbury P. NFSSTONE: A network file server performance benchmark. Proceedings of the USENIX Summer Conference, Baltimore, MD, June 1989. USENIX Association, 1989; 269-275.
10. Prestor U. Evaluating the memory performance of a ccnuma system. MS Thesis, Department of Computer Science, University of Utah, May 2001.
11. Saavedra RH, Smith AJ. Measuring cache and TLB performance and their effect on benchmark runtimes. IEEE Transactions on Computers 1995; 44(10):1223-1235.
12. Hristea C, Lenoski D, Keen J. Measuring memory hierarchy performance of cache-coherent multiprocessors using microbenchmarks. Proceedings of Supercomputing '97, San Jose, CA, November 1997. IEEE Computer Society Press, 1997; 1-12.
13. Saavedra-Barrera RH. CPU performance evaluation and execution time prediction using narrow spectrum benchmarking. PhD Thesis, Department of Computer Science, University of California at Berkeley, 1992.
14. Seltzer M, Krinsky D, Smith K, Zhang X. The case for application-specific benchmarking. Proceedings of the 1999 Workshop on Hot Topics in Operating Systems, Rico, AZ. USENIX Association, 1999; 102-107.
15. Park A, Becker JC. IOStone: A synthetic file system benchmark. Computer Architecture News 1990; 18(2):45-52.
16. Wolman BL, Olson TM. IOBENCH: A system independent IO benchmark. Computer Architecture News 1989; 17(5):55-70.
17. Howard J, Kazar M, Menees S, Nichols S, Satyanrayanan M, Sidebotham R, West M. Scale and performance in a distributed system. ACM Transactions on Computer Systems 1988; 6(1):51-81.
18. Bray T. Bonnie benchmark, 1990. http://www.textuality.com/bonnie/ [10 February 2005].
19. Chen PM, Patterson D. Storage performance: Metrics and benchmarks. Proceedings of the IEEE 1993; 81(8):1151-1165.
20. Chen PM, Patterson DA. A new approach to I/O performance evaluation: Self-scaling I/O benchmarks, predicted I/O performance. Transactions on Computer Systems 1994; 12(4):308-339.
21. Smith KA, Seltzer ML. File system aging: Increasing the relevance of file system benchmarks. Proceedings of the 1997 SIGMETRICS Conference, Seattle, WA, June 1997. Association for Computing Machinery, 1997; 203-213.
22. PARallel Kernels and BENCHmarks committee. PARKBENCH, 2002. http://www.netlib.org/parkbench/ [10 February 2005].
23. NASA Advanced Supercomputing Division, NASA Ames Research Center. NAS parallel benchmarks. http://www.nas.nasa.gov/NAS/NPB [10 February 2005].
24. Glendinning I. GENESIS distributed memory benchmark suite, 1994. http://wotug.ukc.ac.uk/parallel/performance/benchmarks/genesis [10 February 2005].
25. McVoy L, Staelin C. lmbench: Portable tools for performance analysis. Proceedings of the USENIX Winter Conference, San Diego, CA, January 1996. USENIX Association, 1996; 279-284.
26. Staelin C, McVoy L. mhz: Anatomy of a microbenchmark. Proceedings of the USENIX Annual Technical Conference, New Orleans, LA, June 1998. USENIX Association, 1998; 155-166.
27. Jain R. The Art of Computer Systems Performance Analysis: Techniques for Experimental Design, Measurement, Simulation, and Modeling. Wiley-Interscience: New York, 1991.
28. Efron B, Tibshirani RJ. An Introduction to the Bootstrap (Monographs on Statistics and Applied Probability, vol. 57). Chapman and Hall: New York, 1993.
29. Gilat D. Hill TP. Strongly-consistent, distribution-free confidence intervals for quartiles. Statistics and Probability Letters 1996; 29:45-53. Available at: http://www.math.gatech.edu/~hill/publications/cv.dir/dg.pdf.
30. McCalpin JD. The stream2 home page, 2002. http://www.cs.virginia.edu/ stream/stream2/ [10 February 2005].
31. TheFreeDictionary.com. Fused multiply add, 2004. http://encyclopedia. thefreedictionary.com/Fused%20Multiply%20Add [10 February 2005].
32. Intel Corporation. Profusion: An 8-way symmetric multiprocessing chipset. Whitepaper, July 1999.
33. Zhou T. Profusion architecture, November 1999. http://www.WindowsITPro. com/Windows/Article/ArticleID/7273/7273.html [10 February 2005].