Automated detection of performance regressions: The Mono experience

Proceedings - IEEE Computer Society's Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems, MASCOTS

Volumn 2005, Issue , 2005, Pages 183-190

  Kalibera, Tomas ^a   Bulej, Lubomir ^a,b   Tuma, Petr ^a  

^a CHARLES UNIVERSITY   (Czech Republic)

^b INSTITUTE OF COMPUTER SCIENCE   (Czech Republic)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATION; BENCHMARKING; COMPUTER SYSTEMS; REGRESSION ANALYSIS; STATISTICAL METHODS;

AUTOMATED BENCHMARKING; MONO OPEN SOURCE PROJECT; SOFTWARE PROJECT;

SOFTWARE ENGINEERING;

EID: 33646904518     PISSN: 15267539     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/MASCOTS.2005.18     Document Type: Conference Paper

References (14)

1. A. Buble, L. Bulej, and P. Tuma. Corba benchmarking: A course with hidden obstacles. In IPDPS, page 279. IEEE Computer Society, 2003.
2. L. Bulej, T. Kalibera, and P. Tuma. Regression benchmarking with simple middleware benchmarks. In H. Hassanein, R. L. Olivier, G. G. Richard, and L. L. Wilson, editors, International Workshop on Middleware Performance, IPCCC 2004, pages 771-776, 2004.
3. L. Bulej, T. Kalibera, and P. Tuma. Repeated results analysis for middleware regression benchmarking. Performance Evaluation, 60(1-4):345-358, May 2005.
4. Distributed Systems Research Group. Mono regression benchmarking, http://nenya.ms.mff.cuni.cz/projects/mono, 2005.
5. ECMA. ECMA-335: Common Language Infrastructure (CLI). ECMA (European Association for Standardizing Information and Communication Systems), Geneva, Switzerland, Dec. 2002.
6. C. Fraley and A. E. Raftery. Mclust: Software for model-based clustering, density estimation and discriminant analysis. Technical Report 415, Department of Statisticis, University of Washington, WA, USA, Oct 2002.
7. C. Fraley and A. E. Raftery. Model-based clustering, discriminant analysis, and density estimation. Journal of the American Statistical Association, 97:611-631, 2002.
8. R. E. Jeffries, A. Anderson, and C. Hendrickson. Extreme Programming Installed. Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA, 2000.
9. T. Kalibera, L. Bulej, and P. Tuma. Benchmark precision and random initial state. In accepted for 2005 International Symposium on Performance Evaluation of Computer and Telecommunications Systems (SPECTS 2005), July 2005.
10. T. Kalibera, L. Bulej, and P. Tuma. Quality assurance in performance: Evaluating mono benchmark results. In accepted for Second International. Workshop on Software Quality (SOQUA 2005), Sept. 2005.
11. C. E. McCulloch and S. R. Searle. Generalized, Linear and Mixed Models. Wiley-Interscience, New York, NY, USA, 2001.
12. Novell, Inc. The Mono Project. http://www.mono-project.com, 2005.
13. R. Pozo and B. Miller. Scimark 2.0 benchmark, http://math.nist.gov/ scimark2/, 2005.
14. C. Re and W. Vogels. Scimark-c#. http://rotor.cs.cornell.edu/SciMark/, 2004.