Testing randomized software by means of statistical hypothesis tests

SOQUA'07: Fourth International Workshop on Software Quality Assurance - In conjunction with the 6th ESEC/FSE Joint Meeting

Volumn , Issue , 2007, Pages 46-54

  Guderlei, Ralph ^a   Mayer, Johannes ^a   Schneckenburger, Christoph ^a   Fleischer, Frank ^b  

^a UNIVERSITY OF ULM   (Germany)

^b BOEHRINGER INGELHEIM PHARMA GMBH AND CO KG   (Germany)

Author keywords

Randomized software; Statistical hypothesis test; Test evaluation; Test oracle

Indexed keywords

MATHEMATICAL MODELS; PROBABILITY DISTRIBUTIONS; PROBLEM SOLVING; STATISTICAL METHODS;

RANDOMIZED SOFTWARE; STATISTICAL HYPOTHESIS TEST; TEST EVALUATION;

SOFTWARE TESTING;

EID: 38849185052     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1295074.1295084     Document Type: Conference Paper

References (29)

1. Apache Software Foundation. Apache Commons Math homepage, http://jakarta.apache.org/commons/math.
2. J. Bible and G. Rothermel. A unifying framework supporting the analysis and development of safe regression test selection techniques. Technical Report 99-6011, Oregon State University, 1999.
3. R., V. Binder. Testing Object-Oriented Systems. Addison-Wesley, 1999.
4. J. Bohrmann. On random testing and test oracles in the context of credit risk. Diploma thesis, Faculty of Computer Science, Ulm University, 2006.
5. G. Casella and R. L. Berger. Statistical Inference. Wadsworth Group, Duxbury, CA, USA, 2002.
6. A. Di Pierro and H. Wiklicky. Probabilistic abstract interpretation and statistical testing. In Proceedings of the Second Joint International Workshop on Process Algebra and Probabilistic Methods, Performance Modeling and Verification, volume 2399 of Lecture Notes in Computer Science, pages 211-212. Springer-Verlag, 2002.
7. C. Gloaguen, F. Fleischer, H. Schmidt, and V. Schmidt. Simulation of typical Cox-Voronoi cells with a special regard to implementation tests. Mathematical Methods of Operations Research (ZOR), 62(3):357-373, 2005.
8. C. Gloaguen, F. Fleischer, H. Schmidt, and V. Schmidt. Fitting of stochastic telecommunication network models via distance measures and Monte-Carlo tests. Telecommunication Systems, 31(4):353-377, 2006.
9. C. Gloaguen, F. Fleischer, H. Schmidt, and V. Schmidt. Modelling and simulation of telecommunication networks: Analysis of mean shortest path lengths. In R. Lechnerova, I. Saxl, and V. Benes, editors, Proceedings of the 6th International Conference on Stereology, Spatial Statistics and Stochastic Geometry, pages 25-36. Union of Czech Mathematicians and Physicists, Prague, Czech Republic, 2006.
10. R. Hierons. Testing from a nondeterministic finite state machine using adaptive state counting. IEEE Transactions on Computers, 53(10):1330-1342, 2004.
11. D. Hoffman. Heuristic test oracles. Software Testing and Quality Engineering Magazine, 1(2), 1999.
12. Inst, of Stochastics, Ulm University. GeoStoch homepage, http://www.geostoch.de/.
13. K. N. King and A. J. Offutt. A fortran language system for mutation-based software testing. Software Practice and Experience, 21(7):685-718, 1991.
14. D. Kozen. Semantics of probabilistic programs. Journal of Computer and System Sciences, 22(3):328-350, 1981.
15. Y.-S. Ma, J. Offutt, and Y.-R. Kwon. MuJava: An automated class mutation system. Software Testing, Verification, and Reliability, 15(2):97-133, 2005.
16. R. Maier and V. Schmidt. Stationary iterated tessellations. Advances in Applied Probability, 35:337-353, 2003.
17. J. Mayer. On testing image processing applications with statistical methods. In Proceedings of Software Engineering 2005 (SE 2005), volume P-64 of Lecture. Notes in Informatics, pages 69-78, Bonn, Germany, 2005. Köllen Druck+Verlag GmbH.
18. J. Mayer and R. Guderlei. Test oracles using Statistical methods. In Proceedings of the First International Workshop on Software Quality (SOQUA 2004), volume P-58 of Lecture Notes in Informatics, pages 179-189, Bonn, Germany, 2004. Köllen Druck+Verlag GmbH.
19. J. Mayer, V. Schmidt, and F. Schweiggert. A unified simulation framework for spatial stochastic models. Simulation Modelling Practice and Theory, 12(5):307-326, 2004.
20. J. Mecke. Parametric representation of mean values for stationary random mosaics. Mathematische Operationsforschung und Statistik Series Statistics, 15:437-442, 1984.
21. D. Monniaux. An abstract Monte-Carlo method for the analysis of probabilistic programs. In Proceedings of the 28th ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages, pages 93-101. ACM Press, New York, NY, USA, 2001.
22. D. Monniaux. Abstraction of expectation functions using Gaussian distributions. In Proceedings of the 4th International Conference on Verification, Model Checking, and Abstract Interpretation, volume 2575 of Lecture Notes In Computer Science, pages 161-173. Springer-Verlag, 2002.
23. L. Nachmanson, M. Veanes, W. Schulte, N. Tillmann, and W. Grieskamp. Optimal strategies for testing nondeterministic systems. SIGSOFT Software Engineering Notes, 29(4):55-64, 2004.
24. J. Offutt and R. H. Untch. Mutation 2000: Uniting the orthogonal. In Proceedings of Mutation 2000: Mutation Testing in the Twentieth and the Twenty First Centuries, pages 45-55, 2000.
25. C. H. Papadimitriou. Computational Complexity. Addison-Wesley, 1995.
26. H. Sevcikova, A. Borning, D. Socha, and W.-G. Bleek. Automated testing of stochastic systems: A statistically grounded approach. In Proceedings of the A CM/SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2006), pages 215-224. ACM, 2006.
27. C. Szyperski, D. Gruntz, and S. Murer. Component Software - Beyond Object-Oriented Programming. Addison-Wesley / ACM Press, 2nd edition, 2002.
28. E. W. Weyuker. On testing non-testable programs. The Computer Journal, 25(4):465-470, 1982.
29. F. Wilcoxon. Individual comparisons by ranking methods. Biometrics Bulletin, 1(6):80-83, 1945.