Towards automatic testing of imaging software by means of random and metamorphic testing

International Journal of Software Engineering and Knowledge Engineering

Volumn 17, Issue 6, 2007, Pages 757-781

  Guderlei, Ralph ^a   Mayer, Johannes ^a  

^a UNIVERSITY OF ULM   (Germany)

Author keywords

Imaging software; Metamorphic testing; Random testing; Test oracle

Indexed keywords

AUTOMATIC TEST PATTERN GENERATION; COMPUTER SOFTWARE SELECTION AND EVALUATION; IMAGING SYSTEMS; RANDOM PROCESSES;

IMAGING SOFTWARE; METAMORPHIC TESTING; RANDOM TESTING; TEST ORACLE;

SOFTWARE TESTING;

EID: 38849167495     PISSN: 02181940     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0218194007003471     Document Type: Conference Paper

References (36)

1. J. H. Andrews, L. C. Briand, and Y. Labiche, Is mutation an appropriate tool for testing experiments? in Proc. 27th Int. Conf. on Software Engineering (ICSE 2005), ACM, 2005, pp. 402-411.
2. R. V. Binder, Testing Object-Oriented Systems (Addison-Wesley, 1999).
3. H. Breu, J. Gil, D. Kirkpatrick, and M. Werman, Linear time Euclidean distance algorithms, IEEE Trans. on Pattern Analysis and Machine Intelligence 17(5) (1995) 529-533.
4. F. Chan, T. Y. Chen, S. C. Cheung, M. Lau, and S. Yiu, Application of metamorphic testing in numerical analysis, in Proc. 1998 IASTED Conf. Software Engineering, Acta Press, 1998, pp. 191-197.
5. W. K. Chan, T. Y. Chen, H. Lu, T. H. Tse, and S. S. Yau, A metamorphic approach to integration testing of context-sensitive middleware-based applications, in Proc. Fifth Int. Conf. on Quality Software (QSIC 2005), IEEE Computer Society Press, Los Alamitos, CA, 2005, pp. 241-249.
6. T. Chen, F. Kuo, Y. Liu, and A. Tang, Metamorphic testing and testing with special values, in Proc. 5th Int. Conf. on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing (SNPD 2004), 2004, pp. 128-134.
7. T. Y. Chen, S. C. Cheung, and S. M. Yiu, Metamorphic testing: A new approach for generating next test cases, Technical Report HKUST-CS98-01, Department of Computer Science, Hong Kong University of Science and Technology, 1998.
8. T. Y. Chen, J. Feng, and T. H. Tse, Metamorphic testing of programs on partial differential equations: A case study, in Proc. 26th IEEE Annual Int. Computer Software and Applications Conf. (COMPSAC 2002), IEEE Computer Society, 2002, pp. 327-333.
9. T. Y. Chen, D. H. Huang, T. H. Tse, and Z. Q. Zhou, Case studies on the selection of useful relations in metamorphic testing, in Proc. 4th Ibero-American Symposium on Software Engineering and Knowledge Engineering, Polytechnic University of Madrid, Madrid, Spain, 2004, pp. 569-583.
10. T. Y. Chen, T. Tse, and Z. Zhou, Fault based testing in the absence of an oracle, in Proc. 25th IEEE Annual Int. Computer Software and Applications Conf. (COMPSAC 2001), IEEE Computer Society, 2001, pp. 172-178.
11. P. Danielsson, Euclidean distance mapping, Computer Graphics and Image Processing 14(3) (1980) 227-248.
12. A. Gotlieb, Exploiting symmetries to test programs, in Proc. 14th Int. Symp. on Software Reliability Engineering (ISSRE 2003), IEEE Computer Society, 2003, pp. 365-374.
13. R. Guderlei, J. Mayer, C. Schneckenburger, and F. Fleischer, Testing randomized software by means of statistical hypothesis tests, in Proc. Fourth Int. Workshop on Software Quality Assurance (SOQUA 2007), ACM Press, 2007, pp. 46-54.
14. R. Hamlet, Random testing, Encylopedia of Software Engineering (Wiley, 1994), pp. 970-978.
15. B. Jahne, Digital Image Processing, 6th ed. (Springer-Verlag, 2005).
16. K. N. King and A. J. Offutt, A Fortran language system for mutation-based software testing, Software Practice and Experience 21(7) (1991) 685-718.
17. Y.-S. Ma, J. Offutt, and Y.-R. Kwon, MuJava: An automated class mutation system, Software Testing, Verification, and Reliability 15(2) (2005) 97-133.
18. J. Mayer, On testing image processing applications with statistical methods, in Proc. Software Engineering 2005 (SE 2005), LNI, Vol. P-64, Gesellschaft für Informatik e.V., Köllen Druck+Verlag GmbH, Bonn, 2005, pp. 69-78.
19. J. Mayer and R. Guderlei, Test oracles using Statistical methods, in Proc. First Int. Workshop on Software Quality (SOQUA 2004), LNI, Vol. P-58, Gesellschaft für Informatik e.V., Köllen Druck+Verlag GmbH, Bonn, 2004, pp. 179-189.
20. J. Mayer and R. Guderlei, An empirical study on the selection of good metamorphic relations, in Proc. 30th Annual Int. Computer Software and Applications Conf. (COMPSAC 2006), IEEE Computer Society, 2006, pp. 475-484.
21. J. Mayer and R. Guderlei, On random testing of image processing applications, in Proc. 6th Int. Conf. on Quality Software (QSIC 2006), IEEE Computer Society, 2006, pp. 85-92.
22. J. Mayer, V. Schmidt, and F. Schweiggert, A unified simulation framework for spatial stochastic models, Simulation Modelling Practice and Theory 12(5) (2004) 307-326.
23. B. P. Miller, G. Cooksey, and F. Moore, An empirical study of the robustness of MacOS applications using random testing, in Proc. 1st Int. Workshop on Random Testing (RT 2006), ACM, 2006, pp. 46-54.
24. P. Moreau and C. Ronse, Generation of shading-off in images by extrapolation of Lipschitz functions, Graphical Models and Image Processing 58(4) (1996) 314-333.
25. National Institutes of Health, ImageJ homepage, 2007, http://rsb.info.nih.gov/ij/.
26. J. Offutt and R. H. Untch, Mutation 2000: Uniting the orthogonal, in Proc. Mutation 2000: Mutation Testing in the Twentieth and the Twenty-First Centuries, San Jose, CA, 2000, pp. 45-55.
27. P. Rusås, Java, Image Processing API homepage, 2004, http://www.ia.hiof.no/~por/imageprocAPI/version2/.
28. D. Slutz, Massive stochastic testing of SQL, in Proc. 24th Int. Conf. on Very Large Data Bases (VLDB 1998), 1998, pp. 618-622.
29. P. Soille, Morphological Image Analysis: Principles and Applications, 2nd ed. (Springer-Verlag, 2004).
30. M. Stencel and J. Janacek, Homepage of the Lipschitz filter ImageJ plugin, 2006, http://rsb.info.nih.gov/ij/plugins/lipschitz/index.html.
31. D. Stoyan, W. S. Kendall, and J. Mecke, Stochastic Geometry and Applications (John Wiley, 1995).
32. Ulm University, Inst. of Stochastics and Inst. of Applied Information Processing, GeoStoch homepage, http://www.geostoch.de.
33. W. Weil and J. A. Wieacker, Densities for stationary random sets and point processes, Advances in Applied Probability 16 (1984) 324-346.
34. E. J. Weyuker, On testing non-testable programs, The Computer Journal 25(4) (1982) 465-470.
35. T. Yoshikawa, K. Shimura, and T. Ozawa, Random program generator for Java JIT compiler test system, in Proc. 3rd Int. Conf. on Quality Software (QSIC 2003), IEEE Computer Society, 2003, pp. 20-24.
36. Z. Q. Zhou, D. H. Huang, T. H. Tse, Z. Yang, H. Huang, and T. Y. Chen, Metamorphic testing and its applications, in Proc. 8th Int. Symp. on Future Software Technology (ISFST 2004), Japan, Software Engineers Association, 2004.