An empirical study on the selection of good metamorphic relations

Proceedings - International Computer Software and Applications Conference

Volumn 1, Issue , 2006, Pages 475-484

  Mayer, Johannes ^a   Guderleit, Ralph ^a  

^a UNIVERSITY OF ULM   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATION; COMPUTATIONAL METHODS; COMPUTER OPERATING SYSTEMS; JAVA PROGRAMMING LANGUAGE; PROBLEM SOLVING; SUPERVISORY AND EXECUTIVE PROGRAMS;

METAMORPHIC TESTING; MUTATION ANALYSIS; ORACLE PROBLEMS;

SOFTWARE TESTING;

EID: 34247474866     PISSN: 07303157     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/COMPSAC.2006.24     Document Type: Conference Paper

References (38)

1. P. E. Ammann and J. C. Knight. Data diversity: An approach to software fault tolerance. IEEE Transactions on Computers, 37(4), 1988.
2. J. Andrews, L. Briand, and Y. Labiche. Is mutation an appropriate tool for testing experiments? In Proceedings of the 27th International Conference on Software Engineering (ICSE 2005), pages 402-411. ACM, 2005.
3. Apache Software Foundation. Apache Jakarta Commons.Math. http://jakarta.apache.org/commons/math/.
4. R. V. Binder. Testing Object-Oriented Systems. Addison-Wesley, 1999.
5. M. Blum and S. Kannan. Designing programs that check their work. In Proceedings of the 21st ACM Symposium on the Theory of Computing (STOC 1989), pages 86-97, 1989.
6. M. Blum and S. Kannan. Designing program that check their work. Journal of the ACM, 41(1):269-291, 1995.
7. F. Chan, T. Y. Chen, S. C. Cheung, M. Lau, and S. Yiu. Application of metamorphic testing in numerical analysis. In Proceedings of the 1998 IASTED Conference in Software Engineering, pages 191-197. Acta Press, 1998.
8. W. K. Chan, T. Y. Chen, H. Lu, T. H. Tse, and S. S. Yau. A metamorphic approach to integration testing of context-sensitive middleware-based applications. In Proceedings of the Fifth International Conference on Quality Software (QSIC 2005), pages 241-249, Los Alamitos, California, 2005. IEEE Computer Society Press.
9. T. Y. Chen, S. C. Cheung, and S. M. Yiu. Metamorphic testing: A new approach for generating next test cases. Technical Report HKUST-CS98-01, Department of Computer Science, Hong Kong University of Science and Technology, 1998.
10. T. Y. Chen, J. Feng, and T. H. Tse. Metamorphic testing of programs on partial differential equations: A case study. In Proceedings of the 26th IEEE Annual International Computer Software and Applications Conference (COMPSAC 2002), pages 327-333. IEEE Computer Society, 2002.
11. T. Y. Chen, D. H. Huang, T. H. Tse, and Z. Q. Zhou. Case studies on the selection of useful relations in metamorphic testing. In Proceedings of the 4th Ibero-American Symposium on Software Engineering and Knowledge Engineering, pages 569-583, Madrid, Spain, 2004. Polytechnic University of Madrid.
12. T. Y. Chen, T. Tse, and Z. Zhou. Fault based testing in the absence of an oracle. In Proceedings of the 25th IEEE Annual International Computer Software and Applications Conference (COMPSAC 2001), pages 172-178. IEEE Computer Society, 2001.
13. T. Y. Chen, T. H. Tse, and Z. Q. Zhou. Semi-proving: An integrated method based on global symbolic evaluation and metamorphic testing. In Proceedings of the 2002 ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2002), pages 191-195, New York, 2002. ACM Press.
14. K. Claessen and J. Hughes. Quickcheck: a lightweight tool for random testing of haskell programs. In Proceedings of the Fifth ACM SIGPLAN International Conference on Functional Programming (ICFP '00), pages 268-279. ACM, 2000.
15. J.-M. Dautelle. JScience. http://jscience.org/.
16. R. A. DeMillo, R. J. Lipton, and F. G. Sayward. Hints on test data selection: Help for the practicing programmer. IEEE Computer, 11:34-41, 1978.
17. M. T. Flanagan. Java library. http://www.ee.ucl.ac.uk/~mflanaga/java/ Matrix.html.
18. J. E. Forrester and B. P. Miller. An empirical study of the robustness of Windows NT applications using random testing. In Proceedings of the 4th USENIX Windows Systems Symposium, pages 59-68, 2000.
19. A. Gotlieb. Exploiting symmetries to test programs. In Proceedings of the 14th IEEE International Symposium on Software Reliability Engineering (ISSRE 2003), pages 365-374. IEEE Computer Society, 2003.
20. A. Gotlieb and B. Botella. Automated metamorphic testing. In Proceedings of the 27th IEEE Annual International Computer Software and Applications Conference (COMPSAC 2003), pages 34-40. IEEE Computer Society, 2003.
21. R. Hamlet. Random testing. In Encyclopedia of Software Engineering, pages 970-978. Wiley, 1994.
22. D. Hoffman. Heuristic test oracles. Software Testing and Quality Engineering, 1(2):29-32, 1999.
23. JAMA Project. Java matrix package (JAMA). http://math.nist.gov/ javanumerics/jama/.
24. K. N. King and A. J. Offutt. A fortran language system for mutation-based software testing. Software Practice and Experience, 21(7):685-718, 1991.
25. J. Mayer. On testing image processing applications with statistical methods. In Proceedings of Software Engineering 2005, Lecture Notes in Informatics P-64, pages 69-78. Gesellschaft für Informatik, Köllen Druck+Verlag GmbH, 2005.
26. J. Mayer. Towards a reliable statistical oracle and its applications. Softwaretechnik-Trends, 25(1):21-27, 2005.
27. J. Mayer and R. Guderlei. Test oracles using statistical methods. In Lecture Notes in Informatics P-58, pages 179-189. Gesellschaft für Informatik, Köllen Druck+Verlag GmbH, 2004.
28. C. D. Meyer. Matrix Analysis and Applied Linear Algebra. Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA, USA, 2000.
29. A. J. Offutt. Investigations of the software testing coupling effect. ACM Transactions on Software Engineering Methodology, 1(1):5-20, 1992.
30. J. Offutt, Y.-S. Ma, and Y.-R. Kwon. An experimental mutation system for Java. ACM SIGSOFT Software Engineering Notes, 29(5):1-4, 2004.
31. J. Offutt and R. H. Untch. Mutation 2000: Uniting the orthogonal. In Proceedings of Mutation 2000: Mutation Testing in the Twentieth and the Twenty First Centuries, San Jose, CA, pages 45-55, 2000.
32. D. Slutz. Massive stochastic testing of SQL. In Proceedings of the 24th International Conference on Very Large Data Bases (VLDB 1998), pages 618-622, 1998.
33. J. Squire. A Java matrix class. http://www.csee.umbc.edu/~squire/ download/Matrix.java.
34. T. H. Tse, S. S. Yau, W. K. Chan, H. Lu, and T. Y. Chen. Testing context-sensitive middleware-based software applications. In Proceedings of the 28th Annual International Computer Software and Applications Conference (COMPSAC 2004), pages 458-466, Los Alamitos, California, 2004. IEEE Computer Society Press.
35. Ulm University, Dept. of Stochastics and Dept. of Applied Information Processing. GeoStoch homepage. http://www.geostoch.de.
36. E. Weyuker. On testing non-testable programs. The Computer Journal, 25(4):465-470, 1982.
37. T. Yoshikawa, K. Shimura, and T. Ozawa. Random program generator for Java JIT compiler test system. In Proceedings of the 3rd International Conference on Quality Software (QSIC 2003), pages 20-24. IEEE Computer Society, 2003.
38. Z. Q. Zhou, D. H. Huang, T. H. Tse, Z. Yang, H. Huang, and T. Y. Chen. Metamorphic testing and its applications. In Proceedings of the 8th International Symposium on Future Software Technology (ISFST 2004), Japan, 2004. Software Engineers Association.