On testing effectiveness of metamorphic relations: A case study

Proceedings - 2011 5th International Conference on Secure Software Integration and Reliability Improvement, SSIRI 2011

Volumn , Issue , 2011, Pages 147-156

  Asrafi, Mahmuda ^a   Liu, Huai ^a   Kuo, Fei Ching ^a  

^a SWINBURNE UNIVERSITY OF TECHNOLOGY   (Australia)

Author keywords

Code coverage; Fault detection effectiveness; Metamorphic relation; Metamorphic testing; Software testing

Indexed keywords

CODE COVERAGE; DEGREE OF CORRELATIONS; DETECTION ABILITY; FAULT-DETECTION EFFECTIVENESS; INNOVATIVE APPROACHES; METAMORPHIC RELATION; METAMORPHIC TESTING; ORACLE PROBLEM; SOFTWARE EXECUTION; TEST DATA; TESTING PROCESS;

FAULT DETECTION; SOFTWARE RELIABILITY;

SOFTWARE TESTING;

EID: 80052956692     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SSIRI.2011.21     Document Type: Conference Paper

References (28)

1. Binder, R. V.: Testing Object-Oriented Systems: Models, Patterns, and Tools. Addison Wesley, Massachusetts (2000).
2. Briand, L. C., Penta, M. Di, Labiche, Y.: Assessing and improving state-based class testing: a series of experiments. IEEE Transactions on Software Engineering, 30 (11): 770-783(2004).
3. CodeCover: an open source glass- box testing tool, http://codecover.org/ index.html.
4. Chan, W. K., Chen, T. Y., Lu, H., Tse, T. H., Yau, S. S.: A metamorphic approach to integration testing of contextsensitive middleware-based applications. In Proceedings of the 5th International Conference on Quality Software (QSIC 2005). 241-249 (2005).
5. Chan, W. K., Cheung, S. C., Ho, J. C. F., Tse, T. H.: Reference models and automatic oracles for the testing of mesh simplification software for graphics rendering. In Proceedings of the 30th Annual International Computer Software and Applications Conference (COMPSAC 2006), 429-438 (2006).
6. Chan, W. K., Cheung, S. C., Ho, J. C. F., Tse, T. H.: PAT: a pattern classification approach to automatic reference oracles for the testing of mesh simplification programs. Journal of Systems and Software, Vol. 82, 422-434 (2008).
7. Chen, T. Y., Cheung, S. C., Yiu, S. M.: Metamorphic testing: a new approach for generating next test cases.Technical Report HKUSTCS98- 01, Department of Computer Science, Hong Kong University of Science and Technology (1998).
8. Chen, T. Y., Feng, J., Tse, T. H.: Metamorphic testing of programs on partial differential equations: A case study. In Proceedings of the 26th IEEE Annual International Computer Software and Applications Conference (COMPSAC 2002). 327-333 (2002).
9. Chen, T. Y., Ho., J. W. K., Liu, H., Xie, X.: "An innovative approach for testing bioinformatics programs using metamorphic testing". BMC Bioinformatics. 10-24 (2009).
10. Chen, T. Y., Huang, D. H., Tse, T. H., Zhou, Z. Q.: Case studies on the selection of useful relations in metamorphic testing. In Proceedings of the 4th Ibero-American Symposium on Software Engineering and Knowledge Engineering. 569-583 (2004).
11. Chen, T. Y., Tse, T. H., Zhou, Z. Q.: Semi-proving: An integrated method based on global symbolic evaluation and metamorphic testing. In Proceedings of the 2002 ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2002). 191- 195 (2002).
12. Chen, T. Y., Tse, T. H., Zhou, Z. Quan.: "Fault-based testing without the need of oracles." Information and Software Technology. Vol. 45(1). 1-9 (2003).
13. Davis, M. D., Weyuker, E. J.: Pseudo-oracles for non-testable programs. In Proceedings of the ACM'81 Conference. 254- 257(1981).
14. Gotlieb, A., Botella, B.: Automated metamorphic testing. In Proceedings of the 27th IEEE Annual International Computer Software and Applications Conference (COMPSAC2003). 34-40 (2003).
15. Hutchins, M., Foster, H., Goradia, T., and Ostrand, T.: Experiments on the effectiveness of dataflow- and controlflow-based test adequacy criteria. In Proceedings of the 16th International Conference on Software Engineering (ICSE 1994), 191-200 (1994).
16. Jia, Y., Harman, M.: A Custimizable, Runtime-Optimized Higher Order Mutation Testing Tool for the Full C Language. The 3rd Testing Academia and Industry Conferrence- Practice and Research Techniqes TAIC PART'08, Windsor, UK, 29th-31st August 2008.
17. Kaner, C. Center for Software Testing & Research: Examples of Test Oracle.http://www.testingeducation.org/k04/OracleExamples.htm.
18. Kenney, J. F. and Keeping, E. S. Mathematics of Statistics, Pt. 1, 3rd ed. Princeton, NJ: Van Nostrand, pp. 25-26, 1962.
19. Lau, H. T. 2007, A java library of graph algorithms and optimisation, Taylor & Francis Group, Boca Raton.
20. LCOV- the LTP GCOVextension, http://ltp.sourceforge.net/coverage/lcov. php.
21. Gcov-kernel - a gcov infrastructure for the Linux kernel, http://ltp.so urce forge.net/coverage/gcov.php.
22. Ma, Y.-S., Offutt, J., Kwon, Y.-R.: MuJava: An Automated Class Mutation System. Journal of Software Testing, Verification and Reliability. 15(2):97-133, June 2005.
23. Manolache, L. I., Kourie, D.G.: Software testing using model programs. Software: Practice and Experience. Vol. 31, 1211-1236, (2001).
24. Mayer, J., Guderlei, R.: Test oracles using statistical methods. In Lecture Notes in Informatics P-58, 179-189 (2004).
25. Mayer, J., Guderlei, R.: An Empirical Study on the Selection of Good Metamorphic Relations. In Proceedings of the 30th Annual international Computer Software and Applications Conference (COMPSAC 2006). 475-484 (2006).
26. Meyer, B.: Eiffel: the Language. Prentice Hall (1992).
27. Murphy, C., Shen, K., Kaiser, G.: Automatic system testing of programs without test oracles. In Proceedings of the Eighteenth international Symposium on Software Testing and Analysis (ISSTA 2009). 189-200 (2009).
28. Tse, T. H., Yau, S. S., Chan, W. K., Lu, H., Chen, T. Y.: Testing context-sensitive middleware-based software applications. In Proceedings of the 28th Annual International Computer Software and Applications Conference (COMPSAC 2004). 458-466 (2004).