On the correlation between the effectiveness of metamorphic relations and dissimilarities of test case executions

Proceedings of the International Symposium on the Physical and Failure Analysis of Integrated Circuits, IPFA

Volumn , Issue , 2013, Pages 153-162

  Cao, Yuxiang ^a   Zhou, Zhi Quan ^a   Chen, Tsong Yueh ^b  

^a UNIVERSITY OF WOLLONGONG   (Australia)

^b SWINBURNE UNIVERSITY OF TECHNOLOGY   (Australia)

Author keywords

distance measurement; execution dissimilarity; fault detection effectiveness; follow up execution; initial execution; metamorphic relation; metamorphic testing; Software testing

Indexed keywords

EXECUTION DISSIMILARITY; FAULT-DETECTION EFFECTIVENESS; FOLLOW-UP EXECUTION; INITIAL EXECUTION; METAMORPHIC RELATIONS; METAMORPHIC TESTING;

DISTANCE MEASUREMENT; TESTING;

SOFTWARE TESTING;

EID: 84885595167     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/QSIC.2013.43     Document Type: Conference Paper

References (22)

1. L. I. Manolache and D. G. Kourie, "Software testing using model programs," Software: Practice and Experience, vol. 31, no. 13, pp. 1211-1236, 2001.
2. T. Y. Chen, T. H. Tse, and Z. Q. Zhou, "Semi-proving: An integrated method based on global symbolic evaluation and metamorphic testing," in Proceedings of the ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA'02). ACM Press, New York, 2002, pp. 191-195.
3. T. Y. Chen, F.-C. Kuo, D. Towey, and Z. Q. Zhou, "Metamorphic testing: Applications and integration with other methods," in Proceedings of the 12th International Conference on Quality Software (QSIC'12). IEEE Computer Society Press, 2012, pp. 285-288.
4. M. Blum and S. Kannan, "Designing programs that check their work," in Proceedings of the 31st Annual ACM Symposium on Theory of Computing (STOC'89). ACM Press, New York, 1989, pp. 86-97.
5. R. J. Lipton, "New directions in testing," in Proceedings of the DIMACS Workshop on Distributed Computing and Cryptography. American Mathematical Society, Providence, RI, 1991, pp. 191-202.
6. M. Blum, M. Luby, and R. Rubinfeld, "Self-testing / correcting with applications to numerical problems," Journal of Computer and System Sciences, vol. 47, no. 3, pp. 549-595, 1993.
7. Z. Q. Zhou, S. Zhang, M. Hagenbuchner, T. H. Tse, F.-C. Kuo, and T. Y. Chen, "Automated functional testing of online search services," Software Testing, Verification and Reliability, vol. 22, no. 4, pp. 221-243, 2012.
8. T. Y. Chen, T. H. Tse, and Z. Q. Zhou, "Semi-proving: An integrated method for program proving, testing, and debugging," IEEE Transactions on Software Engineering, vol. 37, no. 1, pp. 109-125, 2011.
9. X. Xie, W. E. Wong, T. Y. Chen, and B. Xu, "Metamorphic slice: an application in spectrum-based fault localization," Information and Software Technology, vol. 55, no. 5, pp. 866-879, 2013.
10. T. Y. Chen, T. H. Tse, and Z. Q. Zhou, "Fault-based testing without the need of oracles," Information and Software Technology, vol. 45, no. 1, pp. 1-9, 2003.
11. T. Y. Chen, D. H. Huang, T. H. Tse, and Z. Q. Zhou, "Case studies on the selection of useful relations in metamorphic testing," in Proceedings of the 4th Ibero-American Symposium on Software Engineering and Knowledge Engineering (JIISIC'04). Madrid, Spain: Polytechnic University of Madrid, 2004, pp. 569-583.
12. Z. Q. Zhou, "Using coverage information to guide test case selection in adaptive random testing," in Proceedings of the 34th Annual International Computer Software and Applications Conference (COMPSAC'10), 7th International Workshop on Software Cybernetics. IEEE Computer Society Press, 2010, pp. 208-213.
13. Z. Q. Zhou, A. Sinaga, and W. Susilo, "On the fault-detection capabilities of adaptive random test case prioritization: Case studies with large test suites," in Proceedings of the 45th Annual Hawaii International Conference on System Sciences (HICSS'12). IEEE Computer Society Press, 2012, pp. 5584-5593.
14. W. Dickinson, D. Leon, and A. Podgurski, "Finding failures by cluster analysis of execution profiles," in Proceedings of the 23rd International Conference on Software Engineering (ICSE'01). IEEE Computer Society Press, 2001, pp. 339-348.
15. W. Masri, A. Podgurski, and D. Leon, "An empirical study of test case filtering techniques based on exercising information flows," IEEE Transactions on Software Engineering, vol. 33, no. 7, pp. 454-477, 2007.
16. G. Rothermel, R. H. Untch, C. Chu, and M. J. Harrold, "Prioritizing test cases for regression testing," IEEE Transactions on Software Engineering, vol. 27, no. 10, pp. 929-948, 2001.
17. S. Yoo and M. Harman, "Regression testing minimization, selection and prioritization: a survey," Software Testing, Verification and Reliability, vol. 22, pp. 67-120, 2012.
18. H. Do, S. G. Elbaum, and G. Rothermel, "Supporting controlled experimentation with testing techniques: An infrastructure and its potential impact," Empirical Software Engineering: An International Journal, vol. 10, no. 4, pp. 405-435, 2005.
19. A. Rubin, Statistics for Evidence-Based Practice and Evaluation, 2nd ed. Brooks/Cole, 2010.
20. M. Asrafi, H. Liu, and F.-C. Kuo, "On testing effectiveness of metamorphic relations: A case study," in Proceedings of the 5th International Conference on Secure Software Integration and Reliability Improvemen (SSIRI'11). IEEE Computer Society Press, 2011, pp. 147-156.
21. H. Hemmati, A. Arcuri, and L. Briand, "Achieving scalable modelbased testing through test case diversity," ACM Transactions on Software Engineering and Methodology, vol. 22, no. 1, pp. 6:1-6:42, 2013.
22. K.-Y. Cai, J. W. Cangussu, R. A. DeCarlo, and A. P. Mathur, "An overview of software cybernetics," in Proceedings of the 11th International Workshop on Software Technology and Engineering Practice. IEEE Computer Society Press, 2003, pp. 77-86