Measurable metrics for qualitative guidelines of metamorphic relation

Proceedings - International Computer Software and Applications Conference

Volumn 3, Issue , 2015, Pages 417-422

  Hui, Zhan Wei ^a   Huang, Song ^a   Li, Hui ^a   Liu, Jian Hao ^b   Rao, Li Ping ^a  

^a PLA UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^b AIR FORCE EARLY WARNING ACADEMY   (China)

Author keywords

Metamorphic relation; Metamorphic testing; Metri; Test priority

Indexed keywords

APPLICATION PROGRAMS; COMPUTER SOFTWARE; FAULT DETECTION; TESTING;

FORMAL MODEL; IN-DEGREE; METAMORPHIC RELATIONS; METAMORPHIC TESTING; METRI; PROBLEM-BASED; TEST INPUTS; TEST ORACLES;

SOFTWARE TESTING;

EID: 84962115479     PISSN: 07303157     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/COMPSAC.2015.179     Document Type: Conference Paper

References (36)

1. E.J. Weyuker, The Oracle Assumption of Program Testing, in: Proceedings of the 13th International Conference on System Sciences (ICSS), Honolulu, HI, 1980, pp. 44-49
2. T.Y. Chen, S.C. Cheung, S. Yiu, Metamorphic testing: a new approach for generating next test cases, Department of Computer Science, Hong Kong University of Science and Technology, Tech. Rep. HKUST-CS98-01, (1998).
3. T.Y. Chen, J. Feng, T. Tse, Metamorphic testing of programs on partial differential equations: a case study, in: Computer Software and Applications Conference, 2002. COMPSAC 2002. Proceedings. 26th Annual International, IEEE, 2002, pp. 327-333.
4. Z.Q. Zhou, T. Tse, F. Kuo, T. Chen, Automated functional testing of Web search engines in the absence of an oracle, in: TECHNICAL REPORT TR-2007-06, DEPARTMENT OF COMPUTER SCIENCE, THE UNIVERSITY OF HONG KONG, 2007.
5. C.-a. Sun, G. Wang, B. Mu, H. Liu, Z. Wang, T.Y. Chen, A Metamorphic Relation-Based Approach to Testing Web Services Without Oracles, International Journal of Web Services Research (IJWSR), 9 (2012) 51-73.
6. Z.Q. Zhou, S. Zhang, M. Hagenbuchner, T. Tse, F.C. Kuo, T.Y. Chen, Automated functional testing of online search services, Software Testing, Verification and Reliability, 22 (2012) 221-243.
7. C. Murphy, G.E. Kaiser, Improving the dependability of machine learning applications, in, Department of Computer Science, Columbia University, 2008.
8. Z.Q. Zhou, D. Huang, T. Tse, Z. Yang, H. Huang, T. Chen, Metamorphic testing and its applications, in: Proceedings of the 8th International Symposium on Future Software Technology (ISFST 2004), 2004, pp. 346-351.
9. R.C. Lin, X.M. Liu, S. Huang, Z.W. Hui, Y.Z. Du, Metamorphic Testing for Visibility Analysis Program, in: 2012 PLA Graduate of Engineering Innovation Forum (PLAGEIF), Wuhan, China, 2012, pp. 217-223.
10. F.T. Chan, T.Y. Chen, S.C. Cheung, M.F. Lau, S.M. Yiu, Application of metamorphic testing in numerical analysis, in: In Proceedings of IASTED Conference on Software Engineering 98, Las Vegas USA, 1998, pp. 191-197.
11. S. Yoo, Metamorphic testing of stochastic optimisation, in: Software Testing, Verification, and Validation Workshops (ICSTW), 2010 Third International Conference on, IEEE, 2010, pp. 192-201.
12. F.-C. Kuo, Z. Zhou, J. Ma, G. Zhang, Metamorphic testing of decision support systems: a case study, Software, IET, 4 (2010) 294-301.
13. F.-C. Kuo, S. Liu, T.Y. Chen, Testing a binary space partitioning algorithm with metamorphic testing, in: Proceedings of the 2011 ACM Symposium on Applied Computing, ACM, 2011, pp. 1482-1489.
14. X.-l. Lu, Y.-w. Dong, C. Luo, Testing of Component-Based Software: A Metamorphic Testing Methodology, in: Ubiquitous Intelligence &Computing and 7th International Conference on Autonomic &Trusted Computing (UIC/ATC), 2010 7th International Conference on, IEEE, 2010, pp. 272-276.
15. W.K. Chan, S.C. Cheung, J.C.F. Ho, T.H. Tse, Reference models and automatic oracles for the testing of mesh simplification software for graphics rendering, in: Computer Software and Applications Conference, 2006. COMPSAC'06. 30th Annual International, IEEE, 2006, pp. 429-438.
16. T. Chen, J. Ho, H. Liu, X. Xie, An innovative approach for testing bioinformatics programs using metamorphic testing, BMC bioinformatics, 10 (2009) 24.
17. S. Segura, R.M. Hierons, D. Benavides, A. Ruiz-Cortés, Automated test data generation on the analyses of feature models: a metamorphic testing approach, in: Software Testing, Verification and Validation (ICST), 2010 Third International Conference on, IEEE, 2010, pp. 35-44.
18. T.H. Tse, F. Lau, W.K. Chan, P.C.K. Liu, C.K.F. Luk, Testing objectoriented industrial software without precise oracles or results, Communications of the ACM, 50 (2007) 78-85.
19. F.-C. Kuo, T.Y. Chen, W.K. Tam, Testing embedded software by metamorphic testing: A wireless metering system case study, in: Local Computer Networks (LCN), 2011 IEEE 36th Conference on, IEEE, 2011, pp. 291-294.
20. T. Chen, D. Huang, T. Tse, Z.Q. Zhou, Case studies on the selection of useful relations in metamorphic testing, in: Proceedings of the 4th Ibero-American Symposium on Software Engineering and Knowledge Engineering (JIISIC 2004), 2004, pp. 569-583.
21. J. Mayer, R. Guderlei, An empirical study on the selection of good metamorphic relations, in: Computer Software and Applications Conference, 2006. COMPSAC'06. 30th Annual International, IEEE, 2006, pp. 475-484.
22. G.W. Dong, B.W. Xu, L. Chen, C.H. Nie, L.L. Wang, Case studies on testing with compositional metamorphic relations, Journal of Southeast University (English Edition), 24 (2008) 437-443.
23. X. Xie, J. Ho, C. Murphy, G. Kaiser, B. Xu, T.Y. Chen, Application of metamorphic testing to supervised classifiers, in: Quality Software, 2009. QSIC'09. 9th International Conference on, IEEE, 2009, pp. 135-144.
24. T.Y. Chen, T. Tse, Z. Zhou, Semi-proving: an integrated method based on global symbolic evaluation and metamorphic testing, in: ACM SIGSOFT Software Engineering Notes, ACM, 2002, pp. 191-195.
25. T.Y. Chen, F.-C. Kuo, Y. Liu, A. Tang, Metamorphic Testing and Testing with Special Values, in: SNPD, 2004, pp. 128-134.
26. T.Y. Chen, T. Tse, Z.Q. Zhou, Semi-proving: An integrated method for program proving, testing, and debugging, Software Engineering, IEEE Transactions on, 37 (2011) 109-125.
27. Z.W. Hui, S. Huang, A Formal Model for Metamorphic Relation Decomposition, in: 2013 Fourth World Congress on Software Engineering, Hong Kong, China, 2013, pp. 64-68.
28. Z.W. Hui, S. Huang, Formal Description and Decomposition of Metamorphic Relation, in: The 11th Annual Academic Conference For PH.D. Candidates, Chengdu China, 2013, pp. 203-213.
29. G.W. Dong, C.H. Nie, B.W. Xu, Effectively Metamorphic Testing Based on Program Path Analysis, CHINESE JOURNAL OF COMPUTERS, 32 (2009) 1002-1013.
30. Y. Cao, Z.Q. Zhou, T.Y. Chen, On the Correlation between the Effectiveness of Metamorphic Relations and Dissimilarities of Test Case Executions, in: Quality Software (QSIC), 2013 13th International Conference on, IEEE, 2013, pp. 153-162.
31. J.-K. Kamarainen, V. Kyrki, J. Ilonen, H. Kälviäinen, Improving similarity measures of histograms using smoothing projections, Pattern Recognition Letters, 24 (2003) 2009-2019.
32. Y. Jia, M. Harman, A Custimizable, Runtime-Optimized Higher Order Mutation Testing Tool for the Full C Language., in: The 3rd Testing Academia and Industry Conferrence-Practice and Research Techniqes TAIC PART'08, Windsor, UK, 2008.
33. H. Liu, X. Liu, T.Y. Chen, A New Method for Constructing Metamorphic Relations, in: Quality Software (QSIC), 2012 12th International Conference on, IEEE, 2012, pp. 59-68.
34. G. Dong, Metamorphic testing techniques for error detection efficiency, in: School of Computer Science and Engineering, Southeast University, Nanjing, China, 2009.
35. M. Hutchins, H. Foster, T. Goradia, T. Ostrand, Experiments of the effectiveness of dataflow-and controlflow-based test adequacy criteria, in: Proceedings of the 16th international conference on Software engineering, IEEE Computer Society Press, 1994, pp. 191-200.
36. S. Huang, R.H. Ding, H. Li, Y. Yao, Research on metamorphic testing of slope and aspect calculation programs, Journal of Computer Applications, 33 (2013) 1657-1661.