An application of metamorphic testing for testing scientific software

Proceedings - International Conference on Software Engineering

Volumn 16, Issue , 2016, Pages 37-43

  Ding, Junhua ^a,b   Zhang, Dongmei ^b   Hu, Xin Hua ^a  

^a EAST CAROLINA UNIVERSITY   (United States)

^b CHINA UNIVERSITY OF GEOSCIENCES   (China)

Author keywords

discrete dipole approximation; metamorphic relation; metamorphic testing; mutation testing; scientific software

Indexed keywords

APPLICATION PROGRAMS; ITERATIVE METHODS; OPEN SOURCE SOFTWARE;

DISCRETE DIPOLE APPROXIMATION; METAMORPHIC RELATIONS; METAMORPHIC TESTING; MUTATION TESTING; SCIENTIFIC SOFTWARES;

SOFTWARE TESTING;

EID: 85011024018     PISSN: 02705257     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2896971.2896981     Document Type: Conference Paper

References (23)

1. ADDA project, https://code.google.com/p/a-dda/, Last accessed on January 25, 2016.
2. L. Baresi, M. Young. "Test oracles". Technical Report CIS-TR01-02, Dept. of Computer, Information Science, Univ. of Oregon, 2001.
3. T. Y. Chen, S. C. Cheung, S. Yiu, "Metamorphic testing: a new approach for generating next test cases", Tech. Rep. HKUST-CS98-01, Dept. of Computer Science, Hong Kong Univ. of Science, Technology, 1998.
4. T. Y. Chen, T. H. Tse, Z. Q. Zhou, "Semi-proving: an integrated method based on global symbolic evaluation, metamorphic testing". In Proc. of ISSTA, pp. 191-195, 2002.
5. J. Ding, T. Wu, J. Q. Lu, X. Hu, "Self-Checked Metamorphic Testing of an Image Processing Program", 4th IEEE Intl. Conference on Security Software Integration, Reliability Improvement, Singapore, June 9-11, 2010.
6. R. Guderlei, J. Mayer, "Statistical metamorphic testing-testing programs with random output by means of statistical hypothesis tests, metamorphic testing", In Proc. of the 7th ICQS. pp. 404-409, 2007.
7. R. Haralick, "On a Texture-Context Feature Extraction Algorithm for Remotely Sensed Imagery, " Proceedings of the IEEE Computer Society Conference on Decision, Control, Gainesville, FL, pp. 650-657, Dec. 1971.
8. P. Hu, Z. Zhang, W. K. Chan, T. H. Tse. "An empirical comparison between direct, indirect test result checking approaches". In Proc. of the 3rd Int. Workshop on Soft. Quality Assurance, pp. 6-13, 2006.
9. K.M. Jacobs, J.Q. Lu, X.H. Hu, "Development of a diffraction imaging flow cytometer", Optics Letters, 34, 2985-2987, 2009.
10. U. Kanewala, J. M. Bieman, "Testing scientific software: A systematic literature review, Information, Software Technology", Vol. 56, Issue 10, Oct. 2014, pp. 1219-1232, 2014.
11. U. Kanewala, J. M. Bieman, A. Ben-Hur, "Predicting Metamorphic Relations for Testing Scientific Software: A Machine Learning Approach Using Graph Kernels", Journal of Software Testing, Verification, Reliability, Nov. 16, 2015, DOI: 10.1002/stvr.1594.
12. V. Le, M. Afshari, Z. Su. "Compiler validation via equivalence modulo inputs". In Proceedings of the 35th ACM SIGPLAN Conference on Programming Language Design, Implementation (PLDI '14). ACM, New York, NY, USA, pp.216-226. 2014.
13. H. Liu, F.-C. Kuo, D. Towey, T.Y. Chen, "How Effectively Does Metamorphic Testing Alleviate the Oracle Problem" IEEE Transactions on Software Engineering, vol.40, no.1, pp.4, 22, Jan. 2014.
14. M. Lindvall, D. Ganesan, R. Árdal, R. E. Wiegand. "Metamorphic model-based testing applied on NASA DAT: an experience report". In Proc. of the 37th Intl. Conference on Software Engineering, Vol. 2. pp. 129-138. 2015.
15. M. Moran, "Correlating the morphological, light scattering properties of biological cells", PhD dissertation, department of physics, East Carolina University, 2013.
16. C. Murphy, G. Kaiser, L. Hu, L. Wu. "Properties of machine learning applications for use in metamorphic testing". In Proc. of the 20th SEKE, pp. 867-872, 2008.
17. L. Shan, H. Zhu, "Generating Structually Complex Test Cases by Data Mutation: A Case Study of Testing An Automated Modelling Tool". The Computer Journal, Vol. 52, No. 5, 2009.
18. S. K. Thati, J. Ding, D. Zhang, X. Hu, "Feature Selection, Analysis of Diffraction Images", the 4th IEEE Intl. Workshop on Information Assurance, Vancouver, Canada, August 3-5, 2015.
19. W. E. Wong, A.P. Mathur, "Reducing the cost of mutation testing: an experimental study, " J. Systems, Software, vol. 31, no.3, pp.185-196, Dec. 1995.
20. X. Xie, J. Ho, C. Murphy, G. Kaiser, B. Xu, T. Y. Chen, "Application of metamorphic testing to supervised classifiers". In Proc. of the 9th Intl. Conference on Quality Software (QSIC '09), pp. 135-144, 2009.
21. M.A. Yurkin, A.G. Hoekstra, "User manual for the discrete dipole approximation code ADDA 1.3b4", http://adda. googlecode.com/svn/trunk/doc/manual.pdf (2014). Last accessed on January 25, 2016.
22. Z.Q. Zhou, S. Xiang, T.Y. Chen, "Metamorphic Testing for Software Quality Assessment: A Study of Search Engines", IEEE Trans. on Software Engineering, Pre Prints, Issue 99, doi:10.1109/TSE.2015.2478001, 2015.
23. LIBSVM, https://www.csie.ntu.edu.tw/~cjlin/libsvm/, last accessed on Jan. 22, 2016