Spectrum-based fault localization: Testing oracles are no longer mandatory

Proceedings - International Conference on Quality Software

Volumn , Issue , 2011, Pages 1-10

  Xie, Xiaoyuan ^a,c,d   Wong, W Eric ^b   Chen, Tsong Yueh ^a   Xu, Baowen ^c  

^a SWINBURNE UNIVERSITY OF TECHNOLOGY   (Australia)

^b The University of Texas at Dallas   (United States)

^c NANJING UNIVERSITY   (China)

^d SOUTHEAST UNIVERSITY   (China)

Author keywords

metamorphic testing; mice; slice; spectrum based fault localization; testing oracle

Indexed keywords

FAULT LOCALIZATION; METAMORPHIC TESTING; MICE; SLICE; TESTING ORACLE;

COMPUTER SOFTWARE SELECTION AND EVALUATION; MAMMALS;

SOFTWARE TESTING;

EID: 80053023151     PISSN: 15506002     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/QSIC.2011.20     Document Type: Conference Paper

References (39)

1. J. S. Collofello and S. N. Woodfield, "Evaluating the effectiveness of reliability-assurance techniques," The Journal of Systems and Software, vol. 9, no. 3, pp. 191-195, 1989.
2. W. E. Wong, T. Sugeta, Y. Qi, and J. Maldonado, "Smart debugging software architectural design in SDL," The Journal of Systems and Software, vol. 76, no. 1, pp. 15-28, 2005.
3. R. Abreu, P. Zoeteweij, and A. van Gemund, "On the accuracy of spectrum-based fault localization," in Proceedings of Testing: Academic and Industrial Conference Practice and Research Techniques-MUTATION (TAICPART-MUTATION), Windsor, UK, 2007, pp. 89-98.
4. M. Chen, E. Kiciman, E. Fratkin, A. Fox, and E. Brewer, "Pinpoint: problem determination in large, dynamic internet services," in Proceedings of the 32th IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), Washington, DC, USA, 2002, pp. 595-604.
5. J. Jones, M. Harrold, and J. Stasko, "Visualization of test information to assist fault localization," in Proceedings of the 24th International Conference on Software Engineering (ICSE), Florida, USA, 2002, pp. 467-477.
6. R. Abreu, P. Zoeteweij, and A. Gemund, "An evaluation of similarity coefficients for software fault localization," in Proceedings of the 12th Pacific Rim International Symposium on Dependable Computing (PRDC), Riverside, USA, 2006, pp. 39-46.
7. B. Liblit, M. Naik, A. Zheng, A. Aiken, and M. Jordan, "Scalable statistical bug isolation," in Proceedings of the ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI), Chicago, USA, 2005, pp. 15-26.
8. B. R. Liblit, "Cooperative bug isolation," Ph.D. dissertation, University of California, 2004.
9. C. Liu, X. Yan, L. Fei, J. Han, and S. Midkiff, "SOBER: statistical model-based bug localization," IEEE Transactions on Software Engineering, vol. 32, no. 10, pp. 831-848, 2006.
10. H. Pan and E. Spafford, "Heuristics for automatic localization of software faults," Technical Report SERC-TR-116-P, Purdue University, Tech. Rep., 1992.
11. T. Reps, T. Ball, M. Das, and J. Larus, "The use of program profiling for software maintenance with applications to the year 2000 problem," ACM SIGSOFT Software Engineering Notes, vol. 22, no. 6, pp. 432-449, 1997.
12. W. E. Wong, V. Debroy, and B. Choi, "A family of code coverage-based heuristics for effective fault localization," The Journal of Systems and Software, vol. 83, no. 2, pp. 188-208, 2010.
13. W. E. Wong, T. Wei, Y. Qi, and L. Zhao, "A crosstab-based statistical method for effective fault localization," in Proceedings of the 1st International Conference on Software Testing, Verification and Validation (ICST), Lillehammer, Norway, 2008, pp. 42-51.
14. A. Zeller, "Isolating cause-effect chains from computer programs," ACM SIGSOFT Software Engineering Notes, vol. 27, no. 6, p. 10, 2002.
15. J. Baker and J. Thornton, "Software engineering challenges in bioinformatics," in Proceedings of the 26th International Conference on Software Engineering (ICSE), Scotland, UK, 2004, pp. 12-15.
16. T. Y. Chen, J. W. K. Ho, H. Liu, and X. Y. Xie, "An innovative approach for testing bioinformatics programs using metamorphic testing," BMC bioinformatics, vol. 10, no. 1, pp. 24-35, 2009.
17. J. W. K. Ho, M. W. Lin, S. Adelstein, and C. G. dos Remedios, "Customising an antibody leukocyte capture microarray for systemic lupus erythematosus: beyond biomarker discovery," Proteomics-Clinical Applications, vol. in press, 2010.
18. J. W. K. Ho, M. Stefani, C. G. dos Remedios, and M. A. Charleston, "Differential variability analysis of gene expression and its application to human diseases," Bioinformatics, vol. 24, pp. 390-398, 2008.
19. E. J. Weyuker, "On testing non-testable programs," Computer Journal, vol. 25, no. 4, pp. 465-470, November 1982.
20. X. Y. Xie, J. W. K. Ho, C. Murphy, G. Kaiser, B. W. Xu, and T. Y. Chen, "Application of metamorphic testing to supervised classifiers," in Proceedings of the 9h International Conference on Quality Software (QSIC), Jeju, Korea, 2009, pp. 135-144.
21. M. Harrold, G. Rothermel, K. Sayre, R. Wu, and L. Yi, "An empirical investigation of the relationship between spectra differences and regression faults," Software Testing Verification and Reliability, vol. 10, no. 3, pp. 171-194, 2000.
22. A. Gotlieb and B. Botella, "Automated Metamorphic Testing," in Proceedings of the 27th Annual International Conference on Computer Software and Applications (COMPSAC), Dallas, TX, USA, 2003, pp. 34-40.
23. W. Chan, S. Cheung, and K. Leung, "A metamorphic testing approach for online testing of service-oriented software applications," International Journal of Web Services Research, vol. 4, no. 2, pp. 61-81, 2007.
24. C. Murphy, K. Shen, and G. Kaiser, "Using JML runtime assertion checking to automate metamorphic testing in applications without test oracles," in Proceedings of the 2nd International Conference on Software Testing,Verification and Validation (ICST), Denver, Colorado, USA, 2009, pp. 436-445.
25. -, "Automatic system testing of programs without test oracles," in Proceedings of the International Symposium on Software Testing and Analysis (ISSTA), Chicago, IL, USA, 2009, pp. 189-200.
26. C. Murphy, "Metamorphic testing techniques to detect defects in applications without test oracles," Ph.D. dissertation, Columbia University, 2010.
27. T. Y. Chen, S. C. Cheung, and S. M. Yiu., "Metamorphic testing: a new approach for generating next test cases." Technical Report HKUST-CS98-01, Dept. of Computer Science, Hong Kong Univ. of Science and Technology, Tech. Rep., 1998.
28. T. Y. Chen, T. H. Tse, and Z. Q. Zhou, "Semi-proving: an integrated method for program proving, testing, and debugging," accepted to appear in IEEE Transactions on Software Engineering.
29. D. Binkley and M. Harman, "A survey of empirical results on program slicing," Advances in Computers, vol. 62, pp. 105-178, 2004.
30. D. Binkley, S. Danicic, T. Gyimóthy, M. Harman, Á. Kiss, and B. Korel, "Theoretical foundations of dynamic program slicing," Theoretical Computer Science, vol. 360, no. 1-3, pp. 23-41, 2006.
31. D. Binkley, N. Gold, and M. Harman, "An empirical study of static program slice size," ACM Transactions on Software Engineering and Methodology, vol. 16, no. 2, p. 8, 2007.
32. SIR, "http://sir.unl.edu/php/index.php."
33. H. Jiang and W. H. Wong, "SeqMap: mapping massive amount of oligonucleotides to the genome," Bioinformatics, vol. 24, pp. 2395-2396, 2008.
34. J. H. Andrews, L. C. Briand, and Y. Labiche, "Is mutation an appropriate tool for testing experiments?" in Proceedings of the 27th International Conference on Software Engineering (ICSE), St. Louis, MO, USA, 2005, pp. 402-411.
35. SeqMap, "http://biogibbs.stanford.edu/ jiangh/SeqMap/."
36. SLOCCount, "http://www.dwheeler.com/sloccount/."
37. GNU, "http://www.gnu.org/software/grep/."
38. J. Jones and M. Harrold, "Empirical evaluation of the tarantula automatic fault-localization technique," in Proceedings of the 20th IEEE/ACM International Conference on Automated Software Engineering (ASE), Long Beach, California, USA, 2005, pp. 273-282.
39. J. Jones, J. Bowring, and M. Harrold, "Debugging in Parallel," in Proceedings of the International Symposium on Software Testing and Analysis (ISSTA), New York, NY, USA, 2007, pp. 16-26.