A theoretical analysis of the risk evaluation formulas for spectrum-based fault localization

ACM Transactions on Software Engineering and Methodology

Volumn 22, Issue 4, 2013, Pages

  Xie, Xiaoyuan ^a   Chen, Tsong Yueh ^a   Kuo, Fei Ching ^a   Xu, Baowen ^b  

^a SWINBURNE UNIVERSITY OF TECHNOLOGY   (Australia)

^b NANJING UNIVERSITY   (China)

Author keywords

Debugging; Risk evaluation formulas; Spectrum based fault localization; Testing

Indexed keywords

DISJOINT SETS; EMPIRICAL APPROACH; FAULT LOCALIZATION; PROGRAM STATEMENTS; RISK EVALUATION; SATISFACTORY SOLUTIONS; THEORETICAL INVESTIGATIONS; TYPES OF RELATIONS;

COMPUTER DEBUGGING; COMPUTER SOFTWARE; TESTING;

SOFTWARE ENGINEERING;

EID: 84886517134     PISSN: 1049331X     EISSN: 15577392     Source Type: Journal    
DOI: 10.1145/2522920.2522924     Document Type: Article

References (40)

1. ABREU, R.,ZOETEWEIJ, P.,GOLSTEIJN, R., AND VANGEMUND, A. J. C. 2009. A practical evaluation of spectrum-based fault localization. J. Syst. Softw. 82, 11, 1780-1792.
2. ABREU, R., ZOETEWEIJ, P., AND VAN GEMUND, A. J. C. 2006. An evaluation of similarity coefficients for software fault localization. In Proceedings of the 12th Pacific Rim International Symposium on Dependable Computing. 39-46.
3. ABREU, R., ZOETEWEIJ, P., AND VAN GEMUND, A. J. C. 2007. On the accuracy of spectrum-based fault localization. In Proceedings of Testing: Academic and Industrial Conference Practice and Research Techniques (TAICPART-MUTATION'07). 89-98.
4. AGRAWAL, H., HORGAN, J. R., LONDON, S., AND WONG, W. E. 1995. Fault localization using execution slices and dataflow tests. In Proceedings of the 6th International Symposium on Software Reliability Engineering. 143-151.
5. BAAH, G. K., PODGURSKI, A., AND HARROLD, M. J. 2010. Causal inference for statistical fault localization. In Proceedings of the International Symposium on Software Testing and Analysis. 73-84.
6. BANDYOPADHYAY, A. AND GHOSH, S. 2011. Proximity based weighting of test cases to improve spectrum based fault localization. In Proceedings of the 26th IEEE/ACMInternational Conference on Automated Software Engineering. 420-423.
7. CHEN, M., KICIMAN, E., FRATKIN, E., FOX, A., AND BREWER, E. 2002. Pinpoint: Problem determination in large, dynamic internet services. In Proceedings of the 32nd IEEE/IFIP International Conference on Dependable Systems and Networks. 595-604.
8. COLLOFELLO, J. S. ANDWOODFIELD, S. N. 1989. Evaluating the effectiveness of reliability-assurance techniques. J. Syst. Softw. 9, 3, 191-195.
9. DALLMEIER, V., LINDIG, C., AND ZELLER, A. 2005. Lightweight defect localization for java. In Proceedings of the 19th European Conference on Object-Oriented Programming. 528-550.
10. DICKINSON, W., LEON, D., AND PODGURSKI, A. 2001. Finding failures by cluster analysis of execution profiles. In Proceedings of the 23rd International Conference on Software Engineering. 339-348.
11. DIGIUSEPPE, N. AND JONES, J. A. 2011. On the influence of multiple faults on coverage-based fault localization. In Proceedings of the International Symposium on Software Testing and Analysis. 199-209.
12. HARROLD,M. J.,ROTHERMEL, G.,SAYRE, K.,WU, R., AND YI, L. 2000. An empirical investigation of the relationship between spectra differences and regression faults. Softw. Testing Verif. Reliab. 10, 3, 171-194.
13. HARROLD, M. J., ROTHERMEL, G., WU, R., AND YI, L. 1998. An empirical investigation of program spectra. In Proceedings of the 1st ACM SIGPLAN-SIGSOFT Workshop on Program Analysis for Software Tools and Engineering. 83-90.
14. JIANG, B., ZHANG, Z., TSE, T. H., AND CHEN, T. Y. 2009. How well do test case prioritization techniques support statistical fault localization. In Proceedings of the 33rd Annual International Conference on Computer Software and Applications. Vol. 1. 99-106.
15. JONES, J. A.,BOWRING, J. F., ANDHARROLD,M. J. 2007. Debugging in parallel. In Proceedings of the International Symposium on Software Testing and Analysis. 16-26.
16. JONES, J. A. AND HARROLD, M. J. 2005. Empirical evaluation of the tarantula automatic fault-localization technique. In Proceedings of the 20th IEEE/ACM International Conference on Automated Software Engineering. 273-282.
17. JONES, J. A.,HARROLD, M. J., AND STASKO, J. 2002. Visualization of test information to assist fault localization. In Proceedings of the 24th International Conference on Software Engineering. 467-477.
18. LEE, H. J.,NAISH, L., AND RAMAMOHANARAO, K. 2009a. Study of the relationship of bug consistency with respect to performance of spectra metrics. In Proceedings of the 2nd IEEE International Conference on Computer Science and Information Technology. 501-508.
19. LEE, H. J., NAISH, L., AND RAMAMOHANARAO, K. 2009b. The effectiveness of using non redundant test cases with program spectra for bug localization. In Proceedings of the 2nd IEEE International Conference on Computer Science and Information Technology. 127-134.
20. LIBLIT, B. R. 2004. Cooperative bug isolation. Ph.D. thesis, University of California. http://theory. stanford.edu/?aiken/publications/theses/liblit. pdf.
21. LIBLIT, B. R., NAIK, M., ZHENG, A. X., AIKEN, A., AND JORDAN, M. I. 2005. Scalable statistical bug isolation. In Proceedings of the ACM SIGPLAN Conference on Programming Language Design and Implementation. 15-26.
22. LIU, C., FEI, L., YAN, X., HAN, J., AND MIDKIFF, S. 2006. Statistical debugging: A hypothesis testing-based approach. IEEE Trans. Softw. Engin. 32, 10, 831-848.
23. LIU, C. AND HAN, J. 2006. Failure proximity: A fault localization-based approach. In Proceedings of the 14th ACM SIGSOFT International Symposium on Foundations of Software Engineering. 46-56.
24. NAISH, L.,LEE, H. J., AND RAMAMOHANARAO, K. 2009. Spectral debugging with weights and incremental ranking. In Proceedings of the 16th Asia-Pacific Software Engineering Conference. 168-175.
25. NAISH, L.,LEE, H. J., AND RAMAMOHANARAO, K. 2011. A model for spectra-based software diagnosis. ACMTrans. Softw. Engin. Methodol. 20, 3, 11:1-11:32.
26. PARNIN, C. AND ORSO, A. 2011. Are automated debugging techniques actually helping programmers? In Proceedings of the International Symposium on Software Testing and Analysis. 199-209.
27. PODGURSKI, A., LEON, D., FRANCIS, P.,MASRI, W.,MINCH, M., SUN, J., AND WANG, B. 2003. Automated support for classifying software failure reports. In Proceedings of the 25th International Conference on Software Engineering. 465-475.
28. REPS, T., BALL, T., DAS, M., AND LARUS, J. 1997. The use of program profiling for software maintenance with applications to the year 2000 problem. In Proceedings of the 6th European Software Engineering Conference held jointlywith the 5th ACMSIGSOFT International Symposium on Foundations of Software Engineering. 432-449.
29. SANTELICES, R., JONES, J. A., YU, Y., AND HARROLD, M. J. 2009. Lightweight fault-localization using multiple coverage types. In Proceedings of the 31st International Conference on Software Engineering. 56-66.
30. SIR. 2005. http://sir.unl.edu/php/index.php.
31. WONG, W. E., DEBROY, V., AND CHOI, B. 2010. A family of code coverage-based heuristics for effective fault localization. J. Syst. Softw. 83, 2, 188-208.
32. WONG, W. E. AND QI, Y. 2006. Effective program debugging based on execution slices and inter-block data dependency. J. Syst. Softw. 79, 7, 891-903.
33. WONG, W. E.,QI, Y., ZHAO, L., AND CAI, K. Y. 2007. Effective fault localization using code coverage. In Proceedings of the 31st Annual International Conference on Computer Software and Applications. 449-456.
34. WONG, W. E., WEI, T., QI, Y., AND ZHAO, L. 2008. A crosstab-based statistical method for effective fault localization. In Proceedings of the 1st International Conference on Software Testing, Verification and Validation. 42-51.
35. XIE, X. Y. 2012. On the analysis of spectrum-based fault localization. Ph.D. thesis, Swinburne University of Technology, Australia. http://www.ict.swin.edu.au/personal/xxie/publications/XiaoyuanXie-PhDThesis.pdf.
36. XIE, X. Y., CHEN, T. Y., AND XU, B. W. 2010. Isolating suspiciousness from spectrum-based fault localization techniques. In Proceedings of the 10th International Conference on Quality Software. 385-392.
37. XIE, X. Y., WONG, W. E., CHEN, T. Y., AND XU, B. W. 2011. Spectrum-based fault localization: Testing oracles are no longer mandatory. In Proceedings of the 11th International Conference on Quality Software. 1-10.
38. YU, Y., JONES, J. A., AND HARROLD, M. J. 2008. An empirical study of the effects of test-suite reduction on fault localization. In Proceedings of the 30th International Conference on Software Engineering. 201-210.
39. ZELLER, A. 2002. Isolating cause-effect chains from computer programs. In Proceedings of the 10th ACM SIGSOFT Symposium on Foundations of Software Engineering. 1-10.
40. ZHENG, A. X., JORDAN, M. I., LIBLIT, B., NAIK, M., AND AIKEN, A. 2006. Statistical debugging: Simultaneous identification ofmultiple bugs. In Proceedings of the 23rd International Conference on Machine Learning. 1105-1112.