A family of code coverage-based heuristics for effective fault localization

Journal of Systems and Software

Volumn 83, Issue 2, 2010, Pages 188-208

  Eric Wong, W ^a   Debroy, Vidroha ^a   Choi, Byoungju ^b  

^a The University of Texas at Dallas   (United States)

^b Ewha Womans University   (South Korea)

Author keywords

Code coverage; Failed tests; Fault localization; Heuristics; Program debugging; Successful tests; Suspiciousness of code

Indexed keywords

AUTOMATED TECHNIQUES; CODE COVERAGE; FAILED TESTS; FAULT LOCALIZATION; PRIORITIZATION; PROGRAM BUGS; SIEMENS; TEST CASE;

HEURISTIC METHODS; TESTING;

PROGRAM DEBUGGING;

EID: 73149083478     PISSN: 01641212     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jss.2009.09.037     Document Type: Article

References (35)

1. Abreu, R., Zoeteweij, P., van Gemund, A.J.C., 2007. On the accuracy of spectrum-based fault localization. In: Proceedings of the Testing: Academic and Industrial Conference - Practice and Research Techniques, September 2007, pp. 89-98.
2. Agrawal H., DeMillo R.A., and Spafford E.H. Debugging with dynamic slicing and backtracking. Software - Practice and Experience 23 6 (1996) 589-616 (June)
3. Agrawal, H., Horgan, J.R., 1990. Dynamic program slicing. In: Proceedings of the ACM SIGPLAN'90 Conference on Programming Language Design and Implementation, June 1990.
4. Agrawal H., Horgan J.R., Wong W.E., et al. Mining system tests to aid software maintenance. IEEE Computer 31 7 (1998) 64-73 (July)
5. Agrawal, H., Horgan, J.R., London, S., Wong, W.E., 1995. Fault localization using execution slices and dataflow tests. In: Proceedings of the 6th IEEE International Symposium on Software Reliability Engineering, Toulouse, France, October 1995, pp. 143-151.
6. Andrews, J.H., Briand, L.C., Labiche, Y., 2005. Is mutation an appropriate tool for testing experiments? In: Proceedings of the 27th International Conference on Software Engineering, St. Louis, Missouri, USA, May 2005, pp. 402-411.
7. Cleve, H., Zeller, A., 2005. Locating causes of program failures. In: Proceedings of the 27th International Conference on Software Engineering (ICSE 2005), St. Louis, Missouri, USA, May 2005, pp. 342-351.
8. Ellsberger J., Hogrefe D., and Sarma A. SDL: Formal object-oriented language for communicating systems (1997), Prentice Hall
9. Horgan, J.R., London, S.A., 1991. Data flow coverage and the C Language. In: Proceedings of the 4th Symposium on Software Testing, Analysis, and Verification, Victoria, British Columbia, Canada, October 1991, pp. 87-97.
10. Hutchins, M., Foster, H., Goradia, T., Ostrand, T., 1994. Experiments on the effectiveness of dataflow- and controlflow-based test adequacy criteria. In: Proceedings of the 16th International Conference on Software Engineering, Sorrento, Italy, May 1994, pp. 191-200.
11. Jones, J.A., Harrold, M.J., 2005. Empirical evaluation of the Tarantula automatic fault-localization technique. In: Proceedings of the 20th IEEE/ACM International Conference on Automated Software Engineering (ASE 2005), Long Beach, CA, USA, November 2005, pp. 273-282.
12. Jones, A., Bowring, J., Harrold, M.J., 2007. Debugging in parallel. In: Proceedings of the 2007 International Symposium on Software Testing and Analysis, London, UK, July 2007, pp. 16-26.
13. Korel B., and Laski J. Dynamic program slicing. Information Processing Letters 29 3 (1988) 155-163 (October)
14. Liblit, B., Naik, M., Zheng, A.X., Aiken, A., Jordan, M.I., 2005. Scalable statistical bug isolation. In: Proceedings of the 2005 ACM SIGPLAN Conference on Programming Language Design and Implementation, Chicago, IL, June 2005, pp. 15-26.
15. Lyle, J.R., Weiser, M., 1987. Automatic program bug location by program slicing. In: Proceedings of the 2nd International Conference on Computer and Applications, Beijing, China, June 1987, pp. 877-883.
16. Liu C., Fei L., Yan X., Han J., and Midkiff S.P. Statistical debugging: a hypothesis testing-based approach. IEEE Transactions on Software Engineering 32 10 (2006) 831-848 (October)
17. Liu, C., Han, J., 2006. Failure proximity: a fault localization-based approach. In: Proceedings of the 14th ACM SIGSOFT International Symposium on Foundations of Software Engineering, Portland, Oregon, USA, November 2006, pp. 46-56.
18. Renieris, M., Reiss, S.P., 2003. Fault localization with nearest neighbor queries. In: Proceedings of the 18th IEEE International Conference on Automated Software Engineering, Montreal, Canada, October 2003, pp. 30-39.
19. Podgurski, A., Leon, D., Francis, P., Masri, W., Minch, M., Sun, J., Wang, B., 2003. Automated support for classifying software failure reports. In: Proceedings of the 25th International Conference on Software Engineering, Portland, Oregon, USA, May 2003, pp. 465-475.
20. The Siemens Suite, January 2007. .
21. Vessey I. Expertise in debugging computer programs. International Journal of Man-Machine Studies: A Process Analysis 23 5 (1985) 459-494
22. Wang, X., Cheung, S.C., Chan, W.K., Zhang, Z., 2009. Taming coincidental correctness: refine code coverage with context pattern to improve fault localization. In: Proceedings of the 31st IEEE International Conference on Software Engineering, Vancouver, Canada, May 2009, pp. 45-55.
23. Weiser M. Programmers use slices when debugging. Communications of the ACM 25 7 (1982) 446-452 (July)
24. Wong, W.E., Li, J.J., 2005. An integrated solution for testing and analyzing Java applications in an industrial setting. In: Proceedings of the 12th IEEE Asia-Pacific Software Engineering Conference (APSEC), Taipei, Taiwan, December 2005, pp. 576-583.
25. Wong W.E., Horgan J.R., London S., and Mathur A.P. Effect of test set minimization on fault detection effectiveness. Software-Practice and Experience 28 4 (1998) 347-369 (April)
26. Wong W.E., and Qi Y. Effective program debugging based on execution slices and inter-block data dependency. Journal of Systems and Software 79 7 (2006) 891-903 (July)
27. Wong W.E., and Qi Y. BP neural network-based effective fault localization. International Journal of Software Engineering and Knowledge Engineering 19 4 (2009) 573-597 (June)
28. Wong W.E., Sugeta T., Qi Y., and Maldonado J.C. Smart debugging software architectural design in SDL. Journal of Systems and Software 76 1 (2005) 15-28 (April)
29. Wong, W.E., Shi, Y., Qi, Y., Golden, R., 2008a. Using an RBF neural network to locate program bugs. In: Proceedings of the 19th IEEE International Symposium on Software Reliability Engineering (ISSRE), Seattle, USA, November 2008, pp. 27-38.
30. Wong, W.E., Wei, T., Qi, Y., Zhao, L., 2008b. A Crosstab-based statistical method for effective fault localization. In: Proceedings of the First International Conference on Software Testing, Verification and Validation (ICST), Lillehammer, Norway, April 2008, pp. 42-51.
31. χSuds User's manual, 1998. Telcordia Technologies.
32. Zeller, A., 2002. Isolating cause-effect chains from computer programs. In: Proceedings of the 10th ACM SIGSOFT Symposium on Foundations of Software Engineering, Charleston, South Carolina, USA, November 2002, pp. 1-10.
33. Zeller A., and Hildebrandt R. Simplifying and isolating failure-inducing input. IEEE Transactions on Software Engineering 28 2 (2002) 183-200 (February)
34. Zhang, X., Gupta, N., Gupta, R., 2006. Locating faults through automated predicate switching. In: Proceeding of the 28th International Conference on Software Engineering, Shanghai, China, May 2006, pp. 272-281.
35. Zheng, A.X., Jordan, M.I., Liblit, B., Naik, M., Aiken, A., 2006. Statistical debugging: simultaneous identification of multiple bugs. In: Proceedings of the 23rd International Conference on Machine Learning, Pittsburgh, Pennsylvania, June 2006, pp. 1105-1112.