How well do professional developers test with code coverage visualizations? An empirical study

Proceedings - 2005 IEEE Symposium on Visual Languages and Human-Centric Computing

Volumn 2005, Issue , 2005, Pages 53-60

  Lawrence, Joseph ^a,b   Clarke, Steven ^a   Burnett, Margaret ^b   Rothermel, Gregg ^c  

^a MICROSOFT   (United States)

^b Oregon State University   (United States)

^c UNIVERSITY OF NEBRASKA LINCOLN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CODE COVERAGE VISUALIZATIONS; END-USER DEVELOPERS; PROFESSIONAL SOFTWARE DEVELOPERS; PROGRAMMING ENVIRONMENTS;

CODES (SYMBOLS); COMPUTER SYSTEMS PROGRAMMING; COMPUTER VISION; PROBLEM SOLVING; PROFESSIONAL ASPECTS; USER INTERFACES;

SOFTWARE ENGINEERING;

EID: 33746513132     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. C. Allwood, "Error detection processes in statistical problem solving." Cognitive Science, vol. 8, no. 4, pp. 413-437, 1984.
2. V. R. Basili and R. W. Selby, "Comparing the effectiveness of software testing strategies," IEEE Trans. Software Engineering, vol. 13, no. 12, pp. 1278-1296, 1987.
3. L. Briand and Y. Labiche, "Empirical studies of software testing techniques: Challenges, practical strategies, and future research," WERST Proceedings/ACM SIGSOFT Software Engineering Notes, vol. 29, no. 5, pp. 1-3, 2004.
4. S. Elbaum, A. G. Malishevsky, and G. Rothermel, "Test case prioritization: A family of empirical studies," IEEE Trans. Software Engineering, vol. 28, no. 2, pp. 159-182, 2002.
5. P. Frankl and E. Weyuker, "An applicable family of data flow criteria," IEEE Trans. Software Engineering, vol. 14, no. 10, pp. 1483-1498, 1988.
6. P. G. Frankl and S. N. Weiss, "An experimental comparison of the effectiveness of branch testing and data flow testing," IEEE Trans. Software Engineering, vol. 19, no. 8, pp. 774-787, 1993.
7. P. G. Frankl and O. Iakounenko, "Further empirical studies of test effectiveness," in SIGSOFT '98/FSE-6: 6th ACM SIGSOFT International Symposium on Foundations of Software Engineering, Lake Buena Vista, Florida, USA, 1998, pp. 153-162.
8. B. A. Galler, "ACM president's letter: NATO and software engineering?" Comm. ACM, vol. 12, no. 6, p. 301, 1969.
9. J. B. Goodenough and S. L. Gerhart, "Toward a theory of test data selection," in International Conf. Reliable Software, 1975, pp. 493-510.
10. M. Hutchins, H. Foster, T. Goradia, and T. Ostrand, "Experiments of the effectiveness of dataflow- and controlflow-based test adequacy criteria," in ICSE '94: 16th International Conf. Software Engineering, 1994, pp. 191-200.
11. J. A. Jones, M. J. Harrold, and J. Stasko, "Visualization of test information to assist fault localization," in ICSE '02: 24th International Conf. Software Engineering, 2002, pp. 467-477.
12. N. Juristo, A. M. Moreno, and S. Vegas, "Reviewing 25 years of testing technique experiments," Empirical Software Engineering, vol. 9, no. 1-2, pp. 7-44, 2004.
13. E. Kamsties and C. M. Lott, "An empirical evaluation of three defect-detection techniques," in Fifth European Software Engineering Conference, W. Schafer and P. Botella, Eds. Lecture Notes in Computer Science Nr. 989, 1995, pp. 362-383.
14. R. Panko, "What we know about spreadsheet errors." Journal of End User Computing, pp. 15-21, 1998.
15. S. Rapps and E. J. Weyuker, "Selecting software test data using data flow information," IEEE Trans. Software Engineering, vol. 11, no. 4, pp. 367-375, 1985.
16. K. J. Rothermel, C. R. Cook, M. M. Burnett, J. Schonfeld, T. R. G. Green, and G. Rothermel, "WYSIWYT testing in the spreadsheet paradigm: An empirical evaluation," in ICSE '00: 22nd International Conf. Software Engineering, 2000, pp. 230-239.
17. RTI, "The economic impacts of inadequate infrastructure for software testing," National Institute of Standards and Technology, Tech. Rep. 02-3, 2002. [Online]. Available: http://www.nist.gov/director/prog-ofc/report02-3.pdf
18. M. Wood, M. Roper, A. Brooks, and J. Miller, "Comparing and combining software defect detection techniques: A replicated empirical study," in ESEC '97/FSE-5: 5th ACM SIGSOFT International Symposium on Foundations of Software Engineering, 1997, pp. 262-277.
19. H. Zhu, P. A. V. Hall, and J. H. R. May, "Software unit test coverage and adequacy," ACM Comput. Surv., vol. 29, no. 4, pp. 366-427, 1997.