An empirical study about the effectiveness of debugging when random test cases are used

Proceedings - International Conference on Software Engineering

Volumn , Issue , 2012, Pages 452-462

  Ceccato, Mariano ^a   Marchetto, Alessandro ^a   Mariani, Leonardo ^b   Nguyen, Cu D ^a   Tonella, Paolo ^a  

^a FONDAZIONE BRUNO KESSLER   (Italy)

^b UNIVERSITY OF MILANO BICOCCA   (Italy)

Author keywords

Automatic Test Case Generation; Debugging; Empirical Software Engineering

Indexed keywords

AUTOMATIC TESTCASE GENERATION; AUTOMATICALLY GENERATED; CONTROLLED EXPERIMENT; EMPIRICAL SOFTWARE ENGINEERING; EMPIRICAL STUDIES; FAULT LOCALIZATION; HUMAN SUBJECTS; RANDOM TESTS; TEST CASE; TEST SCENARIO;

COMPUTER DEBUGGING; SOFTWARE ENGINEERING;

AUTOMATIC TEST PATTERN GENERATION;

EID: 84864209263     PISSN: 02705257     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSE.2012.6227170     Document Type: Conference Paper

References (20)

1. J. Andrews, A. Groce, M. Weston, and R.-G. Xu. Random test run length and effectiveness. In Proceedings of the 2008 23rd IEEE/ACM International Conference on Automated Software Engineering, ASE, pages 19-28, Washington, DC, USA, 2008. IEEE Computer Society.
2. N. E. Beckman, A. V. Nori, S. K. Rajamani, R. J. Simmons, S. D. Tetali, and A. V. Thakur. Proofs from tests. IEEE Transactions on Software Engineering, 36:495-508, 2010.
3. M. Ceccato, C. D. Nguyen, A. Marchetto, L. Mariani, and P. Tonella. Debugging tasks supported either by manual or automatic test cases, analysis of two replications: Trento and Milano. Technical report, FBK, TR-FBK-SE-2011-4-0, http://se.fbk.eu/en/techreps, September 2011.
4. I. Ciupa, A. Leitner, M. Oriol, and B. Meyer. Experimental assessment of random testing for object-oriented software. In Proceedings of the 2007 international symposium on Software testing and analysis, ISSTA '07, pages 84-94, New York, NY, USA, 2007. ACM.
5. T. M. Cover and P. E. Hart. Nearest neighbor pattern classification. IEEE Transactions on on Information Theory, 13(1):21-27, 1967.
6. J. W. Duran. An evaluation of random testing. IEEE Transactions on Software Engineering, 4:438-444, 1984.
7. P. G. Frankl and S. N. Weiss. An experimental comparison of the effectiveness of the all-uses and all-edges adequacy criteria. In Proceedings of the symposium on Testing, analysis, and verification, TAV4, pages 154-164, New York, NY, USA, 1991. ACM.
8. G. Fraser and A. Zeller. Mutation-driven generation of unit tests and oracles. In Proceedings of the 19th international symposium on Software testing and analysis, ISSTA, pages 147-158, New York, NY, USA, 2010. ACM.
9. Z. P. Fry and W. Weimer. A human study of fault localization accuracy. In Proceedings of the 2010 IEEE International Conference on Software Maintenance, ICSM '10, pages 1-10, Washington, DC, USA, 2010. IEEE Computer Society.
10. P. Godefroid, N. Klarlund, and K. Sen. DART: directed automated random testing. In Proceedings of the 2005 ACM SIGPLAN conference on Programming language design and implementation, PLDI, pages 213-223, New York, NY, USA, 2005. ACM.
11. L. Huang and M. Holcombe. Empirical investigation towards the effectiveness of test first programming. Inf. Softw. Technol., 51:182-194, January 2009.
12. A. N. Oppenheim. Questionnaire Design, Interviewing and Attitude Measurement. Pinter, London, 1992.
13. C. Pacheco and M. D. Ernst. Randoop: feedback-directed random testing for java. In Companion to the 22nd ACM SIGPLAN conference on Object-oriented programming systems and applications companion, OOPSLA, pages 815-816, New York, NY, USA, 2007. ACM.
14. C. Parnin and A. Orso. Are automated debugging techniques actually helping programmers? In Proceedings of the International Symposium on Software Testing and Analysis, ISSTA, USA, 2011. ACM.
15. F. Ricca, M. Torchiano, M. D. Penta, M. Ceccato, and P. Tonella. Using acceptance tests as a support for clarifying requirements: A series of experiments. Information and Software Technology, 51(2):270-283, 2009.
16. K. Sen, D. Marinov, and G. Agha. Cute: a concolic unit testing engine for c. SIGSOFT Softw. Eng. Notes, 30:263-272, September 2005.
17. N. Tillmann and J. D. Halleux. Pex: white box test generation for .NET. In Proceedings of the 2nd international conference on Tests and proofs, TAP, pages 134-153, Berlin, Heidelberg, 2008. Springer-Verlag.
18. C. J. van Rijsbergen. Information Retrieval (2nd ed.). Butterworths, London, UK, 1979.
19. M. Weiser and J. Lyle. Experiments on slicing-based debugging aids. In Papers presented at the first workshop on empirical studies of programmers on Empirical studies of programmers, pages 187-197, Norwood, NJ, USA, 1986. Ablex Publishing Corp.
20. C. Wohlin, P. Runeson, M. Höst, M. Ohlsson, B. Regnell, and A. Wesslén. Experimentation in Software Engineering - An Introduction. Kluwer Academic Publishers, 2000.