A comparative analysis of three replicated experiments comparing inspection and unit testing

Proceedings - 2011 2nd International Workshop on Replication in Empirical Software Engineering Research, RESER 2011

Volumn , Issue , 2011, Pages 35-42

  Runeson, Per ^a   Stefik, Andreas ^b   Andrews, Anneliese ^c   Grönblom, Sam ^d   Porres, Ivan ^d   Siebert, Susanna ^a  

^a LUND UNIVERSITY   (Sweden)

^b SOUTHERN ILLINOIS UNIVERSITY EDWARDSVILLE   (United States)

^c UNIVERSITY OF DENVER   (United States)

^d ÅBO AKADEMI UNIVERSITY   (Finland)

Author keywords

Code inspection; Formal experiments; Replication; Unit testing

Indexed keywords

CODES (SYMBOLS); DEFECTS; EMBEDDED SYSTEMS; ENGINEERING RESEARCH; INSPECTION; SOFTWARE DESIGN; SOFTWARE TESTING; STUDENTS;

CODE INSPECTIONS; COMPARATIVE ANALYSIS; DEFECT DETECTION METHOD; FORMAL EXPERIMENTS; REPLICATED EXPERIMENT; REPLICATION; UNDERGRADUATE STUDENTS; UNIT TESTING;

DESIGN OF EXPERIMENTS;

EID: 84858009988     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/RESER.2011.13     Document Type: Conference Paper

References (20)

1. B. Boehm, Software engineering economics. Prentice-Hall Englewood Cliffs, NJ, 1981.
2. A. Aurum, H. Petersson, and C. Wohlin, "State-of-the-art: software inspections after 25 years, " Software Testing, Verification and Reliability, vol. 12, no. 3, pp. 133-154, 2002.
3. N. Juristo, A. M. Moreno, and S. Vegas, "Reviewing 25 years of testing technique experiments, " Empirical Software Engineering, vol. 9, no. 1-2, pp. 7-44, 2004.
4. P. Runeson, C. Anderson, T. Thelin, A. Andrews, and T. Berling, "What do we know about defect detection methods, " IEEE Software, vol. 23, no. 3, pp. 82-90, 2006.
5. P. Runeson and A. Andrews, "Detection or isolation of defects? An experimental comparison of unit testing and code inspection, " 14th International Symposium on Software Reliability Engineering, pp. 3-13, 2003.
6. W. Hetzel, "An Experimental Analysis of Program Verification Problem Solving Capabilities as they Relate to Programmer Efficiency, " Comput. Personnel, vol. 3, no. 3, pp. 10-15, 1972.
7. V. Basili and R. Selby, "Comparing the effectiveness of software testing strategies, " IEEE Transactions on Software Engineering, vol. 13, no. 12, pp. 1278-1296, 1987.
8. S. So, S. Cha, T. Shimeall, and Y. Kwon, "An empirical evaluation of six methods to detect faults in software, " Software Testing, Verification & Reliability, vol. 12, no. 3, pp. 155-171, 2002.
9. O. Laitenberger, "Studying the effects of code inspection and structural testing on software quality, " International Symposium on Software Reliability Engineering, pp. 237-246, 1998.
10. C. Wohlin, P. Runeson, M. Ḧost, M. C. Ohlsson, B. Regnell, and A. Wesslen, Experimentation in Software Engineering: An Introduction. Springer, 2000.
11. D. Sjøberg, T. Dyb°a, and M. Jørgensen, "The future of empirical methods in software engineering research, " International Conference on Software Engineering, pp. 358-378, 2007. (Pubitemid 47484937)
12. L. Pickard, B. A. Kitchenham, and P. Jones, "Combining empirical results in software engineering, " Information and Software Technology, vol. 40, no. 14, pp. 811-821, 1998. (Pubitemid 128415104)
13. J. Miller, "Applying meta-analytical procedures to software engineering experiments, " Journal of Systems and Software, vol. 54, no. 1, pp. 29-39, 2000.
14. B. A. Kitchenham, "The role of replications in empirical software engineering-a word of warning, " Empirical Software Engineering, vol. 13, pp. 219-221, 2008.
15. F. Shull, V. R. Basili, J. Carver, J. C. Maldonado, G. H. Travassos, M. Mendonca, and S. Fabbri, "Replicating software engineering experiments: addressing the tacit knowledge problem, " in Proceedings of the International Symposium Empirical Software Engineering, pp. 7-16, 2002.
16. F. J. Shull, J. Carver, S. Vegas, and N. Juristo, "The role of replications in empirical software enginering, " Empirical Software Engineering, vol. 13, no. 2, pp. 211-218, 2008.
17. O. S. Gomes, N. Juristo, and S. Vegas, "Replications types in experimental disciplines, " in Proceedings of the Fourth International Symposium on Empirical Software Engineering and Measurement, 2010.
18. S. Siegel and N. Castellan, Nonparametric statistics for the behavioural sciences. McGraw-Hill New York, 1956.
19. T. Anderson and D. Darling, "Asymptotic theory of certain "goodness of fit" criteria based on stochastic processes, " Ann. Math. Statist, vol. 23, no. 2, 1952.
20. W. S. Humphrey, A discipline for software engineering. Addison Wesley, 1995.