In search of what we experimentally know about unit testing

IEEE Software

Volumn 23, Issue 6, 2006, Pages 72-80

  Juristo, Natalia ^a   Moreno, Ana M ^a   Vegas, Sira ^a   Solari, Moreno ^b  

^a UNIVERSIDAD POLITÉCNICA DE MADRID   (Spain)

^b UNIVERSIDAD ORT URUGUAY   (Uruguay)

Author keywords

Empirical methods; Evidence based software engineering; Experimentation; Testing techniques; Unit testing

Indexed keywords

COMPUTER SOFTWARE; COMPUTER SOFTWARE SELECTION AND EVALUATION; TESTING;

EMPIRICAL METHODS; EVIDENCE-BASED SOFTWARE ENGINEERING; TESTING TECHNIQUES; UNIT TESTING;

SOFTWARE ENGINEERING;

EID: 36949034058     PISSN: 07407459     EISSN: None     Source Type: Journal    
DOI: 10.1109/MS.2006.166     Document Type: Article

References (33)

1. T. Dyba, B.A. Kitchenham, and M. Jorgensen, "Evidence-Based Software Engineering for Practitioners," IEEE Software, Jan./Feb. 2005, pp. 58-65.
2. M.V. Zelkowitz, D.R Wallace, and D.W. Binkley, "Experimental Validation of New Software Technology," Lecture Notes on Empirical Software Eng., N. Juristo and A.M. Moreno, eds., World Scientific, 2003, pp. 229-263.
3. N. Juristo and A.M. Moreno, Basics of Software Engineering Experimentation, Kluwer, 2001.
4. L.M. Pickard, B.A. Kitchenham, and P.W. Jones, "Combining Empirical Results in Software Engineering," Information and Software Technology, vol. 40, no. 14, 1998, pp. 811-821.
5. S.L. Pfleeger, "Soup or Art? The Role of Evidential Force in Empirical Software Engineering," IEEE Software, Jan./Feb. 2005, pp. 66-73.
6. N. Juristo, A.M. Moreno, and S. Vegas, "Reviewing 25 Years of Testing Technique Experiments," Empirical Software Eng., vol 9, no. 1, 2004, pp. 7-44.
7. IEEE/ACM Software Eng. Body of Knowledge, Iron Man Version, 2004; www.swebok.org.
8. V.R. Basili and R.W. Selby. "Comparing the Effectiveness of Software Testing Strategies," IEEE Trans. Software Eng., vol. 13, no. 2, 1987, pp. 1278-1296.
9. E. Kamsties and C.M. Lott, "An Empirical Evaluation of Three Defect-Detection Techniques," Proc. 5th European Software Eng. Conf. (ESEC 95), LNCS 989, Springer, 1995, pp. 362-383.
10. B. Beizer, Software Testing Techniques, Int'l Thomson Computer Press, 1990.
11. M. Roper, M. Wood, and J. Miller, "An Empirical Evaluation of Defect Detection Techniques," Information and Software Tech., vol. 39, no. 11, 1997, pp. 763-775.
12. J.M. Bieman and J.L. Schultz, "An Empirical Evaluation (and Specification) of the All-du-paths Testing Criterion," Software Eng. J., Jan. 1992, pp. 43-51.
13. E.J. Weyuker, "The Complexity of Data Flow Criteria for Test Data Selection," Information Processing Letters, vol. 19, no. 2, 1984, pp. 103-109.
14. M. Hutchins et al., "Experiments on the Effectiveness of Dataflow- and Controlflow-Based Test Adequacy Criteria," Proc. 16th Int'l Conf. Software Eng. (ICSE 94), IEEE CS Press, 1994, pp. 191-200.
15. A.J. Offut and S.D. Lee, "An Empirical Evaluation of Weak Mutation," IEEE Trans. Software Eng., vol. 20, no. 5, 1994, pp. 337-344.
16. A.J. Offut et al., "An Experimental Determination of Sufficient Mutant Operators," ACM Trans. Software Eng. and Methodology, vol. 5, no. 2, 1996, pp. 99-118.
17. E. Wong and A.P. Mathur, "Fault Detection Effectiveness of Mutation and Data-flow Testing," Software Quality J., vol. 4, no. 1, 1995, pp. 69-83.
18. H. Lee, Y. Ma, and Y. Kwon, "Empirical Evaluation of Orthogonality of Class Mutation Operators," Proc. 11th Asia-Pacific Software Eng. Conf. (APSEC 04), IEEE CS Press, 2004, pp. 512-518.
19. E.J. Weyuker, "The Cost of Data Flow Testing: An Empirical Study," IEEE Trans. Software Eng., vol. 16, no. 2, 1990, pp. 121-128.
20. P. Frankl and O. Iakounenko, "Further Empirical Studies of Test Effectiveness," Proc. Int'l Symp. Foundations Software Eng., ACM Press, 1998, pp. 53-162.
21. P.G. Frankl and Y. Deng, "Comparison of Delivered Reliability of Branch, Data Flow and Operational Testing: A Case Study," Proc. ACM Int'l Symp. Software Testing and Analysis, ACM Press, 2000, pp. 124-131.
22. P.G. Frankl and S.N. Weiss, "An Experimental Comparison of the Effectiveness of Branch Testing and Data Flow Testing," IEEE Trans. Software Eng., vol. 19, no. 8, 1993, pp. 774-787.
23. P.G. Frankl, S.N. Weiss, and C. Hu, "All-Uses versus Mutation Testing: An Experimental Comparison of Effectiveness," J. Systems and Software, vol. 38, 1997, pp. 235-253.
24. G. Rothermel and M.J. Harrold, "Empirical Studies of a Safe Regression Test Selection Technique," IEEE Trans. Software Eng., vol. 24, no. 6, 1998, pp. 401-419.
25. J. Bible, G. Rothermel, and D. Rosenblum, "A Comparative Study of Coarse - and Fine-Grained Safe Regression Test Selection," ACM Trans. Software Eng. and Methodology, vol. 10, no. 2, 2001, pp. 149-183.
26. F. Vokolos and P.G. Frankl, "Empirical Evaluation of the Textual Differencing Regression Testing Technique," Proc. Int'l Conf. Software Maintenance, IEEE CS Press, 1998, pp. 44-53.
27. J.M. Kim, A. Porter, and G. Rothermel, "An Empirical Study of Regression Test Application Frequency," Proc. 22nd Int'l Conf. Software Eng. (ICSE 00), IEEE CS Press, 2000, pp. 126-135.
28. D. Leon, W. Masri, and A. Podgurski, "An Empirical Evaluation of Test Case Filtering Techniques Based on Exercising Complex Information Flows," Proc. 27th Int'l Conf. Software Eng. (ICSE 05), IEEE CS Press, 2005; pp. 412-421.
29. T.L. Graves et al., "An Empirical Study of Regression Test Selection Techniques," ACM Trans. Software Eng. and Methodology, vol. 10, no. 2, 2001, pp. 184-208.
30. G. Rothermel et al., "Test Case Prioritization: An Empirical Study," Proc. Int'l Conf. Software Maintenance, IEEE CS Press, 1999, pp. 179-188.
31. S. Elbaum, A.G. Mailshevsky, and G. Rothermel, "Prioritizing Test Cases for Regression Testing," Proc. Int'l Symp. Software Testing and Analysis, ACM Press, 2000, pp. 102-112.
32. G. Rothermel et al., "On Test Suite Composition and Cost-Effective Regression Testing," ACM Trans. Software Eng. and Methodology, vol. 13, no. 3, 2004, pp. 277-331.
33. W.E. Wong et al., "A Study of Effective Regression Testing in Practice," Proc. 8th Int'l Symp. Software Reliability Eng., 1998, pp. 264-274.