A comprehensive evaluation of capture-recapture models for estimating software defect content

IEEE Transactions on Software Engineering

Volumn 26, Issue 6, 2000, Pages 518-540

  Briand, Lionel C ^a   Emam, Khaled El ^b   Freimut, Bernd G ^c   Laitenberger, Oliver ^c  

^a CARLETON UNIVERSITY   (Canada)

^b NATIONAL RESEARCH COUNCIL CANADA   (Canada)

^c FRAUNHOFER IESE   (Germany)

Author keywords

Inspections, capture recapture models, robustness, fault content estimation

Indexed keywords

COMPUTER SIMULATION; DECISION MAKING; ERROR ANALYSIS; ESTIMATION; MATHEMATICAL MODELS; PROBABILITY;

CAPTURE-RECAPTURE MODELS; FAULT CONTENT ESTIMATION; JACKKNIFE ESTIMATOR; SOFTWARE DEFECT;

COMPUTER SOFTWARE SELECTION AND EVALUATION;

EID: 0034205795     PISSN: 00985589     EISSN: None     Source Type: Journal    
DOI: 10.1109/32.852741     Document Type: Article

References (41)

1. A. Ackerman, L. Buchwald, and F. Lewski, "Software Inspections: An Effective Verification Process," IEEE Software, vol. 6, no. 3, pp. 31-36, 1989.
2. V. Basili, S. Green, O. Laitenberger, F. Lanubile, F. Shull, S. S0rumgârd, and M.V. Zelkowitz, "The Empirical Investigation of Perspective-Based Reading," Empirical Software Eng.: An Int'l J., vol. 1, no. 2, pp. 133-164, 1996.
3. S.L. Basin, "Estimation of Software Error Rates via CaptureRecapture Sampling," Technical eport, Science Applications, 1973.
4. M. Begon, Investigating Animal Abundance. Edward Arnold Publishers, 1979.
5. D. Bisant and J. Lyle, "A Two-Person Inspection Method to Improve Programming Productivity," IEEE Trans. Software Eng., vol. 15, no. 10, pp. 1,294-1,304, Oct. 1989.
6. K.V. Bourgeois, "Process Insights from a Large-Scale Software Inspection Data Analysis," Crosstalk, The J. Defense Software Eng., pp. 17-23, 1996.
7. L. Briand, K. El Emam, O. Laitenberger, and T. Fussbroich, "Using Simulation to Build Inspection Efficiency Benchmarks for Development Projects," Proc. 19th Int'l Conf. Software Eng., pp. 340-349, 1998.
8. L.C. Briand, K. El Emam, and E.G. Freimut, "A Comparison and Integration of Capture-Recapture Models and the Detection Profile Method," Proc. Ninth Int'l Symp. Software Reliability Eng., pp. 32-41, 1998.
9. K.P. Burnham and W.S. Overton, "Estimation of the Size of a Closed Population when Capture Probabilities Vary Among Animals," Biometrika, vol. 65, pp. 625-633, 1978.
10. A. Chao, "Estimating the Population Size for Capture-Recapture Data with Unequal Catchability," Biometrics, vol. 43, pp. 783-791, 1987.
11. A. Chao, "Estimating Population Size for Sparse Data in CaptureRecapture Experiments," Biometrics, vol. 45, pp. 427-438, 1989. 12 A. Chao, S.M. Lee, and S.L Jeng, "Estimation Population Size for
12. Capture-Recapture Data when Capture Probabilities Vary by.
13. Time and Individual Animal," Biometrics, vol. 48, pp. 201-216,
14. E. Doolan, "Experience with Pagan's Inspection Method," Software-Practice and Experience, vol. 22, no. 2, pp. 173-182, 1992. 14 E. Dudewicz, Modern Mathematical Statistics. John Wiley & Sons,
15. N. Ebrahimi, "On the Statistical Analysis of the Number of Errors Remaining in a Software Design Document after Inspection," IEEE Trans. Software Eng., vol. 26, pp. 529-532, 1997.
16. S. Eick, C. Loader, M. Long, L. Votta, and S. Vander Wiel, "Estimating Software Fault Content Before Coding," Proc. 14th Int'l Conf. Software Eng., pp. 59-65, 1992.
17. S. Eick, C. Loader, S. Vander Wiel, and L. Votta, "How Many Errors Remain in a Software Design After Inspection?," Proc. 25th Symp. Interface. 1993.
18. K. El Emam, O. Laitenberger, and T. Harbich, "The Application of Subjective Estimates of Effectiveness to Controlling Software Inspections," To appear J. Systems and Software, 2000.
19. M. Pagan, "Design and Code Inspections to Reduce Errors in Program Development.," IBM Systems ., vol. 15, no. 3, pp. 182-211, 1976.
20. T. Gilb and D. Graham, Software Inspections. Addison-Wesley, 1993.
21. IEEE Standards Collection-Software Engineering, Std 830-1993,1994.
22. C. Jones, "Software Defect Removal Efficiency," Computer, vol. 29, no. 4, pp. 94-95, Apr. 1996.
23. O. Laitenberger and J.-M. DeBaud, "Perspective-Based Reading of Code Documents at Robert Bosch GmbH," Information and Software Technology, vol. 39, pp. 781-791, 1997. 24 L. Lapin, Statistics for Modern Business Decisions, Second edition, Hartcourt, Brace, & Jovanovich, 1978.
24. J. Miller, Estimating the Number of Remaining Defects after Inspection, Technical report ISERN-98-24, Int'l Software Eng. Network, Univ. of Strathclyde, 1998.
25. H. Mills, "On the Statistical Validation of Computer Programs," Technical report FSC-72-6015, IBM Federal Systems Division, 1972.
26. J. Musa, A. lannino, and K. Okumoto, Software Reliability: Measurement, Prediction, Application. McGraw-Hill, 1987.
27. D. Otis, K. Burnham, G. White, and D. Anderson, "Statistical Inference from Capture Data on Closed Animal Populations," Wildlife Monographs, vol. 62, pp. 1-135, 1978.
28. A.A. Porter, H. Siy, A. Mockus, and L. Votta, "Understanding the Sources of Variation in Software Inspections," ACM Trans. Software Eng. and Methodology, vol. 7, pp. 41-79, 1998.
29. K. Pollock, "Modeling Capture, Recapture, and Removal Statistics for Estimation of Demographic Parameters: Past, Present, and Future," J. Am. Statistical Assoc., vol. 86, no. 413, pp. 225-238,1991.
30. J. Rice, Mathematical Statistics and Data Analysis. Duxbury Press, 1987.
31. P. Runeson and C. Wohlin, "An Experimantal Evaluation of an Experience-Based Capture-Recapture Method in Software Code Inspections," Empirical Software Eng., vol. 3, no. 3, pp. 381-406, 1998.
32. G. Schick and R. Wolverton, "An Analysis of Competing Software Reliability Models," IEEE Trans. Software Eng., vol. 4, no. 2, pp. 104-120, 1978.
33. G. Seber, The Estimation of Animal Abundance and Related Parameters, Second edition., Charles Griffin & Company Ltd., 1982.
34. S. Siegel and J.N. Castellan, Nonparametric Statistics for the Behavioral Sciences. McGraw-Hill, 1988.
35. S. Strauss and R. Ebenau, Software Inspection Process. McGraw-Hill, 1993.
36. E. Weller, "Lessons from Three Years of Inspection Data," IEEE Software, vol. 10, no. 5, pp. 38-45, 1993.
37. G. White, D. Anderson, K. Burnham, and D. Otis, "CaptureRecapture and Removal Methods for Sampling Closed Populations," Technical report, Los Alamos Nat. Laboratory, 1982.
38. S. Vander Wiel and L. Votta, "Assessing Software Designs Using Capture-Recapture Methods," IEEE Trans. Software Eng., vol. 19, no. 11, pp. 1,045-1,054, Nov. 1993.
39. C. Wohlin, P. Runeson, and J. Brantestam, "An Experimental Evaluation of Capture-Recapture in Software Inspections," Software Testing, Verification, and Reliability, vol. 5, pp. 213-232, 1995.
40. C. Wohlin and P. Runeson, "Defect Content Estimations from Review Data," Proc. 20th Int'l Conf. Software Eng., pp. 400-409, 1998.
41. R. Zwick, "Testing Pairwise Contrasts in One-Way Analysis of Variance Designs," Psyschoneuroendocrinology, vol. 11, no. 3, pp. 253-276, 1986.