Application of subjective estimates of effectiveness to controlling software inspections

Journal of Systems and Software

Volumn 54, Issue 2, 2000, Pages 119-136

  Emam, Khaled El ^a   Laitenberger, Oliver ^b   Harbich, Thomas ^c  

^a NATIONAL RESEARCH COUNCIL CANADA   (Canada)

^b FRAUNHOFER IESE   (Germany)

^c Bosch Telecom GmbH   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SYSTEMS PROGRAMMING; DATA STRUCTURES; DECISION THEORY; MATHEMATICAL MODELS;

CAPTURE-CAPTURE MODELS; DETECTION PROFILE METHOD (DPM);

SOFTWARE ENGINEERING;

EID: 0034300772     PISSN: 01641212     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0164-1212(00)00032-7     Document Type: Article

References (54)

1. T. Adams A formula for the reinspection decision Software Engineering Notes 24 3 1999 80
2. Ardissone, M., Spolverini, M., Valentini, M., 1998. Statistical decision support method for in-process inspections. In: Proceedings of the Fourth International Conference on Achieving Quality in Software, pp. 135–143
3. Basin, S., 1972. Estimation of software error rates via capture–recapture sampling. Technical Report, Science Applications Inc
4. Basu, S., Ebrahimi, N., 1998. Estimating the number of undetected errors: Bayesian model selection. In: Proceedings of the Ninth International Symposium on Software Reliability Engineering, pp. 22–31
5. Briand, L., El Emam, K., Freimut, B., Laitenberger, O., 1997. Quantitative evaluation of capture–recapture models to control software inspections. In: Proceedings of the Eighth International Symposium on Software Reliability Engineering, pp. 234–244
6. Briand, L., El Emam, K., Freimut, B., 1998a. A comparison and integration of capture–recapture models and the detection profile method. In: Proceedings of the Ninth International Symposium on Software Reliability Engineering, pp. 32–41
7. Briand, L., El Emam, K., Bomarius, F., 1998b. COBRA: A hybrid method for software cost estimation, benchmarking, and risk assessment. In: Proceedings of the 20th International Conference on Software Engineering, pp. 390–399
8. Briand, L., El Emam, K., Laitenberger, O., Fussbroich, T., 1998c. Using simulation to build inspection efficiency benchmarks for development projects. In: Proceedings of the 20th International Conference on Software Engineering, pp. 340–349
9. Briand, L., Freimut, B., Laitenberger, O., Ruhe, G., Klein, B., 1998d. Quality assurance technologies for the EURO conversion – industrial experience at Allianz life assurance. In: Proceedings of the Quality Week Europe
10. Briand, L., El Emam, K., Freimut, B., Laitenberger, O., 1998e. A comprehensive evaluation of capture–recapture models for estimating software defect content. IEEE Transactions on Software Engineering (to appear)
11. C. Chandra Sekar W. Deming On a method of estimating birth and death rates and the extent of registration Journal of the American Statistical Association 44 245–248 1949 101 115
12. Y. Chernak A statistical approach to the inspection checklist formal synthesis and improvement IEEE Transactions on Software Engineering 22 12 1996 866 874
13. T. Connolly D. Dean Decomposed versus holistic estimates of effort required for software writing tasks Management Science 43 7 1997 1029 1045
14. H. Deitel P. Deitel C How to Program second ed 1994 Prentice-Hall New York
15. Devnani-Chulani, S., 1997. Incorporating Bayesian analysis to improve the accuracy of COCOMO II and its quality model extension. Technical Report, University of Southern California, Computer Science Department
16. J. Duran J. Wiorkowski Capture–recapture sampling for estimating software error content IEEE Transactions on Software Engineering 7 1 1981 147 148
17. N. Ebrahimi On the statistical analysis of the number of errors remaining in a software design after inspection IEEE Transactions on Software Engineering 23 8 1997 529 532
18. Eick, S., Loader, C., Long, M., Votta, L., Vander Wiel, S., 1991. Investigating the application of capture–recapture techniques to requirements and design reviews. In: Proceedings of the SEL Software Engineering Workshop, pp. 97–102
19. Eick, S., Loader, C., Long, M., Votta, L., Vander Wiel, S., 1992. Estimating software fault content before coding. In: Proceedings of the 14th International Conference on Software Engineering, pp. 59–65
20. Eick, S., Loader, C., Vander Weil. S., Votta, L., 1993. How many errors remain in a software design after inspection? In: Proceedings of the 25th Symposium on the Interface, Interface Foundation of North America, pp. 195–202
21. El Emam, K., Garro, I., 1999. Estimating the Extent of Standards Use: The Case of ISO/IEC 15504, Journal of Systems and Software 53 (2), 137–143
22. M.E. Fagan Design and code inspections to reduce errors in program development IBM Systems Journal 15 3 1976 182 211
23. T. Gilb D. Graham Software Inspection 1993 Addison-Wesley Reading, MA
24. F. Heemstra Software cost estimation Information and Software Technology 34 10 1992 627 639
25. Hihn, J., Habib-Agahi, H., 1991. Cost estimation of software intensive projects: a survey of current practices. In: Proceedings of the 13th International Conference on Software Engineering, pp. 276–287
26. Host, M., Wohlin, C., 1997. A subjective effort estimation experiment. In: Proceedings of the Conference on Empirical Assessment in Software Engineering
27. Host, M., Wohlin, C., 1998. An experimental study of individual subjective effort estimations and combinations of estimates. In: Proceedings of the 20th International Conference on Software Engineering, pp. 332–339
28. R. Hughes Expert judgement as an estimating method Information and Software Technology 38 1996 67 75
29. S. Isoda A criticism on the capture and recapture method for software reliability assurance Journal of Systems and Software 43 1998 3 10
30. B.W. Kernighan D.M. Ritchie Programming in C 1990 Hanser Verlag Munich
31. R. Kusters M. vanGenuchten F. Heemstra Are software cost estimation models accurate? Information and Software Technology 32 3 1990 187 190
32. Laitenberger, O., DeBaud, J.M., 1998. An encompassing life-cycle centric survey of software inspection. International Software Engineering Research Network (ISERN) Technical Report ISERN-98-14, Fraunhofer Institute for Experimental Software Engineering. Journal of Systems and Software (to appear)
33. Laitenberger, O., El Emam, K., Harbich, T., 1999. An Internally replicated quasi-experimental comparison of checklist and perspective-based reading of code documents. International Software Engineering Research Network, Technical Report ISERN-99-01, IEEE Transactions on Software Engineering, (in press)
34. A. Lederer J. Prasad Nine management guidelines for better cost estimating Communications of the ACM 35 2 1992 51 59
35. A. Lederer J. Prasad A causal model of software cost estimating error IEEE Transactions on Software Engineering 24 2 1998 137 148
36. Miller, J., 1998. Estimating the number of remaining defects after inspection. International Software Engineering Research Network Technical Report ISERN-98-24
37. Mills, H., On the statistical validation of computer programs. Technical Report FSC-72-6015, IBM Federal Systems Division
38. National Aeronautics and Space Administration, 1993. Software formal inspection guidebook. Technical Report NASA-GB-A302, National Aeronautics and Space Administration. http://satc.gsfc.nasa.gov/fi/fipage.html
39. Ohba, M., 1982. Software quality=test accuracy × test coverage. In: Proceedings of the Sixth International Conference on Software Engineering, pp. 287–293
40. D. Otis K. Burnham G. White D. Anderson Statistical inference from capture data on closed animal populations Wildlife Monographs 62 1978 1 135
41. Petersson, H., Wohlin, C., 1999. Evaluation of using capture–recapture methods on software review data. In: Proceedings of the Conference on Empirical Assessment in Software Engineering
42. P. Runeson C. Wohlin An experimental evaluation of an experience-based capture–recapture method in software code inspections Empirical Software Engineering 3 1998 381 406
43. G. Seber The Estimation of Animal Abundance and Related Parameters second ed 1982 Charles Griffin London
44. Selby, R.W., 1985. Evaluations of software technologies: testing, cleanroom, and metrics. Ph.D. Thesis, Department of Computer Science, University of Maryland
45. C. Stephen Capture–recapture methods in epidemiological studies Infection Control and Hospital Epidemiology 17 4 1996 262 266
46. S. Strauss R. Ebenau Software Inspection Process 1994 McGraw Hill New York
47. Thelin, T., Runeson, P., 1999a. Robust estimations of fault content with capture–recapture and detection profile estimators. In: Proceedings of the Conference on Empirical Assessment in Software Engineering
48. Thelin, T., Runeson, P., 1999b. Capture–recapture Estimations for Perspective-Based Reading – A Simulated Experiment (submitted)
49. S. Vander Wiel L. Votta Assessing software designs using capture–recapture methods IEEE Transactions on Software Engineering 19 11 1993 1045 1054
50. S. Vicinanza T. Mukhopadhyay M. Prietula Software-effort estimation: an exploratory study of expert performance Information Systems Research 2 4 1991 243 262
51. White, G., Anderson, D., Burnham, K., Otis, D., 1982. Capture–recapture and removal methods for sampling closed populations. Technical Report LA-8787-NERP, Los Alamos National Laboratory
52. Wickens, T., 1989. Multiway Contingency Tables Analysis for the Social Sciences. Lawrence Erlbaum Associates
53. C. Wohlin P. Runeson J. Brantestam An experimental evaluation of capture–recapture in software inspections Software Testing, Verification and Reliability 5 1995 213 232
54. Wohlin. C., Runeson, P., 1998. Defect content estimations from review data. In: Proceedings of the 20th International Conference on Software Engineering, pp. 400–409