Encompassing life cycle centric survey of software inspection

Journal of Systems and Software

Volumn 50, Issue 1, 2000, Pages 5-31

  Laitenberger, Oliver ^a   Debaud, Jean Marc ^b  

^a FRAUNHOFER IESE   (Germany)

^b NOKIA RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

INSPECTION; LIFE CYCLE; QUALITY ASSURANCE;

TAXONOMY;

SOFTWARE ENGINEERING;

EID: 0033640333     PISSN: 01641212     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0164-1212(99)00073-4     Document Type: Article

References (122)

1. Ackerman A.F., Buchwald L.S., Lewsky F.H. Software inspections: an effective verification process. IEEE Software. 6(3):1989;31-36.
2. Association of Computing Machinery, 1998. The ACM Digital Library. http://www.acm.org/dl/.
3. Barnard J., Price A. Managing code inspection information. IEEE Software. 11(2):1994;59-69.
4. Basili V., Green S., Laitenberger O., Lanubile F., Shull F., Sorumgard S., Zelkowitz M. The empirical investigation of perspective-based reading. J. Empirical Software Eng. 2(1):1996;133-164.
5. Basili V.R. Evolving and packaging reading technologies. J. Systems Software. 38(1):1997.
6. Basili V.R., Selby R.W. Comparing the effectiveness of software testing techniques. IEEE Trans. Software Eng. 13(12):1987;1278-1296.
7. Belli, F., Crisan, R., 1996. Towards automation of checklist-based code-reviews. In: Proceedings of the Eighth International Symposium on Software Reliability Engineering.
8. Bisant D.B., Lyle J.R. A two-person inspection method to improve programming productivity. IEEE Trans. Software Eng. 15(10):1989;1294-1304.
9. Blakely F.W., Boles M.E. A case study of code inspections. Hewlett-Packard J. 42(4):1991;58-63.
10. Blalock H.M. Theory Construction. 1979;Prentice-Hall, Englewood Cliffs, NJ.
11. Boehm, B.W., 1981. Software Engineering Economics. Advances in Computing Science and Technology. Prentice-Hall, Englewood Cliffs.
12. Bourgeois K.V. Process insights from a large-scale software inspections data analysis. Cross Talk, J. Defense Software Eng. 1996;17-23.
13. Briand, L., El-Emam, K., Freimut, B., Laitenberger, O., 1997. Quantitative evaluation of capture-recapture models to control software inspections. In: Proceedings of the Ninth International Symposium on Software Reliability Engineering.
14. Briand, L., El-Emam, K., Fussbroich, T., Laitenberger, O., 1998. Using simulation to build inspection efficiency Benchmarks for development projects. In: Proceedings of the 20th International Conference on Software Engineering, pp. 340-349.
15. Briand L.C., Differding C.M., Rombach H.D. Practical guidelines for measurement based process improvement. Software Process. 2(4):1996;253-280.
16. Bröhl A.-P., Dröschel W. Das V-Modell. 1995;Oldenburg, Munich.
17. Brothers, L., Sembugamoorthy, V., Muller, M., 1990. ICICLE: Groupware for code inspection. In: Proceedings of the ACM Conference on Computer Supported Cooperative Work, pp. 169-181.
18. Brykczynski B., Wheeler D.A. An annotated bibliography on software inspections. ACM SIGSOFT Software Eng. Notes. 18(1):1993;81-88.
19. Cheng, B., Jeffrey, R., 1996. Comparing inspection strategies for software requirements specifications. In: Proceedings of the 1996 Australian Software Engineering Conference, pp. 203-211.
20. Chernak Y. A statistical approach to the inspection checklist formal synthesis and improvement. IEEE Trans. Software Eng. 22(12):1996;866-874.
21. Christenson D.A., Steel H.T., Lamperez A.J. Statistical quality control applied to code inspections. IEEE J. Selected Areas Commun. 8(2):1990;196-200.
22. Collofello J.S., Woodfield S.N. Evaluating the effectiveness of reliability-assurance techniques. J. Systems Software. 9:1989;191-195.
23. Cooper H.M. Scientific guidelines for conducting integrative research reviews. Rev. Educational Res. 52(2):1982;291-302.
24. Crossman T.D. A method of controlling quality of applications software. South African Comput. J. 5:1991;70-74.
25. Deck, M., 1994. Cleanroom Software Engineering to reduce Software Cost. Technical report. Cleanroom Software Engineering Associates, 6894 Flagstaff Rd. Boulder, CO 80302.
26. DeMarco T. Controlling Software Projects. 1982;Yourdon Press, New York.
27. Dennis A., Valacich J. Computer brainstorms: more heads are better than one. J. Appl. Social Psychology. 78(4):1993;531-537.
28. Doolan E.P. Experience with Fagan's inspection method. Software-Practice Experience. 22(3):1992;173-182.
29. Dyer M. The Cleanroom Approach to Quality Software Development. 1992a;Wiley, Chichester.
30. Dyer, M., 1992b. Verification-based inspection. In: Proceedings of the 26th Annual Hawaii International Conference on System Sciences, pp. 418-427.
31. Eick, S.G., Loader, C.R., Long, M.D., Votta, L.G., VanderWiel, S., 1992. Estimating software fault content before coding. In: Proceedings of the 14th International Conference on Software Engineering, pp. 59-65.
32. Fagan M.E. Design and code inspections to reduce errors in program development. IBM Sys. J. 15(3):1976;182-211.
33. Fagan M.E. Advances in software inspections. IEEE Trans. Software Eng. 12(7):1986;744-751.
34. Fowler P.J. In-process inspections of workproducts at AT&T. AT&T Technical J. 65(2):1986;102-112.
35. Franz L.A., Shih J.C. Estimating the value of inspections and early testing for software projects. CS-TR-6 Hewlett-Packard J. 1994.
36. Fraunhofer Institute for Experimental Software Engineering, 1998. An Inspection Bibliography. http:// www.iese.fhg.de/ISE/Inspbib/inspection.html.
37. Freedman, D.P., Weinberg, G.M., 1990. Handbook of Walkthroughs, Inspections, and Technical Reviews, 3rd ed. Dorset House Publishing, New York.
38. Gilb T., Graham D. Software Inspection. 1993;Addison-Wesley, Reading, MA.
39. Gintell, J., Houde, M., McKenney, R., 1995. Lessons learned by building and using scrutiny, a collaborative software inspection system. In: Proceedings of the Seventh International Workshop on Computer-Aided Software Engineering, pp. 350-357.
40. Graden M.E., Horsley P.S., Pingel T.C. The effects of software inspections on a major telecommunications-project. AT&T Technical J. 65(3):1986;32-40.
41. Grady R.B. Successfully applying software metrics. IEEE Comput. 27(9):1994;18-25.
42. Grady R.B., vanSlack T. Key lessons in achieving widespread inspection use. IEEE Software. 11(4):1994;46-57.
43. Hatton L. Does OO Sync with how we think? IEEE Software. 15(3):1998;46-54.
44. Hetzel, W.C., 1976. An Experimental Analysis of Program Verification Methods. PhD thesis, University of North Carolina at Chapel Hill, Department of Computer Science.
45. Humphrey W.H. A Discipline for Software Engineering. 1995;Addison-Wesley, Reading, MA.
46. International Software Engineering Research Network, 1998. Bibliography of the International Software Engineering Research Network. http://www.iese.fhg.de/ISERN/pub/isern_biblio_tech.html.
47. Jackson A., Hoffman D. Inspecting module interface specifications. Software Testing, Verification Reliability. 4(2):1994;101-117.
48. Jalote, P., Haragopal, M., 1998. Overcoming the NAH syndrome for inspection deployment. In: Proceedings of the 20th International Conference on Software Engineering, pp. 371-378.
49. Johnson, P., 1998a. The WWW Formal Technical Review Archive. http://zero.ics.hawaii.edu/johnson/ FTR.
50. Johnson P.M. Reengineering inspection. Commun. ACM. 41(2):1998b;49-52.
51. Johnson, P.M., Tjahjono, D., 1993. Improving software quality through computer supported collaborative review. In: Proceedings of the 19th International Conference on Software Engineering, pp 61-76.
52. Johnson P.M., Tjahjono D. Assessing Software Review Meetings: A Controlled Experimental Study Using CSRS. 1997;118-127 ACM Press, New York.
53. Jones C. Gaps in the object-oriented paradigm. IEEE Comput. 27(6):1994;90-91.
54. Jones C. Software defect-removal efficiency. IEEE Comput. 29(4):1996;94-95.
55. Kamsties, E., Lott, C.M., 1995. An empirical evaluation of three defect-detection techniques. In: Schäfer, W., Botella, P. (Eds.), Proceedings of the Fifth European Software Engineering Conference, pp. 362-383. Lecture Notes in Computer Science Nr. 989, Springer, Berlin.
56. Kan S.H. Metrics and Models in Software Quality Engineering. 1995;Addison-Wesley, Reading, MA.
57. Kelly J.C., Sherif J.S., Hops J. An analysis of defect densities found during software inspections. J. Sys. Software. 17:1992;111-117.
58. Kim L.P.W., Sauer C., Jeffery R. A framework for software development technical reviews. Software Quality and Productivity: Theory, Practice, Education and Training. 1995.
59. Kitchenham B., Kitchenham A., Fellows J. The effects of inspections on software quality and productivity. Technical Report 1, ICL Technical J. 1986.
60. Knight J.C., Myers E.A. Phased inspections and their implementation. ACM SIGSOFT Software Engineering Notes. 16(3):1991;29-35.
61. Knight J.C., Myers E.A. An improved inspection technique. Commun. ACM. 36(11):1993;51-61.
62. Kusumoto, S., 1993. Quantitative Evaluation of Software Reviews and Testing Processes. PhD thesis, Faculty of the Engineering Science of Osake University.
63. Laitenberger O., DeBaud J.-M. Perspective-based reading of code documents at robert bosch GmbH. Information Software Technol. 39:1997;781-791.
64. Land, L.P.W., Sauer, C., Jeffery, R., 1997. Validating the defect detection performance advantage of group designs for software reviews: report of a laboratory experiment using program code. In: Jazayeri, M., Schauer, H. (Eds.), Lecture Notes in Computer Science No 1301, Proceedings of the Sixth European Software Engineering Conference, pp. 294-309.
65. Letovsky S., Pinto J., Lampert R., Soloway E. A cognitive analysis of a code inspection. Empirical Studies Programming. 1987;231-247.
66. Levine J.M., Moreland R.L. Progress in small group research. Annual Rev. Psychology. 41:1990;585-634.
67. Linger R.C., Mills H.D., Witt B.I. Structured Programming: Theory and Practice. 1979;Addison-Wesley, Reading, MA.
68. Macdonald, F., 1997. Assist v1.1 User Manual. Technical Report RR-96-199 [EFoCS-22-96]. Empirical Foundations of Computer Science, (EFoCS), University of Strathclyde, UK.
69. Macdonald, F., Miller, J., 1995. Modelling Software Inspection Methods for the Application of Tool Support. Technical Report RR-95-196 [EFoCS-22-96]. Empirical Foundations of Computer Science, (EFoCS), University of Strathclyde, UK.
70. Macdonald F., Miller J., Brooks A., Roper M., Wood M. Applying inspection to object oriented software. Software Testing, Verification Reliability. 6:1996b;61-82.
71. Macdonald F., Miller J., Brooks A., Roper M., Wood M. Automating the software inspection process. Automated Software Eng. 3(193):1996a;193-218.
72. MacLeod J.M. Implementing and sustaining a software inspection program in an R&D environment. Hewlett-Packard J. 1993.
73. Madachy, R., Little, L., Fan, S., 1993. Analysis of a successful inspection program. In: Procceding of the 18th Annual NASA Software Eng. Laboratory Workshop, pp. 176-198.
74. Marciniak, J.J., 1994. Reviews and audits. In: Marciniak, J.J. (Ed.), Encyclopedia of Software Engineering, vol. 2. Wiley, Chichester, pp. 1084-1090.
75. Martin J., Tsai W.T. N-fold inspection: a requirements analysis technique. Commun. ACM. 33(2):1990;225-232.
76. Mashayekhi V., Drake J.M., Tsai W.T., Riedl J. Distributed, collaborative software inspection. IEEE Software. 10:1993;66-75.
77. McCabe T.J. A complexity measure. IEEE Trans. Software Eng. 2(4):1976;308-320.
78. McGibbon, T., 1996. A Business Case for Software Process Improvement. Technical Report F30602-92-C-0158. Data & Analysis Center for Software (DACS). URL: http://www.dacs.com/techs/ roi.soar/soar.html.
79. Murphy, P., Miller, J., 1997. A process for asynchronous software inspection. In: Proceedings of the Eighth International Workshop on Software Technology and Engineering Practice, pp. 96-104.
80. Myers G.J. A controlled experiment in program testing and code walkthroughs/inspections. Commun. ACM. 21(9):1978;760-768.
81. National Aeronautics and Space Administration, 1993. Software Formal Inspection Guidebook. Technical Report NASA-GB-A302. National Aeronautics and Space Administration. http://satc.gs-fc.nasa.gov/fi/fipage.html.
82. OCLC, 1998. Online Computer Library Center. http://www.oclc.org/oclc/menu/home1.html.
83. Parnas D.L. Active design reviews: principles and practice. J. Sys. Software. 7:1987;259-265.
84. Parnas, D.L., Weiss, D., 1985. Active design reviews: principles and practices. In: Proceedings of the Eighth International Conference on Software Engineering, pp. 132-136. Also Available as NRL Report 8927, 18 November 1985.
85. Pedhazur, E.J., 1982. Multiple Regression in Behavioral Research, 2nd ed. Harcourt Brace College, New York.
86. Perpich, J., Perry, D., Porter, A., Votta, L., Wade, M., 1997. Anywhere, anytime code inspections: using the web to remove inspection bottlenecks in large-scale software development. In: Proceedings of the 19th International Conference on Software Engineering, pp. 14-21.
87. Perry, D.E., Porter, A., Votta, L.G., Wade, M.W., 1996. Evaluating workflow and process automation in wide-area software development. In: Montangero, C. (Ed.), Proceedings of the Fifth European Workshop on Software Process Technology, Lecture Notes in Computer Science Nr. 1149. Springer, Berlin, Heidelberg, pp. 188-193.
88. Porter A.A., Johnson P.M. Assessing software review meetings: results of a comparative analysis of two experimental studies. IEEE Trans. Software Eng. 23(3):1997;129-144.
89. Porter A.A., Siy H., Mockus A., Votta L. Understanding the sources of variation in software inspections. ACM Trans. Software Eng. Methodology. 7(1):1998;41-79.
90. Porter, A.A., Siy, H., Votta, L.G., 1995a. A Review of Software Inspections. Technical Report CS-TR-3552, UMIACS-TR-95-104. Department of Computer Science, University of Maryland, College Park, Maryland 20742.
91. Porter A.A., Siy H.P., Toman C.A., Votta L.G. An experiment to assess the cost-benefits of code inspections in large scale software development. IEEE Trans. Software Eng. 23(6):1997;329-346.
92. Porter A.A., Votta L.G. What makes inspections work. IEEE Software. 1997;99-102.
93. Porter A.A., Votta L.G., Basili V.R. Comparing detection methods for software requirements inspections: a replicated experiment. IEEE Trans. Software Eng. 21(6):1995b;563-575.
94. Raz T., Yaung A.T. Factors affecting design inspection effectiveness in software development. Information Software Technol. 39:1997;297-305.
95. Reeve J.T. Applying the fagan inspection technique. Quality Forum. 17(1):1991;40-47.
96. Remus H. Integrated software validation in the view of inspections/reviews. Software Validation. 1984;57-65.
97. Rifkin, S., Deimel, L., 1994. Applying program comprehension techniques to improve software inspection. In: Proceedings of the 19th Annual NASA Software Eng. Laboratory Workshop, NASA.
98. Rosenthal R. The 'file drawer problem' and tolerance for null results. Psychological Bulletin. 86(3):1979;638-641.
99. Russell G.W. Experience with inspection in ultralarge-scale developments. IEEE Software. 8(1):1991;25-31.
100. Sauer, C., Jeffery, R., Lau, L., Yetton, P., 1996. A behaviourally motivated programme for empirical research into software development technical review. Technical Report 96/5, Centre for Advanced Empirical Software Research, Sydney, Australia.
101. Schneider G.M., Martin J., Tsai W.T. An experimental study of fault detection in user requirements documents. ACM Trans. Software Eng. Methodology. 1(2):1992;188-204.
102. Seaman C.B., Basili V.R. Communication and organization: an empirical study of discussion in inspection meetings. IEEE Trans. Software Eng. 24(6):1998;559-572.
103. Shaw M.E. Group Dynamics: The Psychology of Small Group Behaviour. 1976;McGraw-Hill, New York.
104. Shirey, G.C., 1992. How inspections fail? In: Proceedings of the Ninth International Conference on Testing Computer Software, pp. 151-159.
105. Stein, M., Riedl, J., Harner, S., Mashayekhi, V., 1997. A case study of distributed, asynchronous software inspection. In: Proceedings of the 19th International Conference on Software Engineering. IEEE Computer Society Press, pp. 107-117.
106. Strauss, S.H., Ebenau, R.G., 1993. Software Inspection Process. McGraw Hill Systems Design & Implementation Series.
107. Svendsen, F.N., 1992. Experience with inspection in the maintenance of software. In: Proceedings of the Second European Conference on Software Quality Assurance.
108. Tervonen I. Support for quality-based design and inspection. IEEE Software. 13(1):1996;44-54.
109. Tjahjono, D., 1996. Exploring the effectiveness of formal technical review factor with CSRS, a collaborative software review system. PhD thesis, Department of Information and Computer Science, University of Hawaii.
110. Tripp, L.L., Stuck, W.F., Pflug, B.K., 1991. The application of multiple team inspections on a safety-critical software standard. In: Proceedings of the Fourth Software Engineering Standards Application Workshop. IEEE Computer Society Press, pp. 106-111.
111. Votta L.G. Does every inspection need a meeting? ACM Software Eng. Notes. 18(5):1993;107-114.
112. Weinberg G.M., Freedman D.P. Reviews, walkthroughs, and inspections. IEEE Trans. Software Eng. 12(1):1984;68-72.
113. Weller, E.F., 1992. Experiences with inspections at Bull HN information system. In: Proceedings of the Fourth Annual Software Quality Workshop.
114. Weller E.F. Lessons from three years of inspection data. IEEE Software. 10(5):1993;38-45.
115. Wenneson, G., 1985. Quality assurance software inspections at NASA Ames: metrics for feedback and modification. In: Proceedings of the 10th Annual Software Engineering Workshop.
116. Wheeler D.A., Brykczinski B., Meeson R.N. Software Inspection - An Industrial Best Practice. IEEE Computer Society Press. 1996.
117. Wheeler, D.A., Brykczynski, B., Jr., R.N.M., 19 97. Software peer reviews. In: Thayer, R.H. (Ed.), Software Engineering Project Management. IEEE Computer Society, Silver Spring, MD.
118. Wiel S.A.V., Votta L.G. Assessing software designs using capture-recapture methods. IEEE Trans. Software Eng. 19(11):1993;1045-1054.
119. Wohlin, C., Runeson, P., 1998. Defect content estimations from review data. In: Proceedings of the 20th International Conference on Software Engineering, pp. 400-409.
120. Wood, M., Roper, M., Brooks, A., Miller, J., 1997. Comparing and combining software defect detection techniques: a replicated empirical study. In: Jazayeri, M., Schauer, H. (Eds.), Lecture Notes in Computer Science No 1301. Proceeding of the Sixth European Software Engineering Conference, pp. 262-277.
121. Yourdon, E., 1989. Structured Walkthroughs, 4th ed. Prentice-Hall, New York.
122. Yourdon E. Death March. 1997;Prentice-Hall, Englewood Cliffs.