Faults-slip-through - A concept for measuring the efficiency of the test process

Software Process Improvement and Practice

Volumn 11, Issue 1, 2006, Pages 47-59

  Damm, Lars Ola ^a,b   Lundberg, Lars ^b   Wohlin, Claes ^b  

^a ERICSSON RESEARCH   (Sweden)

^b BLEKINGE INSTITUTE OF TECHNOLOGY   (Sweden)

Author keywords

Early fault detection; Fault latency; Fault metrics; Faults slip through; Software process improvement

Indexed keywords

COST EFFECTIVENESS; FAULT TOLERANT COMPUTER SYSTEMS; INDUSTRIAL MANAGEMENT; PRODUCT DEVELOPMENT;

EARLY FAULT DETECTION; FAULT LATENCY; FAULT METRICS; FAULTS-SLIP-THROUGH; SOFTWARE PROCESS IMPROVEMENT;

SOFTWARE ENGINEERING;

EID: 33646067113     PISSN: 10774866     EISSN: 10991670     Source Type: Journal    
DOI: 10.1002/spip.253     Document Type: Article

References (25)

1. Basili V. 1994. Software modeling and measurement: The goal question metric paradigm. Computer science technical report series. CS-TR-2956 UMIACS-TR-92-96. Technical report, University of Maryland.
2. Berling T, Thelin T. 2003. An industrial case study of the verification and validation activities. Proceedings of the Ninth International Software Metrics Symposium. Sydney, Australia, IEEE: 226-238.
3. Biehl R. 2004. Six sigma for software. IEEE Software 21(2): 68-71.
4. Boehm B. 1983. Software Engineering Economics. Prentice-Hall: Englewood Cliffs, NJ, USA.
5. Chillarege R, Prasad K. 2002. Test and development process retrospective-a case study using ODC triggers. Proceedings of the International Conference on Dependable Systems and Network. IEEE: Bethesda, Maryland, USA, 669-678.
6. Cook E, Votta L, Wolf L. 1998. Cost-effective analysis of in-place software processes. IEEE Transactions on Software Engineering 24(8): 650-662.
7. Damm L-O, Lundberg L. 2004. Introducing test automation and test-driven development: an experience report. Proceedings of the International Workshop on Test and Analysis of Component Based Systems. Elsevier: Barcelona, Spain, 3-15, Electronic Notes in Theoretical Computer Science 116.
8. Damm LO, Lundberg L, Wohlin C. 2004. Determining the improvement potential of a software development organization through fault analysis: a method and a case study. Proceedings of the 11th International Conference on Software Process Improvement. Springer-Verlag: Trondheim, Norway, 138-149, Lecture Notes in Computer Science 3281.
9. Deming EW. 2000. Out of the Crisis. The MIT Press: Cambridge, MA, ISBN 0-262-54115-7.
10. Glass R. 2004. Some heresy regarding software engineering. IEEE Software 21(4): 104-107.
11. Grady R. 1992. Practical Software Metrics for Project Management and Process Improvement. Prentice Hall: Englewood Cliffs, NJ, USA.
12. Hevner A. 1997. Phase containment for software quality improvement. Information and Software Technology 39: 867-877.
13. IEEE. 1998. IEEE guide for the use of IEEE standard dictionary of measures to produce reliable software. IEEE/ANSI Standard 982.2-1988.
14. Jakobsen A. 1998. Bottom up process improvement tricks. IEEE Software 15(3): 64-68.
15. Kaplan S, Norton D. 1996. The Balanced Scorecard. Harvard Business School Press: Boston, MA.
16. Kitchenham B, Pfleeger S, Pickard L, Jones P, Hoaglin D, El Emam K, Rosenberg J. 2002. Preliminary guidelines for empirical research in software engineering. IEEE Transactions on Software Engineering 28(8): 721-734.
17. Leszak M, Perry D, Stoll D. 2000. A case study in root cause defect analysis. Proceedings of the 22nd International Conference on Software Engineering. ACM Press: Limerick, Ireland, 428-437.
18. Mathiassen L, Pries-Heje J, Ngwenyama O. 2002. Improving Software Organizations: From Principles to Practice. Addison-Wesley: Upper Saddle River, NJ, USA.
19. Paulk M, Weber C, Curtis B, Chrissis M. 1995. The Capability Maturity Model: Guidelines for Improving the Software Process. Addison Wesley Longman: Reading, MA, USA.
20. Shull F, Basili V, Boehm B, Brown W, Costa P, Lindwall M, Port D, Rus I, Tesoriero R, Zelkowitz M. 2002. What we have learned about fighting defects. Proceedings of the Eight IEEE Symposium on Software Metrics, Ottawa, Canada, 249-258.
21. SW-CMM. http://www.sei.cmu.edu/cmm/cmm.html. Last Accessed: 2005-02-04.
22. Tanaka T, Sakamoto K, Kusumoto S, Matsumoto K, Kikuno T. 1995. Improvement of software process by process description and benefit estimation. Proceedings of the 17th International Conference on Software Engineering. ACM: Seattle, WA, USA, 123-132.
23. Tian J. 2001. Quality assurance alternatives and techniques: A defect-based survey and analysis. Software Quality Professional 3(3): 6-18, ASQ.
24. Wohlwend H, Rosenbaum S. 1993. Software improvements in an international company. Proceedings of the 15th International Conference on Software Engineering. IEEE Computer Society Press: Baltimore, MA, USA, 212-220.
25. Wohlin C, Host M, Henningsson K. 2003. Empirical research methods in software engineering. In Empirical Methods and Studies in Software Engineering: Experiences from ESERNET, Conradi R, Wang AI (eds). Spinger-Verlag: Heidelberg, Germany, 7-23, Lecture Notes in Computer Science. LNCS 2765.