Experiences and results from initiating field defect prediction and product test prioritization efforts at ABB Inc.

Proceedings - International Conference on Software Engineering

Volumn 2006, Issue , 2006, Pages 413-422

  Li, Paul Luo ^a   Herbsleb, James ^a   Shaw, Mary ^a   Robinson, Brian ^b  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b ABB INC   (United States)

Author keywords

Deployment and usage metrics; Software and hardware configuration metrics; Software reliability modeling; System test prioritization

Indexed keywords

LARGE SCALE SYSTEMS; PROCESS PLANNING; RESOURCE ALLOCATION; SOCIETIES AND INSTITUTIONS; SOFTWARE ENGINEERING; SOFTWARE RELIABILITY; SOFTWARE TESTING;

HARDWARE CONFIGURATION METRICS; INTEGRATION TESTING; SOFTWARE CONFIGURATION METRICS; SOFTWARE RELIABILITY MODELING; SYSTEM TEST PRIORITIZATION; USAGE METRICS;

RISK MANAGEMENT;

EID: 34247259817     PISSN: 02705257     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1134285.1134343     Document Type: Conference Paper

References (38)

1. Norman Fenton and Shari Lawrence Pfleeger. Software metrics (2nd ed.): a rigorous and practical approach. Boston, MA: PWS Publishing Co., 1997.
2. Norman Fenton and Martin Neil. Software metrics: road map. Proc. ICSE, May 2000, pp. 357-370.
3. Donald E. Harter and Mayuram S. Krishnan and Sandra A. Slaughter. Effects of Process Maturity on Quality, Cycle Time, and Effort in Software Product Development. Management Science, vol. 46 no. 4, Apr 2000, pp. 451-466.
4. Myles Hollander and Douglas A. Wolfe. Nonparametric statistical inference. New York, NY: Wiley & Sons, 1973.
5. rd European Conference on Software Maintenance and Reengineering, Mar 1999, pp. 148-157.
6. IEEE standard for a software quality metrics methodology. IEEE Std 1061-1998, Dec 1998.
7. Garrison Kenny. Estimating Defects in Commercial Software during Operational Use. IEEE Tr. on Reliability, vol. 42 no. 1, Mar 1993, pp. 107-115.
8. Taghi M. Khoshgoftaar and Edward B. Allen. Predicting fault-prone software modules in embedded systems with classification trees. Proc. HASE, Nov 1999, pp. 105-112.
9. Taghi Khoshgoftaar, Edward Allen, and Jianyu Deng. Controlling Over-fitting in Software Quality Models: Experiments with Regression Trees and Classification. Proc. METRICS, Apr 2001, pp. 190-198.
10. Taghi M Khoshgoftaar and Edward B. Allen and John P. Hudepohl and Stephen J. Aud. Application of Neural Networks to Software Quality Modeling of a Very Large Telecommunications System. IEEE Tr. on Neural Networks, vol. 8 no. 4, Jul 1997, pp. 902-909.
11. Taghi Khoshgoftaar, Bibhuti Bhattacharyya, and Gary Richardson. Predicting Software Errors, During Development, Using Nonlinear Regression Models: A Comparative Study. IEEE Tr. On Reliability, vol. 41 no. 3, Sep 1992, pp. 390-395.
12. Taghi Khoshgoftaar and John Munson. Predicting Software Development Errors using Software Complexity Metrics. IEEE J. Selected Areas in Communications, vol. 8 no. 2, Feb 1990, pp. 253-261.
13. Taghi Khoshgoftaar, John Munson, and David Lanning. A Comparative Study of Predictive Models for Program Changes during System Testing and Maintenance. Proc. ICSM, Sep 1993, pp. 72-79.
14. Taghi Khoshgoftaar, Abhijit Pandya, and David Lanning. Application of Neural Networks for Predicting Program Fault. Annals of Software Engineering, vol. 1, 1995, pp. 141-154.
15. Taghi Khoshgoftaar, Abhijit Pandya, and Hamant More. A Neural Networks Approach for Predicting Software Development Faults. Proc. ISSRE, Oct 1992, pp. 83-89.
16. Taghi Khoshgoftaar and Naeem Seliya. Tree-based Software Quality Estimation Models for Fault Prediction. Proc. METRICS, Jun 2002, pp. 203-214.
17. Taghi Khoshgoftaar, Vishal Thaker, and Edward Alien. Modeling Fault-prone Modules of Subsystems. Proc. ISSRE, Oct 2000, pp. 259-267.
18. Paul Luo Li, Mary Shaw, Jim Herbsleb, Bonnie Ray, and P. Santhanam. Empirical Evaluation of Defect Projection Models for Widely-deployed Production Software Systems. Proc. FSE, vol. 29 no. 6, Oct 2004, pp. 263-272.
19. Paul Luo Li, Mary Shaw, Jim Herbsleb, Bonnie Ray, and P. Santhanam. An Empirical Comparison of Field Defect Modeling Methods, CMU Tech Report CMU-ISRI-06-102, 2006
20. Paul Luo Li, Jim Herbsleb, and Mary Shaw. Finding Predictors of Field Defects for Open Source Software Systems in Commonly Available Data Sources: a Case Study of OpenBSD. Proc. METRICS, Sep 2005, (to appear).
21. Paul Luo Li, Jim Herbsleb, and Mary Shaw. ForecastingField Defects Using a Combined Time-based and Metrics-based Approach: a Case Study of OpenBSD. CMUTechReport, CMU-ISRI-05-125, 2005.
22. Zhaohui Liu, Nalini Ravishanker, and Bonnie Ray. Modeling Dynamic Reliability Growth Using Bayesian Methods, Reliability Review, vol. 23 no. 1, Mar 2003, pp. 5-9.
23. Michael Lyu. Handbook of Software Reliability Engineering, McGraw-Hill, 1996.
24. Microsoft Visual SourceSafe, msdn.microsoft.com/ssafe/
25. Audris Mockus, David Weiss, and Ping Zhang. Understanding and Predicting Effort in Software Projects. Proc. ICSE, May 2003, pp. 274-284.
26. Audris Mockus, Ping Zhang, and Paul Luo Li. Predictors of Customer Perceived Quality. Proc. ICSE, May 2005, pp. 225-233.
27. John Munson and Taghi Khoshgoftaar. The Dimensionality of Program Complexity. Proc. ICSE, May 1989, pp. 245-253.
28. John Musa and Anthony Iannino and Kazuhira Okumoto. Software Reliability. McGraw-Hill, 1990.
29. National Institute of Standards and Technology. The economic impacts of inadequate infrastructure for software testing. Planning Report 02-3, Jun 2002
30. Magnus Ohlsson and Per Runeson. Experience from Replicating Empirical Studies on Prediction Models. Proc. METRICS, Jun 2002, pp. 217-226.
31. Thomas Ostrand, Elaine Weyuker, and Thomas Bell. Where the Bugs are. Proc. ISSTA, vol. 29 no. 4, Jul 2004, pp. 86-96.
32. The R project for statistical computing, www.r-project.org
33. Richard Selby and Adam Porter. Learning from examples: generation and evaluation of decision trees for software resource analysis. IEEE Tr. On Software Engineering, vol 14. no. 12, Dec 1988, pp. 1743-1757.
34. Norman F. Schneidewind. Body of Knowledge for Software Quality Measurement. IEEE Computer, vol. 35 no. 2, Feb 2002, pp. 77-83.
35. Martin Sheppard. Evaluating Software Project Prediction Systems. METRICS, Keynote speech, 2005.
36. Tracker. www.serena.com/Products/professional/tracker/
37. Understand for C++. www.scitools.com/metrics.txt
38. nd Edition. New York, NY: Wiley and Son, 1985.