Quantitative analysis of faults and failures in a complex software system

IEEE Transactions on Software Engineering

Volumn 26, Issue 8, 2000, Pages 797-814

  Fenton, Norman E ^a,b,c,d  

^a IEEE

^b Niclas Ohlsson Member ^*

^c QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

^d GratisTel International AB   (Sweden)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL COMPLEXITY; COMPUTER SYSTEM RECOVERY; COMPUTER SYSTEMS PROGRAMMING; RESPONSE TIME (COMPUTER SYSTEMS);

COMPLEX SOFTWARE SYSTEMS;

SOFTWARE ENGINEERING;

EID: 0034245310     PISSN: 00985589     EISSN: None     Source Type: Journal    
DOI: 10.1109/32.879815     Document Type: Article

References (46)

1. E. Adams, " Optimizing Preventive Service of Software Products," IBM Research J., vol. 28, no. 1, pp. 2-14, 1984.
2. W.W. Agresti and W.M. Evanco, " Project Software Defects From Analyzing Ada Designs," IEEE Trans. Software Eng., vol. 18, no. 11, pp. 988-997, Nov. 1992.
3. V.R. Basili and B.T. Perricone, " Software Errors and Complexity: An Empirical Investigation," Comm. ACM, vol. 27, no. 1, pp. 42-52, 1984.
4. D.W. Carman, A.A. Dolinsky, M.R. Lyu, and J.S. Yu, " Software Reliability Engineering Study of a Large-Scale Telecommunications System," Proc. Sixth Int'l Symp. Software Reliability Eng., pp. 350-359, 1995.
5. D.A. Christenson and S.T. Huang, " Estimating the Fault Content of Software Suing the Fix-on-Fix Model," Bell Labs Technical J., vol. 1, no. 1, pp. 130-137, 1996.
6. T.B. Compton and C. Withrow, " Prediction and Control of ADA Software Defects," J. Systems Software, vol. 12, pp. 199-207, 1990.
7. M.K. Daskalantonakis, " A Practical View of Software Measurement and Implementation Experiences within Motorola," IEEE Trans. Software Eng., vol. 18, no. 11, pp. 998-1,010, Nov. 1992.
8. M. Dyer, The Cleanroom Approach to Quality Software Development. John Wiley & Sons, 1992.
9. C. Ebert and T. Liedtke, " An Integrated Approach to Criticality Prediction," Proc. Sixth Int'l Symp. Software Reliability Eng., pp. 14-23, 1995.
10. S.G. Eick, C.R. Loader, M.D. Long, L.G. Votta, and S. Vanderweil, " Estimating Software Fault Content before Coding," Proc. 14th Int'l Conf. Software Eng., pp. 59-65, 1992.
11. N.E. Fenton, " Software Measurement: A Necessary Scientific Basis," IEEE Trans Software Eng., vol. 20, no. 3, pp. 199-206, Mar. 1994.
12. N.E. Fenton and B.A. Kitchenham, " Validating Software Measures," J. Software Testing, Verification, and Reliability, vol. 1, no. 2, pp. 27-42, 1991.
13. N.E. Fenton and S.L. Pfleeger, Software Metrics: A Rigorous and Practical Approach, second ed., Int'l Thomson Computer Press, 1996.
14. R. Gibson, Managing Computer Projects. London: Prentice Hall, 1992.
15. R.B. Grady, Practical Software Metrics for Project Management and Process Improvement. Prentice Hall, 1992.
16. L. Hatton, " Static Inspection: Tapping the Wheels of Software," IEEE Trans. Software Eng., pp. 85-87, vol 21, no. 5, May 1995.
17. L. Hatton, " Software Failures: Follies and Fallacies," IEE Review, vol. 43, no. 2, pp. 49-52, Mar. 1997.
18. U. Heitkoetter, B. Helling, H. Nolle, and M. Kelly, " Design Metrics and Aids to Their Automatic Collection," J. Information and SoftwareTech., vol. 32, no. l, pp. 79-87, 1990.
19. S. Henry and D. Kafura, " Software Structure Metrics Based on Information Flow," IEEE Trans. Software Eng., vol. 7, no. 5, pp. 510-518, 1981.
20. K. Kaaniche and K. Kanoun, " Reliability of a Telecommunications System," Proc. Seventh Int'l Symp. Software Reliability Eng., pp. 207-212, 1996.
21. K. Kaaniche, K. Kanoun, M. Cukier, and M.M. Bastos, " Software Reliability Analysis of Three Successive Generations of a Switching System," Proc. First European Conf. Dependable Computing (EDCC-1), pp. 473-490, 1994.
22. K. Kanoun and T. Sabourin, " Software Dependability of a Telephone Switching System," Proc. 17th IEEE Int'l Symp. Fault-Tolerant Computing (FTCS-17), pp. 236-241, 1987.
23. K. Kanoun, M. Kaaniche, and J.-C. Laprie, " Experience in Software Reliability: From Data Collection to Quantitative Evaluation," Proc. Fourth Int'l Symp. Software Reliability Eng., pp. 234-245, 1993.
24. G.Q. Kenney and M.A. Vouk, " Measuring the Field Quality of Wide-Distribution Commerical Software," Proc. Third Int'l Symp Software Reliability Eng., pp. 351-357, 1992.
25. T.M. Khoshgoftaar, E.B. Alien, K.S. Kalaichelvan, and N. Goel, " Early Quality Prediction: A Case Study in Telecommunications," IEEE Trans. Software Eng., vol 13, no. 1, pp. 65-71, Jan. 1996.
26. B.A. Kitchenham, A.P. Kitchenham, and J.P. Fellows, " The Effects of Inspections on Software Quality and Productivity," ICL Technical J, pp. 112-22, May 1986.
27. B.A. Kitchenham, L.M. Pickard, and S.J. Linkman, " An Evaluation of Some Design Metrics," Software Eng. J., vol 5, no. 1, pp. 50-58, 1990.
28. Y. Levendel, " Reliability Analysis of Large Software Systems: Defects Data Modelling," IEEE Trans. Software Eng., vol. 16, no. 2, pp. 141-152, Feb. 1990.
29. T. McCabe, " A Software Complexity Measure," IEEE Trans. Software Eng., vol. 2, no. 4, pp. 308-320, 1976.
30. K.-H. Moller and D. Paulish, " An Empirical Investigation of Software Fault Distribution," Software Quality Assurance and Measurement, N.E. Fenton, R.W. Whitty, and Y. Iizuka, eds., pp. 242-253, Int'l Thomson Computer Press, 1995.
31. J.C. Munson and T.M. Khoshgoftaar, " The Detection of FaultProne Programs," IEEE Trans. Software Eng., vol. 18, no. 5, pp. 423-433, May 1992.
32. J. Musa, " Operational Profiles in Software Reliability Engineering," IEEE Trans. Software Eng., vol. 10, no. 2, pp. 24-32, Feb. 1993.
33. M. Neil and N.E. Fenton, " Predicting Software Quality Using Bayesian Belief Networks," Proc 21st Ann. Software Eng. Workshop, pp. 217-230, Dec. 1996.
34. N. Ohlsson, " Predicting Error-Prone Software Modules in Telephone Switches." Masters thesis, Linköping Univ., Sweden, 1993.
35. N. Ohlsson and H. Alberg, " Predicting Error-Prone Software Modules in Telephone Switches," IEEE Trans. Software Eng., vol. 22, no. 12, pp. 886-894, Dec. 1996.
36. N. Ohlsson, M. Zhao, and M. Heiander, " Application of Multivariate Analysis for Software Fault Prediction," Software Quality J., vol. 7, no. 1, pp. 51-66, 1998.
37. S.L. Pfleeger and L. Hatton, " Investigating the Influence of Formal Methods," IEEE Computer, vol. 30, no. 2, pp. 33-43, Feb. 1997.
38. V.Y. Shen, T. Yu, S.M. Thebaut, and L.R. Paulsen, " Identifying Error-Prone Software-An Empirical Study," IEEE Trans. Software Eng., vol 11, no. 4, pp. 317-323, Apr. 1985.
39. K.J. Turner, Using Formal Description Techniques - An Introduction to ESTELLE, LOTOS and SDL. John Wiley & Sons, 1993.
40. I. Vessey and R. Weber, " Research on Structured Programming: An Empiricist's Evaluation," IEEE Trans. Software Eng., vol. 10, no. 7, pp. 397-407, July 1984.
41. K. Yasuda and K. Koga, " Product Development and Quality in the Software Factory," Software Quality Assurance and Metrics: A Worldwide Prespective, N.E. Fenton, R.W. Whitty, and Y. Iizuka eds., pp. 195-205, Int'l Thomson Press, 1995.
42. T.J. Yu, V.Y. Shen, and H.E. Dunsmore, " An Analysis of Several Software Defect Models," IEEE Trans. Software Eng., vol. 14, no. 9, pp. 1,261-1,270, Sept. 1988.
43. H. Zuse, Software Complexity: Measures and Methods. Berlin: De Gruyter, 1991.
44. J.M. Juran, F.M. Gryna, Jr., and F.M. Bingham, Quality Control Handbook. Third edition, McGraw Hill, New York, 1979.
45. G.G. Schulmeyer and J.I. McManus, Handbook for Software Quality Assurance. G.G. Schulmeyer and J.I. McManus eds., Van Nostrand Rheinhold, New York, 1987.
46. N.P. Fenton and M. Neil, " A Critique of Software Defect Prediction Models," Trans. Software Eng., vol. 25, no. 5, pp. 675-689, May 1999.