Evaluation of Competing Software Reliability Predictions

IEEE Transactions on Software Engineering

Volumn SE-12, Issue 9, 1986, Pages 950-967

  Abdel Ghaly, Abdalla A ^a   Chan, P Y ^a   Littlewood, Bev ^a  

^a CITY UNIVERSITY   (United Kingdom)

Author keywords

Prediction analysis; prediction biasedness and noise; prediction systems; predictive quality; prequential likelihood; software reliability models

Indexed keywords

EID: 0001578348     PISSN: 00985589     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSE.1986.6313050     Document Type: Article

References (37)

1. Z. Jelinski and P. B. Moranda, “Software reliability research,” in Statistical Computer Performance Evaluation, W. Freiberger, Ed. New York: Academic, 1972, pp. 465–484.
2. M. Shooman, “Operational testing and software reliability during program development,” in Rec. 19 73 IEEE Symp. Comput. Software Rel., New York, Apr. 30-May 2, 1973, pp. 51–57.
3. B. Littlewood and J. L. Verrall, “A Bayesian reliability growth model for computer software,” J. Roy. Statist. Soc. C, vol. 22, pp. 332–346, 346, 1973.
4. J. D. Musa, “A theory of software reliability and its application,” IEEE Trans. Software Eng., vol. SE-1, pp. 312–327, Sept. 1975.
5. C. J. Dale, “Software reliability evaluation methods,” British Aerospace Dynamics Group, Rep. ST-26750, 1982.
6. P. A. Keiller, B. Littlewood, D. R. Miller, and A. Sofer, “Comparison of software reliability predictions,” in Dig. FTCS 13 (13th Int. Symp. Fault-Tolerant Comput., 1983, pp. 128–134.
7. B. Littlewood, “How to measure software reliability and how not to,” IEEE Trans. Rel. vol. R-28, pp. 103–110, June 1979.
8. J. C. Laprie, “Dependability evaluation of software systems in operation,” IEEE Trans. Software Eng., vol. SE-10, pp. 701–714, Nov. 1984.
9. E. N. Adams, “Optimizing preventive service of software products,” IBM J. Res. Develop., vol. 28, no. 1, 1984.
10. H. Ascher and H. Feingold, Repairable Systems Reliability (Lecture Notes in Statistics, No. 7). New York: Dekker, 1984.
11. J. Aitchison and I. R. Dunsmore, Statistical Prediction Analysis. Cambridge: Cambridge University Press, 1975.
12. P. M. Nagel and J. A. Skrivan, “Software reliability: Repetitive run experimentation and modelling,” Boeing Comput. Services Company, Seattle, WA, Rep. BCS-40399, Dec. 1981.
13. E. H. Forman and N. D. Singpurwalla, “An empirical stopping rule for debugging and testing computer software,” J. Amer. Statist. Ass., vol. 72, pp. 750–757, Dec. 1977.
14. B. Littlewood and J. L. Verrall, “On the likelihood function of a debugging model for computer software reliability,” IEEE Trans. Rel., vol. R-30, pp. 145–148, June 1981.
15. H. Joe and N. Reid, “Estimating the number of faults in a system,” J. Amer. Statist. Ass., vol. 80, pp. 222–226, Mar. 1985.
16. B. Littlewood and A. Sofer, “A Bayesian modification to the Jelinski-Moranda software reliability growth model,” available from first author.
17. B. Littlewood, “Stochastic reliability growth: A model for fault-removal in computer programs and hardware designs,” IEEE Trans. Rel., vol. R-30, pp. 313–320, Oct. 1981.
18. A. A. Abdel-Ghaly, Ph.D. dissertation, City Univ., London, 1986.
19. P. A. Keiller, B. Littlewood, D. R. Miller, and A. Sofer, “On the quality of software reliability predictions,” in Proc. NATO ASI Electron. Syst. Effectiveness and Life Cycle Costing, Norwich, England. Berlin: Springer, 1983, pp. 441–460.
20. D. R. Miller, “Exponential order statistic models of software reliability growth,” George Washington Univ., Washington, DC, Tech. Rep. T-496/84, 1984.
21. J. T. Duane, “Learning curve approach to reliability monitoring,” IEEE Trans. Aerosp., vol. AS-2, pp. 563–566, 1964.
22. L. H. Crow, “Confidence interval procedures for reliability growth analysis,” U.S. Army Material Syst. Anal. Activity, Aberdeen, MD, Tech. Rep. 197, 1977.
23. H. Akaike, “Prediction and Entropy,” Math. Res. Center, Univ. Wisconsin—Madison, MRC Tech. Summary Rep., June 1982.
24. M. G. Kendall and A. Stuart, The Advanced Theory of Statistics. London: Griffin, 1961.
25. M. Rosenblatt, “Remarks on a multivariate transformation,” Ann. Math. Statist., vol. 23, pp. 470–472, 1952.
26. A. P. Dawid, “Statistical theory: The prequential approach,” J. Roy. Statist. Soc. A, vol. 147, pp. 278–292, 1984.
27. ―, “Calibration-based empirical probability,” Dep. Statist. Sci., University College, London, Res. Rep. 36, 1984.
28. D. R. Cox and P. A. W. Lewis, Statistical Analysis of Series of Events. London: Methuen, 1966.
29. A. P. Dawid, “The well-calibrated Bayesian” (with discussion), J. Amer. Statist. Ass., vol. 77, pp. 605–613, 1982.
30. A. P. Dawid, “Probability forecasting,” in Encyclopedia of Statistical Sciences, vol. 6, S. Kotz, N. L. Johnson, and C. B. Read, Eds. New York: Wiley-Interscience, to be published.
31. D. R. Miller, private communication, 1983.
32. H. Braun and J. M. Paine, “A comparative study of models for reliability growth,” Series 2, Dep. Statist., Princeton Univ., Princeton, NJ, Tech. Rep. 126, 1977.
33. B. Littlewood and P. A. Keiller, “Adaptive software reliability mod-elling,” in Dig. FTCS-14 (14th Int. Conf. Fault-Tolerant Comput.), 1984, pp. 108–113.
34. I. Goudie, private communication, 1984.
35. J. D. Musa, “Software reliability data,” Data and Analysis Center for Software, Rome Air Development Center, Rome, NY, Tech. Rep.
36. N. Langberg and N. D. Singpurwalla, “A unification of some software reliability models via the Bayesian approach,” George Washington Univ., Washington, DC, Tech. Rep. TM-66571, 1981.
37. A. L. Goel and K. Okumoto, “Time-dependent error-detection rate model for software reliability and other performance measures,” IEEE Trans. Rel., vol. R-28, pp. 206–211, 1979.