A mathematical modeling framework for software reliability testing

International Journal of General Systems

Volumn 36, Issue 4, 2007, Pages 399-463

  Cai, Kai Yuan ^a   Dong, Zhao ^b   Liu, Ke ^b   Bai, Cheng Gang ^a  

^a BEIHANG UNIVERSITY   (China)

^b INSTITUTE OF APPLIED MATHEMATICS   (China)

Author keywords

Markov usage model based testing; Software reliability; Software testing; Software testing stability

Indexed keywords

COMPUTER SIMULATION; CONTINUOUS TIME SYSTEMS; MARKOV PROCESSES; SOFTWARE RELIABILITY; TIME DOMAIN ANALYSIS;

DISCRETE TIME DOMAIN; MARKOV USAGE MODEL BASED TESTING; SOFTWARE TESTING STABILITY;

SOFTWARE TESTING;

EID: 34047220352     PISSN: 03081079     EISSN: 15635104     Source Type: Journal    
DOI: 10.1080/03081070600957939     Document Type: Article

References (47)

1. A. Avritzer and E.J. Weyuker, "The automatic generation of load test suites and the assessment of the resulting software", IEEE Trans. Softw. Eng., 21(9), pp. 705-716, 1995.
2. R.E. Barlow and F. Proschan, Mathematical Theory of Reliability, New York: John Wiley & Sons, 1965.
3. R.E. Barlow and F. Proschan, Statistical Theory of Reliability and Life Testing: Probability Models, Holt: Rinbart and Winston, 1975.
4. B. Beizer, Software Testing Techniques, 2nd ed., New York: Van Nostrand Reinhold, 1990.
5. M. Beyer, W. Dulz and F. Zhen, "Automated TTCN-3 test case generation by means of UML sequence diagrams and Markov chains", Proceedings of the 12th Asian Test Symposium, IEEE Computer Society Press, 2003.
6. R.V. Binder, Testing Object-Oriented Systems: Models, Patterns, and Tools, Reading, MA: Addison-Wesley, 2000.
7. K.Y. Cai, Software Defect and Operational Profile Modeling, Dordrecht: Kluwer Academic Publishers, 1998.
8. K.Y. Cai, "Towards a conceptual framework of software run reliability modeling", Inf. Sci., 126, pp. 137-163, 2000.
9. K.Y. Cai, "Optimal software testing and adaptive software testing in the context of software cybernetics", Inf. Softw. Technol., 44, pp. 841-855, 2002.
10. K.Y. Cai, D.B. Hu, C.G. Bai, H. Hu and T. Jing, "Does software reliability growth behavior follow a non-homogeneous poisson process", Submitted for publication, 2004.
11. K.Y. Cai, Y.C. Li and K. Liu, "Optimal and adaptive testing for software reliability assessment", Inf. Softw. Technol., 46, pp. 989-1000, 2004.
12. K.Y. Cai, Y.C. Li and W.Y. Ning, "Optimal software testing in the setting of controlled Markov chains", Eur. J. Oper. Res., 162(2), pp. 552-579, 2005.
13. M.F. Chen, Eigenvalues, Inequalities and Ergodic Theory, Beijing: Beijing Normal University, 2003.
14. M.H. Chen, A.P. Mathur and V.J. Rego, "Effect of testing techniques on software reliability estimates obtained using a time-domain model", IEEE Trans. Rel., 44(1), pp. 97-103, 1995.
15. S. Chen and S. Mills, "A binary Markov process model for random testing", IEEE Trans. Sofiw, Eng., 22(3), pp. 218-223, 1996.
16. K. Doerner and W.J. Gutjahr, "Representation and optimization of software usage models with non-markovian state transitions", Inf. Softw. Technol., 42, pp. 873-887, 2000.
17. K. Doerner, W.J. Gutjahr, "Extracting test sequences from a Markov software usage model by ACO", in Genetic and Evolutionary Computation - GECCO 2003, E. Cantu-Paz, et al. Eds, LNCS 2724, Springer, 2003, pp. 2465-2476.
18. S. Dolev, Self-Stabilization, The MIT Press, 2000.
19. W. Feller, An Introduction to Probability Theory and Its Applications, 2nd ed., Vol. II, Wiley, 1971, p. 345.
20. P.G. Frankl, R.G. Hamlet, B. Littlewwod and L. Strigini, "Evaluating testing methods by delivered reliability", IEEE Trans. Softw. Eng., 24(8), pp. 586-601, 1998.
21. M.A. Friedman and J.M. Voas, Software Assessment: Reliability, Safety, Testability, John Wiley & Sons, 1995.
22. W.J. Gutjahr, "Importance sampling of test cases in markovian software usage models", Probability Eng. Inf. Sci., 11, pp. 19-26, 1997.
23. W.J. Gutjahr, "Software dependability evaluation based on Markov usage models", Perform. Eval., 40, pp. 199-222, 2000.
24. J.R. Horgan and A.P. Mathur, "Software testing and reliability", in Handbook of Software Reliability Engineering, M.R. Lyu, Ed., McGraw-Hill, 1996, pp. 531-565.
25. H.K. Khalil, Nonlinear Systems, 3rd ed., Prentice Hall, 2001.
26. H.J. Kushner, Stochastic Stability and Control, Academic Press, 1967.
27. M.R. Lyu, M.R. Lyu, Ed., Handbook of Software Reliability Engineering, McGraw-Hill, 1996.
28. Y.K. Malaiya and R. Karcich, "The relationship between test coverage and reliability", Proc. 5th Int. Symp. Softw. Reliability Eng., pp. 186-195, 1994.
29. T. Menzies, D. Owen and B. Cukic, "Saturation effects in testing of formal models", 13th Proc. Int. Symp. Softw. Reliability Eng., pp. 15-26, 2002.
30. J.D. Musa, "Software-reliability-engineered testing", Computer, 29(11), pp. 61-68, 1996.
31. J.H. Poore, G.H. Walton and J.A. Whittaker, "A constraint-basd approach to the representation of software usage models", Inf. Softw. Technol., 42, pp. 825-833, 2000.
32. R.S. Pressman, Software Engineering, a Practitioner's Approach, 5th ed., McGraw-Hill, 2000.
33. D. Revuz and M. Yor, Continuous Martingales and Brownian Motion (A Series of Comprehensive Studies in Mathematics, 293), Springer-Verlag, 1991.
34. M. Sahinoglu, J. A. von Mayrhauser, A. Hajjar, T. Chen and Ch. Anderson, "On the efficiency of a compound poisson stopping rule for mixed strategy testing", Proc. IEEE Aerosp. Appl. Conf., 1999.
35. K. Sayre and J.H. Poore, "Partition testing with usage models", Inf. Softw. Technol., 42, pp. 845-850, 2000a.
36. K. Sayre and J.H. Poore, "Stopping criteria for statistical testing", Inf. Softw. Technol., 42, pp. 851-857, 2000b.
37. K. Sayre and J. Poore, "A reliability estimator for model based software testing", Proc. 13th Int. Symp. Softw. Reliability Eng., 2002.
38. G.S. Semmel and D.G. Linton, "Determining optimal testing times for Markov chain usage models", Proc. IEEE Southeastcon, 1998.
39. M.G. Thomason and J.A. Whittaker, "Rare failure state in a Markov chain model for software reliability", Proc. 10th Int. Symp. Softw. Reliability Eng., pp. 12-19, 1999.
40. G.H. Walton, "Generating transition probabilities for Markov chain usage models", Ph.D. Dissertation, Department of Computer Science, University Tennessee, Knoxville, USA, 1995.
41. G.H. Walton and J.H. Poore, "Measuring complexity and coverage of software specifications", Inf. Softw. Technol., 42, pp. 859-872, 2000.
42. J.A. Whittaker, "What is software testing? And why is it so hard?", IEEE Softw., January/February pp. 70-79, 2000.
43. J.A. Whittaker and J.H. Poore, "Markov analysis of software specifications", ACM Trans. Softw. Eng. Methodol., 2, pp. 93-106, 1993.
44. J.A. Whittaker and M.G. Thomason, "A Markov chain model for statistical software testing", IEEE Trans. Softw. Eng., 20(10), pp. 812-824, 1994.
45. J.A. Whittaker, K. Rekab and M.G. Thomason, "A Markov chain model for predicting the reliability of multi-build software", Inf. Softw. Technol., 42, pp. 889-894, 2000.
46. M. Xie, Software Reliability Modeling, World Scientific, 1991.
47. H. Zhu, P.A. Hall and J.H.R. May, "Test Coverage and Adequacy", ACM Comput. Surv., 29(4), pp. 366-427, 1997.