An experimental study of adaptive testing for software reliability assessment

Journal of Systems and Software

Volumn 81, Issue 8, 2008, Pages 1406-1429

  Cai, Kai Yuan ^a   Jiang, Chang Hai ^a   Hu, Hai ^a   Bai, Cheng Gang ^a  

^a BEIHANG UNIVERSITY   (China)

Author keywords

Adaptive testing; Operational profile; Random testing; Software cybernetics; Software reliability assessment; Software testing

Indexed keywords

ADAPTIVE CONTROL SYSTEMS; COMPUTER SOFTWARE SELECTION AND EVALUATION; CONCURRENCY CONTROL; ESTIMATION; QUALITY ASSURANCE; RELIABILITY THEORY; SOFTWARE RELIABILITY; SOFTWARE TESTING;

ADAPTIVE CONTROL; ADAPTIVE TESTING; EXPERIMENTAL STUDIES; HIGH CONFIDENCE; NEW FORMS; OPERATIONAL PROFILE; OPERATIONAL PROFILES; RANDOM TESTING; REAL-WORLD; RELIABILITY ASSESSMENTS; SOFTWARE CYBERNETICS; SOFTWARE RELIABILITY ASSESSMENT; SPACE PROGRAMS;

RELIABILITY;

EID: 50049118573     PISSN: 01641212     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jss.2007.11.721     Document Type: Article

References (36)

1. Beizer B. Software Testing Techniques. second ed. (1990), Van Nostrand Reinhold
2. Binder R.V. Testing Object-Oriented Systems: Models, Patterns, and Tools (2000), Addison-Wesley
3. Cai K.Y. Software Defect and Operational Profile Modeling (1998), Kluwer Academic Publishers
4. Cai K.Y. Towards a conceptual framework of software run reliability modeling. Information Sciences 126 (2000) 137-163
5. Cai K.Y. Optimal software testing and adaptive software testing in the context of software cybernetics. Information and Software Technology 44 (2002) 841-855
6. Cai K.Y., Cai L., Wang W.D., Yu Z.Y., and Zhang D. On the neural network approach in software reliability modeling. Journal of Systems and Software 58 (2001) 47-62
7. Cai K.Y., Cangussu J.W., DeCarlo R.A., and Mathur A.P. An overview of software cybernetics. Proceedings of the 11th International Workshop on Software Technology and Engineering Practice (2004), IEEE Computer Society Press 77-86
8. Cai K.Y., Li Y.C., and Liu K. Optimal and adaptive testing for software reliability assessment. Information and Software Technology 46 (2004) 989-1000
9. Cai K.Y., Li Y.C., and Ning W.Y. Optimal software testing in the setting of controlled Markov chains. European Journal of Operational Research 162 2 (2005) 552-579
10. Cai K.Y., Zhao L., Hu H., and Jiang C.H. On the test case definition of GUI testing. Proceedings of the 5th International Conference on Quality Software (2005), IEEE Computer Society Press 19-26
11. Cai K.Y., Gu B., Hu H., and Li Y.C. Adaptive software testing with fixed-memory feedback. Journal of Systems and Software 80 (2007) 1328-1348
12. DeMillo R.A., Lipton R.J., and Sayward F.G. Hints on test data selection: help for the practicing programmer. IEEE Computer 11 (1978) 34-41 (April)
13. Fenton N., Littlewood B., and Neil M. Applying Bayesian belief network in systems dependability assessment. Proceedings of the Safety Critical Systems Symposium (1996), Springer-Verlag 71-94
14. Frankl P.G., Hamlet R.G., Littlewood B., and Strigini L. Evaluating testing methods by delivered reliability. IEEE Transactions on Software Engineering 24 8 (1998) 586-601
15. Goseva-Popstojanova K., and Trivedi K.S. Architecture-based approach to reliability assessment of software systems. Performance Evaluation 45 (2001) 179-204
16. Henmann, D.S., 1998. Sample implementation of the Littlewood holistic model for assessing software quality, safety and reliability. In: Proceedings of the Annual Reliability and Maintainability Symposium. pp. 138-148.
17. Hernandez-Lerma O. Adaptive Markov Control Processes (1989), Springer-Verlag
18. Kanoun K., Kaaniche M., and Laprie J.C. Qualitative and quantitative reliability assessment. IEEE Software March/April (1997) 77-86
19. Karuanithi N., Whitley D., and Malaiya Y.K. Prediction of software reliability using connectionist models. IEEE Transactions on Software Engineering 18 7 (1992) 563-574
20. Leung H., and Chen T.Y. A new perspective of the proportional sampling strategy. The Computer Journal 42 8 (1999) 693-698
21. Littlewood, B., 2000. The problem of assessing software reliability - when you really need to depend on it. In: Proceedings of the Safety Critical Systems Symposium.
22. In: Lyu M.R. (Ed). Handbook of Software Reliability Engineering (1996), McGraw-Hill
23. Musa J.D. Software-reliability-engineered testing. Computer 29 11 (1996) 61-68
24. Nelson E. Estimating software reliability from test data. Microelectronics and Reliability 17 1 (1978) 67-74
25. Offutt A.J., and Untch R.H. Mutation 2000: uniting the orthogonal. In: Wong W.E. (Ed). Mutation Testing in the New Century (2001), Kluwer Academic Publishers
26. Pressman R.S. Software Engineering: A Practitioner's Approach. fifth ed. (2000), McGraw-Hill
27. Puterman M.L. Markov Decision Processes: Discrete Stochastic Dynamic Programming (1994), John Wiley & Sons
28. Rothermel G., Untch R.H., Chu C., and Harrold M.J. Prioritizing test cases for regression testing. IEEE Transactions on Software Engineering 27 10 (2001) 929-948
29. Rothermel G., Elbaum S., Malishevsky A.G., Kallakuri P., and Qiu X. On test suite composition and cost-effective regression testing. ACM Transactions on Software Engineering and Methodology 13 3 (2004) 277-331
30. Smidts C., Stutzke M., and Stoddard R.W. Software reliability modeling: an approach to early reliability prediction. IEEE Transactions on Reliability 47 3 (1998) 268-278
31. Vokolos, F.I., Frankl, P.G., 1998. Empirical evaluation of the textual differencing regression testing technique. In: Proceedings of the International Conference on Software Maintenance. pp. 44-53.
32. Weiss S.N., and Weyuker E.J. An extended domain-based model of software reliability. IEEE Transactions on Software Engineering 14 10 (1988) 1512-1524
33. Whittaker J.A., and Poore J.H. Markov analysis of software specifications. ACM Transactions on Software Engineering and Methodology 2 (1993) 93-106
34. Whittaker J.A., and Thomason M.G. A Markov chain model for statistical software testing. IEEE Transactions on Software Engineering 20 10 (1994) 812-824
35. Xie M. Software Reliability Modeling (1991), World Scientific
36. Zhu H., Hall P.A., and May J.H.R. Test coverage and adequacy. ACM Computing Surveys 29 4 (1997) 366-427