An empirical study on testing and fault tolerance for software reliability engineering

Proceedings - International Symposium on Software Reliability Engineering, ISSRE

Volumn 2003-January, Issue , 2003, Pages 119-130

  Lyu, M R ^a   Huang, Zubin ^a   Sze, S K S ^a   Cai, Xia ^a  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

data flow coverage testing; empirical study; mutation testing; software fault tolerance

Indexed keywords

APPLICATION PROGRAMS; FAULT DETECTION; FAULT TOLERANCE; SOFTWARE TESTING;

COVERAGE TESTING; DEVELOPMENT STAGES; EMPIRICAL STUDIES; MUTATION TESTING; SOFTWARE FAULT TOLERANCES; SOFTWARE RELIABILITY ENGINEERING; TEST CASE GENERATION; TESTING AND FAULT-TOLERANCE;

SOFTWARE RELIABILITY;

EID: 84954452028     PISSN: 10719458     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISSRE.2003.1251036     Document Type: Conference Paper

References (36)

1. M. Lyu (ed.), Handbook of Software Reliability Engineering, McGraw-Hill, New York, 1996.
2. S. Rapps, E. J. Weyuker, "Selecting Software Test Data Using Data Flow Information," IEEE Transactions on Software Engineering, vol. SE-11, No.4, April 1985.
3. W. E. Howden, "Weak Mutation Testing and Completeness of Test Sets," IEEE Transactions on Software Engineering, vol. SE8, no. 4, July 1982, pp. 371-379.
4. P.G. Frankl, E.J. Weyuker, "An Applicable Family of Data Flow Testing Criteria," IEEE Transactions on Software Engineering, vol. SE-14, No. 10, October 1988.
5. E.J.Weyuker, "The Cost of Data Flow Testing: An Empirical Study," IEEE Transactions on Software Engineering, v.16 n.2,February 1990, pp.121-128.
6. J.R. Horgan, S. London, and M.R. Lyu, "Achieving Software Quality with Testing Coverage Measures," IEEE Computer, vol. 27, no. 9, September 1994, pp. 60-69.
7. L. Briand and D. Pfahl, "Using simulation for assessing the real impact of test coverage on defect coverage," Proceedings of 10th IEEE International Symposium on. Software Reliability Engineering, Nov. 1999, pp. 124-157.
8. M.Chen, M.R. Lyu, and E. Wong, "Effect of Code Coverage on Software Reliability Measurement," IEEE Transactions on Reliability, vol. 50, no. 2, June 2001, pp. 165-170.
9. Y.K. Malaiya, N. Li, J. M. Bieman, and R. Karcich, "Software Reliability Growth with Test Coverage," IEEE Transactions on Reliability, vol. 51, no. 4, December 2002, pp. 420-426.
10. A.J. Offutt, A. Lee, G. Rothermel, R.H. Untch, and C. Zapf, "An Experimental Determination of Sufficient Mutant Operators," ACM Transactions on Software Engineering Methodology, vol. 5, no. 2, 1996, pp. 99-118.
11. A.J. Offutt, G. Rothermel, and C. Zapf, "An Experimental Evaluation of Selective Mutation," Proceedings of the 15th International Software Engineering Conference, May 1993, pp. 1-107.
12. W.E. Wong and A.P. Mathur, "Reducing the Cost of Mutation Testing: An Empirical Study," The Journal of Systems and Software, vol. 31, no. 3, December 1995, pp. 185-196.
13. A. Offutt and S. Lee, "An Empirical Evaluation of Weak Mutation," IEEE Transactions on Software Engineering, vol. 20, no. 5, May 1994.
14. E. Delamaro, C. Maldonado and A.P. Mathur, "Interface Mutation: An Approach for Integration Testing," IEEE Transactions on Software Engineering, Vol. 27, No. 3, March 2001, pp. 228-247.
15. A .J. Offutt and J. Pan, "Automatically Detecting Equivalent Mutants and Infeasible Paths," The Journal of Software Testing, Verification, and Reliability, Vol 7, No. 3, September 1997, pp. 165-192.
16. B. Randell and J. Xu, "The Evolution of the Recovery Block Concept," Software Fault Tolerance, M. R. Lyu (ed.), Wiley, Chichester, 1995, pp. 1-21.
17. A.A. Avizienis, "The Methodology of N-Version Programming," Software Fault Tolerance, M. R. Lyu (ed.), Wiley, Chichester, 1995, pp. 23-46.
18. J.C. Laprie, J. Arlat, C. Beounes, and K. Kanoun, "Architectural Issues in Software Fault Tolerance," Software Fault Tolerance, M. R. Lyu (ed.), Wiley, Chichester, 1995, pp. 47-80.
19. K.E. Grosspietsch, "Optimizing the Reliability of the Component-based N-version Approaches," Proceedings of International Parallel and Distributed Processing Symposium (IPDPS 2002), Fort Lauderdale, Florida, April 2002, pp. 138-145.
20. K.E. Grosspietsch, A. Romanovsky, "An Evolutionary and Adaptive Approach for N-version Programming," Proceedings of 27th Euromicro Conference, Warsaw, Poland, September 2001, pp. 182-189.
21. M. R. Lyu and Y. He, "Improving the N-version programming process through the evolution of a design paradigm," IEEE Transactions on Reliability, 42(2), June 1993, pp. 179-189.
22. B. Littlewood and D.Miller, "Conceptual Modeling of Coincident Failures in Multiversion Software," IEEE Transactions on Software Engineering, vol. 15, no. 12, December 1989, pp. 1596-1614.
23. M. Ege, M.A Eyler, M.U. Karakas, "Reliability Analysis in N-version Programming with Dependent Failures," Proceedings of Euromicro 27th Conference, 2001, pp. 174-181.
24. X. Teng and H. Pham, "A Software-Reliability Growth Model for N-Version Programming Systems," IEEE Transactions on Reliability, vol. 51, issue 3, September 2002, pp. 311-321.
25. F. Belli and P. Jedrzejowicz, "Fault-Tolerant Programs and Their Reliability," IEEE Transactions on Reliability, vol. 29(2), 1990, pp. 184-192.
26. B. Littlewood, P. Popov, and L. Strigini, "Modelling Software Design Diversity - a Review," ACM Computing Surveys, Vol. 33, No. 2, June 2001, pp. 177-208.
27. B. Littlewood, P. Popov, P. and L. Strigini, "Design Diversity: an Update from Research on Reliability Modelling," Proceedings of Safety-Critical Systems Symposium 21, Bristol, U.K., Springer, 2001.
28. D.E. Eckardt and L.D. Lee, "A Theoretical Basis for the Analysis of Multiversion Software Subject to Coincident Errors," IEEE Transaction on Software Engineering, vol, SE-11, no. 12, December 1985, pp. 1511-1517.
29. B. Littlewood, P. Popov and L. Strigini, "Assessing the Reliability of Diverse Fault-Tolerant Software-based Systems," Safety Science, vol40, 2002, pp.781-796.
30. K. Kim, M. A. Vouk and D.F. McAllister, "An Empirical Evaluation of Maximum Likelihood Voting in High Inter-Version Failure Correlation Conditions," Proceedings of 7th International Symposium on Software Reliability Engineering, October 1996, pp 330-339.
31. R. Zhao, Research on Software Testing Methodologies, Ph.D. thesis, Chinese Academy of Science, 2001.
32. L.J. White and E.I. Cohen, "A Domain Testing Strategy," IEEE Transactions on Sofiware Engineering", Vol. SE-6, No. 3, May 1980, pp. 247-257.
33. D.E.Eckhardt, Caglavan, Knight, Lee, McAllister, Vouk, Kelly, "An experimental evaluation of software redundancy as a strategy for improving reliability," IEEE Transaction of Software Engineering, vol 18, July 1991, pp 692-702.
34. M.R. Lyu, J.R. Horgan, S. London, "A Coverage Analysis Tool for the Effectiveness of Software Testing," Proceedings of ISSRE'93, Denver, November 1993, pp. 25-34.
35. R. Chillarege, I.S. Bhandari, J.K. Chaar, M.J. Halliday, D.S. Moebus, B.K. Ray, and M.Y. Wong, "Orthogonal Defect Classification - A Concept for In-Process Measurements," IEEE Transactions on Software Engineering, vol. 18, no. 19, November 1992, pp.943-956.
36. Y. K. Malaiya, L. Naixin, J. Bieman, R. Karcich and B. Skibbe, "The Relationship Between Test Coverage and Reliability," Proceedings of 5th International Symposium on Software Reliability Engineering, November 1994, pp. 186-195.