Using simulation for assessing the real impact of test-coverage on defect-coverage

IEEE Transactions on Reliability

Volumn 49, Issue 1, 2000, Pages 60-70

  Briand, Lionel C ^a   Pfahl, Dietmar ^b  

^a CARLETON UNIVERSITY   (Canada)

^b FRAUNHOFER IESE   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SIMULATION; MONTE CARLO METHODS; PROBABILITY DENSITY FUNCTION; REGRESSION ANALYSIS; RELIABILITY THEORY; SOFTWARE ENGINEERING;

DEFECT COVERAGE; SOFTWARE TEST; TEST COVERAGE; TEST INTENSITY;

COMPUTER SOFTWARE SELECTION AND EVALUATION;

EID: 0034156363     PISSN: 00189529     EISSN: None     Source Type: Journal    
DOI: 10.1109/24.855537     Document Type: Article

References (30)

1. V. Basili and R. Selby, Comparing the effectiveness of software testing strategies, IEEE Trans. Software Engineering, vol. 13, no. 12, pp. 1278-1296, 1987.
2. B. Beizer, Software Testing Techniques: Van Nostrand Reinhold, 1990.
3. A. Bertolino and M. Marré, How many paths are needed for branch testing?, J. Systems and Software, vol. 35, no. 2, pp. 95-106, 1996.
4. BestFit: Probability Distribution Fitting for Windows, User's Guide, Palisade Corp., 1997.
5. F. Del Frate, P. Garg, A. Mathur, and A. Pasquini, On the correlation between code coverage and software reliability, in P roc. 4th Int 7. Symp. Software Reliability Engineering (ISSRE), 1995, pp. 124-132.
6. L. Foreman and S. Zweben, A study of the effectiveness of control and data flow testing strategies, J. Software and Systems, vol. 21, no. 3, pp. 213-228, 1993.
7. P. G. Frankl and S. N. Weiss, An experimental comparison of the effectiveness of branch testing and data flow testing, IEEE Trans. Software Engineering, vol. 19, no. 8, pp. 774-787, 1993.
8. P. G. Frankl, S. N. Weiss, and C. Hu, All-uses vs mutation testing: An experimental comparison of effectiveness, J. Systems and Software, vol. 38, no. 3, pp. 235-253, 1997.
9. P. G. Frankl and E. J. Weyuker, An applicable family of data flow testing criteria, IEEE Trans. Software Engineering, vol. 14, no. 10, pp. 1483-1498, 1988.
10. Provable improvements on branch testing, IEEE Trans. Software Engineering, vol. 19, no. 10, pp. 962-975, 1993.
11. L. C. Hamilton, Statistics with Stata 5: Duxbury Press, 1998.
12. B. Haworth, Adequacy criteria for object testing, in Proc. 2nd Int'l. Software Quality Week, Belgium, Nov. 1998.
13. J. R. Morgan, S. London, and M. R. Lyu, Achieving software quality with testing coverage measures, IEEE Computer, pp. 60-69, Sept. 1994.
14. M. Hutchins, H. Foster, T. Goradia, and T. Ostrand, Experiments on the effectiveness of dataflow- and controlflow-based test adequacy criteria,in Proc. 16th Int'l. Conf. Software Engineering (ICSE), 1994, pp. 191-200.
15. R. Jacoby and K. Masuzawa, Test coverage dependent software reliability estimation by the HGD model, in Proc. 1st Int'l. Symp. Software Reliability Engineering (ISSRE), 1992, pp. 193-204.
16. Z. Jin and J. Offutt, Coupling-based criteria for integration testing, software testing, Verification and Reliability, vol. 8, no. 3, pp. 133-154, 1998.
17. N. Li, Y. K. Malaiya, and J. Denton, Estimating the number of defects: A simple and intuitive approach, in Proc. 7th Int '1. Symp. Software Reliability Engineering (ISSRE), 1998, pp. 307-315.
18. M. R. Lyu, J. R. Morgan, and S. London, A coverage analysis tool for the effectiveness of software testing, in Proc. 2nd Int 'I. Symp. Software Reliability Engineering (ISSRE), 1993, pp. 25-34.
19. Y. K. Malaiya, N. Li, andJ. Biemane/aJ., The relationship between test coverage and reliability, in Proc. 3rd Int'l. Symp. Software Reliability Engineering (ISSRE), 1994, pp. 186-195.
20. Microsoft Excel 97, User's Guide, Microsoft Corp., 1997.
21. J. A. Morgan and G. J. Knafl, Residual fault density prediction using regression methods, in Proc. 5th Int'l. Symp. Software Reliability Engineering (ISSRE), 1996, pp. 87-92.
22. S. C. Ntafos, A comparison of some structural testing strategies, IEEE Trans. Software Engineering, vol. 14, no. 6, pp. 868-874, 1988.
23. P. Piwowarski, M. Ohba, and J. Caruso, Coverage measurement experience during function test, in Proc. 15th Int'l. Conf. Software Engineering (ICSE), 1993, pp. 287-301.
24. S. Rapps and E. J. Weyuker, Selecting software test data using data flow information, IEEE Trans. Software Engineering, vol. 11, no. 4, pp. 367-375, 1985.
25. RISKView, The Distribution Viewing Companion, User's Guide, Palisade Corp., 1996.
26. A. Veevers and A. C. Marshall, A relationship between software coverage metrics and reliability, Software Testing, Verification and Reliability, vol. 4, no. 1, pp. 3-8, 1994.
27. D. Vose, Quantitative Risk Analysis: A Guide to Monte Carlo Simulation Modeling: John Wiley & Sons, 1996.
28. L. W. Wayne, Simulation Modeling Using @Risk: Duxbury Press, 1996.
29. E. J. Weyuker, More experience with data flow testing, IEEE Trans. Software Engineering, vol. 19, no. 9, pp. 912-919, 1985.
30. W. E. Wong, J. R. Morgan, S. London, and A. P. Mathur, Effect of test set size and block coverage on the fault detection effectiveness, in P roc. 3rd Int'l. Symp. Software Reliability Engineering (ISSRE), 1994, pp. 230-238.