Can we measure software testing effectiveness?

Proceedings - 1st International Software Metrics Symposium, METRIC 1993

Volumn , Issue , 1993, Pages 100-107

  Weyuker, Elaine J ^a  

^a NEW YORK UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FAULT DETECTION;

PROBABILISTIC MEASURES; TESTING CRITERIA; TESTING EFFECTIVENESS;

SOFTWARE TESTING;

EID: 84951762440     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/METRIC.1993.263796     Document Type: Conference Paper

References (30)

1. V.R. Basili and R.W. Selby, ?Comparing the Effectiveness of Software Testing Strategies, ? IEEE Trans. Software Eng., Vol. SE-13, No. 12, Dec 1987, pp. 1278-1296.
2. V.R. Basili, R.W. Selby, and D.H. Hutchens, ?Experimentation in Software Engineering? IEEE Trans. Software Eng., Vol. SE-12, No. 7, July 1986, pp.773-743.
3. L.A. Clarke, A. Podgurski, D.J. Richardson and S.J. Zeil, ?A Comparison of Data Flow Path Selection Criteria, ? 8th IEEE International Conference on Software Engineering, August, 1985, London, pp. 244-251.
4. M.D. Davis and E.J. Weyuker, ?A Formal Notion of Program-Based Test Data Adequacy, ? In-formation and Control, Vol.56, Nos.l-2, Jan/Feb 1983, pp. 52-71.
5. J.W. Duran and S.C. Ntafos, ?An Evaluation of Random Testing, ? IEEE Trans. Software Eng., Vol. SE-b, No. 4, July 1984, pp. 438-444.
6. J.W. Duran and J. Wiorkowski, ?Quantifying software validity by sampling, ? IEEE Trans. on Reliability, Vol. R-29, 1980, pp. 141-144.
7. M. E. Fagan, ?Advances in Software Inspections, ? IEEE Trans. Software Eng., Vol. SE-12, No. 7, July 1986, pp. 744-751.
8. P.O. Frankl and SN. Weiss, ?An experimental comparison of the effectiveness of the all-uses and all-edges adequacy criteria, ? Symposium on Testing, Analysis and Verification, Victoria, Canada, October 1991.
9. P.O. Frankl and E.J, Weyuker, ?An Applicable Family of Data Flow Testing Criteria, ? IEEE Transactions on Software Engineering, Vol. 14, No. 10, October 1988, pp. 1483-1498.
10. P.O. Frankl and E.J. Weyuker, ?Comparing Fault Detecting Ability of Testing Methods, ? Proceedings of ACM SIGSOFT 91, Conference on Software for Crittcal Systems, New Orleans, La., Dec 1991, pp.77-91.
11. P.O. Frankl and E.J. Weyuker, ?An Analytical Comparison of the Fault-detecting Ability of Data Flow Testing Techniques, ? Proceedings Fifteenth International Conference on Software Engineering, Baltimore, Md., May 1993.
12. P.O. Frankl and E.J. Weyuker ?Provable Improvements on Branch Testing, ? submitted for publication.
13. M.R. Girgis and MR. Woodward, ?An Experimental Comparison of the Error Exposing Ability of Program Testing Criteria, ? Proc. Workshop on Software Testing, Banif, Canada, July 1980, pp. 64-73.
14. J.S. Gourlay, ?A Mathematical Framework for the Investigation of Testing, ? IEEE Trans. on Software Eng., Vol.SE-9, No.6, Nov 1983, pp. 686-709.
15. R. Hamlet, Editor?s Introduction, Special Section on Software Testing, CA CM, Vol. 31, June 1988, pp . 66 2-667.
16. B.. Hamlet, ?Theoretical Comparison of Testing Methods, ? Proc. Third Symposium on Testing, Analysis, and Verification, Key West, Florida, Dec 1989, pp. 28-37.
17. B.. Hamlet and R. Taylor, ?Partition Testing Does Not Inspire Confidence, ? Proc. Second Workshop on Software Testing, Verification, and Analysis, Banfi, Canada, July 1988, pp. 206-215.
18. W.E. Howden, ?Reliability of the Path Analysis Testing Strategy, ? IEEE Trans. Software Eng., Vol.SE-2, No.3, Sept 1976, pp. 208-215.
19. L. Lauterbach and W Randall, ?Experimental evaluation of six test techniques, ? Proc. COMPASS ?89, Gaitersburg, MD, June, 1989, pp. 36-41.
20. G.L. Myers, ?A Controlled Experiment in Program Testing and Code Walkthroughs/ Inspecitons? Communications of the ACM, Sept 1978, pp. 760-768.
21. S. Ntafos, ?A Comparison of Some Structural Testing Strategies, ? IEEE Trans. Software Eng., Vol. 14, No.6, Jun 1988, pp. 868-874.
22. S. Rapps and E.J. Weyuker, ?Data Flow Analysis Techniques for Program Test Data Selection, ? Proceedings Sixth International Conference on Software Engineering, Tokyo, Japan, Sept. 1982, pp. 272-278.
23. S. Rapps and E.J. Weyuker, ?Selecting Software Test Data Using Data Flow Information, ? IEEE Trans. Software Eng., Vol. SE-li, No.4, April 1985, pp. 367-375.
24. P.S. Roberts, Encyclopedia of Mathematics, Vol. 7, Measurement Theory, Addison-Wesley Publishing Co., 1979
25. Rowland, John H. and Yu Zuyuan, ?Experimental comparison of three system test strategies preliminary report, ? Proceedings of the ACM SIGSOFT 89 Third Symposium on Testing, Analysis, and Verification, Dec. 1989, pp. 141-145.
26. T.J. Shimeall and N.G. Leveson, ?An Empirical Comparison of Software Fault Tolerance and Fault Elimination, ? Proceedings of the Workshop on Software Testing, IEEE Computer Society Press, July 1988, pp. 180-187.
27. S.S. Stevens, ?Mathematics, Measurement, and Psychophysics, ? in Handbook of Expemmental P8ychology, S.S. Stevens, ed., Wiley, 1951, pp. 1-49.
28. M.D. Weiser, J.D. Gannon, P.R. McMullin, ?Comparison of Structural Test Coverage Metrics, ? IEEE Software, Vol. 19, No. 2, Mar 1985, pp. 80-85.
29. E.J. Weyuker and B. Jeng, ?Analyzing Partition Testing Strategies, ? IEEE Trans. Software Eng., Vol. 17, No.7, July 1991, pp. 703-711.
30. E.J. Weynker, S.N. Weiss, and R. Hamlet, ?Comparison of Program Testing Strategies, ? Proceedings of the Fourth Symposium on Software Testing, Analysis and Verification (TAV.Q, Victoria, B.C., Canada, Oct 1991, pp. 1-10.