A framework for comparing efficiency, effectiveness and applicability of software testing techniques

Proceedings - Testing: Academic and Industrial Conference - Practice and Research Techniques, TAIC PART 2006

Volumn , Issue , 2006, Pages 159-170

  Eldh, Sigrid ^a,b   Hansson, Hans ^b   Punnekkat, Sasikumar ^b   Pettersson, Anders ^b   Sundmark, Daniel ^b  

^a ERICSSON RESEARCH   (Sweden)

^b MÄLARDALEN UNIVERSITY   (Sweden)

Author keywords

[No Author keywords available]

Indexed keywords

APPROPRIATE TECHNIQUES; DIFFERENT DOMAINS; EXPERIMENTAL STUDIES; SOFTWARE TESTING TECHNIQUES; TEST DESIGNS; TEST TECHNIQUES;

INDUSTRY; TESTING;

SOFTWARE TESTING;

EID: 80053523364     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/TAIC-PART.2006.1     Document Type: Conference Paper

References (31)

1. NIST-Final Report "The Economic Impacts of Inadequate Infrastructure for Software Testing", Table 8-1, National Institute of Standards and Technology, May 2002
2. Basili, V.R., R.W. Selby, "Comparing the Effectiveness of Software Testing Strategies" original 1985, revised dec. 1987, in B. Boehm, H.D. Rombach, Martin V. Zelkowitz(Eds.). Foundations of Empirical Software Engineering, The Legacy of Victor R. Basili, Springer Verlag, 2005
3. Myers, G.J., "A controlled experiment in program testing and code walkthroughs inspections," Comm. ACM pp. 760-768 Sept 1978
4. Hetzel, W.C., "An experimental analysis of program verification methods", PhD dissertation, Univ. North Carolina, Chapel Hill 1976.
5. nd ed., Boston, 1990
6. Rothermel, G., Harrold, M.J., "Analyzing Regression Test Selection Techniques", IEEE Trans. On Software Eng., Vol. 22, No. 8, Aug. 1996
7. Weyuker, E. J.: "Can We Measure Software Testing Effectiveness?" IEEE Softw. Metrics Symposium, 1993, pp.100-10l
8. Avizienis, A, Laprie, J.C. "Dependable Computing: From Concepts to Design Diversity", Proc. of the IEEE, Journal, Vol. 74, No 5, May 1986, pp. 629 - 638 (Pubitemid 16613812)
9. Zhu, H., Hall, P.A.V., May, J.H.R., "Software Unit Test Coverage and Adequacy", ACM Computing Surveys, Vol. 29, No.4 Dec 1997
10. Vegas, S., Basili, V.R., "A characterization schema for Software Testing Techniques', Journal of Empirical Softw. Engineering, 10, Springer, 2005, pp. 437-466 (Pubitemid 41406981)
11. Juristo, N., Moreno, A.M. and Vegas, S. "Reviewing 25 Years of Testing Technique Experiments", Journal of Empirical Softw. Eng., Springer Issue: Volume 9, Numbers 1-2, March 2004, pp. 7 - 44
12. Wohlin, C., Runeson, P., Höst, C., Ohlsson, M. C., Regnell, B. and Wesslen, A., "Experimentation in Software Engineering: An Introduction", Kluwer Academic, 2000
13. Frankl, P.G., Iakounenko, O., "Further empirical studies of test effectiveness", Proc. of the 6'th SigSoft Int. Symp. Foundations on Soft. Eng., ACM, Nov 1998
14. Weyuker, E. J. "The cost of data flow testing: An empirical study." IEEE Trans. on Software Engineering, 19(9), Sept 1990.
15. DeMillo, R.A.; Mathur, A.P.; Wong, W.E.; Frankl, P.G.; Weyuker, E.J.; "Some critical remarks on a hierarchy of fault-detecting abilities of test methods [and reply]", IEEE Trans. on Software Engineering, Vol. 21, Issue 10, Oct 1995, pp.858 - 863
16. Kamsties, E., and Lott, C. M. "An empirical evaluation of three defect-detection techniques", Proc. Fifth European Soft. Eng. Conf., (ISERN), Spain 1995
17. Wood, M., Roper, M., Brooks, A., and Miller, J. 1997. "Comparing and combining software defect detection techniques: A replicated empirical study." Proc. of the 6th European Soft. Eng. Conf., Switzerland, 1997
18. Ishoda, S. "A criticism on the capture-and-recapture method for software reliability assurance", Proc. Soft. Eng. IEEE, 1995
19. Offut, A. J., Rothermel, G., and Zapf, C. "An experimental evaluation of selective mutation", Proc. the 15th Int. Conf. on Soft. Eng. IEEE, 1993
20. DeMillo, R. A. Lipton, R. J. and Sayward, F. G. "Program mutation: a new approach to program testing", State of the Art Report, Soft. Testing, Volume 2: Invited Papers, Infotech Int., 1979
21. Jones, B.F. Sthamer, H.-H. Eyres, D.E. "Automatic Structural testing using genetic algorithms", Journal of Software Engineering, IEEE, Sept 1996
22. Wegener, J. Sthamer, H., Jones, B.F. and Eyres, D.E., "Testing real-time systems using genetic algorithms", Journal of Soft. Quality, Springer, Vol. 6 (2), June 1997
23. Chen, T., Bai, A., Hajjar, A., "Fast Anti-Random (FAR) Test Generation to Improve Quality of Behavioral Model Verification", Jour. Electronic Testing: Theory and Application 18, Kluwer, Dec. 2002, pp. 583-594
24. Duran, J.W., Ntafos, S.C., "Evaluation of Random Testing", Transaction of Software Engineering, Vol. 10(44), IEEE, 1984, pp. 438-444
25. Hamlet, D.; Taylor, R.; "Partition testing does not inspire confidence [program testing]" Transaction of Software Engineering, Vol.16(12), IEEE, Dec. 1990
26. Hyunsook, D., Elbaum, S., Rothermel, G.; "Infrastructure support for controlled experimentation with software testing and regression testing techniques" Proc. Int. Symp. On Empirical Software Engineering, ISESE '04, ACM Aug. 2004, pp.60 - 70 (Pubitemid 40062819)
27. DeMillo, R.A. Guindi, D.S. McCracken, W.M. Offutt, A.J. King, K.N., "An extended overview of the Mothra software testing environment", Proc on Software, Testing, Verification and Analysis, IEEE, July 1988
28. Offutt, A.J., Rothermel, G. Zapf, C. "An experimental evaluation of selective mutation", Proc. Int. Conf. on Software Engineering, IEEE, May 1993
29. Offutt, A.J., Huffman Hayes, J., "A semantic model of program faults", ACM SIGSOFT Soft. Eng. Notes, Vol. 21, Issue 3, May 1996, pp. 195-200
30. Chillarege, R. Bhandari, I.S. Chaar, J.K. Halliday, M.J. Moebus, D.S. Ray, B.K. Wong, M.-Y, "Orthogonal Defect Classification: A concept for Inprocess Measurements", Transaction of Software Engineering, IEEE, Vol.20(6), 1992, pp. 476-493
31. IEEE 1044-1993 Standard Classification for Software Anomalies, IEEE, 1993