Analysis of test suite reduction with enhanced tie-breaking techniques

Information and Software Technology

Volumn 51, Issue 4, 2009, Pages 679-690

  Lin, Jun Wei ^a   Huang, Chin Yu ^a  

^a NATIONAL TSING HUA UNIVERSITY   (Taiwan)

Author keywords

Fault detection effectiveness; Software testing; Test suite minimization; Test suite reduction; Tie breaking

Indexed keywords

COMPUTER SOFTWARE SELECTION AND EVALUATION; FAULT DETECTION; OPTIMIZATION; SOFTWARE TESTING;

EXPERIMENT RESULTS; FAULT DETECTION EFFECTIVENESS; NOVE L APPROACH; TEST CASES; TEST SUITE MINIMIZATION; TEST SUITE REDUCTION; TIE-BREAKING;

TESTING;

EID: 58549105896     PISSN: 09505849     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.infsof.2008.11.004     Document Type: Article

References (34)

1. Goldberg D. Genetic Algorithms in Search, Optimization and Machine Learning (1989), Addison-Wesley
2. Keller G., and Warrack B. Statistics for Management and Economics (2003), Thomson
3. Garey M.R., and Johnson D.S. Computers and Intractability: A Guide to the Theory of NP-Completeness (1979), Freeman, New York
4. Cormen T.H., Leiserson C.E., Rivest R.L., and Stein C. Introduction to Algorithms (2001), MIT Press, Cambridge, MA
5. Jeffrey D., and Gupta N. Improving fault detection capability by selectively retaining test cases during test suite reduction. IEEE Transactions on Software Engineering 33 2 (2007) 108-123
6. Rothermel G., Harrold M.J., von Ronne J., and Hong C. Empirical studies of test-suite reduction. Software Testing Verification and Reliability 12 4 (2002) 219-249
7. Rothermel G., Untch R.H., Chu C., and Harrold M.J. Prioritizing test cases for regression testing. IEEE Transactions on Software Engineering 27 10 (2001) 929-948
8. Zhong H., Zhang L., and Mei H. An experimental study of four typical test suite reduction techniques. Information and Software Technology 50 6 (2008) 534-546
9. Jones J.A., and Harrold M.J. Test-suite reduction and prioritization for modified condition/decision coverage. IEEE Transactions on Software Engineering 29 3 (2003) 195-209
10. Harrold M.J., Gupta R., and Soffa M.L. A methodology for controlling the size of a test suite. ACM Transactions on Software Engineering and Methodology 2 3 (1993) 270-285
11. Mansour N., and El-Fakih K. Simulated annealing and genetic algorithms for optimal regression testing. Journal of Software Maintenance 11 1 (1999) 19-34
12. Frankl P., and Weiss S. An experimental comparison of the effectiveness of branch testing and data flow testing. IEEE Transactions on Software Engineering 19 8 (1993) 774-787
13. Chen T.Y., and Lau M.F. A new heuristic for test suite reduction. Information and Software Technology 40 5-6 (1998) 347-354
14. Chen T.Y., and Lau M.F. A simulation study on some heuristics for test suite reduction. Information and Software Technology 40 13 (1998) 777-787
15. Chen T.Y., and Lau M.F. Dividing strategies for the optimization of a test suite. Information Processing Letters 60 3 (1996) 135-141
16. Chvatal V. A greedy heuristic for the set-covering problem. Mathematics of Operations Research 4 3 (1979) 233-235
17. Wong W.E., Horgan J.R., London S., and Mathur A.P. Effect of test set minimization on fault detection effectiveness. Software-Practice and Experience 28 4 (1998) 347-369
18. Li Z., Harman M., and Hierons R. Search algorithms for regression test case prioritization. IEEE Transactions on Software Engineering 33 4 (2007) 225-237
19. A. Srivastava, J. Thiagrajan, Effectively prioritizing tests in development environment, in: Proceedings of the International Symposium on Software Testing and Analysis, Rome, Italy, 2002, pp. 97-106.
20. D. Jeffrey, N. Gupta, Test suite reduction with selective redundancy, in: Proceedings of the Twenty-first International Conference on Software Maintenance, Budapest, Hungary, 2005, pp. 549-558.
21. D. Leon, A. Podgurski, A comparison of coverage-based and distribution-based techniques for filtering and prioritizing test cases, in: Proceedings of the International Symposium on Software Reliability Engineering, Denver, Colorado, USA, 2003, pp. 442-456.
22. F.I. Vokolos, P.G. Frankl, Empirical evaluation of the textual differencing regression testing technique, in: Proceedings of the Fourteenth International Conference on Software Maintenance, Bethesda, MD, USA, 1998, pp. 44-53.
23. G. Rothermel, M.J. Harrold, J. Ostrin, C. Hong, An empirical study of the effects of minimization on the fault detection capabilities of test suites, in: Proceedings of the Fourteenth International Conference on Software Maintenance, Bethesda, MD, USA, 1998, pp. 34-43.
24. J. Black, E. Melachrinoudis, D. Kaeli, Bi-criteria models for all-uses test suite reduction, in: Proceedings of the Twenty-sixth International Conference on Software Engineering, Scotland, UK, 2004, pp. 106-115.
25. J.R. Horgan, S.A. London, ATAC: a data flow coverage testing tool for C, in: Proceedings of the Second Symposium on Assessment of Quality Software Development Tools, New Orleans, LA, USA, 1992, pp. 2-10.
26. J.W. Lin, C.Y. Huang, C.T. Lin, Test suite reduction analysis with enhanced tie-breaking techniques, in: Proceedings of the Fourth International Conference on Management of Innovation and Technology Bangkok, Thailand, 2008. (6 pages)
27. M. Harder, J. Mellen, M.D. Ernst, Improving test suites via operational abstraction, in: Proceedings of the Twenty-fifth International Conference on Software Engineering, Portland, Oregon, USA, 2003, pp. 60-71.
28. M. Hutchins, H. Foster, T. Goradia, T. Ostrand, Experiments on the effectiveness of dataflow- and controlflow-based test adequacy criteria, in: Proceedings of the Sixteenth International Conference on Software Engineering, Sorrento, Italy, 1994, pp. 191-200.
29. P. Frankl, O. Iakounenko, Further empirical studies of test effectiveness, in: Proceedings of the Sixth ACM SIGSOFT International Symposium on Foundations of Software Engineering, Orlando, FL, USA, 1998, pp. 153-162.
30. S. Sampath, S. Sprenkle, E. Gibson, L. Pollock, Integrating customized test requirements with traditional requirements in web application testing, in: Proceedings of the Workshop on Testing, Analysis, and Verification of Web Services and Applications, Portland, Maine, USA, 2006, pp. 23-32.
31. S. Tallam, N. Gupta, A concept analysis inspired greedy algorithm for test suite minimization, in: Proceedings of the Sixth Workshop Program Analysis for Software Tools and Engineering, Lisbon, Portugal, 2005, pp. 35-42.
32. W.E. Wong, J.R. Horgan, S. London, A.P. Mathur, Effect of test set minimization on fault detection effectiveness, in: Proceedings of the Seventeenth International Conference on Software Engineering, Seattle, Washington, USA, 1995, pp. 41-50.
33. J. von Ronne, Test Suite Minimization: An Empirical Investigation, University Honors College Thesis, Oregon State University, Corvallis, USA, 1999.
34. The software-artifact infrastructure repository, 2008. Available from (June 15).