An experimental study of four typical test suite reduction techniques

Information and Software Technology

Volumn 50, Issue 6, 2008, Pages 534-546

  Zhong, Hao ^a,b   Zhang, Lu ^a,b   Mei, Hong ^a,b  

^a Peking University   (China)

^b PEKING UNIVERSITY   (China)

Author keywords

Empirical studies; Software testing; Test suite minimization; Test suite reduction

Indexed keywords

COMPUTER SIMULATION; COST EFFECTIVENESS; PROBLEM SOLVING; REDUNDANCY; SOFTWARE TESTING;

TEST SUITE MINIMIZATION; TEST SUITE REDUCTION;

SOFTWARE ENGINEERING;

EID: 40849127218     PISSN: 09505849     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.infsof.2007.06.003     Document Type: Article

References (38)

1. Aho A., Hopcroft J., and Ullman J. The Design and Analysis of Computer Algorithms (1974), Addison-Wesley
2. Basili V.R., Selby R.W., and Hutchens D.H. Experimentation in software engineering. IEEE Transaction Software Engineering 12 7 (1986) 733-743
3. Binkley D. Semantics guided regression test cost reduction. IEEE Transactions on Software Engineering 23 8 (1997) 498-516
4. Black J., Melachrinoudis E., and Kaeli D. Bi-criteria models for all-uses test suite reduction. Proceedings of 26th International Conference on Software Engineering (2004), IEEE Computer Society, Washington,DC, USA 106-115
5. Chen T.Y., and Lau M. Dividing strategies for the optimization of a test suite. Information Processing Letters 60 3 (1996) 135-141
6. Chen T.Y., and Lau M. A new heuristic for test suite reduction. Information and Software Technology 40 5-6 (1998) 347-354
7. Chen T.Y., and Lau M. A simulation study on some heuristics for test suite reduction. Information and Software Technology 40 13 (1998) 777-787
8. Elbaum S., Malishevsky A., and Rothermel G. Test case prioritization: a family of empirical studies. IEEE Transactions on Software Engineering 28 2 (2002) 159-182
9. E. Gizdarski, H. Fujiwara. Spirit: Satisfiability problem implementation for redundancy identification and test generation, in: Proceedings of Ninth Asian Test Symposium (ATS'00), Taiwan, 2000, IEEE Computer Society, p. 171.
10. Goldberg D. Genetic Algorithms in Search, Optimization and Machine Learning (1989), Addison-Wesley
11. Graves T., Harrold M., Kim J., Porter A., and Rothermel G. An empirical study of regression test selection techniques. ACM Transactions on Software Engineering and Methodology (TOSEM) 10 2 (2001) 184-208
12. Gupta R., Harrold M.J., and Soffa M.L. Program slicing-based regression testing techniques. Journal of Software Testing Verification and Reliability 6 2 (1996) 83-111
13. Harrold M.J., Gupta R., and Soffa M.L. A methodology for controlling the size of a test suite. ACM Transactions on Software Engineering and Methodology 2 3 (1993) 270-285
14. M.J. Harrold, A. Orso, D. Rosenblum, G. Rothermel, M.L. Soffa, H. Do, Using Component Metadata to Support the Regression Testing of Component-Based Software, 2000.
15. Hartmann J., and Robson D. Revalidation during the software maintenance phase. Proceedings of International Conference on Software Maintenance (1989) 0-80
16. J. Horgan, S. London, ATAC: a data flow coverage testing tool for C, In: Proc. Symposium of Quality Software Development Tools, 1992, pp. 2-10.
17. Hutchins M., Foster H., Goradia T., and Ostrand T. Experiments of the effectiveness of dataflow- and controlflow-based test adequacy criteria. Proceedings of 16th International Conference on Software Engineering (1994), IEEE Computer Society Press, Los Alamitos, CA, USA 191-200
18. Johnson D.S. Approximation algorithms for combinatorial problems. Journal of Computer and System Sciences 9 3 (1974) 256-278
19. Leung H., and White L. Insights into regression testing. Proceedings of the Conference on Software Maintenance (1989) 60-69
20. Li Z., Harman M., and Hierons R. Search algorithms for regression test case prioritization. IEEE Transactions on Software Engineering 33 4 (2007) 225-237
21. Mansour N., and El-Fakih K. Simulated annealing and genetic algorithms for optimal regression testing. Journal of Software Maintenance 11 1 (1999) 19-34
22. Myers G. Software Reliability Principles and Practice (1979), John Wiley and Sons, New York
23. J. Offutt, J. Pan, J. Voas, Procedures for reducing the size of coverage-based test sets, in: Proceedings of 12th International Conference on Testing Computer Software, 1995, pp. 111-123.
24. Orso A., Shi N., and Harrold M.J. Scaling regression testing to large software systems. ACM SIGSOFTSoftware Engineering Notes 29 6 (2004) 241-251
25. T. Ralphs, M. Guzelsoy, The symphony callable library for mixed integer programming, in: Proceedings of Ninth INFORMS Computing Society Conference, 2005, pp. 61-73.
26. G. Rothermel, M.J. Harrold, J. Ostrin, C. Hong, An empirical study of the effects of minimization on the fault detection capabilities of test suites, in: Proceedings of 14th International Conference on Software Maintenance, 1998, pp. 34-43.
27. Rothermel G., Harrold M.J., von Ronne J., and Hong C. Empirical studies of test-suite reduction. Software Testing, Verification And Reliability 12 4 (2002) 219-249
28. Rothermel G., Untch R.H., Chu C., and Harrold M.J. Prioritizing test cases for regression testing. IEEE Transactions on Software Engineering 27 10 (2001) 929-948
29. Rusu V., du Bousquet L., and Jeron T. An approach to symbolic test generation. Proceedings of Second International Conference on Integrated Formal Methods (2000), Springer-Verlag, London, UK 338-357
30. P. Thevenod Fosse, H. Waeselynck, Y. Crouzet, An experimental study on software structural testing: deterministic versus random input generation. Fault-Tolerant Computing, 1991. FTCS-21. Digest of Papers, 21st International Symposium, 1991, pp. 410-417.
31. F. Vokolos, P. Frankl, Pythia: a regression test selection tool based on textual differencing, in: Proceedings of Third International Conference on Reliability, Quality and Safty of Software-Internsive Systems, 1997.
32. F.I. Vokolos, P.G. Frankl, Empirical evaluation of the textual differencing regression testing technique, in: Proceedings of 14th International Conference on Software Maintenance, 1998, pp. 44-53.
33. Walcott K., Soffa M., Kapfhammer G., and Roos R. TimeAware test suite prioritization. Proceedings of the 2006 International Symposium on Software Testing and Analysis (2006) 1-12
34. M.B. Wall, A genetic algorithm for resource-constrained scheduling. Ph.D. Thesis, Massachusetts Institute of Technology, 1996.
35. Wong W.E., Horgan J.R., London S., and Mathur A.P. Effect of test set minimization on fault detection effectiveness. Software: Practice and Experience 28 4 (1998) 347-369
36. Wong W.E., Horgan J.R., Mathur A.P., and Pasquini A. Test set size minimization and fault detection effectiveness: a case study in a space application. Journal of Systems and Software 48 2 (1999) 79-89
37. S. Yoo, M. Harman, Pareto efficient multi-objective test case selection. Proceedings of the 2007 International Symposium on Software Testing and Analysis (2007) 140-150.
38. H. Zhong, L. Zhang, H. Mei, An experimental comparison of four test suite reduction techniques, In: Proc. 28th International Conference on Software Engineering, ACM Press, New York, NY, USA, 2006, pp. 636-640.