Using hybrid algorithm for Pareto efficient multi-objective test suite minimisation

Journal of Systems and Software

Volumn 83, Issue 4, 2010, Pages 689-701

  Yoo, Shin ^a   Harman, Mark ^a  

^a KING'S COLLEGE LONDON   (United Kingdom)

Author keywords

Regression testing; Test suite minimisation

Indexed keywords

COMPLEX PROCESSES; DECISION MAKERS; EMPIRICAL STUDIES; HYBRID ALGORITHMS; MULTI-OBJECTIVE GENETIC ALGORITHM; MULTI-OBJECTIVE TESTS; MULTIPLE OBJECTIVES; MULTIPLE TESTING; OBJECTIVE OPTIMISATION; PARETO EFFICIENCY; PARETO FRONT; REGRESSION TESTING;

APPROXIMATION ALGORITHMS; FAULT DETECTION; MULTIOBJECTIVE OPTIMIZATION; PARETO PRINCIPLE; REGRESSION ANALYSIS;

TESTING;

EID: 76749160721     PISSN: 01641212     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jss.2009.11.706     Document Type: Article

References (33)

1. Bates S., and Horwitz S. Incremental program testing using program dependence graphs. Proceedings of the 20th ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages (1993), ACM Press 384-396
2. Binkley D. Reducing the cost of regression testing by semantics guided test case selection. Proceedings of the International Conference on Software Maintenance (ICSM 1995) (1995), IEEE Computer Society 251-260
3. Burke E.K., Kendall G., Newall J., Hart E., Ross P., and Schulenburg S. Hyper-heuristics: An Emerging Direction in Modern Search Technology (2003), Kluwer pp. 457-474 (Chapter 16)
4. Coello Coello C.A., Van Veldhuizen D.A., and Lamont G.B. Evolutionary Algorithms for Solving Multi-Objective Problems (2002), Kluwer Academic Publishers, New York
5. Collette Y., and Siarry P. Multiobjective Optimization: Principles and Case Studies (2004), Springer, Oxford, UK
6. Deb K. Multi-Objective Optimization Using Evolutionary Algorithms (2001), Wiley, Chichester, UK
7. Deb K., Agrawal S., Pratab A., and Meyarivan T. A fast elitist non-dominated sorting genetic algorithm for multi-objective optimization: NSGA-II. Proceedings of the Parallel Problem Solving from Nature VI Conference. Lecture Notes in Computer Science vol. 1917 (2000), Springer, Paris, France 849-858
8. Do H., Rothermel G., and Kinneer A. Empirical studies of test case prioritization in a junit testing environment. Proceedings of 15th International Symposium on Software Reliability Engineering (ISSRE 2004) (2004), IEEE Computer Society Press 113-124
9. Do H., Elbaum S.G., and Rothermel G. Supporting controlled experimentation with testing techniques: an infrastructure and its potential impact. Empirical Software Engineering 10 4 (2005) 405-435
10. Elbaum S.G., Malishevsky A.G., and Rothermel G. Prioritizing test cases for regression testing. Proceedings of International Symposium on Software Testing and Analysis (ISSTA 2000) (2000), ACM Press 102-112
11. Elbaum S.G., Malishevsky A.G., and Rothermel G. Incorporating varying test costs and fault severities into test case prioritization. Proceedings of the International Conference on Software Engineering (ICSE 2001) (2001), ACM Press 329-338
12. Fonteix C., Massebeuf S., Pla F., and Kiss L.N. Multicriteria optimization of an emulsion polymerization process. European Journal of Operational Research 153 2 (2004) 350-359
13. Fudenberg D., and Tirole J. Game Theory (1983), MIT Press
14. Garey M.R., and Johnson D.S. Computers and Intractability: A Guide to the Theory of NP-Completeness (1979), W.H. Freeman and Company
15. Halloran, T.J., Scherlis, W.L., 2002. High quality and open source software practices. In: Meeting Challenges and Surviving Success: Second Workshop on Open Source Software Engineering.
16. Harrold M.J., Gupta R., and Soffa M.L. A methodology for controlling the size of a test suite. ACM Transactions on Software Engineering and Methodology 2 3 (1993) 270-285
17. Highsmith J., and Cockburn A. Agile software development: the business of innovation. Computer 34 9 (2001) 120-127
18. Hutchins M., Foster H., Goradia T., and Ostrand T. Experiments of the effectiveness of dataflow- and controlflow-based test adequacy criteria. Proceedings of the 16th International Conference on Software Engineering (ICSE 1994) (1994), IEEE Computer Society Press 191-200
19. Johnson D.S. Approximation algorithms for combinatorial problems. Proceedings of the Fifth Annual ACM Symposium on Theory of Computing (STOC 1973) (1973), ACM Press 38-49
20. Kicinger R., and Arciszewski T. Multiobjective evolutionary design of steel structures in tall buildings. Proceedings of the AIAA First Intelligent Systems Technical Conference, Chicago, IL, September 20-23, 2004, AIAA 2004 (2004), American Institute of Aeronautics and Astronautics Press, Reston, VA 6438
21. Leung H.K.N., and White L. Insight into regression testing. Proceedings of International Conference on Software Maintenance (ICSM 1989) (1989), IEEE Computer Society Press 60-69
22. Li Z., Harman M., and Hierons R.M. Search Algorithms for Regression Test Case Prioritization. IEEE Transactions on Software Engineering 33 4 (2007) 225-237
23. Malishevsky, A.G., Ruthruff, J.R., Rothermel, G., Elbaum, S., 2006. Cost-cognizant test case prioritization. Tech. Rep. TR-UNL-CSE-2006-0004, Department of Computer Science and Engineering, University of Nebraska-Lincoln, March.
24. Nethercote N., and Seward J. Valgrind: a program supervision framework. Proceedings of ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI 2007) (2007), ACM Press 89-100
25. Obayashi S. Multidisciplinary design optimization of aircraft wing planform based on evolutionary algorithms. Proceedings of the 1998 IEEE International Conference on Systems, Man, and Cybernetics vol. 4 (1998), IEEE Computer Society Press, La Jolla, California 3148-3153
26. Rothermel G., and Harrold M.J. Analyzing regression test selection techniques. IEEE Transactions on Software Engineering 22 8 (1996) 529-551
27. Rothermel G., Harrold M.J., Ostrin J., and Hong C. An empirical study of the effects of minimization on the fault detection capabilities of test suites. Proceedings of International Conference on Software Maintenance (ICSM 1998) (1998), IEEE Computer Society Press 34-43
28. Rothermel G., Untch R.H., Chu C., and Harrold M.J. Test case prioritization: an empirical study. Proceedings of International Conference on Software Maintenance (ICSM 1999) (1999), IEEE Computer Society Press 179-188
29. Szidarovsky F., Gershon M.E., and Dukstein L. Techniques for Multiobjective Decision Making in Systems Management (1986), Elsevier, New York
30. Walcott K.R., Soffa M.L., Kapfhammer G.M., and Roos R.S. Time aware test suite prioritization. Proceedings of the International Symposium on Software Testing and Analysis (ISSTA 2006) (2006), ACM Press 1-12
31. Wong W.E., Horgan J.R., London S., and Mathur A.P. Effect of test set minimization on fault detection effectiveness. Software Practice and Experience 28 4 (1998) 347-369
32. Yau S.S., and Kishimoto Z. A method for revalidating modified programs in the maintenance phase. Proceedings of International Computer Software and Applications Conference (COMPSAC 1987) (1987), IEEE Computer Society Press 272-277
33. Yoo S., and Harman M. Pareto efficient multi-objective test case selection. Proceedings of International Symposium on Software Testing and Analysis (ISSTA 2007) (2007), ACM Press 140-150