Evolutionary algorithms for the multi-objective test data generation problem

Software - Practice and Experience

Volumn 42, Issue 11, 2012, Pages 1331-1362

  Ferrer, Javier ^a   Chicano, Francisco ^a   Alba, Enrique ^a  

^a UNIVERSITY OF MÁLAGA   (Spain)

Author keywords

branch coverage; evolutionary algorithms; evolutionary testing; multi objective test data generation; oracle cost; search based software engineering

Indexed keywords

AUTOMATIC TEST DATA GENERATION; BRANCH COVERAGE; EVOLUTIONARY TESTING; EXPERIMENTAL ANALYSIS; JAVA PROGRAM; LARGE SOFTWARE SYSTEMS; MULTI OBJECTIVE; MULTI OBJECTIVE ALGORITHM; MULTI-OBJECTIVE TESTS; PARETO EFFICIENCY; SEARCH-BASED SOFTWARE ENGINEERING; SECOND PHASE; SYSTEM BEHAVIORS; TEST CASE SELECTION;

ALGORITHMS; COMPUTER SOFTWARE; DATA COMMUNICATION SYSTEMS; EVOLUTIONARY ALGORITHMS; JAVA PROGRAMMING LANGUAGE; MULTIOBJECTIVE OPTIMIZATION;

COSTS;

EID: 84867102016     PISSN: 00380644     EISSN: 1097024X     Source Type: Journal    
DOI: 10.1002/spe.1135     Document Type: Article

References (44)

1. Xanthakis S, Ellis C, Skourlas C, Gall AL, Katsikas S, Karapoulios K,. Application of genetic algorithms to software testing, Proceedings of the 5th International Conference on Software Engineering and Applications, Toulouse, France, 1992; 625-636.
2. Harman M, Jones BF,. search-based software engineering. Information and Software Technology 2001; 43 (14): 833-839.
3. McMinn P,. search-based software test data generation: a survey. Software Testing, Verification and Reliability 2004; 14 (2): 105-156.
4. Harman M,. The current state and future of search based software engineering. In Proceedings of International Conference on Software Engineering/Future of Software Engineering 2007 (ICSE/FOSE '07), IEEE Computer Society: Minneapolis, Minnesota, USA, 2007; 342-357.
5. Miller W, Spooner DL,. Automatic generation of floating-point test data. IEEE Transactions on Software Engineering 1976; 2 (3): 223-226.
6. Korel B,. Automated software test data generation. IEEE Transactions on Software Engineering 1990; 16 (8): 870-879.
7. Beizer B,. Software Testing Techniques, (2nd edn), Van Nostrand Reinhold Co.: New York, NY, USA, 1990.
8. Baresel A, Binkley DW, Harman M, Korel B,. Evolutionary testing in the presence of loop-assigned flags: a testability transformation approach, International Symposium on Software Testing and Analysis (ISSTA 2004), 2004; 108-118.
9. Díaz E, Blanco R, Tuya J,. Tabu search for automated loop coverage in software testing, Proceedings of the International Conference on Knowledge Engineering and Decision Support (ICKEDS), Porto, 2006; 229-234.
10. Zhan Y, Clark JA,. The state problem for test generation in Simulink. In GECCO'06: Proceedings of the 8th Annual Conference on Genetic and Evolutionary Computation, ACM Press: New York, USA, 2006; 1941-1948.
11. Tracey N, Clark J, Mander K, McDermid J,. Automated test-data generation for exception conditions. Software Practice and Experience 2000; 30 (1): 61-79.
12. Blanco R, Tuya J, Adenso-Díaz B,. Automated test data generation using a scatter search approach. Information and Software Technology 2009; 51 (4): 708-720.
13. Ahmed MA, Hermadi I,. GA-based multiple paths test data generator. Computers and Operations Research 2008; 35 (10): 3107-3124.
14. Alshraideh M, Bottaci L,. search-based software test data generation for string data using program-specific search operators. Software Testing, Verification and Reliability 2006; 16 (3): 175-203.
15. Xiao M, El-Attar M, Reformat M, Miller J,. Empirical evaluation of optimization algorithms when used in goal-oriented automated test data generation techniques. Empirical Software Engineering 2007; 12 (2): 183-239.
16. Díaz E, Tuya J, Blanco R, Dolado JJ,. A tabu search algorithm for structural software testing. Computers and Operations Research 2008; 35 (10): 3052-3072.
17. Harman M, Kim SG, Lakhotia K, McMinn P, Yoo S,. Optimizing for the number of tests generated in search based test data generation with an application to the oracle cost problem. In Proceedings of the 3rd International Workshop on search-based Software Testing (SBST) in conjunction with ICST 2010, IEEE: Paris, France, 2010; 182-191.
18. Lakhotia K, Harman M, McMinn P,. A multi-objective approach to search-based test data generation. In GECCO '07: Proceedings of the 9th Annual Conference on Genetic and Evolutionary Computation. ACM: New York, NY, USA, 2007; 1098-1105.
19. Deb KD, Pratap A, Agarwal S, Meyarivan T,. A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Transactions on Evolutionary Computation 2002; 6 (2): 182-197.
20. Nebro AJ, Durillo JJ, Luna F, Dorronsoro B, Alba E,. MOCell: A cellular genetic algorithm for multiobjective optimization. International Journal of Intelligent Systems 2009; 24 (7): 726-746.
21. Nebro AJ, Durillo JJ, Luna F, Dorronsoro B, Alba E,. Design issues in a multiobjective cellular genetic algorithm. In Evolutionary Multi-Criterion Optimization. 4th International Conference, EMO 2007, Lecture Notes in Computer Science, Vol. 4403, Obayashi S, Deb K, Poloni C, Hiroyasu T, Murata T, (eds). Springer: Heidelberg, Germany, 2007; 126-140.
22. Zitzler E, Laumanns M, Thiele L,. SPEA2: improving the strength Pareto evolutionary algorithm, Technical Report 103, Gloriastrasse 35, CH-8092 Zurich, Switzerland, 2001.
23. Angeline PJ, Michalewicz Z, Schoenauer M, Yao X, Zalzala A, (eds.). In The Pareto Archived Evolution Strategy: A New Baseline Algorithm for Pareto Multiobjective Optimisation, Vol. 1, IEEE Press: Mayflower Hotel: Washington D.C., USA, 1999.
24. Yoo S, Harman M,. Pareto efficient multi-objective test case selection, ISSTA '07 Proceedings of the 2007 International Symposium on Software Testing and Analysis, 9-12 July 2007; 140-150.
25. Michael CC, McGraw G, Schatz MA,. Generating software test data by evolution. IEEE Transactions on Software Engineering 2001; 27 (12): 1085-1110.
26. Wegener J, Baresel A, Sthamer H,. Evolutionary test environment for automatic structural testing. Information and Software Technology 2001; 43 (14): 841-854.
27. Arcuri A,. It really does matter how you normalize the branch distance in search-based software testing. Software Testing, Verification and Reliability 2011. DOI: 10.1002/stvr.457.
28. McMinn P, Binkley D, Harman M,. Empirical evaluation of a nesting testability transformation for evolutionary testing. ACM Transactions on Software Engineering and Methodology 2009; 18: 11:1-11:27.
29. Rechenberg I,. Evolutionsstrategie: Optimierung Technischer Systeme nach Prinzipien der Biologischen Evolution, Fromman-Holzboog Verlag: Stuttgart, 1973.
30. Rudolph G,. Evolutionary Computation 1. Basic Algorithms and Operators, vol. 1, chap. 9, Evolution Strategies, IOP Publishing Lt: New York, USA, 2000. 81-88.
31. Knowles J, Thiele L, Zitzler E,. February A tutorial on the performance assessment of stochastic multiobjective optimizers, TIK Report 214, Computer Engineering and Networks Laboratory (TIK), ETH Zurich, February 2006.
32. Zitzler E, Thiele L,. Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach. IEEE Transactions on Evolutionary Computation 1999; 3 (4): 257-271.
33. Knowles J,. A summary-attainment-surface plotting method for visualizing the performance of stochastic multiobjective optimizers, International Conference on Intelligent Systems Deisgn and Applications, 2005; 552-557.
34. Alba E, Chicano F,. Observations in using parallel and sequential evolutionary algorithms for automatic software testing. Computers and Operations Research 2008; 35 (10): 3161-3183.
35. King JC,. A new approach to program testing. SIGPLAN Notices 1975; 10: 228-233.
36. King JC,. Symbolic execution and program testing. Communications of the ACM 1976; 19: 385-394.
37. Dijkstra EW,. A Discipline of Programming, Prentice Hall: New York, USA, 1976.
38. Gries D,. The Science of Programming, Springer-Verlag: Secaucus, NJ, USA, 1981.
39. Kaldewaij A,. Programming: The Derivation of Algorithms, Prentice-Hall: Upper Saddle River, NJ, USA, 1990.
40. May PS,. 2007. Test data generation: two evolutionary approaches to mutation testing, PhD Thesis, Computing Laboratory.
41. Arcuri A,. Evolutionary repair of faulty software. Applied Soft Computing 2011; 11: 3494-3514.
42. Jones BF, Sthamer HH, Eyres DE,. Automatic structural testing using genetic algorithms. Software Engineering Journal 1996; 11 (5): 299-306.
43. Durillo JJ, Nebro AJ, Luna F, Dorronsoro B, Alba E,. jMetal: a Java framework for developing multi-objective optimization metaheuristics, Technical Report ITI-2006-10, Departamento de Lenguajes y Ciencias de la Computaciõn, University of Maálaga, E.T.S.I. Informática, Campus de Teatinos, December 2006.
44. Alba E, Dorronsoro B,. Cellular Genetic Algorithms, Operations Research/Computer Science Interfaces, Vol. 42, Springer-Verlag: Heidelberg, 2008.