Observations in using parallel and sequential evolutionary algorithms for automatic software testing

Computers and Operations Research

Volumn 35, Issue 10, 2008, Pages 3161-3183

  Alba, Enrique ^a   Chicano, Francisco ^a  

^a UNIVERSITY OF MÁLAGA   (Spain)

Author keywords

Evolutionary algorithms; Evolutionary testing; Parallel evolutionary algorithms; Software testing

Indexed keywords

COMPUTER SCIENCE; DATA ACQUISITION; PARALLEL ALGORITHMS; PROBLEM SOLVING; SOFTWARE TESTING;

EVOLUTIONARY TESTING; SEQUENTIAL EVOLUTIONARY ALGORITHMS (EA);

EVOLUTIONARY ALGORITHMS;

EID: 40249088314     PISSN: 03050548     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cor.2007.01.016     Document Type: Article

References (61)

1. Dijkstra E.W. A discipline of programming (1976), Prentice-Hall, Englewood Cliffs, NJ
2. Dijkstra E.W., and Scholten C.S. Predicate calculus and program semantics (1990), Springer, New York
3. Hoare C.A.R. An axiomatic basis for computer programming. Communications of the ACM 12 10 (1969) 576-580
4. Clarke E.M., Grumberg O., and Peled D.A. Model checking (2000), The MIT Press, Cambridge
5. Clarke E.M., and Emerson E.A. Design and synthesis of synchronization skeletons using branching-time temporal logic. Logic of programs, workshop (1982), Springer, London, UK 52-71
6. Clarke E.M., Emerson E.A., and Sistla A.P. Automatic verification of finite-state concurrent systems using temporal logic specifications. ACM Transactions on Programming Languages and Systems 8 2 (1986) 244-263
7. Holzmann G.J. The model checker SPIN. IEEE Transactions on Software Engineering 23 5 (1997) 1-17
8. Corbett J.C., Dwyer M.B., Hatcliff J., Laubach S., Pǎsǎreanu C.S., Robby, et al. Bandera: extracting finite-state models from java source code. ICSE '00: Proceedings of the 22nd international conference on software engineering (2000), ACM Press, New York, NY, USA 439-448
9. Park DYW, Stern U, Skakkebaek JU, Dill DL. Java model checking. In: Proceedings of automated software engineering conference; 2000.
10. Bensalem S., Ganesh V., Lakhnech Y., noz C.M., Owre S., Rueß H., et al. An overview of SAL. In: Holloway C.M. (Ed). LFM 2000: fifth NASA Langley formal methods workshop (2000), NASA Langley Research Center, Hampton, VA 187-196
11. Groce A., and Visser W. Heuristics for model checking java programs. Software Tools for Technology Transfer 6 4 (2004) 260-276
12. Lluch-Lafuente A., Leue S., and Edelkamp S. Partial order reduction in directed model checking. Ninth international SPIN workshop on model checking software (2002), Springer, Grenoble
13. Burch JR, Clarke EM, Long DE, McMillan KL, Dill DL. Symbolic model checking for sequential circuit verification. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems 1994;13(4):401-24.
14. Lluch-Lafuente A. Symmetry reduction and heuristic search for error detection in model checking. In: Workshop on model checking and artificial intelligence; 2003.
15. Alberts D. The economics of software quality assurance. In: Proceedings of the 1976 national computer conference, vol. 45. Reston, VA: AFIPS Press; 1976. p. 433-42.
16. Myers G. The art of software testing (1979), Wiley, New York
17. Millo R.D., McCracken W., Martin R., and Passafiume J. Software testing and evaluation (1987), Benjamin/Cummings, Menlo Park, CA
18. Clarke L.A. A system to generate test data and symbolically execute programs. IEEE Transactions on Software Engineering 2 3 (1976) 215-222
19. Miller W., and Spooner D.L. Automatic generation of floating-point test data. IEEE Transactions on Software Engineering 2 3 (1976) 223-226
20. McMinn P. Search-based software test data generation: a survey. Software Testing, Verification and Reliability 14 2 (2004) 105-156
21. Michael C.C., McGraw G., and Schatz M.A. Generating software test data by evolution. IEEE Transactions on Software Engineering 27 12 (2001) 1085-1110
22. McMinn P, Holcombe M. The state problem for evolutionary testing. In: Goos G, et al., editors, Proceedings of the genetic and evolutionary computation conference, LNCS vol. 2724. Chicano, IL, USA: Springer; 2003. p. 2488-98.
23. Mansour N., and Salame M. Data generation for path testing. Software Quality Journal 12 2 (2004) 121-136
24. Sen K., Marinov D., and Agha G. CUTE: a concolic unit testing engine for C. ESEC/FSE-13: proceedings of the 10th European software engineering conference held jointly with 13th ACM SIGSOFT international symposium on foundations of software engineering (2005), ACM Press, New York, NY, USA 263-272
25. Godefroid P., Klarlund N., and Sen K. DART: directed automated random testing. PLDI'05: proceedings of the 2005 ACM SIGPLAN conference on programming language design and implementation (2005), ACM Press, New York, NY, USA 213-223
26. Buehler O., and Wegener J. Evolutionary functional testing of an automated parking system. Proceedings of the international conference on computer, communication and control technologies. Orlando, FL (2003)
27. Buehler O., and Wegener J. Evolutionary functional testing of a vehicle brake assistant system. Proceedings of the sixth metaheuristic international conference. Vienna, Austria (2005) 157-162
28. Korel B., and Al-Yami A.M. Assertion-oriented automated test data generation. Proceedings of the 18th international conference on software engineering (1996), IEEE Computer Society Press, Berlin, Germany 71-80
29. Sthamer H., Wegener J., and Baresel A. Using evolutionary testing to improve efficiency and quality in software testing. Proceedings of the second Asia-Pacific conference on software testing analysis & review. Melbourne, Australia (2002)
30. Wegener J., Sthamer H., Jones B.F., and Eyres D.E. Testing real-time systems using genetic algorithms. Software Quality Journal 6 (1997) 127-135
31. Bird D., and Munoz C. Automatic generation of random self-checking test cases. IBM Systems Journal 22 3 (1983) 229-245
32. Offutt J. An integrated automatic test data generation system. Journal of Systems Integration 1 3 (1991) 391-409
33. Korel B. Automated software test data generation. IEEE Transactions on Software Engineering 16 8 (1990) 870-879
34. Jones B., Sthamer H., and Eyres D. Automatic structural testing using genetic algorithms. Software Engineering Journal 11 5 (1996) 299-306
35. Mantere T., and Alander J.T. Evolutionary software engineering, a review. Applied Soft Computing 5 3 (2005) 315-331
36. Ostrowski D, Reynolds R. Knowledge-based software testing agent using evolutionary learning with cultural algorithms. In: Proceedings of the congress on evolutionary computation, vol. 3; 1999. p. 1657-63.
37. Tracey N. A search-based automated test-data generation framework for safety-critical software. PhD thesis, University of York, 2000.
38. Tracey N., Clark J., Mander K., and McDermid J. An automated framework for structural test-data generation. Proceedings of the 13th IEEE conference on automated software engineering. Hawaii, USA (1998) 285-288
39. Díaz E., Tuya J., and Blanco R. Automated software testing using a metaheuristic technique based on tabu search. Proceedings of the 18th IEEE international conference on automated software engineering (ASE'03). Montreal, Que., Canada (2003) 310-313
40. Sagarna R, Lozano J. Variable search space for software testing. In: Proceedings of the international conference on neural networks and signal processing, vol. 1. New York: IEEE Press; 2003. p. 575-8.
41. Sagarna R., and Lozano J.A. Scatter search in software testing, comparison and collaboration with estimation of distribution algorithms. European Journal of Operational Research 169 2 (2006) 392-412 [available online]
42. Alba E, Chicano JF. Software testing with evolutionary strategies. In: Proceedings of the second international workshop on rapid integration of software engineering techniques, Lecture notes in computer science, vol. 3943. Crete, Greece: Heraklion; 2005. p. 50-65.
43. Bäck T. Evolutionary algorithms in theory and practice: evolution strategies, evolutionary programming, genetic algorithms (1996), Oxford University Press, New York
44. Alba E., and Tomassini M. Parallelism and evolutionary algorithms. IEEE Transactions on Evolutionary Computation 6 5 (2002) 443-462
45. Levine D. Users guide to the PGAPack parallel genetic algorithm library, Technical report ANL-95/18, Argonne National Laboratory, Mathematics and Computer Science Division, January 31, 1995.
46. Belding T.C. The distributed genetic algorithm revisited. In: Eshelman L.J. (Ed). Proceedings of the sixth international conference on genetic algorithms (1995), Morgan Kaufmann, Los Altos, CA 114-121
47. Tanese R. Distributed genetic algorithms. In: Schaffer J.D. (Ed). Proceedings of the third international conference on genetic algorithms (1989), Morgan Kaufmann, Los Altos, CA 434-439
48. Baluja S. Structure and performance of fine-grain parallelism in genetic search. In: Forrest S. (Ed). Proceedings of the fifth international conference on genetic algorithms (1993), Morgan Kaufmann, Los Altos, CA 155-162
49. Alba E, Troya JM. Gaining new fields of application for OOP: the parallel evolutionary algorithm case, Journal of Object Oriented Programming, December 2001.
50. Gordon V.S., and Whitley D. Serial and parallel genetic algorithms as function optimizers. In: Forrest S. (Ed). Proceedings of the fifth international conference on genetic algorithms (1993), Morgan Kaufmann, Los Altos, CA 177-183
51. Holland J.H. Adaptation in natural and artificial systems (1975), The University of Michigan Press, Ann Arbor, MI
52. Rechenberg I. Evolutionsstrategie: optimierung technischer systeme nach prinzipien der biologischen evolution (1973), Fromman-Holzboog Verlag, Stuttgart
53. Fogel L.J., Owens A.J., and Walsh M.J. Artificial intelligence through simulated evolution (1966), Wiley, New York
54. Koza J.R. Genetic programming (1992), The MIT Press, Cambridge, MA
55. Bäck T, Fogel DB, Michalewicz Z, editors. Evolutionary computation 1. Basic algorithms and operators, vol. 1. IOP Publishing Lt; 2000.
56. Rudolph G. Evolutionary computation 1. Basic algorithms and operators, vol. 1. IOP Publishing Lt; 2000. p. 81-8 [Chapter 9, Evolution strategies].
57. Xanthakis S., Ellis C., Skourlas C., Le Gall A., Katsikas S., and Karapoulios K. Application of genetic algorithms to software testing. Proceedings of the fifth international conference on software engineering and its applications. Toulouse, France (1992) 625-636
58. Sthamer H-H. The automatic generation of software test data using genetic algorithms, PhD thesis, University of Glamorgan, November 1995.
59. Alba E., and Troya J.M. A survey of parallel distributed genetic algorithms. Complexity 4 (1999) 31-52
60. Wegener J., Baresel A., and Sthamer H. Evolutionary test environment for automatic structural testing. Information and Software Technology 43 14 (2001) 841-854
61. Alba E, editor. Parallel metaheuristics. A new class of algorithms. New York: Wiley; 2005.