Evolutionary software engineering, a review

Applied Soft Computing Journal

Volumn 5, Issue 3 SPEC.ISS., 2005, Pages 315-331

  Mantere, Timo ^a   Alander, Jarmo T ^b  

^a LAPPEENRANTA UNIVERSITY OF TECHNOLOGY   (Finland)

^b UNIVERSITY OF VAASA   (Finland)

Author keywords

Genetic algorithms; Software engineering; Software production; Software testing

Indexed keywords

ALGORITHMS; AUTOMATION; COMPUTATIONAL COMPLEXITY; COMPUTATIONAL METHODS; GENETIC ENGINEERING; IMAGE CODING; MACHINE DESIGN; ONLINE SEARCHING; OPTIMIZATION; PROBLEM SOLVING; RANDOM PROCESSES;

FITNESS FUNCTION; RANDOM TESTING; SOFTWARE PRODUCTION; SOFTWARE TESTING;

SOFTWARE ENGINEERING;

EID: 13844322280     PISSN: 15684946     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.asoc.2004.08.004     Document Type: Article

References (88)

1. J.T. Alander, Indexed bibliography of genetic algorithms basics, reviews, and tutorials, Report 94-1-BASICS, Department of Information Technology and Production Economics, University of Vaasa (ftp://uwasa.fi/cs/report94-1/ gaBASICSbib.ps.Z), 1995.
2. J.T. Alander, Indexed bibliography of genetic programming, Report 94-1-GP, Department of Information Technology and Production Economics, University of Vaasa (ftp://uwasa.fi/cs/report94-1/gaGPbib.ps.Z), 1995.
3. J.T. Alander, Indexed bibliography of genetic algorithms in electronics and VLSI design and testing, Report 94-1-VLSI, Department of Information Technology and Production Economics, University of Vaasa (ftp://uwasa.fi/cs/ report94-1/gaVLSIbib.ps.Z), 1995.
4. J.T. Alander, Indexed bibliography of genetic algorithms in computer science, Report 94-1-CS, Department of Information Technology and Production Economics, University of Vaasa (ftp://uwasa.fi/cs/report94-1/gaCSbib.ps.Z), 1995.
5. R.W. Warfield, Automatic software testing tool, U.S. patent no. 5,754,760, issued May 19, 1998.
6. T.G. Whitten, Method and computer program product for generating a computer program product test that includes an optimized set of computer program product test cases, and method for selecting same, U.S. patent no. 5,805,795, issued September 8, 1998.
7. E.B. Boden, Automated testing of software application interfaces, object methods and commands, U.S. patent no. 5,708,774, issued January 13, 1998.
8. A. Gounares, P. Sikchi, Adaptive problem solving method and apparatus utilizing evolutionary computation techniques, U.S. patent no. 6,282,527, issued August 28, 2001.
9. H.-H. Sthamer, The automatic generation of software test data using genetic algorithms, Ph.D. thesis, Department of Electronics and Information Technology, University of Glamorgan, 1996.
10. X. Yang, Automatic testing from Z specifications, Ph.D. thesis, University of Glamorgan, 1998.
11. H.-G. Gross, Measuring evolutionary testability of real-time software, Ph.D. thesis, University of Glamorgan, 2000.
12. N. Tracey, A search-based automated test-data generation framework for safety-critical software, Ph.D. thesis, University of York, 2000.
13. T. Mantere, Automatic software testing by genetic algorithms, Ph.D. thesis, Acta Wasaensia 112, Department of Computer Science, University of Vaasa, 2003.
14. J.H. Holland, Adaptation in Natural and Artificial Systems, University of Michigan Press, Ann Arbor, 1975.
15. D.E. Goldberg Genetic Algorithms in Search, Optimization, and Machine Learning 1989 Addison-Wesley
16. C. Darwin, The Origin of Species: By Means of Natural Selection or the Preservation of Favoured Races in the Struggle for Life, Oxford University Press, London, UK, 1859 (http://www.literature.org/authors/darwin-charles/the- origin-of-species/).
17. J.R. Koza Genetic Programming 1992 The MIT Press Cambridge, MA
18. T.C. Jones Measuring programming quality and productivity IBM Syst. J. 17 1978 39 63
19. B.W. Boehm Some Steps Towards Formal and Automated Aids to Software Requirements Analysis and Design 1974 IFIB74, North-Holland Publishing Company Amsterdam, The Netherlands
20. E. Kit Software Testing in the Real World - Improving the Process 1995 Addison-Wesley
21. IEEE/ANSI, IEEE Standard Glossary of Software Engineering Terminology IEEE Std 620.12-1990, IEEE/ANSI, 1990.
22. IEEE/ANSI, IEEE Standard for Software Test Documentation, IEEE Std 829-1983, IEEE/ANSI, 1983.
23. Lonsdale Systems, Software testing glossary (members.iinet.net.au/ lonsdale/seng/se20.htm), 2002.
24. R.S. Pressman, Associates Inc., An abbreviated software engineering glossary (http://www.rspa.com/spi/glossary.html), 2003.
25. H.-G. Beyer, E. Brucherseifer, W. Jakob, H. Pohlheim, B. Sendhoff, T. Binh, Evolutionary algorithms - terms and definitions (ls11- http://www.cs.uni-dortmund.de/people/beyer/EA-glossary/def-engl-html.html), 2002.
26. E. Miller, Program testing - an overview for managers (IEEE software testing tutorial), 1980.
27. R.L. Baber Software Reflected 1982 North-Holland Publishing Company Amsterdam, The Netherlands
28. F. Liguori Automatic Test Equipment: Hardware, Software, and Management 1972 IEEE Press New York, USA
29. W. Hetzel The Complete Guide to Software Testing second ed. 1988 John Wiley and Sons Inc. New York, USA
30. N.D. Singpurwalla, and S.P. Wilson Statistical Methods in Software Engineering - Reliability and Risk 1999 Springer-Verlag New York, USA
31. J.C. Browne, and M. Shaw Toward a scientific basis for software evaluation A. Perlis F. Sayward M. Shaw Software Metrics: An Analysis and Evaluation 1981 The MIT Press Cambridge, Massachusetts, USA
32. M. Denicoff, and R. Grafton Software metrics: a research initiative A. Perlis F. Sayward M. Shaw Software Metrics: An Analysis and Evaluation 1981 The MIT Press Cambridge, Massachusetts, USA
33. S. Xanthakis, C. Ellis, C. Skourlas, A.L. Gall, S. Katsikas, and K. Karapoulios Application of genetic algorithms to software testing Proceedings of the 5th International Conference on Software Engineering Toulouse, France 1992 625 636
34. A.C. Schultz, J.J. Grefenstette, and K.A.D. Jong Adaptive testing of controllers for autonomous vehicles Proceedings of the 1992 Symposium on Autonomous Underwater Vehicle Technology (AUV'92) IEEE, New York, Washington, DC 1992 158 164
35. A.C. Schultz, J.J. Grefenstette, and K.A.D. Jong Test and evaluation by genetic algorithms IEEE Expert 8 5 1993 9 14
36. A.C. Schultz, J.J. Grefenstette, K.A.D. Jong, G3.5 learning to break things: adaptive testing of intelligent controllers, 1995, pp. G3.5:1-10.
37. M. Pei, E.D. Goodman, Z. Gao, K. Zhong, Automated software test data generation using a genetic algorithm, Technical report 6/2/94, Beijing University of Aeronautics and Astronautics, 1994.
38. B. Korel Automated software test data generation IEEE Trans. Software Eng. 16 8 1980 870 879
39. A.L. Watkins, The automatic-generation of test data using genetic algorithms, in: I.M. Marshall, W.B. Samson, D.G. Edgar-Nevill (Eds.), Proceedings of the 4th Software Quality Conference, vol. 2, University of Abertay Dundee, Scotland, Dundee, UK, 1995, pp. 300-309.
40. M. Roper, I. Maclean, A. Brooks, J. Miller, M. Wood, Genetic algorithms and the automatic generation of test data, Research report RR/95/195 [EFoCS-19-95], Department of Computer Science, University of Strathclyde, 1995.
41. M. Roper Software testing - searching for the missing link Inform. Software Technol. 41 14 1999 991 994
42. J.E. Smith, and T.C. Fogarty Evolving software test data - GA's learn self expression Proceedings of the Evolutionary Computing on AISB Workshop Springer-Verlag, Berlin (Germany), Brighton (UK) 1996 227 235
43. J.E. Smith, M. Bartley, T.C. Fogarty, Microprocessor design verification by two-phase evolution of variable length tests, in: Proceedings of the IEEE International Conference on Evolutionary Computation, IEEE Piscataway, NJ, Indianapolis, IN, 1997, pp. 453-458.
44. C.C. Michael, G.E. McGraw, M.A. Schatz, and C.C. Walton Genetic algorithms for dynamic test data generation Proceedings of the 12th IEEE International Conference Automated Software Engineering IEEE Computer Society Press, Los Alamitos, CA, Incline Village, NV, USA 1997 307 308
45. G.E. McGraw, C.C. Michael, M.A. Schatz, Generating software test data by evolution, Technical report RSTR-018-97-01, RST Corporation, 1998.
46. C.C. Michael, G.E. McGraw, and M.A. Schatz Generating software test data by evolution IEEE Trans. Software Eng. 27 12 2001 1085 1110
47. R.P. Pargas, M.J. Harrold, and R.R. Peck Test-data generation using genetic algorithms J. Software Test. Verif. Reliab. 9 4 1999 263 282
48. P.M.S. Bueno, and M. Jino Identification of potentially infeasible program paths by monitoring the search for test data Proceedings of the Fifteenth IEEE International Conference on Automated Software Engineering, ASE 2000 IEEE Piscataway, NJ, Grenoble, France 2000 209 218
49. J. Hunt Testing control software using a genetic algorithm Eng. Appl. Artif. Intell. 8 6 1995 671 680
50. B.F. Jones, H.-H. Sthamer, X. Yang, and D.E. Eyres The automatic generation of software test data sets using adaptive search techniques Proceedings of the Software Quality Management 3 Computational Mechanics Publications Ltd., Southhampton, UK, Seville, Spain 1995 435 444
51. T. Minohara, and Y. Tohma Parameter estimation of hyper-geometric distribution software reliability growth model by genetic algorithms Proceedings of the Sixth International Symposium on Software Reliability Engineering IEEE Piscataway, NJ, Toulouse, France 1995 324 329
52. J.-C. Lin, and P.-L. Yeh Automatic test data generation for path testing using GAs Inform. Sci. 131 1-4 2001 47 64
53. D.J. Kasik, and H.G. George Toward automatic generation of novice user test scripts Proceedings of the 1996 Conference on Human Factors in Computing Systems, CHI 96 ACM, New York, NY, Vancouver, BC, Canada 1996 244 251
54. E.B. Boden, G.F. Martino, Testing software using order-based genetic algorithms, in: J.R. Koza, D.E. Goldberg, D.B. Fogel, R.L. Riolo (Eds.), Proceedings of the GP-96 Conference, MIT Press, Cambridge, MA, Stanford, CA, 1996, pp. 461-466.
55. J. Wegener, M. Grochtmann, and B. Jones Testing temporal correctness of realtime systems by means of genetic algorithms Proceedings of the 10th International Software Quality Week (QW '97) San Francisco, CA 1997
56. B.F. Jones, J. Wegener, Measurement of extreme execution times for software, in: IEE Colloquium on Real-Time Systems, vol. 306, IEE, 1998, pp. 4/1-4/5.
57. J. Wegener, and M. Grochtmann Verifying timing constraints of real-time systems Real-Time Syst. 15 3 1998 275 298
58. J. Wegener, A. Baresel, and H. Sthamer Evolutionary test enviroment for automatic structural testing Inform. Software Technol. 43 2001 841 854
59. P. Puschner, and R. Nossal Testing the results of static worst-case execution-time analysis Proceedings of the 19th IEEE Real-Time Systems Symposium (RTSS '98) IEEE Piscataway, NJ, Madrid, Spain 1998 134 143
60. D.A. Ostrowski, and R.G. Reynolds Knowledge-based software testing agent using evolutionary learning with cultural algorithms Proceedings of the 1999 Congress on Evolutionary Computation, CEC '99 IEEE Piscataway, NJ, Washington, DC 1999 1657 1663
61. J. Wegener, H. Sthamer, and H. Pohlheim Testing the temporal behaviour of realtime tasks using extended evolutionary algorithms Proceedings of the 7th European Conference on Software Testing, Analysis and Review (EuroSTAR '1999) Barcelona, Spain 1999
62. H. Pohlheim Competition and cooperation in extended evolutionary algorithms L. Spector Gecco 2001 - Late Breaking Papers 2001 Morgan Kauffman San Francisco, CA
63. Z. Bingul, A.S. Sekmen, S. Palaniappan, and S. Zein-Sabatto Genetic algorithms applied to real time multiobjective optimization problems Proceedings of the IEEE Southeastcon IEEE Piscataway, NJ, Nashville, TN 2000 95 103
64. J.T. Alander, T. Mantere, P. Turunen, Genetic algorithm based software testing, in: G.D. Smith, N.C. Steele, R.F. Albrecht (Eds.), Artificial Neural Nets and Genetic Algorithms, Proceedings of International Conference (ICANNGA'97), Springer-Verlag, Wien, Norwich, UK, 1998, pp. 325-328.
65. J.T. Alander, T. Mantere, G. Moghadampour, Testing software response times using a genetic algorithm, in: J.T. Alander (Ed.), Proceedings of the Third Nordic Workshop on Genetic Algorithms and their Applications (3NWGA), Finnish Artificial Intelligence Society (FAIS), Helsinki, Finland, 1997, pp. 293-298, (ftp://uwasa.fi/cs/3NWGA/*.ps.Z).
66. J.T. Alander, T. Mantere, G. Moghadampour, and J. Matila Searching protection relay response time extremes using genetic algorithm - software quality by optimization Electr. Power Syst. Res. 46 1998 229 233
67. J.T. Alander, T. Mantere, Automatic software testing by genetic algorithm optimization, a case study, in: C. Ryan (Ed.), Proceedings of the First International Workshop on Soft Computing Applied to Software Engineering, Limerick University Press, Limerick, Ireland, 1999, pp. 1-9.
68. T. Mantere, J.T. Alander, Automatic test image generation by genetic algorithms for testing halftoning methods, in: D.P. Casasent (Ed.), Intelligent Systems and Advanced Manufacturing: Intelligent Robots and Computer Vision XIX: Algorithms, Techniques, and Active Vision, vol. SPIE-4197, The International Society for Optical Engineering, Bellingham, WA, Boston, MA, 2000, pp. 297-308.
69. T. Mantere, and J.T. Alander Testing halftoning methods by images generated by genetic algorithms Arpakannus 1 2001 39 44
70. T. Mantere, and J.T. Alander Developing and testing structural light vision software by co-evolutionary genetic algorithm Proceedings of the Second ASERC Workshop on Quantitative and Soft Computing based Software Engineering Alberta Software Engineering Research Consortium (ASERC), Banff, Canada 2002 31 37
71. R. Hochman, T.M. Khoshgoftaar, E.B. Allen, and J.P. Hudepohl Using the genetic algorithm to build optimal neural networks for faultprone module detection Proceedings of the Seventh International Symposium on Software Reliability Engineering IEEE Computer Society Press, Los Alamitos, CA, White Plains, NY, USA 1996 152 162
72. R. Hochman, T.M. Khoshgoftaar, E.B. Allen, and J.P. Hudepohl Evolutionary neural networks: a robust approach to software reliability problems Proceedings of the Eighth International Symposium on Software Reliability Engineering IEEE Computer Society Press, Los Alamitos, CA, Albuquerque, NM 1997 13 26
73. N. Mansour, and K. El-Fakih Natural optimization algorithms for optimal regression testing Proceedings of the 1997 21st Annual International Conputer Software & Applications Conference IEEE, Los Alamitos, CA, Washington, DC 1997 511 514
74. G. Baradhi, and M. Nashat Comparative study of five regression testing algorithms Proceedings of the 1997 Australian Software Engineering Conference IEEE Computer Society Press, Los Alamitos, CA, Sydney, NSW, Australia 1997 174 182
75. E. Baisch, and T. Liedtke Comparison of conventional approaches and soft-computing approaches for software quality prediction Proceedings of the 1997 IEEE International Conference on Systems, Man, and Cybernetics IEEE, Piscataway, NJ, Orlando, FL 1997 1045 1049
76. E. Baisch, and T. Liedtke Automated knowledge acquisition and application for software development projects 13th IEEE Conference on Automated Software Engineering IEEE Piscataway, NJ, Honolulu, HI 1998 13 16
77. C.J. Burges, and M. Lefley Can genetic programming improve software effort estimation? A comparative evaluation Inform. Software Technol. 43 14 2001 863 873
78. J.S. Aguilar-Ruiz, I. Ramos, J.C. Riquilme, and M. Toro An evolutionary approach to estimating software development projects Inform. Software Technol. 43 14 2001 875 882
79. H.-G. Gross, B.F. Jones, D.E. Eyres, Structural performance measure of evolutionary testing applied to worst-case timing of real-time systems, IEE Proceedings: Software 147 (2) (2000) 25-30.
80. B.F. Jones, H.-H. Sthamer, and D.E. Eyres Automatic structural testing using genetic algorithms Software Eng. J. 11 5 1996 299 306
81. B.F. Jones, D.E. Eyres, and H.-H. Sthamer A strategy for using genetic algorithms to automate branch and fault-based testing Comput. J. 41 2 1998 98 107
82. H.-G. Gross, B.F. Jones, D.E. Eyres, Evolutionary algorithms for the verification of execution time bounds for real-time software, in: IEE Colloquium on Applicable Modelling, Verification and Analysis Techniques for Real-Time Systems (ref. no. 1999/006), IEEE Piscataway, NJ, London, UK, 1999, pp. 8/1-8/8.
83. H.-H. Sthamer, B.F. Jones, and D.E. Eyres Generating test data for ADA generic procedures using genetic algorithms Proceedings of ACEDC 1994 University of Plymouth, UK 1994 134 140
84. M. Harman, and B.F. Jones Search-based software engineering Inform. Software Technol. 43 2001 833 839
85. C. Kaner Improving the maintainability of automated test suites Proceedings of the Tenth International Quality Week on Software Research San Francisco, CA 1997
86. B. Marick Classic testing mistakes Proceedings of STAR 97, Sixth International Conference on Software Testing, Analysis, and Review San Jose, CA 1997
87. B. Pettischord Success with test automation Proceedings of the Ninth International Quality Week on Software Research San Francisco, CA 1996
88. M. Evett, T. Khoshgoftar, P. Chien, E. Allen, GP-based software quality prediction, in: Proceedings of the Third Annual Conference Genetic Programming, Morgan Kauffman, Madison, WJ, pp. 60-65.