Parameter tuning for configuring and analyzing evolutionary algorithms

Swarm and Evolutionary Computation

Volumn 1, Issue 1, 2011, Pages 19-31

  Eiben, A E ^a   Smit, S K ^a  

^a VU UNIVERSITY AMSTERDAM   (Netherlands)

Author keywords

Algorithm performance; Evolutionary algorithms; Experimental methodology; Parameter tuning; Robustness

Indexed keywords

PARAMETER ESTIMATION; ROBUSTNESS (CONTROL SYSTEMS); SURVEYS;

ALGORITHM ANALYSIS; ALGORITHM PERFORMANCE; CONCEPTUAL FRAMEWORKS; EXPERIMENTAL COMPARISON; EXPERIMENTAL METHODOLOGY; PARAMETER-TUNING; PERFORMANCE MEASURE; PROBLEM INSTANCES;

EVOLUTIONARY ALGORITHMS;

EID: 79960494768     PISSN: 22106502     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.swevo.2011.02.001     Document Type: Review

References (68)

1. J. Hooker, Testing heuristics: we have it all wrong, Journal of Heuristics 1 (1995) 33-42.
2. R. Barr, B. Golden, J. Kelly, M. Rescende, W. Stewart, Designing and reporting on computational experiments with heuristic methods, Journal of Heuristics 1 (1995) 9-32.
3. A.E. Eiben, J. Smith, Introduction to Evolutionary Computing, Springer-Verlag, London, 2003.
4. T. Bartz-Beielstein, Experimental Research in Evolutionary Computation- The New Experimentalism, in: Natural Computing Series, Springer, Berlin, Heidelberg, New York, 2006.
5. B. Yuan, M. Gallagher, Combining meta-EAs and racing for difficult EA parameter tuning tasks, in: [15], pp. 121-142.
6. M. Birattari, Z. Yuan, P. Balaprakash, T. Stützle, F -race and iterated F -race: an overview, in: T. Bartz-Beielstein, M. Chiarandini, L. Paquete, M. Preuss (Eds.), Experimental Methods for the Analysis of Optimization Algorithms, Springer, 2010, pp. 311-336.
7. J. Maturana, F. Lardeux, F. Saubion, Controlling behavioral and structural parameters in evolutionary algorithms, in: International Conference on Artificial Evolution, EA'2009, in: Lecture Notes in Computer Science, vol. 5926, Springer, 2009, pp. 110-121.
8. V. Nannen, S.K. Smit, A.E. Eiben, Costs and benefits of tuning parameters of evolutionary algorithms, in: G. Rudolph, T. Jansen, S.M. Lucas, C. Poloni, N. Beume (Eds.), Parallel Problem Solving from Nature - PPSN X, in: Lecture Notes in Computer Science, vol. 5199, Springer, 2008, pp. 528-538.
9. A.E. Eiben, R. Hinterding, Z. Michalewicz, Parameter control in evolutionary algorithms, IEEE Transactions on Evolutionary Computation 3 (1999) 124-141.
10. O. Kramer, Evolutionary self-adaptation: a survey of operators and strategy parameters, Evolutionary Intelligence 3 (2010) 51-65. On-line first.
11. A. Fialho, Adaptive operator selection for optimization, Ph.D. Thesis, Université Paris-Sud XI, Orsay, France, 2010.
12. A.K. Qin, V.L. Huang, P.N. Suganthan, Differential evolution algorithm with strategy adaptation for global numerical optimization, Transactions on Evolutionary Computation 13 (2009) 398-417.
13. R. Mallipeddi, P. Suganthan, Differential evolution algorithm with ensemble of parameters and mutation and crossover strategies, in: B. Panigrahi, S. Das, P. Suganthan, S. Dash (Eds.), Swarm, Evolutionary, and Memetic Computing, in: Lecture Notes in Computer Science, vol. 6466, Springer, Berlin, Heidelberg, 2010, pp. 71-78.
14. Z.-H. Zhan, J. Zhang, Adaptive particle swarm optimization, in: M. Dorigo, M. Birattari, C. Blum, M. Clerc, T. Stützle, A. Winfield (Eds.), Ant Colony Optimization and Swarm Intelligence, in: Lecture Notes in Computer Science, vol. 5217, Springer, Berlin, Heidelberg, 2008, pp. 227-234.
15. F. Lobo, C. Lima, Z. Michalewicz, Parameter Setting in Evolutionary Algorithms, Springer, 2007.
16. M. Birattari, Tuning Metaheuristics, Springer, 2005.
17. A.E. Eiben, M. Jelasity, A critical note on experimental research methodology in experimental research methodology in EC, in: 2002 Congress on Evolutionary Computation, CEC'2002, IEEE Press, Piscataway, NJ, 2002, pp. 582-587.
18. T. Bartz-Beielstein, New experimentalism applied to evolutionary computation, Ph.D. Thesis, Universität Dortmund, 2005.
19. M. Chiarandini, L. Paquete, M. Preuss, E. Ridge, Experiments on metaheuristics: methodological overview and open issues, Technical Report DMF-2007-03-003, The Danish Mathematical Society, 2007.
20. P. Suganthan, N. Hansen, J. Liang, K. Deb, Y.-P. Chen, A. Auger, S. Tiwari, Problem definitions and evaluation criteria for the CEC 2005 special session on realparameter optimization, Technical Report, Nanyang Technological University, 2005.
21. S.K. Smit, A.E. Eiben, Beating the 'world champion' evolutionary algorithm via REVAC tuning, in: IEEE Congress on Evolutionary Computation, IEEE Computational Intelligence Society, IEEE Press, Barcelona, Spain, 2010, pp. 1-8.
22. D. Goldberg, Genetic Algorithms in Search, Optimization and Machine Learning, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA, 1989.
23. Z. Michalewicz, Genetic Algorithms + Data Structures = Evolution Programs, 3rd, extended ed., Springer-Verlag New York, Inc., New York, NY, USA, 1996.
24. M. Preuss, Adaptability of algorithms for real-valued optimization, in: M. Giacobini, et al. (Eds.), Applications of Evolutionary Computing, EvoWorkshops 2009. Proceedings, in: Lecture Notes in Computer Science, vol. 5484, Springer, Berlin, 2009, pp. 665-674.
25. S.K. Smit, A.E. Eiben, Comparing parameter tuning methods for evolutionary algorithms, in: IEEE Congress on Evolutionary Computation, IEEE Press, Trondheim, 2009, pp. 399-406.
26. S.K. Smit, A.E. Eiben, Using entropy for parameter analysis of evolutionary algorithms, in: T. Bartz-Beielstein, M. Chiarandini, L. Paquete, M. Preuss (Eds.), Experimental Methods for the Analysis of Optimization Algorithms, in: Natural Computing Series, Springer, 2010, pp. 287-310.
27. T. Bartz-Beielstein, C. Lasarczyk, M. Preuss, The sequential parameter optimization toolbox, in: T. Bartz-Beielstein, M. Chiarandini, L. Paquete, M. Preuss (Eds.), Empirical Methods for the Analysis of Optimization Algorithms, Springer, Berlin, Heidelberg, New York, 2009, pp. 337-360.
28. A.E. Eiben, S.K. Smit, Evolutionary algorithm parameters and methods to tune them, in: E.M.Y. Hamadi, F. Saubion (Eds.), Autonomous Search, Springer, 2011.
29. R. Myers, E.R. Hancock, Empirical modelling of genetic algorithms, Evolutionary Computation 9 (2001) 461-493.
30. G. Taguchi, T. Yokoyama, Taguchi Methods: Design of Experiments, ASI Press, 1993.
31. R.E. Bechhofer, C.W. Dunnett, D.M. Goldsman, M. Hartmann, A comparison of the performances of procedures for selecting the normal population having the largest mean when populations have a common unknown variance, Communications in Statistics B19 (1990) 971-1006.
32. J. Greffenstette, Optimisation of control parameters for genetic algorithms, in: A. Sage (Ed.), IEEE Transactions on Systems, Man and Cybernetics, vol. 16 (1), IEEE Press, Piscataway, NJ, 1986, pp. 122-128.
33. V. Nannen, A.E. Eiben, Relevance Estimation and Value Calibration of evolutionary algorithm parameters, in: M. M. Veloso (Ed.), Proceedings of the 20th International Joint Conference on Artificial Intelligence, IJCAI, Hyderabad, India, 2007, pp. 1034-1039.
34. J. Schaffer, R. Caruana, L. Eshelman, R. Das, A study of control parameters affecting online performance of genetic algorithms for function optimization, in: Proceedings of the Third International Conference on Genetic Algorithms, Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1989, pp. 51-60.
35. O. Maron, A. Moore, The racing algorithm: model selection for lazy learners, in: Artificial Intelligence Review, vol. 11, Kluwer Academic Publishers, Norwell, MA, USA, 1997, pp. 193-225. (Pubitemid 127508239)
36. T. Bartz-Beielstein, K. Parsopoulos, M. Vrahatis, Analysis of particle swarm optimization using computational statistics, in: Chalkis (Ed.), Proceedings of the International Conference of Numerical Analysis and Applied Mathematics, ICNAAM 2004, Wiley, 2004, pp. 34-37.
37. T. Bartz-Beielstein, Experimental analysis of evolution strategies: overview and comprehensive introduction, Technical Report Reihe CI 157/03, SFB 531, Universität Dortmund, Dortmund, Germany, 2003.
38. T. Bartz-Beielstein, M. Preuss, Considerations of budget allocation for sequential parameter optimization, SPO, in: L. Paquete, et al. (Eds.), Workshop on Empirical Methods for the Analysis of Algorithms, Proceedings, Online Proceedings, Reykjavik, Iceland, 2006, pp. 35-40.
39. P. Balaprakash, M. Birattari, T. Stutzle, Improvement strategies for the F-race algorithm: sampling design and iterative refinement, in: T. Bartz-Beielstein, M. Blesa Aguilera, C. Blum, B. Naujoks, A. Roli, G. Rudolph, M. Sampels (Eds.), Hybrid Metaheuristics, in: Lecture Notes in Computer Science, vol. 4771, Springer, Berlin, Heidelberg, 2007, pp. 108-122.
40. B. Adenso-Diaz, M. Laguna, Fine-tuning of algorithms using fractional experimental designs and local search, Operations Research 54 (2006) 99-114.
41. M. El-Beltagy, P. Nair, A. Keane, Metamodeling techniques for evolutionary optimization of computationally expensive problems: promises and limitations, in: W. Banzhaf, J. Daida, A.E. Eiben, M. Garzon, V. Honavar, M. Jakiela, R. Smith (Eds.), Proceedings of the Genetic and Evolutionary Computation Conference, GECCO-1999, Morgan Kaufmann, San Francisco, 1999, pp. 196-203.
42. Y. Jin, A comprehensive survey of fitness approximation in evolutionary computation, Soft Computing 9 (2005) 3-12. (Pubitemid 40097880)
43. A. Czarn, C. MacNish, K. Vijayan, B. Turlach, R. Gupta, Statistical exploratory analysis of genetic algorithms, IEEE Transactions on Evolutionary Computation 8 (2004) 405-421.
44. I. Ramos, M. Goldbarg, E. Goldbarg, A. Neto, Logistic regression for parameter tuning on an evolutionary algorithm, in: Proceedings of the 2005 IEEE Congress on Evolutionary Computation IEEE Congress on Evolutionary Computation, vol. 2, IEEE Press, Edinburgh, UK, 2005, pp. 1061-1068. (Pubitemid 41495969)
45. O. François, C. Lavergne, Design of evolutionary algorithms-a statistical perspective, IEEE Transactions on Evolutionary Computation 5 (2001) 129-148. (Pubitemid 32486962)
46. S.P. Coy, B.L. Golden, G.C. Runger, E.A. Wasil, Using experimental design to find effective parameter settings for heuristics, Journal of Heuristics 7 (2001) 77-97. (Pubitemid 32134485)
47. C.W.G. Lasarczyk, Genetische programmierung einer algorithmischen chemie, Ph.D. Thesis, Technische Universiteit Dortmund, 2007.
48. D. Goldsman, B.L. Nelson, B. Schmeiser, Methods for selecting the best system, in: WSC'91: Proceedings of the 23rd Conference on Winter Simulation, IEEE Computer Society, Washington, DC, USA, 1991, pp. 177-186. (Pubitemid 23574495)
49. B. Schmeiser, Simulation experiments, Handbooks in Operations Research and Management Science 2 (1990) 295-330.
50. Y. Rinott, On two-stage selection procedures and related probabilityinequalities, Communications in Statistics-Theory and Methods 7 (1978) 799-811.
51. Y. Hochberg, A.C. Tamhane, Multiple Comparison Procedures, John Wiley & Sons, Inc., New York, NY, USA, 1987.
52. S.-H. Kim, B.L. Nelson, A fully sequential procedure for indifference-zone selection in simulation, ACM Transactions on Modeling and Computer Simulation 11 (2001) 251-273.
53. J. Branke, E. Chick, C. Schmidt, New developments in ranking and selection: an empirical comparison of the three main approaches, in: WSC'05: Proceedings of the 37th Conference on Winter Simulation, Winter Simulation Conference, 2005, pp. 708-717. (Pubitemid 46187766)
54. R. Mercer, J. Sampson, Adaptive search using a reproductive metaplan, Kybernetes 7 (1978) 215-228.
55. F. Hutter, H.H. Hoos, T. Stützle, Automatic algorithm configuration based on local search, in: Proc. of the Twenty-Second Conference on Artifical Intelligence, AAAI'07, pp. 1152-1157.
56. F. Hutter, H.H. Hoos, K. Leyton-Brown, T. Stutzle, ParamILS: an automatic algorithm configuration framework, Journal of Artificial Intelligence Research 36 (2009) 267-306.
57. V. Nannen, A.E. Eiben, A method for parameter calibration and relevance estimation in evolutionary algorithms, in: M. Keijzer (Ed.), Proceedings of the Genetic and Evolutionary Computation Conference, GECCO'06, Morgan Kaufmann, San Francisco, 2006, pp. 183-190. (Pubitemid 44611314)
58. S.K. Smit, A.E. Eiben, Parameter tuning of evolutionary algorithms: generalist vs. specialist, in: C. Di Chio, et al. (Eds.), Applications of Evolutionary Computation, in: Lecture Notes in Computer Science, vol. 6024, Springer, 2010, pp. 542-551.
59. M. Pedersen, A. Chipperfield, Simplifying particle swarm optimization, Applied Soft Computing 10 (2010) 618-628.
60. S.K. Smit, A.E. Eiben, Z. Szlávik, An MOEA-based method to tune EA parameters on multiple objective functions, in: J. Filipe, J. Kacprzyk (Eds.), Proceedings of the International Joint Conference on Computational Intelligence, IJCCI-2010, SciTePress, Valencia, Spain, 2010, pp. 261-268.
61. J. Dréo, Using performance fronts for parameter setting of stochastic metaheuristics, in: GECCO'09: Proceedings of the 11th Annual Conference Companion on Genetic and Evolutionary Computation Conference, ACM, New York, NY, USA, 2009, pp. 2197-2200.
62. K. Deb, A. Pratap, S. Agarwal, T. Meyarivan, A fast and elitist multiobjective genetic algorithm: NSGA-II, IEEE Transactions on Evolutionary Computation 6 (2002) 182-197. (Pubitemid 34555372)
63. E. Ridge, D. Kudenko, Sequential experiment designs for screening and tuning parameters of stochastic heuristics, in: Workshop on Empirical Methods for the Analysis of Algorithms, Reykjavik, Iceland, Online Proceedings, 2006, pp. 27-34.
64. T. Bartz-Beielstein, S. Markon, Tuning search algorithms for real-world applications: a regression tree based approach, Technical Report of the Collaborative Research Centre 531 Computational Intelligence CI-172/04, University of Dortmund, 2004.
65. B. Freisleben, M. Hartfelder, Optimization of genetic algorithms by genetic algorithms, in: R. Albrecht, C. Reeves, N. Steele (Eds.), Artificial Neural Networks and Genetic Algorithms, Springer, 1993, pp. 392-399.
66. T. Bäck, Parallel optimization of evolutionary algorithms, in: Y. Davidor, H.-P. Schwefel, R. Männer (Eds.), Proceedings of the 3rd Conference on Parallel Problem Solving from Nature, in: Lecture Notes in Computer Science, vol. 866, Springer, Berlin, Heidelberg, New York, 1994, pp. 418-427.
67. M. Meissner, M. Schmuker, G. Schneider, Optimized particle swarm optimization (OPSO) and its application to artificial neural network training,BMCBioinformatics 7 (2006) 125.
68. V. Nannen, A.E. Eiben, Efficient Relevance Estimation and Value Calibration of evolutionary algorithm parameters, in: IEEE Congress on Evolutionary Computation, IEEE, 2007, pp. 103-110.