Determining the significance and relative importance of parameters of a simulated quenching algorithm using statistical tools

Applied Intelligence

Volumn 37, Issue 2, 2012, Pages 239-254

  Castillo, P A ^a   Arenas, M G ^a   Rico, N ^a   Mora, A M ^a   Garcia Sanchez P ^a   Laredo, J L J ^a   Merelo, J J ^a  

^a UNIVERSITY OF GRANADA   (Spain)

Author keywords

ANOVA; Optimization algorithms; Parameter tuning; SA; Search method parameters; Statistical analysis; Statistical significance

Indexed keywords

OPTIMIZATION ALGORITHMS; PARAMETER-TUNING; SA; SEARCH METHOD; STATISTICAL SIGNIFICANCE;

ALGORITHMS; ANALYSIS OF VARIANCE (ANOVA); SIMULATED ANNEALING; STATISTICAL MECHANICS; STATISTICAL METHODS;

PARAMETER ESTIMATION;

EID: 84865108234     PISSN: 0924669X     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10489-011-0324-x     Document Type: Article

References (84)

1. Eiben AE, Smith JE (2003) Introduction to evolutionary computing. Springer, Berlin. ISBN 3-540-40184-9
2. Michalewicz Z, Fogel DB (2004) How to solve it: modern heuristics, 2nd edn. Springer, Berlin
3. Yang XS (2010) Nature-inspired metaheuristic algorithms, 2nd edn. Luniver Press, Cambridge
4. S Kirkpatrick CD Gerlatt MP Vecchi 1983 Optimization by simulated annealing Science 220 671 680 702485 1225.90162 10.1126/science.220.4598.671
5. N Ansari R Sarasa G Wang 1993 An efficient annealing algorithm for global optimization in Boltzmann machines Appl Intell 3 177 192 10.1007/BF00871936
6. Das A, Chakrabarti BK (2005) Quantum annealing and related optimization methods. Lecture note in physics, vol 679. Springer, Heidelberg
7. J De Vicente J Lanchares R Hermida 2003 Placement by thermodynamic simulated annealing Phys Lett A 317 5-6 415 423 1046.68127 10.1016/j.physleta. 2003.08.070
8. Van-Hentenryck P, Michel L (2005) Constraint-based local search. The MIT Press, Cambridge. ISBN: 978-0-262-22077-4
9. Hoos HH, Stutzle T (2004) Stochastic local search. Foundations and applications. Morgan Kaufmann/Elsevier, San Mateo/Amsterdam
10. NK Bambha SS Bhattacharyya J Teich E Zitzler 2004 Systematic integration of parameterized local search into evolutionary algorithms IEEE Trans Evol Comput 8 2 137 155 10.1109/TEVC.2004.823471 ISSN: 1089-778X
11. AE Eiben R Hinterding Z Michalewicz 1999 Parameter control in evolutionary algorithms IEEE Trans Evol Comput 3 2 124 141 10.1109/4235.771166 10.1109/4235.771166 ISSN: 1089-778X
12. CL Karr E Wilson 2003 A self-tuning evolutionary algorithm applied to an inverse partial differential equation Appl Intell 19 3 147 155 1101.68957 10.1023/A:1026097605403
13. Smit SK, Eiben AE (2010) Beating the world champion evolutionary algorithm via REVAC tuning. In: Proc of the WCCI2010 IEEE world congress on computational intelligence. IEEE Press, Barcelona, pp 1295-1302. ISSN: 978-1-4244-8126-2
14. RA Fisher 1925 Theory of statistical estimation Proc Camb Philos Soc 22 700 725 JFM 51.0385.01 10.1017/S0305004100009580
15. Dickinson P, Chow B (1971) Some properties of the Tukey test to Duckworth's specification/by Peter Dickinson, Bryant Chow. Office of Institutional Research, University of Southwestern Louisiana, Lafayette, Louisiana, USA
16. L Ingber 1993 Simulated annealing: practice versus theory Math Comput Model 18 11 29 57 1254392 0819.90080 10.1016/0895-7177(93)90204-C
17. Davis L (1991) Handbook of genetic algorithms. Van Nostrand Reinhold, New York
18. I Jagielska C Matthews T Whitfort 1999 An investigation into the application of neural networks, fuzzy logic, genetic algorithms, and rough sets to automated knowledge acquisition problems Neurocomputing 24 1-3 37 54 0922.68096 10.1016/S0925-2312(98)00090-3 (Pubitemid 29098848)
19. Das S, Chowdhury A, Abraham A (2009) A bacterial evolutionary algorithm for automatic data clustering. In: Proceedings of the eleventh conference on congress on evolutionary computation, CEC'09, Piscataway, NJ, USA. IEEE Press, New York, pp 2403-2410
20. De Jong KA (1975) An analysis of the behavior of a class of genetic adaptive systems. PhD thesis, University of Michigan, Ann Arbor
21. Eiben AE, Michalewicz Z, Schoenauer M, Smith JE (2007) Parameter control in evolutionary algorithms. In: Parameter setting in evolutionary algorithms, studies in computational intelligence, vol 54/2007. Springer, Berlin/Heidelberg, pp 19-46. ISBN 978-3-540-69431-1, ISSN 1860-949X
22. Smit SK, Eiben AE (2009) Using entropy for parameter analysis of evolutionary algorithms. In: Beielstein B et al (eds) Empirical methods for the analysis of optimization algorithms. Natural computing series. Springer, Berlin
23. Eiben AE (2009) Principled approaches to tuning EA parameters. Tutorials-IEEE Congress on Evolutionary Computation (CEC2009). Available at http://www.few.vu.nl/~gusz/papers/eiben-cec-2009-tutorial-corrected.pdf
24. Smit SK, Eiben AE (2009) Comparing parameter tuning methods for evolutionary algorithms. In: Haddow P et al (eds) CEC'09: proc. of the eleventh conference on congress on evolutionary computation, Piscataway, NJ, USA. IEEE Press, New York, pp 399-406
25. Gong Y, Fukunaga A (2011) Distributed island-model genetic algorithms using heterogeneous parameter settings. In: Proceedings of the 2011 IEEE congress on evolutionary computation (CEC2011), New Orleans, LA, USA, pp 820-827. ISBN 978-1-4244-7834-7
26. JJ Grefenstette 1986 Optimization of control parameters for genetic algorithms IEEE Trans Syst Man Cybern 16 1 122 128 10.1109/TSMC.1986.289288 (Pubitemid 16187857)
27. D Kim C Kim 1997 Forecasting time series with genetic fuzzy predictor ensemble IEEE Trans Fuzzy Syst 5 4 523 535 10.1109/91.649911 (Pubitemid 127768532)
28. K Liang X Yao CS Newton 2001 Adapting self-adaptive parameters in evolutionary algorithms Appl Intell 15 171 180 0992.68231 10.1023/A: 1011286929823 (Pubitemid 32897606)
29. MJ Gacto R Alcala F Herrera 2010 A multi-objective evolutionary algorithm for an effective tuning of fuzzy logic controllers in heating, ventilating and air conditioning systems Appl Intell 33 1 18 10.1007/s10489-010-0252-1
30. L Diosan A Rogozan JP Pecuchet 2010 Improving classification performance of support vector machine by genetically optimising kernel shape and hyper-parameters Appl Intell 33 1 15 10.1007/s10489-010-0252-1
31. A Aksac E Uzun T Ozyer 2011 Areal time traffic simulator utilizing an adaptive fuzzy inference mechanism by tuning fuzzy parameters Appl Intell 34 1 23 10.1007/s10489-009-0175-x
32. Bäck T, Fogel D, Michalewicz Z (1997) Handbook of evolutionary computation. Institute of Physics Publishing Ltd, Bristol and Oxford University Press, London
33. Hinterding R, Michalewicz Z, Eiben AE (1997) Adaptation in evolutionary computation: a survey. In: Proceedings of the 4th IEEE conference on evolutionary computation. IEEE Press, New York, pp 65-69
34. Harik GR, Lobo FG (1999) A parameter-less genetic algorithm. In: Banzhaf W, Daida J, Eiben AE, Garzon MH, Honavar V, Jakiela M, Smith RE (eds) Proceedings of the genetic and evolutionary computation conference, Orlando, Florida, USA, vol 1, Morgan Kaufmann, San Mateo, pp 258-265. 13-17
35. Bäck T (1993) Optimal mutation rates in genetic search. In: Forrest S (ed) Proceedings of the 5th international conference on genetic algorithms. Morgan Kaufmann, San Mateo, pp 2-8
36. Goldberg DE (1989) Genetic algorithms in search, optimization and machine learning. Addison-Wesley, Boston
37. Goldberg DE, Deb K, Theirens D (1991) Toward a better understanding of mixing in genetic algorithms. In: Belew RK, Booker LB (eds) Proc of the 4th int conf on genetic algorithms. Morgan Kaufmann, San Mateo, pp 190-195
38. Harik G, Cantú-Paz E, Goldberg DE, Miller BL (1997) The gambler's ruin problem, genetic algorithms, and the sizing of populations. In: Proceedings of the 4th IEEE conference on evolutionary computation. IEEE Press, New York, pp 7-12. ISBN: 0-7803-3949-5
39. Schaffer JD, Morishima A (1987) An adaptive crossover distribution mechanism for genetic algorithms. In: Grefenstette JJ (ed) Proceedings of the 2nd international conference on genetic algorithms and their applications. Lawrence Erlbaum Associates, Hillsdale, pp 36-40
40. Thierens D (1996) Dimensional analysis of allele-wise mixing revisited. In: Voigt HM, Ebeling W, Rechenberg I, Schwefel HP (eds) Proceedings of the 4th conference on parallel problem solving from nature. Lecture notes in computer science, vol 1141. Springer, Berlin, pp 255-265 (Pubitemid 126128314)
41. Jansen T, Weyland D (2007) Analysis of evolutionary algorithms for the longest common subsequence problem. In: GECCO'07: proceedings of the 9th annual conference on genetic and evolutionary computation. ACM, New York, pp 939-946 (Pubitemid 47291645)
42. T Jansen D Weyland 2010 Analysis of evolutionary algorithms for the longest common subsequence problem Algorithmica 57 1 170 186 2581083 1184.68604 10.1007/s00453-008-9243-6
43. Weyland D (2008) Simulated annealing, its parameter settings and the longest common subsequence problem. In: GECCO'08: proceedings of the 10th annual conference on genetic and evolutionary computation. ACM, New York, pp 803-810
44. Lobo FG, Lima CF, Michalewicz Z (2007) Parameter setting in evolutionary algorithms. Springer, Berlin
45. Nannen V, Eiben AE (2006) A method for parameter calibration and relevance estimation in evolutionary algorithms. In: Keijzer M (ed) Proc of the genetic and evolutionary computation conference (GECCO2006). Morgan Kaufmann, San Francisco, pp 183-190 (Pubitemid 44611314)
46. Nannen V, Eiben AE (2007) Relevance estimation and value calibration of evolutionary algorithm parameters. In: Proc of the international joint conference on artificial intelligence (IJCAI2007). AAAI Press, Menlo Park, pp 975-980
47. Smit SK, Eiben AE (2009) Comparing parameter tuning methods for evolutionary algorithms. In: Tyrrell A (ed) Proc of the IEEE congress on evolutionary computation, Thondheim. IEEE Press, New York, pp 399-406
48. Bartz T, Parsopoulos KE, Vrahatis MN (2004) Analysis of particle swarm optimization using computational statistics. In: Chalkis (ed) Proc of the international conference of numerical analysis and applied mathematics (ICAAM2004), pp 34-37
49. Bartz T, Markon S (2004) Tuning search algorithms for real-world applications: a regression tree based approach. Technical Report of the Collaborative Research Centre 531 Computational Intelligence CI-172/04, University of Dortmund, March 2004
50. Bartz T, Lasarczyk CWG, Preuss M (2005) Sequential parameter optimization. In: Proc of the 2005 IEEE congress on evolutionary computation, Edinburgh, UK, vol 1, pp 773-780 (Pubitemid 41495929)
51. Birattari M, Stutzle T, Paquete L, Varrentrapp K (2002) A racing algorithm for configuring metaheuristics. In: Proc of the genetic and evolutionary computation conference. Morgan Kaufmann, San Mateo, pp 11-18
52. Hutter F, Hoos HH, Stutzle T (2007) Automatic algorithm configuration based on local search. In: Proc of the twenty-second conference on artificial intelligence (AAAI 2007). AAAI Press, Menlo Park, pp 1152-1157 (Pubitemid 350149724)
53. Montero E, Riff MC, Neveu B (2010) New requirements for off-line parameter calibration algorithms. In: Proc of the WCCI2010 IEEE world congress on computational intelligence. IEEE Press, Barcelona, pp 3466-3473. ISSN 978-1-4244-8126-2
54. Leung SW, Yuen SY, Chow CK (2010) Parameter control by the entire search history: case study of history-driven evolutionary algorithm. In: Proc of the WCCI2010 IEEE world congress on computational intelligence. IEEE Press, Barcelona, pp 3688-3695. ISSN 978-1-4244-8126-2
55. Smit SK, Eiben AE (2010) Parameter tuning of evolutionary algorithms: generalist vs specialist. In: Di Chio Cecilia et al (eds) Applications of evolutionary computation. LNCS, vol 6024. Springer, Berlin, pp 542-551
56. J He AH Tan CL Tan 2003 On machine learning methods for Chinese document categorization Appl Intell 18 311 322 1034.68070 10.1023/A:1023202221875
57. J Maudes JJ Rodriguez C Garcia-Osorio C Pardo 2011 Random projections for linear SVM ensembles Appl Intell 34 347 359 10.1007/s10489-011-0283-2
58. D Shilane J Martikainen S Dudoit SJ Ovaska 2008 A general framework for statistical performance comparison of evolutionary computation algorithms Inf Sci 178 14 2870 2879 10.1016/j.ins.2008.03.007
59. S Garcia D Molina M Lozano F Herrera 2009 A study on the use of non-parametric tests for analyzing the evolutionary algorithms' behaviour: a case study on the CEC'2005 special session on real parameter optimization J Heuristics 15 617 644 1191.68828 10.1007/s10732-008-9080-4
60. I Rojas J González H Pomares JJ Merelo PA Castillo G Romero 2002 Statistical analisys of the main parameters involved in the desing of a genetic algorithm IEEE Trans Syst Man Cibern, Part C 32 10 31 37 10.1109/TSMCC.2002. 1009128 ISSN:1094-6977 (Pubitemid 34789923)
61. PA Castillo JJ Merelo G Romero A Prieto I Rojas 2002 Statistical analysis of the parameters of a neuro-genetic algorithm IEEE Trans Neural Netw 13 6 1374 1394 10.1109/TNN.2002.804281 ISSN:1045-9227 (Pubitemid 35428526)
62. Talbi EG (2009) Metaheuristics. From design to implementation. University of Lille CNRS Inria. Wiley, New York. ISBN 978-0-470-27858-1
63. Lockett AJ, Miikkulainen R (2011) Measure-theoretic evolutionary annealing. In: Proceedings of the 2011 IEEE congress on evolutionary computation (CEC2011), New Orleans, LA, USA, pp 2139-2146. ISBN 978-1-4244-7834-7
64. JCW Debuse VJ Rayward-Smith 1999 Discretisation of continuous commercial database features for a simulated annealing data mining algorithm Appl Intell 11 285 295 10.1023/A:1008339026836 (Pubitemid 30517151)
65. S Sun F Zhuge J Rosenberg R Steiner G Rubin S Napel 2008 Learning-enhanced simulated annealing: method, evaluation, and application to lung nodule registration Appl Intell 28 83 99 10.1007/s10489-007-0043-5
66. Bonev B, Cazorla M, Martín F, Matellan V (2010) Portable autonomous walk calibration for 4-legged robots. Applied Intelligence 1-12
67. Michalewicz Z (1996) Genetic algorithms + data structures = evolution programs, 3rd edn. Springer, Berlin
68. ZG Wang M Rahman YS Wong KS Neo 2006 Development of heterogeneous parallel genetic simulated annealing using multi-niche crowding Intl J Comput Intel 3 1 55 62
69. van Laarhoven PJ, Aarts EH (1987) Simulated annealing: theory and applications (mathematics and its applications), 1st edn. Springer, Berlin
70. S Kirkpatrick CD Gelatt Jr MP Vecchi 1983 Optimization by simulated annealing Science 220 671 680 702485 1225.90162 10.1126/science.220.4598.671
71. Weicker K (2002) Evolutionare algorithmen. Teubner, Leipzig
72. Smith GB (1987) Preface to S Geman, D Geman, "Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images", pp 562-563
73. AO Griewank 1981 Generalized descent for global optimization J Optim Theory Appl 34 1 11 39 626627 0431.49036 10.1007/BF00933356
74. Törn A, Zilinskas A (1989) Global optimization. Springer lecture notes in computer science, vol 350. Springer, Berlin, pp 1-24
75. Ackley DH (1987) A connectionist machine for genetic hillclimbing. Kluwer, Boston
76. Bäck T (1996) Evolutionary algorithms in theory and practice. Oxford University Press, London
77. Whitley D, Garrett D, Watson JP (2003) Quad search and hybrid genetic algorithms. In: Genetic and evolutionary computation-GECCO 2003. Springer, Berlin, pp 1469-1480
78. R Gutiérrez P Roman F Torres 2001 Inference on some parametric functions in the univariate lognormal diffusion process with exogenous factors Test 10 2 357 373 1881145 1014.62098 10.1007/BF02595702 (Pubitemid 33684638)
79. H Cho F Olivera SD Guikema 2008 A derivation of the number of minima of the Griewank function Appl Math Comput 204 2 694 701 2460306 1154.65335 10.1016/j.amc.2008.07.009
80. RM Capocelli LM Ricciardi 1974 A diffusion model for population growth in random environment Theor Popul Biol 5 28 41 10.1016/0040-5809(74)90050-1
81. MAE Basel SA Ahmad MS Wafaa 2004 Modelling the CPI using a lognormal diffusion process and implications on forecasting inflation IMA J Manag Math 15 39 51 2064070 1061.62124 10.1093/imaman/15.1.39
82. F Herrera M Lozano AM Sánchez 2003 A taxonomy for the crossover operator for real-coded genetic algorithms: an experimental study Int J Intell Syst 18 309 338 1048.68067 10.1002/int.10091
83. DH Wolpert WG Macready 1997 No free lunch theorems for optimization IEEE Trans Evol Comput 1 1 67 82 10.1109/4235.585893 (Pubitemid 127771019)
84. Yoav Benjamini 1988 Opening the box of a boxplot Am Stat 42 4 257 262