Analyzing convergence performance of evolutionary algorithms: A statistical approach

Information Sciences

Volumn 289, Issue 1, 2014, Pages 41-58

  Derrac, Joaquín ^a   García, Salvador ^b   Hui, Sheldon ^c   Suganthan, Ponnuthurai Nagaratnam ^c   Herrera, Francisco ^d,e  

^a CARDIFF UNIVERSITY   (United Kingdom)

^b UNIVERSITY OF JAÉN   (Spain)

^c NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^d UNIVERSITY OF GRANADA   (Spain)

^e KING ABDULAZIZ UNIVERSITY   (Saudi Arabia)

Author keywords

Convergence based algorithmic comparison; Evolutionary algorithms; Nonparametric tests; Page's trend test

Indexed keywords

OPTIMIZATION;

CONVERGENCE PERFORMANCE; CONVERGENCE-BASED ALGORITHMIC COMPARISON; EVOLUTIONARY OPTIMIZATION ALGORITHM; EVOLUTIONARY TECHNIQUES; INTERMEDIATE RESULTS; NON-PARAMETRIC TEST; STATISTICAL APPROACH; TREND TESTS;

EVOLUTIONARY ALGORITHMS;

EID: 84948614401     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2014.06.009     Document Type: Article

References (43)

1. M.G. Arenas, N. Rico, A.M. Mora, P.A. Castillo, J.J. Merelo, Using statistical tools to determine the significance and relative importance of the main parameters of an evolutionary algorithm, Intell. Data Anal. 17 (2013) 771-789.
2. T. Bartz-Beielstein, Experimental Research in Evolutionary Computation: The New Experimentalism, Springer, New York, 2006.
3. B. Bischl, O. Mersmann, H. Trautmann, M. Preuss, Algorithm selection based on exploratory landscape analysis and cost-sensitive learning, in: Proceedings of the 14th Annual Conference on Genetic and Evolutionary Computation, GECCO '12, New York, USA, July 7-11.
4. P.A.N. Bosman, On gradients and hybrid evolutionary algorithms for real-valued multiobjective optimization, IEEE Trans. Evol. Comput. 16 (2012) 51-69.
5. J. Brest, S. Greiner, B. Boskovic, M. Mernik, V. Zumer, Self-adapting control parameters in differential evolution: a comparative study on numerical benchmark problems, IEEE Trans. Evol. Comput. 10 (2006) 646-657.
6. J. Brest, M.S. Maucec, Self-adaptive differential evolution algorithm using population size reduction and three strategies, Soft Comput. 15 (2011) 2157-2174.
7. P. Chakraborty, S. Das, G.G. Roy, A. Abraham, On convergence of the multi-objective particle swarm optimizers, Inf. Sci. 181 (2011) 1411-1425.
8. W.J. Conover, Practical Nonparametric Statistic, third ed., John Wiley & Sons, 1999.
9. M. Crepinsek, S.H. Liu, M. Mernik, Replication and comparison of computational experiments in applied evolutionary computing: common pitfalls and guidelines to avoid them, Appl. Soft Comput. 19 (2014) 161-170.
10. A. Czarn, C. MacNish, K. Vijayan, R. Turlach, R. Gupta, Statistical exploratory analysis of genetic algorithms, IEEE Trans. Evol. Comput. 8 (2004) 405-421.
11. S. Das, P.N. Suganthan, Differential evolution: a survey of the state-of-the-art, IEEE Trans. Evol. Comput. 15 (2011) 4-31.
12. J. Derrac, S. García, D. Molina, F. Herrera, A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms, Swarm Evol. Comput. 1 (2011) 3-18.
13. E.A. Duéñez-Guzmán, M.D. Vose, No free lunch and benchmarks, Evolut. Comput. 21 (2013) 293-312.
14. M. Gallagher, B. Yuan, A general-purpose tunable landscape generator, IEEE Trans. Evol. Comput. 10 (2006) 590-603.
15. S. García, A. Fernández, J. Luengo, F. Herrera, A study of statistical techniques and performance measures for genetics-based machine learning: accuracy and interpretability, Soft Comput. 13 (2009) 959-977.
16. S. García, A. Fernández, J. Luengo, F. Herrera, Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: experimental analysis of power, Inform. Sci. 180 (2010) 2044-2064.
17. S. García, F. Herrera, An extension on Statistical Comparisons of Classifiers over Multiple Data Sets for all pairwise comparisons, J. Mach. Learn. Res. 9 (2008) 2677-2694.
18. S. García, D. Molina, M. Lozano, F. Herrera, A study on the use of non-parametric tests for analyzing the evolutionary algorithms' behaviour: a case study on the CEC'2005 special session on real parameter optimization, J. Heuristics 15 (2009) 617-644.
19. J. Gibbons, S. Chakraborti, Nonparametric Statistical Inference, fifth ed., Chapman & Hall, 2010.
20. F. Herrera, M. Lozano, D. Molina, Test Suite for the Special Issue of Soft Computing on Scalability of Evolutionary Algorithms and Other Metaheuristics for Large Scale Continuous Optimization Problems, 2010. 〈http://sci2s.ugr.es/eamhco/cfp.php〉.
21. F. Herrera, M. Lozano, D. Molina, Editorial scalability of evolutionary algorithms and other metaheuristics for large-scale continuous optimization problems, Soft Comput. 15 (2011) 2085-2087.
22. J.J. Higgins, Introduction to Modern Nonparametric Statistics, Duxbury Press, 2003.
23. J. Hooker, Testing heuristics: we have it all wrong, J. Heuristics 1 (1997) 33-42.
24. J. Luengo, S. García, F. Herrera, A study on the use of statistical tests for experimentation with neural networks: analysis of parametric test conditions and non-parametric tests, Expert Syst. Appl. 36 (2009) 7798-7808.
25. R. Mallipeddi, P.N. Suganthan, Q.K. Pan, M.F. Tasgetiren, Differential evolution algorithm with ensemble of parameters and mutation strategies, Appl. Soft Comput. 11 (2011) 1679-1696.
26. O. Mersmann, B. Bischl, H. Trautmann, M. Preuss, C. Weihs, G. Rudolph, Exploratory landscape analysis, in: Proceedings of the 13th Annual Conference on Genetic and Evolutionary Computation, GECCO '11, New York, USA, July 12-16.
27. E.B. Page, Ordered hypotheses for multiple treatments: a significance test for linear ranks, J. Am. Stat. Assoc. 58 (1963) 216-230.
28. A.K. Qin, V.L. Huang, P.N. Suganthan, Differential evolution algorithm with strategy adaptation for global numerical optimization, IEEE Trans. Evol. Comput. 13 (2009) 398-417.
29. I. Rojas, J. González, H. Pomares, J.J. Merelo, P.A. Castillo, G. Romero, Statistical analysis of the main parameters involved in the design of a genetic algorithm, IEEE Trans. Syst. Man Cybern. Part C: Appl. Rev. 32 (2002) 31-37.
30. G. Rudolph, Convergence analysis of canonical genetic algorithms, IEEE Trans. Neural Networks 5 (1994) 96-101.
31. D.J. Sheskin, Handbook of Parametric and Nonparametric Statistical Procedures, fifth ed., Chapman & Hall/CRC, 2011.
32. R. Storn, K. Price, Differential evolution - a simple and efficient heuristic for global optimization over continuous spaces, J. Global Optim. Arch. 11 (1997) 341-359.
33. P. Suganthan, N. Hansen, J. Liang, K. Deb, Y. Chen, A. Auger, S. Tiwari, Problem Definitions and Evaluation Criteria for the CEC'2005 Special Session on Real Parameter Optimization. Nanyang Technological University, Technical Report, 2005. 〈www.ntu.edu.sg/home/epnsugan/index-files/cec-05/Tech-Report-May-30-05.pdf〉.
34. K. Tang, X. Yao, P.N. Suganthan, C. MacNish, Y.P. Chen, C.M. Chen, Z. Yang, Benchmark Functions for the CEC'2008 Special Session and Competition on Large Scale Global Optimization. Nature Inspired Computation and Applications Laboratory, USTC, China, Technical Report, 2007.
35. N. Vecek, M. Mernik, M. Crepinšek, A chess rating system for evolutionary algorithms: a new method for the comparison and ranking of evolutionary algorithms, Inform. Sci. 277 (2014) 656-679.
36. H. Wang, Z. Wu, S. Rahnamayan, Enhanced opposition-based differential evolution for solving high-dimensional continuous optimization problems, Soft Comput. 15 (2011) 2127-2140.
37. M. Weber, F. Neri, V. Tirronen, Shuffle or update parallel differential evolution for large scale optimization, Soft Comput. 15 (2011) 2089-2107.
38. D.L. Whitley, S. Rana, J. Dzubera, K.E. Mathias, Evaluating evolutionary algorithms, Artif. Intell. 85 (1996) 245-276.
39. D. Wolpert, W.G. Macready, No free lunch theorems for optimization, IEEE Trans. Evol. Comput. 1 (1997) 67-82.
40. Z. Yang, K. Tang, X. Yao, Scalability of generalized adaptive differential evolution for large-scale continuous optimization, Soft Comput. 15 (2011) 2141-2155.
41. J.H. Zar, Biostatistical Analysis, fifth ed., Prentice Hall, 2009.
42. S.Z. Zhao, P.N. Suganthan, Comprehensive comparison of convergence performance of optimization algorithms based on nonparametric statistical tests, in: Proceedings of the IEEE Congress on Evolutionary Computation, CEC 2012, Brisbane, Australia, June 10-15.
43. S.Z. Zhao, P.N. Suganthan, S. Das, Self-adaptive differential evolution with multi-trajectory search for large scale optimization, Soft Comput. 15 (2011) 2175-2185.