Parallel differential evolution with self-adapting control parameters and generalized opposition-based learning for solving high-dimensional optimization problems

Journal of Parallel and Distributed Computing

Volumn 73, Issue 1, 2013, Pages 62-73

  Wang, Hui ^a   Rahnamayan, Shahryar ^b   Wu, Zhijian ^c  

^a NANCHANG INSTITUTE OF TECHNOLOGY   (China)

^b UNIVERSITY OF ONTARIO INSTITUTE OF TECHNOLOGY   (Canada)

^c WUHAN UNIVERSITY   (China)

Author keywords

Differential evolution (DE); Generalized opposition based learning; Graphics processing units (GPU); High dimensional global optimization

Indexed keywords

BENCH-MARK PROBLEMS; CANDIDATE SOLUTION; COMPUTATIONAL TIME; CONTROL PARAMETERS; DIFFERENTIAL EVOLUTION; GLOBAL OPTIMIZATION PROBLEMS; GRAPHICS PROCESSING UNIT; GRAPHICS PROCESSING UNITS; HIGH-DIMENSIONAL; HIGH-DIMENSIONAL OPTIMIZATION; HIGH-DIMENSIONAL PROBLEMS; OPPOSITION-BASED LEARNING; SELF-ADAPTING CONTROL PARAMETERS; TIME-CONSUMING TASKS;

COMPUTER GRAPHICS; COMPUTER GRAPHICS EQUIPMENT; GLOBAL OPTIMIZATION; PROGRAM PROCESSORS;

EVOLUTIONARY ALGORITHMS;

EID: 84869457784     PISSN: 07437315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jpdc.2012.02.019     Document Type: Article

References (55)

1. A. Akoglu, and G.M. Striemer Scalable and highly parallel implementation of Smith-Waterman on graphics processing unit using CUDA Cluster Comput. 12 2009 341 352
2. A. Auger, N. Hansen, A restart CMA evolution strategy with increasing population size, in: Proceedings of IEEE Congress on Evolutionary Computation, 2005, pp. 1769-1776.
3. T. Bäck Evolutionary Algorithms in Theory and Practice: Evolution Strategies, Evolutionary Programming, Genetic Algorithms 1996 Oxford University Publisher New York
4. W. Banzhaf, S. Harding, W.B. Langdon, and G. Wilson Accelerating genetic programming through graphics processing units Genetic Programming Theory and Practice vol. VI 2009 1 19
5. R.E. Bellman Dynamic Programming 1957 Princeton University Press
6. J. Brest, S. Greiner, G. Bošković, M. Mernik, and V. Žumer Self-adapting control parameters in differential evolution: a comparative study on numerical benchmark problems IEEE Trans. Evol. Comput. 10 6 2006 646 657
7. J. Brest, and M.S. Maučec Self-adaptive differential evolution algorithm using population size reduction and three strategies Soft Comput. 15 11 2011 2157 2174
8. J. Brest, A. Zamuda, B. Bošković, M.S. Maučec, V. Žumer, High-dimensional real-parameter optimization using self-adaptive differential evolution algorithm with population size reduction, in: Proceedings of IEEE Congress on Evolutionary Computation, 2008, pp. 2032-2039.
9. M. Dorigo, V. Maniezzo, and A. Colorni The ant system: optimization by a colony of cooperating agents IEEE Trans. Syst. Man Cybern. Part B 26 1996 29 41
10. A. Duarte, R. Marti, An adaptive memory procedure for continuous optimization, in: Proceedings of International Conference on Intelligent System Design and Applications, 2009, pp. 1085-1089.
11. L.J. Eshelman, and J.D. Schaffer Real-coded genetic algorithm and interval schemata Found. Genet. Algorithms 2 1993 187 202
12. S. García, A. Fernández, J. Luengo, and F. Herrera Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: experimental analysis of power Inform. Sci. 180 2010 2044 2064
13. S. García, D. Molina, M. Lozano, and F. Herrera A study on the use of non-parametric tests for analyzing the evolutionary algorithms' behaviour: a case study on the CEC'2005 special session on real parameter optimization J. Heuristics 15 2009 617 644
14. C. Garcí-Martínez, M. Lozano, Continuous variable neighbourhood search algorithm based on evolutionary metaheuristic components: a scalability test, in: Proceedings of International Conference on Intelligent System Design and Applications, 2009, pp. 1074-1079.
15. C. García-Martínez, F.J. Rodríguez, and M. Lozano Role differentiation and malleable mating for differential evolution: an analysis on large scale optimisation Soft Comput. 15 11 2011 2109 2126
16. F. Herrera, M. Lozano, D. Molina, Components and parameters of DE, real-coded CHC, and G-CMAES, Technical Report, University of Granada, Spain, 2010.
17. F. Herrera, M. Lozano, D. Molinam, Test suite for the special issue of Soft Computing on scalability of evolutionary algorithms and other metaheuristics for large scale continuous optimization problems, Technical Report, University of Granada, Spain, 2010. http://sci2s.ugr.es/eamhco/LSCOP- special-issue-SOCO.
18. S. Hsieh, T. Sun, C. Liu, S. Tsai, Solving large scale global optimization using improved particle swarm optimizer, in: Proceedings of IEEE Congress on Evolutionary Computation, 2008, pp. 1777-1784.
19. T. Hu, S. Harding, and W. Banzhaf Variable population size and evolution acceleration: a case study with a parallel evolutionary algorithm Genet. Program. Evolvable Mach. 11 2010 205 225
20. J. Kennedy, R.C. Eberhart, Particle swarm optimization, in: Proceedings of IEEE International Conference on Neural Networks, 1995, pp. 1942-1948.
21. S. Kirkpatrick, C.D. Gelatt, and P.M. Vecchi Optimization by simulated annealing Science 220 1983 671 680
22. P. Larranaga, and J.A. Lozano Estimation of Distribution Algorithms - A New Tool for Evolutionary Computation 2001 Kluwer Academic Publishers Boston
23. J. Liu, and J. Lampinen A fuzzy adaptive differential evolution algorithm Soft Comput. 9 6 2005 448 462
24. D. Molina, M. Lozano, F. Herrera, Memetic algorithm with local search chaining for continuous optimization problems: a scalability test, in: Proceedings of International Conference on Intelligent System Design and Applications, 2009, pp. 1068-1073.
25. S. Muelas, A. LaTorre, J. Peña, A memetic differential evolution algorithm for continuous optimization, in: Proceedings of International Conference on Intelligent System Design and Applications, 2009, pp. 1080-1084.
26. nVidia, NVIDIA CUDA programming guide version 2.2.1, 2009.
27. K. Price, R. Storn, and J. Lampinen Differential Evolution: A Practical Approach to Global Optimization first ed. 2005 Springer-Verlag New York
28. S. Rahnamayan, H.R. Tizhoosh, M.M.A. Salama, Opposition-based differential evolution algorithms, in: Proceedings of IEEE Congress on Evolutionary Computation, 2006, pp. 2010-2017.
29. S. Rahnamayan, H.R. Tizhoosh, M.M.A. Salama, Opposition-based differential evolution for optimization of noisy problems, in: Proceedings of IEEE Congress on Evolutionary Computation, 2006, pp. 1865-1872.
30. S. Rahnamayan, H.R. Tizhoosh, and M.M.A. Salama Opposition-based differential evolution IEEE Trans. Evol. Comput. 12 1 2008 64 79
31. S. Rahnamayan, and G.G. Wang Solving large scale optimization problems by opposition-based differential evolution (ODE) Trans. Comput. 7 10 2008 1792 1804
32. D. Robilliard, V. Marion-Poty, and C. Fonlupt Genetic programming on graphics processing units Genet. Program. Evolvable Mach. 10 2009 447 471
33. R. Storn, K.V. Price, Differential evolution: a simple and efficient adaptive scheme for global optimization over continuous spaces, ICSI, USA, Tech. Rep. TR-95-012, 1995.
34. R. Storn, and K. Price Differential evolution - a simple and efficient heuristic for global optimization over continuous spaces J. Global Optim. 11 1997 341 359
35. K. Tang, X. Li, S.N. Suganthan, Z. Yang, T. Weise, Benchmark functions for the CEC'2010 special session and competition on large-scale global optimization, Technical Report, Nature Inspired Computation and Applications Laboratory, USTC, China, 2010. http://nical.ustc.edu.cn/cec10ss.php.
36. K. Tang, X. Yao, P.N. Suganthan, C. Macnish, Y. Chen, C. Chen, Z. Yang, Benchmark functions for the CEC'2008 special session and competition on high-dimensional real-parameter optimization, Technical Report, Nature Inspired Computation and Applications Laboratory, USTC, China, 2007.
37. H.R. Tizhoosh, Opposition-based learning: a new scheme for machine intelligence, in: Proceedings of International Conference on Computational Intelligence for Modeling Control and Automation, 2005, pp. 695-701.
38. L. Tseng, C. Chen, Multiple trajectory search for large scale global optimization, in: Proceedings of IEEE Congress on Evolutionary Computation, 2008, pp. 3057-3064.
39. T. Tušar, B. Filipič, Differential evolution versus genetic algorithms in multiobjective optimization, in: Proceedings of Evolutionary Multi-Criterion Optimization, 2007, pp. 257-271.
40. L.P. Veronese, R.A. Krohling, Differential evolution algorithm on the GPU with C-CUDA, in: Proceedings of IEEE Congress on Evolutionary Computation, 2010, pp. 1-7.
41. J. Vesterstrom, R. Thomsen, A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems, in: Proceedings of IEEE Congress on Evolutionary Computation, 2004, pp. 1980-1987.
42. H. Wang, Y. Liu, S.Y. Zeng, H. Li, C.H. Li, Opposition-based particle swarm algorithm with Cauchy mutation, in: Proceedings of IEEE Congress on Evolutionary Computation, 2007, pp. 4750-4756.
43. H. Wang, Z.J. Wu, and S. Rahnamayan Enhanced opposition-based differential evolution for solving high-dimensional continuous optimization problems Soft Comput. 15 11 2011 2127 2140
44. H. Wang, Z.J. Wu, S. Rahnamayan, L.S. Kang, A scalability test for accelerated DE using generalized opposition-based learning, in: Proceedings of International Conference on Intelligent System Design and Applications, 2009, pp. 1090-1095.
45. H. Wang, Z.J. Wu, S. Rahnamayan, Y. Liu, and M. Ventresca Enhancing particle swarm optimization using generalized opposition-based learning Inform. Sci. 181 20 2011 4699 4714
46. M. Weber, F. Neri, and V. Tirronen Shuffle or update parallel differential evolution for large scale optimization Soft Comput. 15 11 2011 2089 2107
47. M.L. Wong, Parallel multi-objective evolutionary algorithms on graphics processing units, in: Proceedings of the 11th Annual Conference Companion on Genetic and Evolutionary Computation Conference, 2009, pp. 2515-2522.
48. M.L. Wong, T.T. Wong, Parallel hybrid genetic algorithms on Consumer-Level graphics hardware, in: Proceedings of IEEE Congress on Evolutionary Computation, 2006, pp. 2973-2980.
49. Z. Yang, K. Tang, X. Yao, Multilevel cooperative coevolution for large scale optimization, in: Proceedings of IEEE Congress on Evolutionary Computation, 2008, pp. 1663-1670.
50. Z. Yang, K. Tang, and X. Yao Scalability of generalized adaptive differential evolution for large-scale continuous optimization Soft Comput. 15 11 2011 2141 2155
51. J.Q. Zhang, and A.C. Sanderson JADE: adaptive differential evolution with optional external archive IEEE Trans. Evol. Comput. 13 5 2009 945 958
52. S. Zhao, J. Liang, P.N. Suganthan, M.F. Tasgetiren, Dynamic multi-swarm particle swarm optimizer with local search for large scale global optimization, in: Proceedings of IEEE Congress on Evolutionary Computation, 2008, pp. 3846-3853.
53. S.Z. Zhao, P.N. Suganthan, and S. Das Self-adaptive differential evolution with multi-trajectory search for large scale optimization Soft Comput. 15 11 2011 2175 2185
54. H. Zhou, K.L. Lange, M.A. Suchard, Graphical processing units and high-dimensional optimization. arXiv:1003.3272v1, 2009.
55. W. Zhu Massively parallel differential evolution - pattern search optimization with graphics hardware acceleration: an investigation on bound constrained optimization problems J. Global Optim. 50 3 2011 417 437