Multi-strategy coevolving aging particle optimization

International Journal of Neural Systems

Volumn 24, Issue 1, 2014, Pages

  Iacca, Giovanni ^a   Caraffini, Fabio ^b   Neri, Ferrante ^b  

^a Innovation Center for Advanced Sensors and Sensor Systems INCAS3   (Netherlands)

^b DE MONTFORT UNIVERSITY   (United Kingdom)

Author keywords

Evolutionary computation; Feedforward neural network; Memetic computing; Optimization algorithms; Robotic arms; Swarm intelligence

Indexed keywords

BLACK-BOX OPTIMIZATION; DIFFERENTIAL EVOLUTION; MEMETIC COMPUTING; NUMERICAL RESULTS; OPTIMIZATION ALGORITHMS; PARTICLE OPTIMIZATION; POPULATION-BASED ALGORITHM; SWARM INTELLIGENCE;

ARTIFICIAL INTELLIGENCE; EVOLUTIONARY ALGORITHMS; FEEDFORWARD NEURAL NETWORKS; ROBOT APPLICATIONS; ROBOTIC ARMS;

OPTIMIZATION;

AGING; ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; COMPUTER SIMULATION; HUMAN; QUALITY CONTROL; ROBOTICS;

AGING; ALGORITHMS; BENCHMARKING; COMPUTER SIMULATION; HUMANS; NEURAL NETWORKS (COMPUTER); ROBOTICS;

EID: 84890697415     PISSN: 01290657     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0129065714500087     Document Type: Article

References (84)

1. G. Rennera and A. Ekárt, Genetic algorithms in computer aided design, Comput. Aided Design 35(8) (2003) 709-726.
2. G. C. Bower and I. M. Kroo, Multi-objective aircraft optimization for minimum cost and emissions over specific route networks, 26th International Congress of the Aeronautical Sciences Anchorage, Alaska, USA, (2008).
3. T. Chabuk, J. Reggia, J. Lohn and D. Linden, Causally-guided evolutionary optimization and its application to antenna array design, Integr. Comput. Aided Eng. 19 (2012) 111-124.
4. H. Tao, J. M. Zain, M. M. Ahmed, A. N. Abdalla and W. Jing, A wavelet-based particle swarm optimization algorithm for digital image watermarking, Integr. Comput. Aided Eng. 19(1) (2012) 81-91.
5. V. Plevris and M. Papadrakakis, A hybrid particle swarm gradient algorithm for global structural optimization, Comput. Aided Civ. Infrastruct. Eng. 26(1) (2011) 48-68.
6. R. Putha, L. Quadrifoglio and E. Zechman, Comparing ant colony optimization and genetic algorithm approaches for solving traffic signal coordination under oversaturation conditions, Comput. Aided Civ. Infrastruct. Eng. 27(1) (2012) 14-28.
7. H. Adeli and O. Kamal, Efficient optimization of space trusses, Comput. Struct. 24(3) (1986) 501-511.
8. S. Abuyounes and H. Adeli, Optimization of hybrid steel plate girders, Comput. Struct. 27(2) (1987) 241-248.
9. H. Adeli and K. Balasubramanyam, A synergic manmachine approach to shape optimization of structures, Comput. Struct. 30(3) (1988) 553-561.
10. H. Adeli, High-performance computing for largescale analysis, optimization and control, J. Aerosp. Eng. 13(1) (2000) 1-10.
11. F. Caraffini, F. Neri, G. Iacca and A. Mol, Parallel memetic structures, Inform. Sci. 227 (2013) 60-82.
12. G. Iacca, F. Caraffini and F. Neri, Memorysaving memetic computing for path-following mobile robots, Appl. Soft Comput. 13(4) (2013) 2003-2016.
13. H. Adeli and A. Saleh, Integrated structural/control optimization of large adaptive/smart structures, Int. J. Solids Struct. 35(28-29) (1998) 3815-3830.
14. G. Bello-Orgaz, D. F. Barrero, M. D. R-Moreno and D. Camacho, Acquisition of business intelligence from human experience in route planning, Enterprise Inform. Syst. (2013).
15. M. D. Rodriguez-Moreno, D. Camacho, D. F. Barrero and M. Gutiérrez, A decision support system for logistics operations, in Soft Computing Models in Industrial and Environmental Applications, 5th International Workshop (SOCO 2010), Vol. 73 (Springer Berlin Heidelberg, 2010), pp. 103-110.
16. P. Moscato, On evolution, search, optimization, genetic algorithms and martial arts: Towards memetic algorithms, Technical Report 826 (Caltech, 1989).
17. F. Neri, C. Cotta and P. Moscato, Handbook of Memetic Algorithms, Studies in Computational Intelligence, Vol. 379 (Springer, 2012).
18. F. Neri and C. Cotta, Memetic algorithms and memetic computing optimization: A literature review, Swarm Evol. Comput. 2 (2012) 1-14.
19. T. T. Nguyen and X. Yao, An experimental study of hybridizing cultural algorithms and local search, Int. J. Neural Syst. 18(1) (2008) 1-17.
20. H.-B. Duan, C.-F. Xu and Z.-H. Xing, A hybrid artificial bee colony optimization and quantum evolutionary algorithm for continuous optimization problems, Int. J. Neural Syst. 20(1) (2010) 39-50.
21. H. Ishibuchi, T. Yoshida and T. Murata, Balance between genetic search and local search in memetic algorithms for multiobjective permutation flow shop scheduling, IEEE Trans. Evol. Comput. 7(2) (2003) 204-223.
22. K. Sarma and H. Adeli, Fuzzy genetic algorithm for optimization of steel structures, J. Struct. Eng. 126(5) (2000) 586-604.
23. Z. Sankari and H. Adeli, Probabilistic neural networks for EEG-based diagnosis of Alzheimer's disease using conventional and wavelet coherence, J. Neurosci. Meth. 197(1) (2011) 165-170.
24. G. Ghodrati Amiri, A. Abdolahi Rad and M. Khorasani, Generation of near-field artificial ground motions compatible with median predicted spectra using pso-based neural network and wavelet analysis, Comput. Aided Civ. Infrastruct. Eng. 27(9) (2012) 711-730.
25. N. R. Luque, J. A. Garrido, J. Ralli, J. J. Laredo and E. Ros, From sensors to spikes: Evolving receptive fields to enhance sensorimotor information in a robot-arm, Int. J. Neural Syst. 22(4) (2012) 1-20.
26. H. Adeli and A. Panakkat, A probabilistic neural network for earthquake magnitude prediction, Neural Netw. 22 (2009) 1018-1024.
27. M. Ahmadlou and H. Adeli, Enhanced probabilistic neural network with local decision circles: A robust classifier, Integr. Comput. Aided Eng. 17(3) (2010) 197-210.
28. F. Neri, N. Kotilainen and M. Vapa, A memeticneural approach to discover resources in P2P networks, in Recent Advances in Evolutionary Computation for Combinatorial Optimization, Chap. 8, eds. J. van Hemert and C. Cotta, Studies in Computational Intelligence (Springer, 2008), pp. 119-136.
29. I. Vilovic, N. Burum and D. Milic, Using particle swarm optimization in training neural network for indoor field strength prediction, ELMAR, 2009. ELMAR'09. Int. Symp. (2009), pp. 275-278.
30. H. Li and Q. Zhang, A multiobjective differential evolution based on decomposition for multiobjective optimization with variable linkages, in Parallel Problem Solving from Nature - PPSN IX, Lecture Notes in Computer Science, Vol. 4193 (Springer, 2006), pp. 583-592.
31. J. Ilonen, J.-K. Kamarainen and J. Lampinen, Differential evolution training algorithm for feed-forward neural networks, Neural Process. Lett. 17(1) (2003) 93-105.
32. A. Slowik and M. Bialko, Training of artificial neural networks using differential evolution algorithm, 2008 Conf. Human System Interactions (2008), pp. 60-65.
33. A. Espinal, M. Sotelo-Figueroa, J. Soria-Alcaraz, M. Ornelas, H. Puga, M. Carpio, R. Baltazar and J. Rico, Comparison of pso and de for training neural networks, 2011 10th Mexican Int. Conf. Artificial Intelligence (MICAI) (2011), pp. 83-87.
34. B. Garro, H. Sossa and R. Vázquez, Evolving neural networks: A comparison between differential evolution and particle swarm optimization, in Advances in Swarm Intelligence, eds. Y. Tan, Y. Shi, Y. Chai and G. Wang, Lecture Notes in Computer Science, Vol. 6728 (Springer, Berlin Heidelberg, 2011), pp. 447-454.
35. F. Neri and E. Mininno, Memetic compact differential evolution for cartesian robot control, IEEE Comput. Intell. Mag. 5(2) (2010) 54-65.
36. N. R. Luque, J. A. Garrido, R. R. Carrillo, S. Tolu and E. Ros, Adaptive cerebellar spiking model embedded in the control loop: Context switching and robustness against noise, Int. J. Neural Syst. 21(5) (2011) 385-401.
37. G. B. Orgaz, H. D. Menéndez and D. Camacho, Adaptive k-means algorithm for overlapped graph clustering, Int. J. Neural Syst. 22(5) (2012) 1-19.
38. S. Tolu, M. Vanegas, J. A. Garrido, N. R. Luque and E. Ros, Adaptive and predictive control of a simulated robot arm, Int. J. Neural Syst. 23(3) (2013) 1-15.
39. Q. Wu and R. Law, Complex system fault diagnosis based on a fuzzy robust wavelet support vector classifier and an adaptive Gaussian particle swarm optimization, Inform. Sci. 180(23) (2010) 4514- 4528.
40. K. M. Zemalache, L. Beji and H. Maaref, Two inertial models of X4-flyers dynamics, motion planning and control, Integr. Comput. Aided Eng. 14(2) (2007) 107-119.
41. G. Iacca, F. Neri, E. Mininno, Y. S. Ong and M. H. Lim, Ockham's razor in memetic computing: Three stage optimal memetic exploration, Inform. Sci. 188 (2012) 17-43.
42. D. C. Theodoridis, Y. S. Boutalis and M. A. Christodoulou, Dynamical recurrent neuro-fuzzy identification schemes employing switching parameter hopping, Int. J. Neural Syst. 22(2) (2012) 1-16.
43. E. K. Nyarko and R. Scitovski, Solving the parameter identification problem of mathematical model using genetic algorithm, 153(2004) 651-658.
44. J. Wang, Z. Wu and H. Wang, A novel particle swarm algorithm for solving parameter identification problems on graphics hardware, Int. J. Comput. Sci. Eng. 6(1/2) (2011) 43-51.
45. F. Liu and M. J. Er, A novel efficient learning algorithm for self-generating fuzzy neural network with applications, Int. J. Neural Syst. 22(1) (2012) 21-35.
46. F. Neri and V. Tirronen, Recent advances in differential evolution: A review and experimental analysis, Artif. Intell. Rev. 33(1-2) (2010) 61-106.
47. R. Mallipeddi, P. N. Suganthan, Q. K. Pan and M. F. Tasgetiren, Differential evolution algorithm with ensemble of parameters and mutation strategies, Appl. Soft Comput. 11(2) (2011) 1679-1696.
48. K. V. Price, R. Storn and J. Lampinen, Differential Evolution: A Practical Approach to Global Optimization (Springer, 2005).
49. N. Krasnogor, Toward robust memetic algorithms, in Recent Advances in Memetic Algorithms, eds. W. E. Hart, N. Krasnogor and J. E. Smith, Studies in Fuzzines and Soft Computing (Springer, Berlin, Germany, 2004), pp. 185-207.
50. R. Ros and N. Hansen, A simple modification in cma-es achieving linear time and space complexity, in Proc. Parallel Problem Solving in Nature (2008), pp. 296-305.
51. N. Hansen, S. D. Müller and P. Koumoutsakos, Reducing the time complexity of the derandomized evolution strategy with covariance matrix adaptation (CMA-ES), Evol. Comput. 11(1) (2003) 1-18.
52. A. Prügel-Bennett, Benefits of a population: Five mechanisms that advantage population-based algorithms, IEEE Trans. Evol. Comput. 14(4) (2010) 500-517.
53. A. Caponio, F. Neri and V. Tirronen, Super-fit control adaptation in memetic differential evolution frameworks, Soft Comput. 13 (2009) 811-831.
54. M. Weber, V. Tirronen and F. Neri, Scale factor inheritance mechanism in distributed differential evolution, Soft Comput. 14(11) (2010) 1187-1207.
55. F. Neri, G. Iacca and E. Mininno, Disturbed exploitation compact differential evolution for limited memory optimization problems, Inform. Sci. 181 (12) (2011) 2469-2487.
56. W.-N. Chen, J. Zhang, Y. Lin, N. Chen, Z.-H. Zhan, H.-H. Chung, Y. Li and Y.-H. Shi, Particle swarm optimization with an aging leader and challengers, IEEE Trans. Evol. Comput. 17(2) (2013) 241-258.
57. D. H. Wolpert and W. G. Macready, No free lunch theorems for optimization, IEEE Trans. Evol. Comput. 1(1) (1997) 67-82.
58. J. J. Liang, B. Y. Qu, P. N. Suganthan and A. G. Hernández- Díaz, Problem definitions and evaluation criteria for the CEC 2013 special session on realparameter optimization, Technical Report 201212, Zhengzhou University and Nanyang Technological University, Zhengzhou China and Singapore (2013).
59. K. Tang, X. Li, P. N. Suganthan, Z. Yang and T. Weise, Benchmark functions for the CEC'2010 special session and competition on large-scale global optimization, Technical Report, University of Science and Technology of China (USTC), School of Computer Science and Technology, Nature Inspired Computation and Applications Laboratory (NICAL), Hefei, Anhui, China (2010).
60. A. K. Qin, V. L. Huang and P. N. Suganthan, Differential evolution algorithm with strategy adaptation for global numerical optimization, IEEE Trans. Evol. Comput. 13(2) (2009) 398-417.
61. J. Zhang and A. Sanderson, JADE: Adaptive differential evolution with optional external archive, IEEE Transa. Evol. Comput. 13(5) (2009) 945-958.
62. J. Brest, S. Greiner, B. Bo?skovíc, M. Mernik and V. ?Zumer, Self-adapting control parameters in differential evolution: A comparative study on numerical benchmark problems, IEEE Trans. Evol. Comput. 10(6) (2006) 646-657.
63. S. Islam, S. Das, S. Ghosh, S. Roy and P. Suganthan, An adaptive differential evolution algorithm with novel mutation and crossover strategies for global numerical optimization, IEEE Trans. Syst., Man, Cybern. B, Cybern. 42 (2012) 482-500.
64. R. Mallipeddi and P. N. Suganthan, Differential evolution algorithm with ensemble of parameters and mutation and crossover strategies, SEMCCO (2010), pp. 71-78.
65. J. J. Liang, A. K. Qin, P. N. Suganthan and S. Baskar, Comprehensive learning particle swarm optimizer for global optimization of multimodal functions, IEEE Trans. Evol. Comput. 10(3) (2006) 281-295.
66. X. Li and X. Yao, Cooperatively coevolving particle swarms for large scale optimization, IEEE Trans. Evol. Comput. 16 (2012) 210-224.
67. D. Molina, M. Lozano, C. Garcia-Martinez and F. Herrera, Memetic algorithms for continuous optimization based on local search chains, Evol. Comput. 18(1) (2010) 27-63.
68. N. Hansen, The CMA evolution strategy (2012), http://www.lri.fr/?hansen/ cmaesintro.html.
69. M. Lozano, F. Herrera and D. Molina, Scalability of evolutionary algorithms and other metaheuristics for large scale continuous optimization problems, Soft Comput. 15(11) (2011) 2085-2087.
70. D. Molina, M. Lozano and F. Herrera, MA-SWChains: Memetic algorithm based on local search chains for large scale continuous global optimization, IEEE Congress on Evolutionary Computation (2010), pp. 1-8.
71. Cyber Dyne Srl Home Page, Kimeme (2012), Available at http://cyberdynesoft.it/.
72. S. S. Shapiro and M. B.Wilk, An analysis of variance test for normality (complete samples), Biometrika 3(52) (1965) 591-611.
73. G. W. Snedecor and W. G. Cochran, Statistical Methods, 8th edn. (1989).
74. W. S. Gosset, The probable error of a mean, Biometrika 6 (1908) 1-25.
75. B. L. Welch, The generalization of 'student's' problem when several different population variances are involved, Biometrika 34(1/2) (1947) 28-35.
76. F. Wilcoxon, Individual comparisons by ranking methods, Biometrics Bull. 1(6) (1945) 80-83.
77. S. Holm, A simple sequentially rejective multiple test procedure, Scand. J. Stat. 6(2) (1979) 65-70.
78. S. Garcia, A. Fernandez, J. Luengo and F. Herrera, A study of statistical techniques and performance measures for genetics-based machine learning: Accuracy and interpretability, Soft Comput. 13(10) (2008) 959-977.
79. J. Denavit and R. S. Hartenberg, A kinematic notation for lower-pair mechanisms based on matrices, ASME J. Appl. Mech. 22 (1955) 215-221.
80. Z. Ghahramani, The kin datasets (1996), Available at http://www.cs. toronto.edu/?delve/data/kin/kin. ps.gz.
81. P. I. Corke, Robotics toolbox for MATLAB, IEEE Robot. Autom. Mag. 3(1) (1996) 24-32.
82. J. Heaton, Programming Neural Networks with Encog 2 in Java (Heaton Research, Inc., 2010).
83. D. Rumelhart, G. Hintont and R.Williams, Learning representations by back-propagating errors, Nature 323(6088) (1986) 533-536.
84. M. Riedmiller and H. Braun, A direct adaptive method for faster backpropagation learning: The rprop algorithm, IEEE Int. Conf. Neural Networks (1993), pp. 586-591.