A hybrid algorithm for artificial neural network training

Engineering Applications of Artificial Intelligence

Volumn 26, Issue 1, 2013, Pages 293-301

  Yaghini, Masoud ^a   Khoshraftar, Mohammad M ^a   Fallahi, Mehdi ^a  

^a IRAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Iran)

Author keywords

Artificial Neural Networks; Backpropagation algorithm; Cross validation; Hybrid training algorithm; Particle swarm optimization; Time varying parameter

Indexed keywords

BACKPROPAGATION ALGORITHMS; NEURAL NETWORKS; PARTICLE SWARM OPTIMIZATION (PSO); RANDOM PROCESSES; TIME VARYING CONTROL SYSTEMS;

CROSS VALIDATION; CROSS-VALIDATION METHODS; EFFECTIVENESS AND EFFICIENCIES; GRADIENT BASED ALGORITHM; HYBRID TRAINING; OPPOSITION-BASED LEARNING; RANDOM PERTURBATIONS; TIME VARYING PARAMETER;

ITERATIVE METHODS;

EID: 84870056917     PISSN: 09521976     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.engappai.2012.01.023     Document Type: Article

References (43)

1. Alba, E.; Chicano, J.F.; 2004.Training Neural Networks with GA hybrid algorithms. In: Proceedings of Genetic and Evolutionary Computation (GECCO04), 26-30 June, Seattle, Washington, 852-863.
2. Al-Kazemi, B.; Mohan, C.K.; 2002. Training feedforward Neural Networks using multi-phase particle swarm optimization. 9th International Conference on Neural Information Processing (ICONIP02), 18-22 November, Singapore, Vol. 5, pp. 2615-2619.
3. R. Battiti, and G. Tecchiolli Training neural nets with the reactive tabu search IEEE Trans. Neural Networks 6 5 1995 1185 1200
4. Blum, C.; Socha, K.; 2005. Training feed-forward Neural Networks with Ant Colony Optimization: an application to pattern classification. IEEE 5th International Conference on Hybrid Intelligent Systems (HIS'05), 6-9 November, Rio de Janeiro, Brazil, 233-238.
5. Cantu-Paz, E.; Kamath, C.; 2005. An Empirical Comparison of Combinations of Evolutionary Algorithms and Neural Networks for Classification Problems, IEEE Trans. Syst. Man. Cybernet - Part B: Cynernet
6. Carvalho, M.; Ludermir, T.B.; 2006. An analysis Of PSO hybrid algorithms for feed-forward Neural Networks training, Proceedings of the Ninth Brazilian Symposium on Neural Networks (SBRN'06), 23-27 October, Ribeirao Preto, SP, Brazil.
7. Carvalho, M.; Ludermir, T.B.; 2007. Particle swarm optimization of neural network architectures and weights. 7th International Conference on Hybrid Intelligent Systems (HIS2007), 17-19 September, Kaiserslautern, Germany, 336-339.
8. M. Castellani, and H. Rowlands Evolutionary Artificial Neural Network design and training for woodveneer classification Eng. Appl. Artif. Intell. 22 4-5 2009 732 741
9. Chalup, S.; Maire, F.; 1999. A study on hill climbing algorithms for neural network training. In: Proceedings of the Congress on Evolutionary Computation (CEC99), 6-9 July, Washington, DC, USA, 3, 2014-2021.
10. Chen, X.;Wang, J.; Sun, D.; Liang J.; 2008.A novel hybrid Evolutionary Algorithm based on PSO and AFSA for feedforward neural network training. 4th International Conference on Wireless Communications, Networking and Mobile Computing (WiCOM), 12-14 October, Dalian, China, 1-5.
11. M. Clerc, and J. Kennedy The particle swarm: explosion, stability, and convergence in a multi-dimensional complex space IEEE Trans. Evol. Comput. 6 2002 58 73
12. A.P. Engelbrecht, and F.V.D. Bergh Cooperative learning in Neural Networks using particle swarm optimizers S. Afr. Comput. J. 26 2000 84 90
13. N. Friedman Bayesian network classifiers Mach. Learn. 29 1997 131 163
14. V.G. Gudise, and G.K. Venayagamoorthy Comparison of particle Swarm optimization and backpropagation as training algorithms for neural networks Proc. IEEE Swarm. Intell. Symp. 24-26 2003 110 117 April
15. Han, L.; He X.; 2007. A novel opposition-based particle swarm optimization for noisy problems. IEEE 3th International Conference on Natural Computation (ICNC2007), Hiakou, Hainan, China, 3, 624-629.
16. M.M. Islam, M.A. Sattar, M.F. Amin, X. Yao, and K. Murase A new adaptive merging and growing algorithm for designing artificial neural networks IEEE Trans. Syst. Manage. Cybernet.; Part B: Cybern. 39 3 2009 705 772
17. Karaboga,D.; Akay,B.;Ozturk, C.;2007 Artificial Bee Colony (ABC) optimization algorithm for training feed-forward neural networks. Proceedings of the 4th International Conference on Modeling Decisions for Artificial Intelligence (MDAI'07), 16-18 August, Kitakyushu, Japan, 318-329.
18. Kennedy, J.; Eberhart, R.; 1995. Particle swarm optimization. IEEE International Conference on Neural Networks, 27 November-1 December, 4, 1942-1948.
19. S. Kiranyaz, T. Ince, A. Yildirim, and M. Gabbouj Evolutionary Artificial Neural Networks by multi-dimensional Particle Swarm Optimization Neural Networks 22 10 2009 1448 1462
20. Malinak, P.; Jaksa, R.; 2007. Simultaneous gradient and evolutionary Neural Network weights adaptation methods. IEEE Congress on Evolutionary Computation (CEC), 25-28 Steptember, Singapore, Maylisa, 2665-2671.
21. M. Mandischer A comparison of evolution strategies and backpropagation for neural network training Neurocomputing. 42 1-4 2002 87 117
22. Mendes, R.; Cortez, P.; Rocha, M.; Neves, J.; 2002. Particle swarm for feedforward Neural Network Training. IEEE International Joint Conference on Neural Networks (IJCNN02), 12-17 May, Honolulu, HI, USA, 1895-1899.
23. Omran, M.G.H.; 2009. Using Opposition-based Learning with Particle Swarm Optimization and Barebones Differential Evolution. Particle Swarm Optimization, InTech Education and Publishing, A. Lazinica (Ed), 373-384.
24. V.W. Porto, D.B. Fogel, and L.J. Fogel Alternative neural network training methods Int. Workshop databases Expert Syst. Appl. 10 3 1995 16 22
25. Parsopoulos, K.E.; Vrahatis, M.N.; 2010. Particle Swarm Optimization and Intelligence: Advances and Applications, information science reference.
26. Prechelt L.; 1994. PROBEN1-A set of neural network benchmark problems and benchmarking rules. Technical Report 21/94, Faculty Informatics, University of Karlsruhe, Karlsruhe, Germany.
27. L. Prechelt Automaticearly stopping using cross validation: quantifying the criteria Neural Networks 11 4 1998 761 767
28. L. Prechelt Some notes on neural learning algorithm benchmarking Neurocomputing 9 3 1995 343 347
29. L. Prechelt A quantitative study of experimental evaluations of neural network learning algorithms Neural Networks 9 3 1996 457 462
30. A. Ratnaweera, K. Saman, and H.C. Watson Self-organizing hierarchical particle swarm optimizer with time-varing acceleration coefficients IEEE Trans. Evol. Comput. 8 3 2004 240 255
31. R.S. Sexton, B. Alidaee, R.E. Dorsey, and J.D. Johnson Global optimization for artificial neural networks: a tabu search application Eur. J. Oper. Res. 106 2-3 1998 570 584
32. R.S. Sexton, and E.D. Dorsey Reliable classification using neural networks: a Genetic Algorithm and backpropagation comparison Decis. Support Syst. 30 2000 11 22
33. E.-G. Talbi Metaheuristic: From Design to Implementation, University of Lille 2009 John Wiley and Sons
34. Tizhoosh H.R.; 2005. Opposition-based learning: a new scheme for machine intelligence. International Conference Computational Intelligence Modeling Control and Automation, 28-30 November, Vienna, Austria, Vol. 1, 695-701.
35. N.K. Treadgold, and T.D. Gedeon Simulated annealing and weight decay in adaptive learning: the SARPROP algorithm IEEE Trans. Neural Networks 9 4 1998 662 668
36. UCI Repository of machine learning databases Department of Information and Computer Science 2011 University of California Irvine
37. G.C. Vosniakos, and P.G. Benardos Optimizing feedforward Artificial Neural Network Architecture Eng. Appl. Artif. Intell. 20 3 2007 365 382
38. Wu, Z.; Ni, Z.; Zhang, C.; Gu, L.; 2008. Opposition based comprehensive learning Particle Swarm Optimization. 3th International Conference on Intelligent System and Knowledge Engineering (ISKE), 17-19 November, 2, 1013-1019.
39. Yaghini, M.; Khoshraftar, M.M.; Fallahi, M.; 2011. HIOPGA: a new hybrid metaheuristic algorithm to train feedforward Neural Networks for Prediction. The 7th International Conference on Data Mining (DMIN'11), July 18-21, Las Vegas, NV, USA.
40. Yaghini, M.; Khoshraftar, M.M.; Seyedabadi, M. Railway passenger train delay prediction via neural network model. J. Adv. Transp. doi: 10.1002/atr.193, in press.
41. X. Yao Evolving Artificial Neural Network Proc. IEEE. 87 9 1999 1423 1447
42. J. Yu, S. Wang, and L. Xi Evolving Artificial Neural Networks using an improved PSO and DPSO Neurocomputing 71 4-6 2008 1054 1060
43. Zaho, F.; Ren, Z.; Yu, D.; Yang, Y.; 2005. Application of an improved particle swarm optimization algorithm for Neural Network training. International Conference on Neural Networks and Brain (ICNN&B05), 13-15 October, Beijing, China, 3, 1639-1698.