Improved particle swarm optimization combined with backpropagation for feedforward neural networks

International Journal of Intelligent Systems

Volumn 28, Issue 3, 2013, Pages 271-288

  Han, Fei ^a   Zhu, Jian Sheng ^a  

^a JIANGSU UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

BENCHMARK CLASSIFICATION; CONVERGENCE PERFORMANCE; FASTER CONVERGENCE; FUNCTION APPROXIMATION; GLOBAL SEARCH ABILITY; GRADIENT DESCENT METHOD; HYBRID ALGORITHMS; HYBRID METHOD; LOCAL MINIMUMS; LOCAL SEARCH METHOD; MIXED PHASE; MUTATION OPERATIONS; PREMATURE CONVERGENCE;

FEEDFORWARD NEURAL NETWORKS; PARTICLE SWARM OPTIMIZATION (PSO);

BACKPROPAGATION ALGORITHMS;

EID: 84872909654     PISSN: 08848173     EISSN: 1098111X     Source Type: Journal    
DOI: 10.1002/int.21569     Document Type: Article

References (35)

1. Wang SN, Huang XL,. A neural network of smooth hinge functions. IEEE Trans Neural Netw 2010; 21: 1381-1395.
2. Hou MZ, Han XL,. Constructive approximation to multivariate function by decay RBF neural network. IEEE Trans Neural Netw 2010; 21: 1517-1523.
3. Francesco P, Ugo F,. A nonlinear, recurrence-based approach to traffic classification. Comput Netw 2009; 53: 761-773.
4. Ozawa S, Roy A, Roussinov D,. A multitask learning model for online pattern recognition. IEEE Trans Neural Netw 2009; 20: 430-445.
5. Bandyopadhyay S, Saha S, Maulik U, Deb K,. A simulated annealing-based multiobjective optimization algorithm. IEEE Trans Evol Comput 2008; 12: 269-283.
6. Kabeya S, Abe T, Saito T., A GA-based flexible learning algorithm with error tolerance for digital binary neural networks. Neural Netw 2009; 14: 1476-1480.
7. He C, Ye Y., Evolution computation based learning algorithms of polygonal fuzzy neural networks. Int J Intell Syst 2011; 26 (4): 340-352.
8. del Valle Y, Venayagamoorthy GK, Mohagheghi S,. Particle swarm optimization: basic concepts, variants and applications in power systems. IEEE Trans Evol Comput 2008; 12: 171-195.
9. Kapp MN, Sabourin R, Maupin P,. A dynamic optimization approach for adaptive incremental learning. Int J Intell Syst 2011; 26 (11): 1101-1124.
10. Andre G., Elman backpropagation as reinforcement for simple recurrent networks. Neural Comput 2007; 19: 3108-3131.
11. Huang G-B, Chen L,. Convex incremental extreme learning machine. Neurocomputing 2007; 70 (16-18): 3056-3062.
12. Huang G-B, Zhu Q-Y, Siew C-K., Extreme learning machine: theory and applications. Neurocomputing 2006; 70 (1-3): 489-501.
13. Dai Q, Chen SC., Integrating the improved CBP model with kernel SOM. Neurocomputing 2006; 69: 2208-2216.
14. Takahumi O, Hidenori N, Kazuhisa W., A new backpropagation learning algorithm for layered neural netwroks with nondifferentiable units. Neural Comput 2007; 19: 1422-1435.
15. Wang XZ, Zhang T, He L., Application of fuzzy adaptive back-propagation neural network in thermal conductivity gas analyzer. Neurocomputing 2010; 73: 679-683.
16. Kennedy J, Eberhart RC., Particle swarm optimization. IEEE Int Conf Neural Netw 1995; 4: 1942-948.
17. Grosan C, Abraham A,. A novel global optimization technique for high dimensional functions. Int J Intell Syst 2009; 24 (4): 421-440.
18. He S, Wu QH, Wen JY,. A particle swarm optimizer with passive congregation. Biosystems 2004; 78: 135-147.
19. Riget J, Vesterstrom JS., A diversity-guided particle swarm optimizer-the ARPSO. EVAlife Tech Report 2: 2002.
20. Shi Y, Eberhary RC., Fuzzy adaptive particle swarm optimization. Evol Comput 2001; 1: 101-106.
21. Noel MM., A new gradient based particle swarm optimization algorithm for accurate computation of global minimum. Appl Soft Comput 2012; 12 (1): 353-359.
22. Lin CJ, Hsieh MH., Classification of mental task from EEG data using neural networks based on particle swarm optimization. Neurocomputing 2009; 72: 1121-1130.
23. Yu JB, Wang SJ, Xi LF., Evolving artificial neural networks using an improved PSO and DPSO. Neurocomputing 2008; 71: 1054-1060.
24. Serkan K, Turker I, Alper Y, Moncerf G,. Evolutionary artificial neural networks by multi-dimensional particle swarm optimization. Neural Netw 2009; 22: 1448-1462.
25. Funahashi K., On the approximate realization of continuous mapping by neural networks. Neural Netw 1989; 2 (3): 183-192.
26. Hornik K, Stinchcombe M, White H., Multilayer feedforward networks are universal, approximators. Neural Netw 1989; 2 (5): 359-366.
27. Shi Y, Eberhart RC., A modified particle swarm optimizer. Comput Intell 1998; 6: 69-73.
28. Pant M, Radha T, Singh VP,. A simple diversity guided particle swarm optimization. In: IEEE Congress on Evolutionary Computation; 2007. pp 3294-3299.
29. Yang GY,. A modified particle swarm optimizer algorithm. In: IEEE Int Conf on Electronic Measurement and Instruments; 2007. pp 2-675-2-679.
30. Cortes C, Vapnik V., Support-vector networks. Mach Learn 1995; 20: 273-297.
31. Fruend Y, Schapire RE., A decision-theoretic generalization of the on-line learning and an application to boosting. J Comput System Sci 1997; 55 (1): 119-139.
32. Paris S, A fast gentle adaboost classifier with two kind of weaklearners. Available at http://www.mathworks.com/matlabcentral/fileexchange/ 22997&watching=22997 (Accessed October 18, 2011).
33. Shi Y., Eberhart RC., Parameter selection in particle swarm optimization. In: Proc. 7th Annual Conf on Evolutionary Programming; 1998. pp 591-600.
34. Shi Y, Eberhart RC., Empirical study of particle swarm optimization. In: Proc 1999 Congress on Evolutionary Computation; 1999; pp 1945-1950.
35. Suganthan PN., Particle swarm optimiser with neighbourhood operator. In: Proc 1999 Congress on Evolutionary Computation.; 1999. pp 1958-1962.