Back-propagation vs particle swarm optimization algorithm: Which algorithm is better to adjust the synaptic weights of a feed-forward ANN?

International Journal of Artificial Intelligence

Volumn 7, Issue 11 A, 2011, Pages 208-218

  Garro, Beatriz A ^a   Sossa, Humberto ^a   Vázquez, Roberto A ^b  

^a INSTITUTO POLITÉCNICO NACIONAL   (Mexico)

^b UNIVERSIDAD LA SALLE   (Mexico)

Author keywords

Artificial neural networks; Particle swarm intelligence; Pattern recognition

Indexed keywords

EID: 80052161867     PISSN: 09740635     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (22)

1. Anderson, J. A., 1995, Introduction to Neural Networks, Cambridge, MA: MIT Press, 1995.
2. Castillo, P. A., Carpio, J., Merelo, J. J., Prieto, A. and Rivas, V., 2000, Evolving multilayer perceptrons, Neural Processing Letters, 12(2), 115-127.
3. Chatterjee, A., Pulasinghe, K., Watanabe, K. and Izumi, K., 2005, A particle swarm optimized fuzzyneural network for voice controlled robot systems, IEEE Transactions on Industrial Electronics, 52(6), 1478-489.
4. Chau, K. W., 2007, Application of a PSO-based neural network in analysis of outcomes of construction claims, Automation in Construction, 16, 642-646.
5. Da, Y. and Ge, X. R., 2005, An improved PSO-based ANN with simulated annealing technique, Neurocomputing Letters, 63(2), 527-533.
6. Garro, B. A., Sossa, H. and Vazquez, R. A., 2009, Design of artificial neural networks using a modified particle swarm optimization algorithm, Proceedings of IEEE International Joint Conference on Neural Networks (IJCNN'09), Atlanta, GA, USA, 938-945.
7. Garro, B. A., Sossa H. and Vazquez, R. A., 2010, Back-propagation vs particle swarm optimization algorithm: which algorithm is better to adjust the synaptic weights of a feed-forward ANN? Presented at the International Conference on Swarm Intelligence (ICSI 2010), Beijing, China.
8. Gudise, V. G. and Venayagamoorthy, G. K., 2003, Comparison of particle swarm optimization and backpropagation as training algorithms for neural networks, Proceedings of IEEE Swarm Intelligence Symposium (SIS'03), Indianapolis, IN, USA, 110-117.
9. Hu, M. K., 1962, Visual pattern recognition by moment invariants, IRE Transactions on Information Theory, 8(2), 179-187.
10. Jain, R. et al., 1995, Machine Vision, McGraw-Hill.
11. Kennedy, J., Eberhart, R. C. And Shi, Y., 2001, Swarm Intelligence, Morgan Kaufmann Publishers.
12. Mohaghegi, S., del Valle, Y., Venayagamoorthy, G. K. and Harley, R.G., 2005, A comparison of PSO and backpropagation for training RBF neural networks for identification of a power system with STATCOM, Proceedings IEEE Swarm Intelligence Symposium (SIS 2005), Pasadena, CA, USA, 381-384.
13. Murphy, P. M. and D. Aha, W., 1994, UCI repository of machine learning databases, Dept. Inf. Comput. Sci., Univ. California, Irvine, CA, USA.
14. Otsu, N., 1979, A threshold selection method from gray-level histograms, IEEE Transactions on Systems, Man, and Cybernetics, 9(1), 62-66.
15. Rivero, D., Rubañal, J., Dorado, J. and Pazos, A., 2007, Automatic design of ANN by means of GP for data mining tasks: iris flower classification, Lecture Notes in Computer Sciences, 4431, 276-285.
16. Rumelhart, D. E, Hinton, G. E. and Williams, R. J., 1986, Learning internal representations and error propagation, in Rumelhart, D. E. and McCleland, J. L. (Eds.), Parallel distributed processing: explorations in the microstructure of cognition (Cambridge, MA: MIT Press), 1, 354-362.
17. Tejen, S., Jyunwei, J. and Chengchih, H., 2008, A hybrid artificial neural networks and particle swarm optimization for function approximation, International Journal of Innovative Computing, Information and Control, 4(9), 2363-2374.
18. th Parallel and Distributed Processing Symposium, Santa Fe, NM, USA, 194-194.
19. Werbos, P. J., 1990, Backpropagation through time: What it does and how to do it, Proceedings of IEEE, 78(10), 1550-1560.
20. Yang, J. M. and Kao, C. Y., 2001, A robust evolutionary algorithm for training neural networks, Neural Computing and Applications, 10(4), 214-230.
21. Yu, J., Xiand, L. and Wang, S., 2007, An improved particle swarm optimization for evolving feedforward artificial neural networks, Neural Processing Letters, 26(3), 217-231.
22. Zhao, L. and Yang, Y., 2009, PSO-based single multiplicative neuron model for time series prediction, Expert Systems with Applications, 36(2), 2805-2812.