Lambda-gamma learning with feedforward neural networks using particle swarm optimization

IEEE SSCI 2011 - Symposium Series on Computational Intelligence - SIS 2011: 2011 IEEE Symposium on Swarm Intelligence

Volumn , Issue , 2011, Pages 52-59

  Van Wyk, Andrich B ^a   Engelbrecht, Andries P ^a  

^a UNIVERSITY OF PRETORIA   (South Africa)

Author keywords

[No Author keywords available]

Indexed keywords

ACTIVATION FUNCTIONS; ADAPTIVE ACTIVATION FUNCTION; BACKPROPAGATION LEARNING ALGORITHM; DATA SETS; GENERALIZATION PERFORMANCE; GRADIENT BASED; INPUT DATAS; OUTPUT RANGE; OVERFITTING; PARTICLE SWARM OPTIMIZATION ALGORITHM; PSO ALGORITHMS; SIGMOID ACTIVATION FUNCTION; SIGMOID FUNCTION; TRAINING ACCURACY;

ARTIFICIAL INTELLIGENCE; BACKPROPAGATION ALGORITHMS; CELLULAR AUTOMATA; CLASSIFICATION (OF INFORMATION); FEEDFORWARD NEURAL NETWORKS; INPUT OUTPUT PROGRAMS; LEARNING ALGORITHMS;

PARTICLE SWARM OPTIMIZATION (PSO);

EID: 79961141353     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SIS.2011.5952561     Document Type: Conference Paper

References (23)

1. A. Asuncion and D.J. Newman. UCI machine learning repository. http://archive.ics.uci.edu/ml/index.html, November 2009. Accessed 4/11/2009 16:48 SAST.
2. Y Davidor. Epistasis variance: A viewpoint on GA-hardness. Foundations of genetic algorithms, 1:23-35, 1991.
3. R. Eberhart and J. Kennedy. A new optimizer using particle swarm theory. In Micro Machine and Human Science, 1995. MHS '95., Proceedings of the Sixth International Symposium on, pages 39-43, 1995.
4. R. Eberhart, P. K. Simpson, and R. W. Dobbins. Computational Intelligence PC Tools. Academic Press Professional, 1996.
5. R.C. Eberhart and Y. Shi. Comparing inertia weights and constriction factors in particle swarm optimization. In Evolutionary Computation, 2000. Proceedings of the 2000 Congress on, volume 1, pages 84-88 vol.1, 2000.
6. A. P. Engelbrecht. Computational Intelligence: An Introduction. Wiley, second edition, 2007.
7. A. P. Engelbrecht, I. Cloete, J. Geldenhuys, and J. Zurada. Automatic scaling using gamma learning for feedforward neural networks. In IWANN '96: Proceedings of the International Workshop on Artificial Neural Networks, pages 374-381. Springer-Verlag, 1995.
8. N. Franken. Visual exploration of algorithm parameter space. In Evolutionary Computation, 2009. CEC'09. IEEE Congress on, pages 389-398. IEEE, 2009.
9. N. Franken and A. P. Engelbrecht. Comparing PSO structures to learn the game of checkers from zero knowledge. In Evolutionary Computation, 2003. CEC '03. The 2003 Congress on, volume 1, pages 234-241 Vol.1, 2003.
10. A. Ismail and A. P. Engelbrecht. Global optimization algorithms for training product unit neural networks. In Neural Networks, 2000. IJCNN 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on, volume 1, pages 132-137, 2000.
11. J. Kennedy. The particle swarm: social adaptation of knowledge. In Evolutionary Computation, 1997., IEEE International Conference on, pages 303-308, 1997.
12. J. Kennedy and R. Mendes. Population structure and particle swarm performance. In Evolutionary Computation, 2002. CEC '02. Proceedings of the 2002 Congress on, volume 2, pages 1671-1676, 2002.
13. Y. LeCun, L. Bottou, G. Orr, and K. Müller. Efficient backprop. Neural networks: Tricks of the trade, pages 546-546, 1998.
14. R. Mendes, P. Cortez, M. Rocha, and J. Neves. Particle swarms for feedforward neural network training. in Proc. Int. Joint Conf. Neural Networks, pages 1895-1899, 2002. (Pubitemid 34647919)
15. National Geophysical Data Center. NGDC/WDC STP, Boulder-Sunspot Number Data via FTP from NGDC. http://www.ngdc.noaa.gov/stp/SOLAR/ftpsunspotnumber. html, November 2009. Accessed 4/11/2009 18:06 SAST.
16. John Platt. A Resource-Allocating network for function interpolation. Neural Computation, 3(2):213-225, June 1991.
17. R. Salomon. Re-evaluating genetic algorithm performance under coordinate rotation of benchmark functions. A survey of some theoretical and practical aspects of genetic algorithms. BioSystems, 39(3):263-278, 1996. (Pubitemid 26332073)
18. M Shanker, M Y Hu, and M S Hung. Effect of data standardization on neural network training. Omega, 24(4):385-397, 1996. (Pubitemid 126162339)
19. Y. Shi and R. Eberhart. A modified particle swarm optimizer. In Evolutionary Computation Proceedings, 1998. IEEE World Congress on Computational Intelligence., The 1998 IEEE International Conference on, pages 69-73, May 1998.
20. F. van den Bergh. An Analysis of Particle Swarm Optimizers. PhD thesis, Department of Computer Science, University of Pretoria, Pretoria, South Africa, 2002.
21. Andrich B van Wyk and Andries P Engelbrecht. Overfitting by PSO trained feedforward neural networks. In Evolutionary Computation (CEC), 2010 IEEE Congress on, pages 1-8, 2010.
22. L. F. A. Wessels and E. Barnard. Avoiding false local minima by proper initialization of connections. IEEE transactions on neural networks, 3(6):899-905, 1992. (Pubitemid 23580842)
23. J M Zurada. Lambda learning rule for feedforward neural networks. In IEEE International Conference on Neural Networks, 1993., pages 1808-1811, 1993.