Overfitting by PSO trained feedforward neural networks

2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010

Volumn , Issue , 2010, Pages

  Van Wyk, Andrich B ^a   Engelbrecht, Andries P ^a  

^a UNIVERSITY OF PRETORIA   (South Africa)

Author keywords

[No Author keywords available]

Indexed keywords

ACTIVATION FUNCTIONS; HIDDEN LAYERS; INFORMATION SHARING; OVERFITTING; TIME-SERIES REGRESSION; TRAINED NEURAL NETWORKS;

ARTIFICIAL INTELLIGENCE; EXPERIMENTS; NETWORK LAYERS; PARTICLE SWARM OPTIMIZATION (PSO); TIME SERIES; TOPOLOGY;

FEEDFORWARD NEURAL NETWORKS;

EID: 79959439480     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CEC.2010.5586333     Document Type: Conference Paper

References (23)

1. A. Asuncion and D.J. Newman. UCI machine learning repository. http://archive.ics.uci.edu/ml/index.html, November 2009. Accessed 4/11/2009 16:48 SAST.
2. M. Clerc and J. Kennedy. The particle swarm - explosion, stability, and convergence in a multidimensional complex space. Evolutionary Computation, IEEE Transactions on, 6(1):58-73, Feb 2002. (Pubitemid 34404564)
3. D. Corne, M. Dorigo, and F. Glover. New Ideas in Optimization. McGraw-Hill, 1999.
4. R. Eberhart and J. Kennedy. A new optimizer using particle swarm theory. In Micro Machine and Human Science, 1995. MHS '95., Proceedings of the Sixth International Symposium on, pages 39-43, 1995.
5. R. Eberhart, Simpson P.K., and Dobbins R.W. Computational Intelligence PC Tools. Academic Press Professional, 1996.
6. R.C. Eberhart and Y. Shi. Comparing inertia weights and constriction factors in particle swarm optimization. In Evolutionary Computation, 2000. Proceedings of the 2000 Congress on, volume 1, pages 84-88 vol.1, 2000.
7. A. P. Engelbrecht. Computational Intelligence: An Introduction. Wiley, second edition, 2007.
8. N. Franken and A.P. Engelbrecht. Comparing PSO structures to learn the game of checkers from zero knowledge. In Evolutionary Computation, 2003. CEC '03. The 2003 Congress on, volume 1, pages 234-241 Vol.1, 2003.
9. A. Ismail and A.P. Engelbrecht. Global optimization algorithms for training product unit neural networks. In Neural Networks, 2000. IJCNN 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on, volume 1, pages 132-137 vol.1, 2000.
10. J. Kennedy. The particle swarm: social adaptation of knowledge. In Evolutionary Computation, 1997., IEEE International Conference on, pages 303-308, 1997.
11. J. Kennedy and R. Mendes. Population structure and particle swarm performance. In Evolutionary Computation, 2002. CEC '02. Proceedings of the 2002 Congress on, volume 2, pages 1671-1676, 2002.
12. T. Krink, J.S. Vesterstrom, and J. Riget. Particle swarm optimisation with spatial particle extension. In Evolutionary Computation, 2002. CEC '02. Proceedings of the 2002 Congress on, volume 2, pages 1474-1479, 2002.
13. R. Mendes, P. Cortez, M. Rocha, and J. Neves. Particle swarms for feedforward neural network training. In Neural Networks, 2002. IJCNN '02. Proceedings of the 2002 International Joint Conference on, volume 2, pages 1895-1899, 2002.
14. National Geophysical Data Center. NGDC/WDC STP, Boulder-Sunspot Number Data via FTP from NGDC. http://www.ngdc.noaa.gov/stp/SOLAR/ftpsunspotnumber. html, November 2009. Accessed 4/11/2009 18:06 SAST.
15. O. Olorunda and A.P. Engelbrecht. Measuring exploration/exploitation in particle swarms using swarm diversity. In Evolutionary Computation, 2008. CEC 2008. (IEEE World Congress on Computational Intelligence). IEEE Congress on, pages 1128-1134, 2008.
16. John Platt. A Resource-Allocating network for function interpolation. Neural Computation, 3(2):213-225, June 1991.
17. A. Röbel. The dynamic pattern selection algorithm: Effective training and controlled generalization of backpropagation neural networks. Technical report, Technische Universität Berlin, 1994.
18. Y. Shi and R. Eberhart. A modified particle swarm optimizer. In Evolutionary Computation Proceedings, 1998. IEEE World Congress on Computational Intelligence., The 1998 IEEE International Conference on, pages 69-73, may 1998.
19. F. van den Bergh. An Analysis of Particle Swarm Optimizers. PhD thesis, Department of Computer Science, University of Pretoria, Pretoria, South Africa, 2002.
20. F. van den Bergh and A. P. Engelbrecht. Particle swarm weight initialization in multi-layer perceptron artificial neural neural networks. In Artificial Intelligence. Proceedings of the International Conference on, pages 42-45, 1999.
21. F. van den Bergh and A. P. Engelbrecht. Cooperative learning in neural networks using particle swarm optimizers. South African Computer Journal, 26:84-90, 2000.
22. F. van den Bergh and A. P. Engelbrecht. Training product unit networks using cooperative particle swarm optimisers. In Neural Networks, 2001. Proceedings. IJCNN '01. International Joint Conference on, volume 1, pages 126-131, 2001.
23. F. van den Bergh and A. P. Engelbrecht. A new locally convergent particle swarm optimiser. In Systems, Man and Cybernetics, 2002 IEEE International Conference on, volume 3, page 6 pp. vol.3, 2002.