MELM-GRBF: A modified version of the extreme learning machine for generalized radial basis function neural networks

Neurocomputing

Volumn 74, Issue 16, 2011, Pages 2502-2510

  Fernández Navarro, Francisco ^a   Hervás Martínez, César ^a   Sanchez Monedero, Javier ^a   Gutiérrez, Pedro Antonio ^a  

^a UNIVERSITY OF CÓRDOBA   (Spain)

Author keywords

Extreme learning machine; Generalized Gaussian distribution; Generalized radial basis functions neural networks; Multi classification

Indexed keywords

ARTIFICIAL NEURAL NETWORK; BASIS FUNCTIONS; DATA SETS; EXPERIMENTAL STUDIES; EXTREME LEARNING MACHINE; GAUSSIAN RADIAL BASIS FUNCTIONS; GENERALIZED GAUSSIAN DISTRIBUTIONS; GENERALIZED RADIAL BASIS FUNCTIONS NEURAL NETWORKS; HIDDEN LAYERS; MODEL PARAMETERS; MULTI-CLASS PROBLEMS; MULTI-CLASSIFICATION; NEW MODEL; NEW PARAMETERS; RADIAL BASIS FUNCTION NEURAL NETWORKS; RADIAL BASIS FUNCTIONS; TRAINING SETS; UCI REPOSITORY;

CHAOS THEORY; GAUSSIAN DISTRIBUTION; IMAGE SEGMENTATION; LEARNING SYSTEMS; NEURAL NETWORKS;

RADIAL BASIS FUNCTION NETWORKS;

ACCURACY; ARTICLE; CLASSIFICATION ALGORITHM; CONTROLLED STUDY; EXTREME LEARNING MACHINE; GENERALIZED RADIAL BASIS FUNCTION; MACHINE LEARNING; MATHEMATICAL COMPUTING; MODIFIED EXTREME LEARNING MACHINE GENERALIZED RADIAL BASIS FUNCTION; NORMAL DISTRIBUTION; PRIORITY JOURNAL; RADIAL BASED FUNCTION;

EID: 80955178270     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2010.11.032     Document Type: Article

References (37)

1. G.B. Huang, C. Slew, Extreme learning machine: RBF network case, in: 8th International Conference on Control, Automation, Robotics and Vision (ICARCV), vol. 2, 2004, pp. 1029-1036.
2. Park J., Sandberg I.W. Approximation and radial-basis-function networks. Neural Computation 1993, 5(2):305-316.
3. Bishop C.M. Neural Networks for Pattern Recognition 1996, Oxford University Press, Oxford, UK.
4. Bishop C.M. Improving the generalization properties of radial basis function neural networks. Neural Computation 1991, 3(4):579-581.
5. Manrique D., Ríos J., Rodríguez-Patón A. Evolutionary system for automatically constructing and adapting radial basis function networks. Neurocomputing 2006, 69(16-18):2268-2283.
6. Staiano A., Tagliaferri R., Pedrycz W. Improving RBF networks performance in regression tasks by means of a supervised fuzzy clustering. Neurocomputing 2006, 69(13-15):1570-1581.
7. Yeh I.C., Cheng W. First and second order sensitivity analysis of MLP. Neurocomputing 2010, 73(10-12):2225-2233.
8. Martínez-Estudillo F.J., Hervás-Martínez C., Gutiérrez P.A., Martínez-Estudillo A.C. Evolutionary product-unit neural networks classifiers. Neurocomputing 2008, 72(1-2):548-561.
9. Martínez-Estudillo A.C., Martínez-Estudillo F.J., Hervás-Martínez C., García N. Evolutionary product unit based neural networks for regression. Neural Networks 2006, 19(4):477-486.
10. Gutiérrez P.A., Hervás-Martínez C., Carbonero M., Fernández J.C. Combined projection and kernel basis functions for classification in evolutionary neural networks. Neurocomputing 2009, 72(13-15):2731-2742.
11. Z. Uykan, C. Guzelis, Input-output clustering for determining centers of radial basis function network, in: Proceedings of the 1997 European Conference on Circuit Theory and Design, vol. 2, Technical University of Budapest, European Circuit Society, Hungary, 1997, pp. 435-439.
12. M. Vogt, Combination of radial basis function neural networks with optimized learning vector quantization, in: Proceedings of IEEE International Conference on Neural Networks (ICNN), vol. 3, San Francisco, CA, 1993, pp. 1841-1846.
13. Xu L. RBF nets, mixture experts, and Bayesian Ying-Yang learning. Neurocomputing 1998, 19(1-3):223-257.
14. Bugmann G. Normalized Gaussian radial basis function networks. Neurocomputing 1998, 20(1-3):97-110.
15. LeCun Y., Bottou L., Bengio Y., Haffner P. Gradient-based learning applied to document recognition. Intelligent Signal Processing 2001, 306-351. IEEE Press.
16. Ventresca M., Tizhoosh H.R. Improving gradient-based learning algorithms for large scale feedforward networks. IJCNN'09: Proceedings of the 2009 International Joint Conference on Neural Networks 2009, 1529-1536. IEEE Press, Piscataway, NJ, USA.
17. Huang G.B., Zhu Q., Siew C. Extreme learning machine: theory and applications. Neurocomputing 2006, 70(1-3):489-501.
18. Huang G.B., Chen L. Enhanced random search based incremental extreme learning machine. Neurocomputing 2008, 71(16-18):3460-3468.
19. Lan Y., Soh Y.C., Huang G. Ensemble of online sequential extreme learning machine. Neurocomputing 2009, 72(13-15):3391-3395.
20. Feng G., Huang G.B., Lin Q., Gay R. Error minimized extreme learning machine with growth of hidden nodes and incremental learning. IEEE Transactions on Neural Networks 2009, 20(8):1352-1357.
21. Cao J., Lin Z., Huang G.B. Composite function wavelet neural networks with extreme learning machine. Neurocomputing 2010, 73(7-9):1405-1416.
22. Scarselli F., Chung Tsoi A. Universal approximation using feedforward neural networks: a survey of some existing methods, and some new results. Neural Networks 1998, 11(1):15-37.
23. F. Fernández-Navarro, C. Hervás-Martínez, P.A. Gutierrez, M. Carboreno, Evolutionary q-gaussian radial basis functions neural networks for multi-classification, Neural Networks, in press. URL http://dx.doi.org/10.1016/j.neunet.2011.03.014.
24. Fernández-Navarro F., Hervás-Martínez C., Cruz M., Gutierrez P.A., Valero A. Evolutionary q-Gaussian radial basis function neural network to determine the microbial grow/thno growth interface of Staphylococcus aureus. Applied Soft Computing 2011, 11(3):3012-3020.
25. Chauvin Y., Rumelhart D.E. Backpropagation: Theory, Architectures, and Applications 1995, Lawrence Erlbaum Associates, Inc, Mahwah, NJ, USA.
26. Igel C., Hüsken M. Empirical evaluation of the improved Rprop learning algorithms. Neurocomputing 2003, 50(6):105-123.
27. G.B. Huang, Q.Y. Zhu, C.K. Siew, Extreme learning machine: a new learning scheme of feedforward neural networks, in: IEEE International Conference on Neural Networks-Conference Proceedings, vol. 2, 2004, pp. 985-990.
28. Park J., Sandberg I.W. Universal approximation using radial basis function networks. Neural Computation 1991, 3(2):246-257.
29. Haykin S. Neural Networks: A Comprehensive Foundation 2008, Prentice-Hall. third ed.
30. Moody J., Darken C. Fast learning in networks of locally-tuned processing units. Neural Computation 1989, 1(2):281-294.
31. Fernández-Navarro F., Valero A., Hervás-Martínez C., Gutíerrez P., García-Gimeno R., Zurera-Cosano G. Development of a multi-classification neural network model to determine the microbial growth/no growth interface. International Journal of Food Microbiology 2010, 141:203-212.
32. Fernández-Navarro F., Hervás-Martínez C., Gutíerrez P. A dynamic over-sampling procedure based on sensitivity for multi-class problems. Pattern Recognition 2011, 44(8):1821-1833. URL 〈http://dx.doi.org/10.1016/j.patcog.2011.02.019〉.
33. A. Asuncion, D. Newman, UCI Machine Learning Repository, 2007. URL http://www.ics.uci.edu/~mlearn/MLRepository.html.
34. Friedman M. A comparison of alternative tests of significance for the problem of mrankings. Annals of Mathematical Statistics 1940, 11(1):86-92.
35. Dunn O.J. Multiple comparisons among means. Journal of the American Statistical Association 1961, 56:52-56.
36. Hochberg Y., Tamhane A. Multiple Comparison Procedures 1987, John Wiley & Sons.
37. Huang G., Ding X., Zhou H. Optimization method based extreme learning machine for classification. Neurocomputing 2010, 74(1-3):155-163.