Comparing error minimized extreme learning machines and support vector sequential feed-forward neural networks

Neural Networks

Volumn 25, Issue , 2012, Pages 122-129

  Romero, Enrique ^a   Alquézar, René ^a  

^a UNIVERSITAT POLITÈCNICA DE CATALUNYA   (Spain)

Author keywords

Error minimized extreme learning machines; Sequential approximations; Support vector sequential feed forward neural networks

Indexed keywords

BENCH-MARK PROBLEMS; BENCHMARK CLASSIFICATION; COMPUTATIONAL COSTS; DATA SETS; EXPERIMENTAL STUDIES; EXTREME LEARNING MACHINE; FEED-FORWARD NETWORK; GENERALIZATION PERFORMANCE; OPTIMAL COEFFICIENT; RANDOM HIDDEN NODES; SEQUENTIAL APPROXIMATION; SUM OF SQUARES; SUPPORT VECTOR; TRAINING SETS;

CLASSIFICATION (OF INFORMATION); IMAGE QUALITY; LEARNING SYSTEMS; OPTIMIZATION;

NEURAL NETWORKS;

ALGORITHM; ARTICLE; CALCULATION; CONTROLLED STUDY; ERROR MINIMIZED EXTREME MACHINE LEARNING; EXPERIMENTAL STUDY; MACHINE LEARNING; MEASUREMENT ERROR; METHODOLOGY; PRIORITY JOURNAL; SEQUENTIAL APPROXIMATION WITH OPTIMAL COEFFICIENTS AND INTERACTING FREQUENCIES METHOD; SINGLE HIDDEN LAYER FEED FORWARD NETWORK; SUPPORT VECTOR MACHINE; SUPPORT VECTOR SEQUENTIAL FEED FORWARD NEURAL NETWORK;

ARTIFICIAL INTELLIGENCE; NEURAL NETWORKS (COMPUTER); RANDOM ALLOCATION; RESEARCH DESIGN; SUPPORT VECTOR MACHINES;

EID: 82355175771     PISSN: 08936080     EISSN: 18792782     Source Type: Journal    
DOI: 10.1016/j.neunet.2011.08.005     Document Type: Article

References (22)

1. Asuncion, A., & Newman, D. J. (2007). UCI machine learning repository. University of California, Irvine, School of Information and Computer Science. http://www.ics.uci.edu/~mlearn/MLRepository.html.
2. Bishop C.M. Neural networks for pattern recognition 1995, Oxford University Press Inc, New York.
3. Chen S., Cowan C.F.N., Grant P.M. Orthogonal least squares learning algorithm for radial basis function networks. IEEE Transactions on Neural Networks 1991, 2:302-309.
4. Feng G., Huang G.B., Lin Q., Gay R. Error minimized extreme learning machine with growth of hidden nodes and incremental learning. IEEE Transactions on Neural Networks 2009, 20:1352-1357.
5. Huang G.B., Chen L., Siew C.K. Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Transactions on Neural Networks 2006, 17:879-892.
6. Huang G.B., Zhu Q.Y., Siew C.K. Extreme learning machine: theory and applications. Neurocomputing 2006, 70:489-501.
7. Keerthi S.S., Chapelle O., DeCoste D. Building support vector machines with reduced classifier complexity. Journal of Machine Learning Research 2006, 7:1493-1515.
8. Kwok T.Y., Yeung D.Y. Constructive algorithms for structure learning in feedforward neural networks for regression problems. IEEE Transactions on Neural Networks 1997, 8:630-645.
9. Liang N.Y., Huang G.B., Saratchandran P., Sundararajan N. A fast and accurate online sequential learning algorithm for feedforward networks. IEEE Transactions on Neural Networks 2006, 17:1411-1423.
10. Liu N.L., Wang H. Ensemble based extreme learning machine. IEEE Signal Processing Letters 2010, 17:754-757.
11. Miche Y., Sorjamaa A., Bas P., Simula O., Jutten C., Lendasse A. OP-ELM: optimally pruned extreme learning machine. IEEE Transactions on Neural Networks 2010, 21:158-162.
12. Platt J. A resource-allocating network for function interpolation. Neural Computation 1991, 3:213-225.
13. Plutowski M., Cottrell G., White H. Experience with selecting exemplars from clean data. Neural Networks 1996, 9:273-294.
14. Romero E., Alquézar R. A new incremental method for function approximation using feed-forward neural networks. International joint conference on neural networks 2002, Vol. 2:1968-1973.
15. Romero E., Alquézar R. A sequential algorithm for feed-forward neural networks with optimal coefficients and interacting frequencies. Neurocomputing 2006, 69:1540-1552.
16. Romero E., Toppo D. Comparing support vector machines and feed-forward neural networks with similar hidden-layer weights. IEEE Transactions on Neural Networks 2007, 18:959-963.
17. Smola, A. J., & Schölkopf, B. (2000). Sparse greedy matrix approximation for machine learning. In International conference on machine learning (pp. 911-918).
18. Van Gestel T., Suykens B., Baesens J.A.K., Viane S., Vanthienen J., Ded ene G., et al. Benchmarking least squares support vector machine classifiers. Machine Learning 2004, 54:5-32.
19. Vapnik V.N. The nature of statistical learning theory 1995, Springer-Verlag, NY.
20. Vincent P., Bengio Y. Kernel matching pursuit. Machine Learning 2002, 48:165-187. (special issue).
21. Yingwei L., Sundararajan N., Saratchandran P. A sequential learning scheme for function approximation using minimal radial basis function neural networks. Neural Computation 1997, 9:461-478.
22. Yu, Y., Zhou, Z. H., & Ting, K. M. (2007). Cocktail ensemble for regression. In International conference on data mining (pp. 721-726).