Constructive hidden nodes selection of extreme learning machine for regression

Neurocomputing

Volumn 73, Issue 16-18, 2010, Pages 3191-3199

  Lan, Yuan ^a   Soh, Yeng Chai ^a   Huang, Guang Bin ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Constructive method; Error minimized extreme learning machine; Extreme learning machine; Incremental extreme learning machine

Indexed keywords

CONSTRUCTIVE METHODS; EMPIRICAL STUDIES; EXTREME LEARNING MACHINE; HIDDEN NODES; INCREMENTAL EXTREME LEARNING MACHINE; LINEAR REGRESSION MODELS; MINIMUM VALUE; MODEL SELECTION; NETWORK STRUCTURES; NON-LINEARITY; OPTIMAL NUMBER; REGRESSION APPLICATIONS; RISK ESTIMATION;

ARCHITECTURAL DESIGN; BENCHMARKING; LINEAR REGRESSION; RISK PERCEPTION;

LEARNING SYSTEMS;

ACCURACY; ARTICLE; CONTROLLED STUDY; EXTREME LEARNING MACHINE; INTERMETHOD COMPARISON; LEARNING ALGORITHM; LINEAR REGRESSION ANALYSIS; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; PRIORITY JOURNAL; PROCESS DESIGN; QUALITY CONTROL; RISK BENEFIT ANALYSIS; VALIDATION PROCESS;

EID: 78650310346     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2010.05.022     Document Type: Article

References (29)

1. Huang G.-B., Zhu Q.-Y., Siew C.-K. Extreme learning machine: theory and applications. Neurocomputing 2006, 70:489-501.
2. G.-B. Huang, Q.-Y. Zhu, C.-K. Siew, Extreme learning machine: a new learning scheme of feedforward neural networks, in: Proceedings of International Joint Conference on Neural Networks, IJCNN'04, vol. 2, Budapest, Hungary, 25-29 July 2004, pp. 985-990.
3. Huang G.-B., Chen L., Siew C.-K. Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Transactions on Neural Networks 2006, 17(4):879-892.
4. Huang G.-B., Chen L. Enhanced random search based incremental extreme learning machine. Neurocomputing 2008, 71:3060-3068.
5. Huang G.-B., Chen L. Convex incremental extreme learning machine. Neurocomputing 2007, 70:3056-3062.
6. Haykin S. Neural Networks: A Comprehensive Foundation 1999, Prentice Hall, New Jersey.
7. Cortes C., Vapnik V. Support vector networks. Machine Learning 1995, 20:273-297.
8. E. Alpaydin, Gal: networks that grow when they learn and shrink when they forget, International Computer Science Institute, TR 91-032, USA, 1991.
9. Rong H.-J., Ong Y.-S., Tan A.-H., Zhu Z. A fast pruned-extreme learning machine for classification problem. Neurocomputing 2008, 72:359-366.
10. Miche Y., Sorjamaa A., Lendasse A. OP-ELM: theory, experiments and a toolbox. ICANN (1) of Lecture Notes in Computer Science 2008, vol. 5163:145-154. Springer.
11. T. Simila, J. Tikka, Multiresponse sparse regression with application to multidimensional scaling, in: Proceedings in Artificial Neural Networks: Fornal Models and Their Applications, ICANN 2005, vol. 3697, 2005, pp. 97-102.
12. Kwok T.-Y., Yeung D.-Y. Constructive algorithm for structure learning in feedforward neural networks for regression problems. IEEE Transactions on Neural Networks 1997, 8(3):630-645.
13. Feng G., Huang G.-B., Lin Q., Gay R. Error minimized extreme learning machine with growth of hidden nodes and incremental learning. IEEE Transactions on Neural Networks 2009, 20(8):1352-1357.
14. A. Asuncion, D. Newman, UCI machine learning repository. School of Information and Computer Sciences, University of California, Irvine, 2007. http://www.ics.uci.edu/mlearn/MLRepository.html.
15. Huang G.-B. Learning capability and storage capacity of two-hidden-layer feedforward networks. IEEE Transactions on Neural Networks 2003, 14(2):274-281.
16. Serre D. Matrices: Theory and Applications 2002, Springer-Verlag Inc, New York.
17. Hastie T., Tibshirani R., Friedman J. The elements of statistical learning: data mining, inference and prediction 2001, Springer Verlag, New York.
18. Weisberg S. Applied Linear Regression 1985, Wiley, New York.
19. Hocking R.R. The analysis and selection of variables in linear regression. Biometrics 1976, 32:1-49.
20. Chen S., Billings S.A., Luo W. Orthogonal least squares methods and their application to non-linear system identification. International Journal of Control 1989, 50(5):1873-1896.
21. Chen S., Cowan C.F.N., Grant P.M. Orthogonal least squares learning algorithm for radial basis function networks. IEEE Transactions on Neural Networks 1991, 2(2):302-309.
22. Chen S., Wigger J. Fast orthogonal least squares algorithm for efficient subset model selection. IEEE Transactions on Signal Processing 1995, 43(7):1713-1715.
23. Zhu Q.M., Billings S.A. Fast orthogonal identification of nonlinear stochastic models and radial basis function neural networks. International Journal of Control 1996, 64(5):871-886.
24. Sherstinsky A., Picard R.W. On the efficiency of the orthogonal least squares training method for radial basis function networks. IEEE Transactions on Neural Networks 1996, 7(1):195-200.
25. Efron B., Hastie T., Johnstone I., Tibshirani R. Least angle regression. Annals of Statistics 2004, 32:407-499.
26. Turlach B.A. Least angle regression: discussion. Annals of Statistics 2004, 32(2):481-490.
27. p. Technometrics 2000, 42(1):87-94.
28. Yan X., Su X.G. Linear Regression Analysis: Theory and Computing 2009, World Scientific Publishing Co. Pte. Ltd.
29. K. Li, G.-B. Huang, S.S. Ge, Fast construction of single hidden layer feedforward networks, in: G. Rozenberg, T.H.W. Bäck, J.N. Kok, (Eds.), Handbook of Natural Computing, Springer, April 2010, ISBN: 978-3-540-92909-3.