Research on extreme learning of neural networks

Jisuanji Xuebao/Chinese Journal of Computers

Volumn 33, Issue 2, 2010, Pages 279-287

  Deng, Wan Yu ^a   Zheng, Qing Hua ^a   Chen, Lin ^b   Xu, Xue Bin ^a  

^a XI'AN JIAOTONG UNIVERSITY   (China)

^b XI AN UNIVERSITY OF POSTS AND TELECOMMUNICATIONS   (China)

Author keywords

Extreme learning machine; Least square; Neural network; Regularized extreme learning machine; Structural risk; Support vector machine

Indexed keywords

AUTOMATIC CONTROL; EXTREME LEARNING MACHINE; GRADIENT DESCENT; HIDDEN LAYERS; LEAST SQUARE; LOCAL MINIMUMS; MULTIPLE ITERATIONS; NETWORK PARAMETERS; NOVEL ALGORITHM; NUMBER OF ITERATIONS; REGULARIZED EXTREME LEARNING MACHINE; SEARCHING SPACES; STRUCTURAL RISK; STRUCTURAL RISK MINIMIZATION; TRADITIONAL LEARNING; WEIGHTED LEAST SQUARES;

AUTOMATION; COMPUTATIONAL COMPLEXITY; CONTROL; LEARNING ALGORITHMS; PATTERN RECOGNITION; SUPPORT VECTOR MACHINES;

NEURAL NETWORKS;

EID: 77950553517     PISSN: 02544164     EISSN: None     Source Type: Journal    
DOI: 10.3724/SP.J.1016.2010.00279     Document Type: Article

References (18)

1. Hornik K. Approximation capabilities of multilayer feedforward networks. Neural Networks, 1991, 4(2): 251-257.
2. Leshno M, Lin V Y, Pinkus A, Schocken S. Multilayer feedforward networks with a nonpolynomial activation function can approximate any function. Neural Networks, 1993, 6(6): 861-867.
3. Huang G-B, Babri H A. Upper bounds on the number of hidden neurons in feedforward networks with arbitrary bounded nonlinear activation functions. IEEE Transactions on Neural Networks, 1998, 9(1): 224-229.
4. Huang G-B. Learning capability and storage capacity of two hidden-layer feedforward networks. IEEE Transactions on Neural Networks, 2003, 14(2): 274-281.
5. Huang G-B, Zhu Q-Y, Siew C-K. Extreme learning machine: Theory and applications. Neurocomputing, 2006, 70(1-3): 489-501.
6. Vapnik V N. The Nature of Statistical Learning Theory. New York: Springer, 1995.
7. Rousseeuw P J, Leroy A. Robust Regression and Outlier Detection. New York: Wiley, 1987.
8. Rumelhart D E, McClelland J L. Parallel Distributed Processing. Cambridge: MIT Press, 1986, 1(2): 125-187.
9. Cristianini N, Shawe-Taylor J. An Introduction to Support Vector Machines. Cambridge: Cambridge University Press, 2000.
10. Tamura S, Tateishi M. Capabilities of a four-layered feedforward neural network: Four layers versus three. IEEE Transactions on Neural Networks, 1997, 8(2): 251-255.
11. Haykin S. Neural Networks: A Comprehensive Foundation. New Jersey: Prentice Hall, 1999.
12. Deng Nai-Yang, Tian Ying-Jie. A New Method of Data Mining-Support Vector Machine. Beijing: Science Press, 2004(in Chinese).
13. Zhang Xue-Gong. Introduction to statistical learning theory and support vector machines. Acta Automatica Sinica, 2000, 26(1): 32-42(in Chinese).
14. David H A. Early sample measures of variability. Statistical Science, 1998, 13(4): 368-377.
15. Suykens J A K, De Brabanter J, Lukas L, Vandewaile J. Weighted least squares support vector machines: Robustness and sparse approximation. Neurocomputing, 2002, 48(1): 85-105.
16. Hsu C-W, Lin C-J. A comparison of methods for multiclass support vector machines. IEEE Transactions on Neural Networks, 2002, 13(2): 415-425.
17. Collobert R, Bengio S, Bengio Y. A parallel mixtures of SVMs for very large scale problems. Neural Computation, 2002, 14(5): 1105-1114.
18. Keerthi S S, Shevade S K. SMO algorithm for least squares SVM formulations. Neural Computation, 2003, 15(2): 487-507.