A study on residence error of training an extreme learning machine and its application to evolutionary algorithms

Neurocomputing

Volumn 146, Issue , 2014, Pages 75-82

  Fu, Ai Min ^a   Wang, Xi Zhao ^b   He, Yu Lin ^b   Wang, Lai Sheng ^a  

^a CHINA AGRICULTURAL UNIVERSITY   (China)

^b HEBEI UNIVERSITY   (China)

Author keywords

Extreme learning machine; Genetic algorithm; Rank of matrix; Residence error; Solution stability

Indexed keywords

ALGORITHMS; GENETIC ALGORITHMS; KNOWLEDGE ACQUISITION; LEARNING ALGORITHMS; MATRIX ALGEBRA;

EXTREME LEARNING MACHINE; HIDDEN LAYERS; INPUT MATRICES; ITS APPLICATIONS; RANK OF MATRIX; SIGMOID FUNCTION; SOLUTION STABILITY; STABILITY OF SOLUTIONS;

LEARNING SYSTEMS;

ANALYTICAL ERROR; ARTICLE; ARTIFICIAL NEURAL NETWORK; CALCULATION; DATA ANALYSIS; EVOLUTIONARY ALGORITHM; EXTREME LEARNING MACHINE; GENETIC ALGORITHM; LINEAR SYSTEM; MACHINE LEARNING; MATHEMATICAL COMPUTING; PRIORITY JOURNAL; ERROR; LEARNING ALGORITHM; PROBABILITY; PROCESS OPTIMIZATION; RESIDENCE ERROR;

EID: 84906946031     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2014.04.067     Document Type: Article

References (29)

1. Bartlett P.L. The sample complexity of pattern classification with neural networks: the size of the weights is more important than the size of the network. IEEE Trans. Inf. Theory 1998, 44(2):525-536.
2. Chacko B.P., Krishnan V.R.V., Raju G., Anto P.B. Handwritten character recognition using wavelet energy and extreme learning machine. Int. J. Mach. Learn. Cybern. 2012, 3(2):149-161.
3. T. Falas, A.G. Stafylopatis, The impact of the error function selection in neural network-based classifiers, in: Proceedings of the 1999 IEEE International Joint Conference on Neural Networks (IJCNN'99), 1999, pp. 1799-1804.
4. Feng G.R., Huang G.B., Lin Q.P., Gay R. Error minimized extreme learning machine with growth of hidden nodes and incremental learning. IEEE Trans. Neural Netw. 2009, 20(8):1352-1357.
5. Gen M., Cheng R. Genetic Algorithms and Engineering Optimization 2000, John Wiley & Sons, New Jersey.
6. Hornik K. Approximation capabilities of multilayer feedforward networks. Neural Netw. 1991, 4:251-257.
7. Huang G.B., Babri H.A. Upper bounds on the number of hidden neurons in feedforward networks with arbitrary bounded nonlinear activation functions. IEEE Trans. Neural Netw. 1998, 9(1):224-229.
8. Huang G.B., Chen L. Convex incremental extreme learning machine. Neurocomputing 2007, 70(16-18):3056-3062.
9. Huang G.B., Chen L. Enhanced random search based incremental extreme learning machine. Neurocomputing 2008, 71(16-18):3460-3468.
10. Huang G.B., Chen L., Siew C.K. Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Trans. Neural Netw. 2006, 17(4):879-892.
11. Huang G.B., Chen Y.Q., Babri H.A. Classification ability of single hidden layer feedforward neural networks. IEEE Trans. Neural Netw. 2000, 11(3):799-801.
12. Huang G.B., Wang D.H., Lan Y. Extreme learning machines: a survey. Int. J. Mach. Learn. Cybern. 2011, 2(2):107-122.
13. Huang G.B., Zhou H., Ding X., Zhang R. Extreme learning machine for regression and multiclass classification. IEEE Trans. Syst. Man Cybern.-Part B: Cybern. 2012, 42(2):513-529.
14. G.B. Huang, Q.Y. Zhu, C.K. Siew, Extreme learning machine: a new learning scheme of feed-forward neural networks, in: Proceedings of the 2004 IEEE International Joint Conference on Neural Networks (IJCNN'04), 2004, pp. 985-990.
15. Huang G.B., Zhu Q.Y., Siew C.K. Extreme learning machine: theory and applications. Neurocomputing 2006, 70(1):489-501.
16. Leshno M., Lin V.Y., Pinkus A., Schocken S. Multilayer feedforward networks with a nonpolynomial activation function can approximate any function. Neural Netw. 1993, 6:861-867.
17. Li J.P., Balazs M.E., Parks G.T., Clarkson P.J. A species conserving genetic algorithm for multimodal function optimization. Evol. Comput. 2002, 10(3):207-234.
18. J. Luo, C.M. Vong, P.K. Wong, Sparse Bayesian extreme learning machine for multi-classification, in: Proceedings of the IEEE Transactions on Neural Networks and Learning Systems, 2014, (in press). http://dx.doi.org/10.1109/TNNLS.2013.2281839.
19. Lv J.C., Yi Z. An improved backpropagation algorithm using absolute error function. Lect. Notes Comput. Sci. 2005, 3496:585-590.
20. Qin A.K., Huang V.L., Suganthan P.N. Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans. Evol. Comput. 2009, 13(2):398-417.
21. Shi L.C., Lu B.L. Eeg-based vigilance estimation using extreme learning machines. Neurocomputing 2013, 102:135-143.
22. Spivak M. A Comprehensive Introduction to Differential Geometry 2005, Publish or Perish, Inc., Boston.
23. K. Taji, T. Miyake, H. Tamura, On error backpropagation algorithm using absolute error function, in: Proceedings of the 1999 IEEE International Conference on Systems, Man, and Cybernetics (SMC'99), 1999, pp. 401-406.
24. Wang R., Kwong S., Wang X.Z. A study on random weights between input and hidden layers in extreme learning machine. Soft Comput. 2012, 16(9):1465-1475.
25. Wang X.Z., Chen A.X., Feng H.M. Upper integral network with extreme learning mechanism. Neurocomputing 2011, 74(16):2520-2525.
26. Wang X.Z., Shao Q.Y., Miao Q., Zhai J.H. Architecture selection for networks trained with extreme learning machine using localized generalization error model. Neurocomputing 2013, 102:3-9.
27. Wang Y.G., Cao F.L., Yuan Y.B. A study on effectiveness of extreme learning machine. Neurocomputing 2011, 74(16):2483-2490.
28. Wu J., Wang S.T., Chung F.L. Positive and negative fuzzy rule system, extreme learning machine and image classification. Int. J. Mach. Learn. Cybern. 2011, 2(4):261-271.
29. Zhang R., Lan Y., Huang G.B., Xu Z.B. Universal approximation of extreme learning machine with adaptive growth of hidden nodes. IEEE Trans. Neural Netw. Learn. Syst. 2012, 23(2):365-371.