Online sequential extreme learning machine with forgetting mechanism

Neurocomputing

Volumn 87, Issue , 2012, Pages 79-89

  Zhao, Jianwei ^a   Wang, Zhihui ^a   Park, Dong Sun ^b  

^a CHINA JILIANG UNIVERSITY   (China)

^b Chonbuk National University   (South Korea)

Author keywords

Extreme learning machine; Forgetting mechanism; Online learning; Timeliness

Indexed keywords

EXTREME LEARNING MACHINE; GENERALIZATION PERFORMANCE; LEARNING EFFECTS; ONLINE LEARNING; ONLINE SEQUENTIAL EXTREME LEARNING MACHINE; PERFORMANCE COMPARISON; SEQUENTIAL LEARNING ALGORITHM; SHORT TERM PREDICTION; STOCK PRICE; TIMELINESS; TRAINING DATA; TRAINING TIME; WEATHER FORECASTS;

LEARNING ALGORITHMS; LEARNING SYSTEMS; WEATHER FORECASTING;

E-LEARNING;

ACCURACY; ARTICLE; CONTROLLED STUDY; DATA ANALYSIS; INTERMETHOD COMPARISON; LEARNING ALGORITHM; MACHINE LEARNING; MATHEMATICAL ANALYSIS; ONLINE SEQUENTIAL EXTREME LEARNING MACHINE WITH FORGETTING MECHANISM; PREDICTION; PRIORITY JOURNAL;

EID: 84862779843     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2012.02.003     Document Type: Article

References (36)

1. Cao F.L., Xie T.F., Xu Z.B. The estimate of approximation error for neural networks: a constructive approach. Neurocomputing 2008, 71:626-630.
2. Cao F.L., Zhang Y.Q., He Z.R. Interpolation and rates of convergence for a class of neural networks. Appl. Math. Model. 2009, 33:1441-1456.
3. p metric. Math. Comput. Model. 2009, 49:1563-1572.
4. Cao F.L., Lin S.B., Xu Z.B. Approximation capability of interpolation neural networks. Neurocomputing 2010, 74:457-460.
5. Chen T.P., Chen H. Approximation capability to functions of several variables, nonlinear functionals, and operators by radial basis function neural networks. IEEE Trans. Neural Networks 1995, 6:904-910.
6. Chen T.P., Chen H. Universal approximation to nonlinear operators by neural networks with arbitrary activation functions and its application to dynamical systems. IEEE Trans. Neural Networks 1995, 6:911-917.
7. Cybenko G. Approximation by superposition of sigmoidal functions. Math. Control Signal Syst. 1989, 2:303-314.
8. Feng G.R., Huang G.-B., Lin Q.P., Gay R. Error minimized extreme learning machine with growth of hidden nodes and incremental learning. IEEE Trans. Neural Networks 2009, 20(8):1352-1357.
9. Funahashi K.I. On the approximate realization of continuous mappings by neural networks. Neural Networks 1989, 2:183-192.
10. Golub G.H., Loan C.F.V. Matrix Computations 1996, The Johns Hopkins University Press, Baltimore, MD. 3rd ed.
11. Heeswijk M., Miche Y., Oja E., Lendasse A. GPU-accelerated and parallelized ELM ensembles for large-scale regression. Neurocomputing 2011, 74(16):2430-2437.
12. Huang G.B., Babri H.A. Upper bounds on the number of hidden neurons in feedforward networks with arbitrary bounded nonlinear activation functions. IEEE Trans. Neural Networks 1998, 9(1):224-229.
13. Huang G.-B., Zhu Q.Y., Siew C.K. Extreme learning machine: theory and applications. Neurocomputing 2006, 70:489-501.
14. Huang G.-B., Zhu Q.Y., Siew C.K. Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Trans. Neural Networks 2006, 17(4):879-892.
15. Huang G.-B., Chen L. Convex incremental extreme learning machine. Neurocomputing 2007, 70:3056-3062.
16. Huang G.-B., Chen L. Enhanced random search based incremental extreme learning machine. Neurocomputing 2008, 71:3460-3468.
17. Huang G.-B., Ding X., Zhou H. Optimization method based extreme learning machine for classification. Neurocomputing 2010, 74:155-163.
18. Huang G.-B., Wang D.H., Yuan L. Extreme learning machine: a survey. Int. J. Mach. Learn. Cybern. 2011, 2(2):107-122.
19. Hornik K. Approximation capabilities of multilayer feedforward networks. Neural Networks 1991, 4:251-257.
20. Hornik K. Some new results on neural network approximation. Neural Networks 1993, 6:1069-1072.
21. Lan Y., Soh Y.C., Huang G.-B. Ensemble of online sequential extreme learning machine. Neurocomputing 2009, 72:3391-3395.
22. Lan Y., Soh Y.C., Huang G.-B. Constructive hidden nodes selection of extreme learning machine for regression. Neurocomputing 2010, 73:3193-3199.
23. Lan Y., Soh Y.C., Huang G.-B. Two-stage extreme learning machine for regression. Neurocomputing 2010, 73:3028-3038.
24. Liang N.Y., Huang G.-B., Saratchandran P., Sundararajan N. A fast and accurate online sequential learning algorithm for feedforward networks. IEEE Trans. Neural Networks 2006, 17(6):1411-1423.
25. Miche Y., Sorjamaa A., Bas P., Simula O., Jutten C., Lendasse A. OP-ELM: optimally pruned extreme learning machine. IEEE Trans. Neural Networks 2010, 21(1):158-162.
26. Miche Y., Heeswijk M., Bas P., Simula O., Lendasse A. TROP-ELM: a double-regularized ELM using LARS and Tikhonov regularization. Neurocomputing 2011, 74(16):2413-2421.
27. Rao C.R., Mitra S.K. Generalized Inverse of Matrices and its Applications 1971, Wiley, New York.
28. Suresh S., Omkar S.N., Mani V., Guru Prakash T.N. Lift coefficient prediction at high angle of attack using recurrent neural network. Aerosp. Sci. Technol. 2003, 7:595-602.
29. Suresh S., Saraswathi S., Sundararajan N. Performance enhancement of extreme learning machine for multi-category sparse data classification problems. Eng. Appl. Artif. Intell. 2010, 23:1149-1157.
30. Suresh S., Venkatesh Babu R., Kim H.J. No-reference image quality assessment using modified extreme learning machine classifier. Appl. Soft Comput. 2009, 9:541-552.
31. Thomson Datastream Database, Historical data repository 〈〉. https://www.datastream.com.
32. Wang Y.G., Cao F.L., Yuan Y.B. A study on effectiveness of extreme learning machine. Neurocomputing 2011, 74(16):2483-2490.
33. Xu Z.B., Cao F.L. The essential order of approximation for neural networks. Sci. China (F) 2004, 47:97-112.
34. p approximation order for neural networks. Neural Networks 2005, 18:914-923.
35. J.W. Zhao, D.S. Park, J.W. Lee, F.L. Cao, Generalized extreme learning machine acting on a metric space, Soft Comput. (2012). this issue, doi: . http://10.1007/s00500-012-0825-5.
36. Z.H. Zhou, J.W. Zhao, F.L. Cao, Surface reconstruction based on extreme learning machine, Neural Comput. Appl. (2012). this issue, doi: . http://10.1007/s00521-012-0891-8.