Online sequential extreme learning machine in nonstationary environments

Neurocomputing

Volumn 116, Issue , 2013, Pages 94-101

  Ye, Yibin ^a   Squartini, Stefano ^a   Piazza, Francesco ^a  

^a UNIVERSITÀ POLITECNICA DELLE MARCHE   (Italy)

Author keywords

Extreme learning machine; Nonstationary and nonlinear system identification; Online sequential learning; Time varying neural networks

Indexed keywords

EXTREME LEARNING MACHINE; GENERALIZATION PERFORMANCE; NON-STATIONARY CONDITION; NON-STATIONARY ENVIRONMENT; NONSTATIONARY; ONLINE SEQUENTIAL EXTREME LEARNING MACHINE; SEQUENTIAL LEARNING; TIME VARYING;

KNOWLEDGE ACQUISITION; LEARNING ALGORITHMS; NEURAL NETWORKS; NONLINEAR SYSTEMS; RESEARCH;

LEARNING SYSTEMS;

ACCURACY; ARTICLE; ARTIFICIAL NEURAL NETWORK; COMPUTER SIMULATION; CONTROLLED STUDY; EXTREME LEARNING MACHINE; INTERMETHOD COMPARISON; LEARNING ALGORITHM; MACHINE LEARNING; MATHEMATICAL ANALYSIS; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; NONLINEAR SYSTEM; ONLINE SYSTEM; PRIORITY JOURNAL; PROCESS DEVELOPMENT;

EID: 84878490532     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2011.12.064     Document Type: Article

References (31)

1. Huang G.-B., Zhu Q.-Y., Siew C.-K. Extreme learning machine. theory and applications. Neurocomputing 2006, 70(1-3):489-501. (Neural Networks-Selected Papers from the 7th Brazilian Symposium on Neural Networks (SBRN'04)).
2. Zhu Q.-Y., Qin A., Suganthan P., Huang G.-B. Evolutionary extreme learning machine. Pattern Recognition 2005, 38(10):1759-1763.
3. Huang G.-B., Chen L., Siew C.-K. Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Trans. Neural Networks 2006, 17(4):879-892.
4. Huang G., Chen L. Enhanced random search based incremental extreme learning machine. Neurocomputing 2008, 71(16-18):3460-3468.
5. Feng G., Huang G.-B., Lin Q., Gay R. Error minimized extreme learning machine with growth of hidden nodes and incremental learning. IEEE Trans. Neural Networks 2009, 20(8):1352-1357.
6. Suresh S., Saraswathi S., Sundararajan N. Performance enhancement of extreme learning machine for multi-category sparse data classification problems. Eng. Appl. Artif. Intell. 2010, 23(7):1149-1157.
7. Soria-Olivas E., Gomez-Sanchis J., Martin J., Vila-Frances J., Martinez M., Magdalena J., Serrano A. BELM. Bayesian extreme learning machine. IEEE Trans. Neural Networks 2011, 22(3):505-509.
8. Miche Y., Sorjamaa A., Bas P., Simula O., Jutten C., Lendasse A. OP-ELM. optimally pruned extreme learning machine. IEEE Trans. Neural Networks 2010, 21(1):158-162.
9. Cao J., Lin Z., Huang G. Composite function wavelet neural networks with extreme learning machine. Neurocomputing 2010, 73(7-9):1405-1416.
10. Han F., Huang D.-S. Improved extreme learning machine for function approximation by encoding a priori information. Neurocomputing 2006, 69(16-18):2369-2373.
11. Huang D. Radial basis probabilistic neural networks. model and application. Int. J. Pattern Recognition Artif. Intell. 1999, 13:1083-1101.
12. Huang D.-S., Du J.-X. A constructive hybrid structure optimization methodology for radial basis probabilistic neural networks. IEEE Trans. Neural Networks 2008, 19(12):2099-2115.
13. G. Huang, C. Siew, Extreme learning machine: RBF network case, in: Control, Automation, Robotics and Vision Conference, 2004. ICARCV 2004 8th, vol. 2, IEEE, 2004, pp. 1029-1036.
14. Liang N.-Y., Huang G.-B., Saratchandran P., Sundararajan N. A fast and accurate online sequential learning algorithm for feedforward networks. IEEE Trans. Neural Networks 2006, 17(6):1411-1423.
15. M.-B. Li, M.J. Er, Nonlinear system identification using extreme learning machine, in: Proceedings of the 9th International Conference on Control, Automation, Robotics and Vision ICARCV '06, 2006, pp. 1-4.
16. Xu Y., Dong Z., Meng K., Zhang R., Wong K. Real-time transient stability assessment model using extreme learning machine. Gener. Transm. Distrib. IET 2011, 5(3):314-322.
17. Percival D., Walden A. Spectral Analysis for Physical Applications. Multitaper and Conventional Univariate Techniques 1993, Cambridge University Press.
18. A. Titti, S. Squartini, F. Piazza, A new time-variant neural based approach for nonstationary and non-linear system identification, in: Proceedings of the IEEE International Symposium on Circuits and Systems ISCAS 2005, 2005, pp. 5134-5137.
19. C. Cingolani, S. Squartini, F. Piazza, An extreme learning machine approach for training time variant neural networks, in: Proc. IEEE Asia Pacific Conference on Circuits and Systems APCCAS 2008, 2008, pp. 384-387.
20. Y. Ye, S. Squartini, F. Piazza, A group selection evolutionary extreme learning machine approach for time-variant neural networks, in: Neural Nets WIRN10: Proceedings of the 20th Italian Workshop on Neural Nets, IOS Press, 2011, pp. 22-33.
21. Y. Ye, S. Squartini, F. Piazza, ELM-based Algorithms for Nonstationary Volterra System Identification, Frontiers in Artificial Intelligence and Applications, Volume 234, 2011 Neural Nets WIRN11 - Proceedings of the 21st Italian Workshop on Neural Nets Edited by Bruno Apolloni, Simone Bassis, Anna Esposito, Carlo Francesco Morabito, ISBN 978-1-60750-971-4.
22. Y. Ye, S. Squartini, F. Piazza, ELM-based time-variant neural networks with incremental number of output basis functions, in: Advances in Neural Networks-ISNN 2011, 2011, pp. 403-410.
23. Y. Ye, S. Squartini, F. Piazza, ELM-based algorithms for nonstationary volterra system identification. Frontiers in artificial intelligence and applications, 234, (2011) Neural Nets WIRN11. In: Proceedings of the 21st Italian Workshop on Neural Nets Edited by Bruno Apolloni, Simone Bassis, Anna Esposito, Carlo Francesco Morabito, ISBN 978-1-60750-971-4.
24. Grenier Y. Time-dependent ARMA modeling of nonstationary signals. IEEE Trans. Acoust. Speech Signal Process. 1983, 31(4):899-911.
25. Horn R., Johnson C. Topics in Matrix Analysis 1994, Cambridge University Press.
26. Golub G., Loan C. Matrix Computations, Johns Hopkins Studies in the Mathematical Sciences 1996, Johns Hopkins University Press. 3rd ed.
27. Narendra K., Parthasarathy K. Identification and control of dynamical systems using neural networks. IEEE Trans. Neural Networks 1990, 1(1):4-27.
28. Azpicueta-Ruiz L., Zeller M., Figueiras-Vidal A., Arenas-Garcia J., Kellermann W. Adaptive combination of Volterra kernels and its application to nonlinear acoustic echo cancellation. IEEE Trans. Audio Speech Lang. Process. 2011, 19(1):97-110.
29. Glentis G., Koukoulas P., Kalouptsidis N. Efficient algorithms for Volterra system identification. IEEE Trans. Signal Process. 1999, 47(11):3042-3057.
30. Iatrou M., Berger T., Marmarelis V. Modeling of nonlinear nonstationary dynamic systems with a novel class of artificial neural networks. IEEE Trans. Neural Networks 1999, 10(2):327-339.
31. A. Deoras, Electricity Load and Price Forecasting Webinar Case Study, 2010. URL 〈〉. http://www.mathworks.com/matlabcentral/fileexchange/28684-electricity-load-and-price-forecasting-webinar-case-study.