An incremental extreme learning machine for online sequential learning problems

Neurocomputing

Volumn 128, Issue , 2014, Pages 50-58

  Guo, Lu ^a,b   Hao, Jing hua ^a,b   Liu, Min ^a,b  

^a TSINGHUA UNIVERSITY   (China)

^b TSINGHUA NATIONAL LABORATORY FOR INFORMATION SCIENCE AND TECHNOLOGY   (China)

Author keywords

Extreme learning machine (ELM); Fixed size LSSVM (FS LSSVM); Incremental ELM (IELM); Incremental learning algorithm; Online sequential ELM (OS ELM)

Indexed keywords

EXTREME LEARNING MACHINE; FIXED SIZE; INCREMENTAL ELM (IELM); INCREMENTAL LEARNING; ONLINE SEQUENTIAL ELM (OS-ELM);

COMPUTATIONAL EFFICIENCY; KNOWLEDGE ACQUISITION; LEARNING ALGORITHMS;

LEARNING SYSTEMS;

ARTICLE; CLASSIFICATION ALGORITHM; INCREMENTAL EXTREME LEARNING MACHINE; INTERMETHOD COMPARISON; KERNEL METHOD; LEARNING ALGORITHM; MACHINE LEARNING; MATHEMATICAL COMPUTING; ONLINE SEQUENTIAL MACHINE LEARNING; PREDICTION; PRIORITY JOURNAL; PROCESS DEVELOPMENT; QUALITY CONTROL; SEMICONDUCTOR PRODUCTION LINE; SIMULATION; STATISTICAL PARAMETERS; SUPPORT VECTOR MACHINE;

EID: 84893693421     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2013.03.055     Document Type: Article

References (20)

1. Haykin S. Neural Networks: A Comprehensive Foundation 1999, Prentice Hall, NJ.
2. Cortes Corinna, Vapnik Vladimir Support vector networks. Mach. Learn. 1995, 20(3):273-297.
3. Suykens J.A.K., Vandewalle J. Least squares support vector machine classifiers. Neural Process. Lett. 1999, 9(3):293-300.
4. Glenn Fung, Olvi L. Mangasarian, Proximal support vector machine classifiers, in: The 7th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, USA, 2001, pp. 77-86.
5. Qiuge Liu, Qing He, Zhongzhi Shi, Extreme support vector machine classifier, in: Advances in Knowledge Discovery and Data Mining, Lecture Notes in Computer Science, vol. 5012, 2008, pp. 222-233.
6. Huang G.-B., Zhu Q.-Y., Siew C.-K. Extreme learning machine: theory and applications. Neurocomputing 2006, 70(1-3):489-501.
7. Huang G.-B., Saratchandran P., Sundararajan N. A generalized growing and pruning RBF (GGAP-RBF) neural network for function approximation. IEEE Trans. Neural Networks 2005, 16(1):57-67.
8. Liang Nan-Ying, Huang Guang-Bin, Saratchandran P., Sundararajan N. A fast and accurate on-line sequential learning algorithm for feedforward networks. IEEE Trans. Neural Networks 2006, 17(6):1411-1423.
9. N. Syed, H. Liu, K. Sung. Incremental learning with support vector machines, in: Proceedings of the Workshop on Support Vector Machines at the International Joint Conference on Artificial Intelligence (IJCAI-99), Stockholm, Sweden, 1999.
10. S. Ruping, Incremental learning with support vector machines, in: Proceedings of the IEEE International Conference on Data Mining, 2001, pp. 641-642.
11. Espinoza M., Suykens J.A.K., De Moor B. Fixed-size least squares support vector machines: a large scale application in electrical load forecasting. Comput. Manage. Sci.-Spec. Issue Support Vector Mach. 2006, 3(2):113-129.
12. He Qing, Du Changying, Wang Qun, Zhuang Fuzhen, Shi Zhongzhi A parallel incremental extreme SVM classifier. Neurocomputing 2011, 74:2532-2540.
13. Weiwei Zong, Yuan Lan, Guang-Bin Huang, Online sequential learning based on enhanced extreme learning machine using left or right pseudo-inverse, in: Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods, ICPRAM, vol. 1, 2012, pp. 300-305.
14. B. Frnay, M. Verleysen, Using SVMs with randomised feature spaces: an extreme learning approach, in: Proceedings of the 18th ESANN, Bruges, Belgium, April 28-30, 2010, pp. 315-320.
15. Huang G.-B., Zhou H., Ding X., Zhang R. Extreme learning machine for regression and multiclass classification. IEEE Trans. Syst. Man Cybern., Part B: Cybern. 2011, 1(99):1-17.
16. Hager William W. Updating the inverse of a matrix. SIAM Rev. 1989, 31(2):221-239.
17. Golub H.Gene, van Van Loan F.Charles Matrix Computations 1996, The Johns Hopkins University Press, Baltimore. 3rd ed.
18. Shores Thomas S. Applied Linear Algebra and Matrix Analysis 2007, Springer.
19. 〈http://archive.ics.uci.edu/ml/〉
20. 〈http://www.esat.kuleuven.be/sista/lssvmlab/〉