Online Sequential Extreme Learning Machine with Kernels

IEEE Transactions on Neural Networks and Learning Systems

Volumn 26, Issue 9, 2015, Pages 2214-2220

  Scardapane, Simone ^a   Comminiello, Danilo ^a   Scarpiniti, Michele ^a   Uncini, Aurelio ^a  

^a SAPIENZA UNIVERSITY OF ROME   (Italy)

Author keywords

Extreme learning machine (ELM); kernel; online learning; recursive least square (RLS).

Indexed keywords

ADAPTIVE FILTERING; ALGORITHMS; E-LEARNING; KNOWLEDGE ACQUISITION; LEARNING SYSTEMS; MAPPING; POSITION CONTROL; SOCIAL NETWORKING (ONLINE);

EXTREME LEARNING MACHINE; KERNEL; KERNEL ADAPTIVE FILTERING; KERNEL RECURSIVE LEAST SQUARES; NONLINEAR ADAPTIVE FILTERING; ONLINE LEARNING; ONLINE SEQUENTIAL EXTREME LEARNING MACHINE; RECURSIVE LEAST SQUARE (RLS);

LEARNING ALGORITHMS;

EID: 84939797937     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2014.2382094     Document Type: Article

References (30)

1. G.-B. Huang, H. Zhou, X. Ding, and R. Zhang, "Extreme learning machine for regression and multiclass classification," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 42, no. 2, pp. 513-529, Apr. 2012.
2. G.-B. Huang, D. H. Wang, and Y. Lan, "Extreme learning machines: A survey," Int. J. Mach. Learn. Cybern., vol. 2, no. 2, pp. 107-122, Jun. 2011.
3. G.-B. Huang, L. Chen, and C.-K. Siew, "Universal approximation using incremental constructive feedforward networks with random hidden nodes," IEEE Trans. Neural Netw., vol. 17, no. 4, pp. 879-892, Jul. 2006.
4. G.-B. Huang, Q.-Y. Zhu, and C.-K. Siew, "Extreme learning machine: Theory and applications," Neurocomputing, vol. 70, nos. 1-3, pp. 489-501, Dec. 2006.
5. S. Haykin, Neural Networks: A Comprehensive Foundation, 2nd ed. Upper Saddle River, NJ, USA: Prentice-Hall, 2004.
6. T. Evgeniou, M. Pontil, and T. Poggio, "Regularization networks and support vector machines," Adv. Comput. Math., vol. 13, no. 1, pp. 1-50, Apr. 2000.
7. S. Scardapane, D. Comminiello, M. Scarpiniti, and A. Uncini, "Music classification using extreme learning machines," in Proc. 8th Int. Symp. Image Signal Process. Anal. (ISPA), Trieste, Italy, Sep. 2013, pp. 377-381.
8. N.-Y. Liang, G.-B. Huang, P. Saratchandran, and N. Sundararajan, "A fast and accurate online sequential learning algorithm for feedforward networks," IEEE Trans. Neural Netw., vol. 17, no. 6, pp. 1411-1423, Nov. 2006.
9. Y. Miche, A. Sorjamaa, P. Bas, O. Simula, C. Jutten, and A. Lendasse, "OP-ELM: Optimally pruned extreme learning machine," IEEE Trans. Neural Netw., vol. 21, no. 1, pp. 158-162, Jan. 2010.
10. S. Suresh, R. V. Babu, and H. J. Kim, "No-reference image quality assessment using modified extreme learning machine classifier," Appl. Soft Comput., vol. 9, no. 2, pp. 541-552, Mar. 2009.
11. S. Suresh, S. Saraswathi, and N. Sundararajan, "Performance enhancement of extreme learning machine for multi-category sparse data classification problems," Eng. Appl. Artif. Intell., vol. 23, no. 7, pp. 1149-1157, Oct. 2010.
12. H.-J. Rong, Y.-S. Ong, A.-H. Tan, and Z. Zhu, "A fast pruned-extreme learning machine for classification problem," Neurocomputing, vol. 72, nos. 1-3, pp. 359-366, Dec. 2008.
13. G.-B. Huang and L. Chen, "Convex incremental extreme learning machine," Neurocomputing, vol. 70, nos. 16-18, pp. 3056-3062, Oct. 2007.
14. H.-J. Rong, G.-B. Huang, N. Sundararajan, and P. Saratchandran, "Online sequential fuzzy extreme learning machine for function approximation and classification problems," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 39, no. 4, pp. 1067-1072, Aug. 2009.
15. J. C. Príncipe, W. Liu, and S. Haykin, Kernel Adaptive Filtering: A Comprehensive Introduction. Hoboken, NJ, USA: Wiley, Mar. 2010.
16. J. Kivinen, A. J. Smola, and R. C. Williamson, "Online learning with kernels," IEEE Trans. Signal Process., vol. 52, no. 8, pp. 2165-2176, Aug. 2004.
17. S. Van Vaerenbergh, I. Santamaria, W. Liu, and J. C. Príncipe, "Fixed-budget kernel recursive least-squares," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process. (ICASSP), Dallas, TX, USA, Mar. 2010, pp. 1882-1885.
18. C. Zhang, X. S. Xia, and B. Liu, "Deformed kernel based extreme learning machine," J. Comput., vol. 8, no. 6, pp. 1602-1609, Jun. 2013.
19. S. Scardapane, D. Comminiello, M. Scarpiniti, and A. Uncini, "GP-based kernel evolution for L2-regularization networks," in Proc. IEEE Congr. Evol. Comput. (CEC), Beijing, China, Jul. 2014, pp. 1674-1681.
20. A. H. Sayed, Fundamentals of Adaptive Filtering. Hoboken, NJ, USA: Wiley, Jun. 2003.
21. A. Uncini, Fundamentals of Adaptive Signal Processing. New York, NY, USA: Springer-Verlag.
22. Y. Engel, S. Mannor, and R. Meir, "The kernel recursive least-squares algorithm," IEEE Trans. Signal Process., vol. 52, no. 8, pp. 2275-2285, Aug. 2004.
23. B. Chen, S. Zhao, P. Zhu, and J. C. Príncipe, "Quantized kernel recursive least squares algorithm," IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 9, pp. 1484-1491, Sep. 2013.
24. W. Liu, I. Park, and J. C. Príncipe, "An information theoretic approach of designing sparse kernel adaptive filters," IEEE Trans. Neural Netw., vol. 20, no. 12, pp. 1950-1961, Dec. 2009.
25. S. Van Vaerenbergh, "Kernel methods for nonlinear identification, equalization and separation of signals," Ph.D. dissertation, Univ. Cantabria, Cantabria, Spain, Feb. 2010.
26. P. Baldi, S. Brunak, Y. Chauvin, C. A. F. Andersen, and H. Nielsen, "Assessing the accuracy of prediction algorithms for classification: An overview," Bioinformatics, vol. 16, no. 5, pp. 412-424, May 2000.
27. H. He and E. A. Garcia, "Learning from imbalanced data," IEEE Trans. Knowl. Data Eng., vol. 21, no. 9, pp. 1263-1284, Sep. 2009.
28. R. Setiono, "Generating concise and accurate classification rules for breast cancer diagnosis," Artif. Intell. Med., vol. 18, no. 3, pp. 205-219, Mar. 2000.
29. K.-R. Müller, T. Adali, K. Fukumizu, J. Principe, and S. Theodoridis, "Special issue on advances in kernel-based learning for signal processing," IEEE Signal Process. Mag., vol. 30, no. 4, pp. 14-15, Jul. 2013.
30. Y. Ye, S. Squartini, and F. Piazza, "Online sequential extreme learning machine in nonstationary environments," Neurocomputing, vol. 116, pp. 94-101, Sep. 2012.