Training extreme learning machine via regularized correntropy criterion

Neural Computing and Applications

Volumn 23, Issue 7-8, 2013, Pages 1977-1986

  Xing, Hong Jie ^a   Wang, Xin Mei ^a  

^a HEBEI UNIVERSITY   (China)

Author keywords

Correntropy; Extreme learning machine; Half quadratic optimization; Regularization term

Indexed keywords

CORRENTROPY; EXTREME LEARNING MACHINE; GAUSSIAN KERNEL FUNCTIONS; HALF-QUADRATIC OPTIMIZATIONS; MEAN SQUARE ERROR CRITERIONS; OPTIMIZATION TECHNIQUES; REGULARIZATION TERMS; SYNTHETIC DATASETS;

ITERATIVE METHODS; KNOWLEDGE ACQUISITION; LEARNING SYSTEMS; OPTIMIZATION;

MEAN SQUARE ERROR;

EID: 84887459759     PISSN: 09410643     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00521-012-1184-y     Document Type: Article

References (39)

1. Huang GB, Zhu QY, Siew CK (2006) Extreme learning machine: theory and applications. Neurocomputing 70: 489-501.
2. Rao CR, Mitra SK (1971) Generalize inverse of matrices and its application. Wiley, New York.
3. Zong WW, Huang GB (2011) Face recognition based on extreme learning machine. Neurocomputing 74: 2541-2551.
4. Wu J, Wang S, Chung FL (2011) Positive and negative fuzzy rule system, extreme learning machine and image classification. Int J Mach Learn Cybern 2(4): 261-271.
5. Chacko BP, Vimal Krishnan V, Raju G, Babu Anto P (2012) Handwritten character recognition using wavelet energy and extreme learning machine. Int J Mach Learn Cybern 3(2): 149-161.
6. Zheng WB, Qian YT, Lu HJ (2012) Text categorization based on regularization extreme learning machine. Neural Comput Appl. doi: 10. 1007/s00521-011-0808-y.
7. Wang H, Qian G, Feng XQ (2012) Predicting consumer sentiments using online sequential extreme learning machine and intuitionistic fuzzy sets. Neural Comput Appl. doi: 10. 1007/s00521-012-0853-1.
8. Deng J, Li K, Irwin WG (2011) Fast automatic two-stage nonlinear model identification based on the extreme learning machine. Neurocomputing 74: 2422-2429.
9. Huang GB, Wang DH, Lan Y (2011) Extreme learning machines: a survey. Int J Mach Learn Cybern 2(2): 107-122.
10. Wang YG, Cao FL, Yuan YB (2011) A study of effectiveness of extreme learning machine. Neurocomputing 74: 2483-2490.
11. Zhao JW, Wang ZH, Park DS (2012) Online sequential extreme learning machine with forgetting mechanism. Neurocomputing 87: 79-89.
12. Savitha R, Suresh S, Sundararajan N (2012) Fast learning circular complex-valued extreme learning machine (CC-ELM) for real-valued classification problems. Inform Sci 187: 277-290.
13. Zhang R, Lan Y, Huang GB, Xu ZB (2012) Universal approximation of extreme learning machine with adaptive growth of hidden nodes. IEEE Trans Neural Netw Learn Syst 23: 365-371.
14. Cao JW, Lin ZP, Huang GB (2012) Self-adaptive evolutionary extreme learning machine. Neural Process Lett. doi: 10. 1007/s11063-012-9236-y.
15. Miche Y, Bas P, Jutten C, Simula O, Lendasse A (2008) A methodology for building regression models using extreme learning machine: OP-ELM. In: European symposium on artificial neural networks. Bruges, Belgium, pp 247-252.
16. Golub GH, van Loan CF (1983) Matrix computation. Johns Hopkins University Press, Baltimore.
17. Santamaria I, Pokharel PP, Principe JC (2006) Generalized correlation function: definition, properties, and application to blind equalization. IEEE Trans Signal Process 54(6): 2187-2197.
18. Liu W, Pokharel PP, Principe JC (2007) Correntropy: properties and applications in non-Gaussian signal processing. IEEE Trans Signal Process 55(11): 5286-5297.
19. Jeong KH, Liu W, Han S, Hasanbelliu E, Principe JC (2009) The correntropy MACE filter. Pattern Recognit 42(5): 871-885.
20. Yuan X, Hu BG (2009) Robust feature extraction via information theoretic learning. In: Proceedings of the 26th annual international conference on machine learning. ACM, New York, pp 1193-1200.
21. Rockfellar R (1970) Convex analysis. Princeton University Press, Princeton.
22. He R, Zheng WS, Hu BG (2011) Maximum correntropy criterion for robust face recognition. IEEE Trans Pattern Anal Mach Intell 33(8): 1561-1576.
23. He R, Hu BG, Zheng WS, Kong XW (2011) Robust principal component analysis based on maximum correntropy criterion. IEEE Trans Image Process 20(6): 1485-1494.
24. He R, Tan T, Wang L, Zheng WS (2012) L21 Regularized correntropy for robust feature selection. In: Proceedings of IEEE international conference on computer vision and pattern recognition.
25. He R, Zheng WS, Hu BG, Kong XW (2011) A regularized correntropy framework for robust pattern recognition. Neural Comput 23(8): 2074-2100.
26. Huang GB, Zhou H, Ding X, Zhang R (2012) Extreme learning machine for regression and multiclass classification. IEEE Trans Syst Man Cybern Part B Cybern 42(2): 513-529.
27. Principe JC, Xu D, Fisher J (2012) Information theoretic learning. In: Haykin S (eds) Unsupervised adaptive filtering. Wiley, New York.
28. Vapnik V (1995) The nature of statistical learning theory. Springer, New York.
29. Yang S, Zha H, Zhou S, Hu B (2009) Variational graph embedding for globally and locally consistent feature extraction. In: Proceedings of the Europe conference on machine learning, vol 5782, pp 538-553.
30. Boyd S, Vandenberghe L (2004) Convex optimization. Cambridge University Press, Cambridge.
31. Zhao GP, Shen ZQ, Man ZH (2011) Robust input weight selection for well-conditioned extreme learning machine. Int J Inform Technol 17(1): 1-13.
32. Ripley BD (1996) Pattern recognition and neural networks. Cambridge University Press, Cambridge.
33. Frank A, Asuncion A (2010) UCI machine learning repository. University of California, Irvine, School of Information and Computer Sciences, Irvine, CA. http://archive. ics. uci. edu/ml.
34. Wang X, Chen A, Feng H (2011) Upper integral network with extreme learning mechanism. Neurocomputing 74: 2520-2525.
35. Yeung D, Ng W, Wang D, Tsang E, Wang X (2007) Localized generalization error model. IEEE Trans Neural Netw 18(5): 1294-1305.
36. Wang X, Hong JR (1999) Learning optimization in simplifying fuzzy rules. Fuzzy Set Syst 106(3): 349-356.
37. Wang XZ, Wang YD, Xu XF, Ling WD, Yeung DS (2001) A new approach to fuzzy rule generation: fuzzy extension matrix. Fuzzy Set Syst 123(3): 291-306.
38. Tsang ECC, Wang X, Yeung DS (2000) Improving learning accuracy of fuzzy decision trees by hybrid neural networks. IEEE Trans Fuzzy Syst 8(5): 601-614.
39. Wang X, Yeung DS, Tsang ECC (2001) A comparative study on heuristic algorithms for generating fuzzy decision trees. IEEE Trans Syst Man Cybern Part B Cybern 31(2): 215-226.