Sparse bayesian extreme learning machine for multi-classification

IEEE Transactions on Neural Networks and Learning Systems

Volumn 25, Issue 4, 2014, Pages 836-843

  Luo, Jiahua ^a   Vong, Chi Man ^a   Wong, Pak Kin ^a  

^a UNIVERSITY OF MACAU   (Macao)

Author keywords

Bayesian learning; classification; extreme learning machine (ELM); sparsity

Indexed keywords

BAYESIAN NETWORKS; CLASSIFICATION (OF INFORMATION); KNOWLEDGE ACQUISITION; NEURONS; RADIAL BASIS FUNCTION NETWORKS;

BAYESIAN LEARNING; BENCHMARK CLASSIFICATION; EXTREME LEARNING MACHINE; LEAST SQUARES MINIMIZATION; MOORE-PENROSE GENERALIZED INVERSE; NEURAL NETWORK CLASSIFIER; SINGLE-HIDDEN LAYER FEEDFORWARD NEURAL NETWORKS; SPARSITY;

LEARNING SYSTEMS;

ALGORITHM; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BAYES THEOREM; COMPUTER SIMULATION; PROCEDURES; THEORETICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BAYES THEOREM; COMPUTER SIMULATION; MODELS, THEORETICAL; PATTERN RECOGNITION, AUTOMATED;

EID: 84897026988     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2013.2281839     Document Type: Article

References (25)

1. G. B. Huang, Q. Y. Zhu, and C. K. Siew, "Extreme learning machine: Theory and applications," Neurocomputing, vol. 70, pp. 489-501, Dec. 2006.
2. K. S. Banerjee, "Generalized inverse of matrices and its applications," Technometrics, vol. 15, pp. 197-202, Apr. 1973.
3. G. B. Huang, H. Zhou, X. Ding, and R. Zhang, "Extreme learning machine for regression and multiclass classification," IEEE Trans. Syst., Man, Cybern., Part B, Cybern., vol. 42, no. 2, pp. 513-529, Apr. 2012.
4. C. C. Chang and C. J. Lin, "LIBSVM: A library for support vector machines," ACM Trans. Intell. Syst. Technol., vol. 2, no. 3, pp. 27:1-27:27, 2011.
5. E. Soria-Olivas, J. Gomez-Sanchis, J. D. Martin, J. Vila-Frances, M. Martinez, J. R. Magdalena, and A. J. Serrano, "BELM: Bayesian extreme learning machine," IEEE Trans. Neural Netw., vol. 22, no. 3, pp. 505-509, Mar. 2011.
6. C. M. Vong, P. K. Wong, and W. F. Ip, "A new framework of simultaneous-fault diagnosis using pairwise probabilistic multi-label classification for time-dependent patterns," IEEE Trans. Ind. Electron., vol. 60, no. 8, pp. 3372-3385, Aug. 2013.
7. C. M. Bishop, Pattern Recognition and Machine Learning. New York, NY, USA: Springer-Verlag, 2006, ch. 4.
8. D. J. C. MacKay, "Bayesian methods for backpropagation networks," Models Neural Netw. III, vol. 6, pp. 211-254, Jan. 1996.
9. M. E. Tipping, "Sparse Bayesian learning and the relevance vector machine," J. Mach. Learn. Res., vol. 1, pp. 211-244, May 2001. (Pubitemid 33687203)
10. T. F. Wu, C. J. Lin, and R. C. Weng, "Probability estimates for multiclass classification by pairwise coupling," J. Mach. Learn. Res., vol. 5, pp. 975-1005, Jan. 2004.
11. G. B. Huang, D. H. Wang, and Y. Lan, "Extreme learning machines: A survey," Int. J. Mach. Learn. Cybern., vol. 2, no. 2, pp. 107-122, 2011.
12. G. B. Huang, Q. Y. Zhu, and C. K. Siew, "Extreme learning machine: A new learning scheme of feedforward neural networks," in Proc. IEEE Int. Joint Conf. Neural Netw., vol. 2. Jul. 2004, pp. 985-990.
13. C. Cortes and V. Vapnik, "Support-vector networks," Mach. Learn., vol. 20, no. 3, pp. 273-297, 1995.
14. W. Deng, Q. Zheng, and L. Chen, "Regularized extreme learning machine," in Proc. IEEE Symp. Comput. Intell. Data Mining, Apr. 2009, pp. 389-395.
15. Y. Miche, A. Sorjamaa, P. Bas, O. Simula, C. Jutten, and A. Lendasse, "OP-ELM: Optimally pruned extreme learning machine," IEEE Trans. Neural Netw., vol. 21, no. 1, pp. 158-162, Jan. 2010.
16. Y. Miche, M. van Heeswijk, P. Bas, O. Simula, and A. Lendasse, "TROP-ELM: A double-regularized ELM using LARS and Tikhonov regularization," Neurocomputing, vol. 74, pp. 2413-2421, Sep. 2011.
17. A. C. Faul and M. Tipping, "Analysis of sparse Bayesian learning," in Proc. Conf. Neural Inf. Process. Syst., 2002, pp. 383-390.
18. G. R. Feng, G. B. Huang, Q. P. Lin, and R. Gay, "Error minimized extreme learning machine with growth of hidden nodes and incremental learning," IEEE Trans. Neural Netw., vol. 20, no. 8, pp. 1352-1357, Aug. 2009.
19. R. Zhang, Y. Lan, G. B. Huang, and Y. C. Soh, "Extreme learning machine with adaptive growth of hidden nodes and incremental updating of output weights," Auto. Intell. Syst., LNCS, vol. 6752, pp. 253-262, Jan. 2011.
20. G. Li, C. Wen, Z. G. Li, A. Zhang, F. Yang, and K. Mao, "Model-based online learning with kernels," IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 3, pp. 356-369, Mar. 2013.
21. - (2013). University of California Irvine Machine Learning Repository [Online]. Available: http://archive.ics.uci.edu/ml/
22. J. Kivinen, A. J. Smola, and R. C. Williamson, "Online learning with kernels," in Proc. Adv. Neural Inf. Process. Syst., 2001, pp. 785-792.
23. G. B. Huang and L. Chen, "Enhanced random search based incremental extreme learning machine," Neurocomputing, vol. 71, pp. 3460-3468, Oct. 2008.
24. G. B. Huang, X. J. Ding, and H. M. Zhou, "Optimization method based extreme learning machine for classification," Neurocomputing, vol. 74, pp. 155-163, Dec. 2010.
25. G. B. Huang, M. B. Li, L. Chen, and C. K. Siew, "Incremental extreme learning machine with fully complex hidden nodes," Neurocomputing, vol. 71, pp. 576-583, Jan. 2008. (Pubitemid 351168446)