Asymmetric mixture model with simultaneous feature selection and model detection

IEEE Transactions on Neural Networks and Learning Systems

Volumn 26, Issue 2, 2015, Pages 400-408

  Nguyen, Thanh Minh ^a   Wu, Q M Jonathan ^a   Zhang, Hui ^b  

^a UNIVERSITY OF WINDSOR   (Canada)

^b NANJING UNIVERSITY OF INFORMATION SCIENCE AND TECHNOLOGY   (China)

Author keywords

Asymmetric mixture model; feature selection; model detection; student's t distribution; variational Bayesian (VB) learning

Indexed keywords

BARIUM COMPOUNDS; GAUSSIAN DISTRIBUTION; GAUSSIAN NOISE (ELECTRONIC); MIXTURES; SPEECH ENHANCEMENT; STUDENTS;

ASYMMETRIC DISTRIBUTION; ASYMMETRIC MIXTURES; NUMBER OF COMPONENTS; NUMERICAL EXPERIMENTS; PATTERN RECOGNITION PROBLEMS; STUDENT'S T DISTRIBUTION; VARIATIONAL BAYESIAN; VARIATIONAL BAYESIAN LEARNING;

FEATURE EXTRACTION;

EID: 85027944464     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2014.2314239     Document Type: Article

References (34)

1. G. McLachlan and D. Peel, Finite Mixture Models. New York, NY, USA: Wiley, 2000.
2. A. K. Jain, R. P. W. Duin, and J. Mao, "Statistical pattern recognition: A review," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 1, pp. 4-37, Jan. 2000.
3. D. Peel and G. McLachlan, "Robust mixture modeling using the t distribution," Stat. Comput., vol. 10, no. 1, pp. 339-348, 2000.
4. C. Liu and D. Rubin, "ML estimation of the t distribution using EM and its extensions, ECM and ECME," Stat. Sinica, vol. 5, no. 1, pp. 19-39, 1995.
5. S. P. Chatzis, D. I. Kosmopoulos, and T. A. Varvarigou, "Robust sequential data modeling using an outlier tolerant hidden Markov model," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 9, pp. 1657-1669, Sep. 2009.
6. M. N. Thanh and Q. M. J. Wu, "Robust Student's-t mixture model with spatial constraints and its application in medical image segmentation," IEEE Trans. Med. Imag., vol. 31, no. 1, pp. 103-116, Jan. 2012.
7. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via EM algorithm," J. Roy. Stat. Soc., vol. 39, no. 1, pp. 1-38, 1977.
8. H. Attias, "A variational Bayesian framework for graphical models," Adv. Neural Inf. Process. Syst., vol. 12, no. 1, pp. 209-215, 2000.
9. C. M. Bishop, Pattern Recognition and Machine Learning. New York, NY, USA: Springer-Verlag, 2006.
10. M. Svensen and C. M. Bishop, "Robust Bayesian mixture modelling," Neurocomputing, vol. 64, pp. 235-252, Mar. 2005.
11. P. Mitra and C. A. Murthy, "Unsupervised feature selection using feature similarity," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 3, pp. 301-312, Mar. 2002.
12. J. G. Dy, C. E. Brodley, A. Kak, L. S. Broderick, and A. M. Aisen, "Unsupervised feature selection applied to content-based retrieval of lung images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 3, pp. 373-378, Mar. 2003.
13. S. J. Raudys and A. K. Jain, "Small sample size effects in statistical pattern recognition: Recommendations for practitioners," IEEE Trans. Pattern Anal. Mach. Intell., vol. 13, no. 3, pp. 252-264, Mar. 1991.
14. J. A. Iglesias, P. Angelov, A. Ledezma, and A. Sanchis, "Evolving classification of agent's behaviors: A general approach," Evolving Syst., vol. 1, no. 3, pp. 161-171, 2010.
15. D. M. Vázquez, J. J. Rubio, and J. Pacheco, "A characterization framework for epileptic signals," IET Image Process., vol. 6, no. 9, pp. 1227-1235, Dec. 2012.
16. J. A. Iglesias, P. Angelov, A. Ledezma, and A. Sanchis, "Creating evolving user behavior profiles automatically," IEEE Trans. Knowl. Data Eng., vol. 24, no. 5, pp. 854-867, May 2012.
17. J. J. Rubio, F. Ortiz, C. R. Mariaca, and J. C. Tovar, "A method for online pattern recognition of abnormal eye movements," Neural Comput. Appl., vol. 22, no. 3, pp. 597-605, 2013.
18. M. H. Law, M. A. T. Figueiredo, and A. K. Jain, "Simultaneous feature selection and clustering using mixture models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 9, pp. 1154-1166, Sep. 2004.
19. C. Constantinopoulos, M. K. Titsias, and A. Likas, "Bayesian feature and model selection for Gaussian mixture models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 6, pp. 1013-1018, Jun. 2006.
20. Y. H. Li, M. Dong, and J. Hua, "Simultaneous localized feature selection and model detection for Gaussian mixtures," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 5, pp. 953-960, May 2009.
21. H. Zhang, Q. M. J. Wu, and M. N. Thanh, "Bayesian feature selection and model detection for Student's t-mixture distributions," in Proc. IEEE Int. Conf. Pattern Recognit., Nov. 2012, pp. 1631-1634.
22. K. Van Leemput, F. Maes, D. Vandermeulen, and P. Suetens, "Automated model-based tissue classification of MR images of the brain," IEEE Trans. Med. Imag., vol. 18, no. 10, pp. 897-908, Oct. 1999.
23. M. N. Thanh and Q. M. J. Wu, "A nonsymmetric mixture model for unsupervised image segmentation," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 43, no. 2, pp. 751-765, Apr. 2013.
24. A. Corduneanu and C. M. Bishop, "Variational Bayesian model selection for mixture distributions," in Proc. Int. Conf. Artif. Intell. Stat., 2001, pp. 27-34.
25. J. Oliver, R. Baxter, and C. Wallace, "Unsupervised learning using MML," in Proc. Int. Conf. Mach. Learn., 1996, pp. 364-372.
26. M. A. T. Figueiredo and A. K. Jain, "Unsupervised learning of finite mixture models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 3, pp. 381-396, Mar. 2002.
27. X. Ren and X. Lv, "Identification of extended Hammerstein systems using dynamic self-optimizing neural networks," IEEE Trans. Neural Netw., vol. 22, no. 8, pp. 1169-1179, Aug. 2011.
28. J. J. Rubio, P. Angelov, and J. Pacheco, "Uniformly stable backpropagation algorithm to train a feedforward neural network," IEEE Trans. Neural Netw., vol. 22, no. 3, pp. 356-366, Mar. 2011.
29. P. Angelov, "Fuzzily connected multimodel systems evolving autonomously from data streams," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 4, pp. 898-910, Aug. 2011.
30. J. J. Rubio, "Modified optimal control with a backpropagation network for robotic arms," IET Control Theory Appl., vol. 6, no. 14, pp. 2216-2225, Sep. 2012.
31. W. Zhang, W. Wu, and M. Yao, "Boundedness and convergence of bath backpropagation algorithm with penalty with feedforward neural networks," Neurocomputing, vol. 89, no. 1, pp. 141-146, 2012.
32. J. H. Pérez-Cruz, J. J. Rubio, E. Ruiz-Velázquez, and G. Solís-Perales, "Tracking control based on recurrent neural networks for nonlinear systems with multiple inputs and unknown deadzone," Abstract Appl. Anal., vol. 2012, pp. 1-18, Nov. 2012.
33. X. He, D. Cai, and P. Niyogi, "Laplacian score for feature selection," Adv. Neural Inf. Process. Syst., vol. 18, pp. 507-514, Dec. 2005.
34. Z. Zhao and H. Liu, "Spectral feature selection for supervised and unsupervised learning," in Proc. Int. Conf. Mach. Learn., 2007, pp. 1151-1157.