Entropy regularized likelihood learning on Gaussian mixture: Two gradient implementations for automatic model selection

Neural Processing Letters

Volumn 25, Issue 1, 2007, Pages 17-30

  Lu, Zhiwu ^a  

^a PEKING UNIVERSITY   (China)

Author keywords

Competitive learning; Gaussian mixture; Model selection; Regularization theory

Indexed keywords

AUTOMATIC PROGRAMMING; LEARNING ALGORITHMS; MATHEMATICAL MODELS; MAXIMUM LIKELIHOOD ESTIMATION; PARAMETER ESTIMATION; PROBLEM SOLVING;

COMPETITIVE LEARNING; GAUSSIAN MIXTURE; MODEL SELECTION; REGULARIZATION THEORY;

LEARNING SYSTEMS;

EID: 33845604574     PISSN: 13704621     EISSN: 1573773X     Source Type: Journal    
DOI: 10.1007/s11063-006-9028-3     Document Type: Article

References (13)

1. Devijver, P. A. and Kittter J.: Pattern Recognition: A Statistical Approach, Prentice Hall, Englewood Cliffs, NJ, 1982.
2. Render, R. A. and Walker, H. F.: Mixture densities, maximum, likelihood and the EM algorithm, SIAM Review 26(2) (1984), 195-239.
3. Akaike, H.: A new look at the statistical model identification, IEEE Transactions on Automatic Control 19(6) (1974), 716-723.
4. Schwarz, G.: Estimating the dimension of a model, The Annals of Statistics 6(2) (1978), 461-464.
5. Xu, L., Krzyzak, A. and Oja, E.: Rival penalized competitive learning for clustering analysis, RBF net, and curve detection, IEEE Transactions on Neural networks 4(4) (1993), 636-648.
6. Xu, L.: BYY harmony learning, structural RPCL, and topological self-organzing on mixture modes, Neural Networks 15 (8-9) (2002), 1231-1237.
7. Lu, Z., Cheng, Q. and Ma, J.: A gradient BYY harmony learning algorithm on mixture of experts for curve detection, Lecture Notes in Computer Science 3578 (2005), 250-257.
8. Ma, J., Wang, T. and Xu, L.: A gradient BYY harmony learning rule on Gaussian mixture with automated model selection, Neurocomputing 56 (2004), 481-487.
9. Dennis, D. C. and Finbarr, O. S.: Asymptotic analysis of penalized likelihood and related estimators, The Annals of Statistics 18(6) (1990), 1676-1695.
10. Vapnik, V. N.: An overview of statistical learning theory, IEEE Transactions on Neural Networks 10(5) (1999), 988-999.
11. Lu, Z.: An iterative algorithm for entropy regularized likelihood learning on Gaussian mixture with automatic model selection, Neurocomputing 69(13-15) (2006), 1674-1677.
12. Lu, Z.: Unsupervised image segmentation using an iterative entropy regularized likelihood learning algorithm, Lecture Notes in Computer Science 3972 (2006), 492-497.
13. Ma, J. and Fu, S.: On the correct convergence of the EM algorithm for Gaussian mixtures, Pattern Recognition 38(12) (2005), 2602-2611.