Constrained monotone EM algorithms for finite mixture of multivariate Gaussians

Computational Statistics and Data Analysis

Volumn 51, Issue 11, 2007, Pages 5339-5351

  Ingrassia, Salvatore ^a   Rocci, Roberto ^b  

^a UNIVERSITY OF CATANIA   (Italy)

^b UNIVERSITY OF ROME TOR VERGATA   (Italy)

Author keywords

Eigenvalues; EM algorithm; Mixture models; Monotonicity

Indexed keywords

ALGORITHMS; CONSTRAINT THEORY; EIGENVALUES AND EIGENFUNCTIONS; GAUSSIAN DISTRIBUTION; MAXIMUM LIKELIHOOD ESTIMATION; OPTIMIZATION;

EM ALGORITHM; MIXTURE MODELS; MONOTONICITY;

MULTIVARIABLE SYSTEMS;

EID: 34247869709     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2006.10.011     Document Type: Article

References (18)

1. Axelsson O. Iterative Solution Methods (1996), Cambridge University Press, Cambridge
2. Banfield J.D., and Raftery A.E. Model-based Gaussian and non-Gaussian clustering. Biometrics 49 (1993) 803-821
3. Biernacki, C., 2004a. Degeneracy in the maximum likelihood estimation of univariate Gaussian mixtures for grouped data and behaviour of the EM algorithm. Technical Report, Université de Franche-Comté.
4. Biernacki, C., 2004b. An asymptotic upper bound of the likelihood to prevent Gaussian mixtures from degenerating. Technical Report, Université de Franche-Comté.
5. Biernacki C., and Chrétien S. Degeneracy in the maximum likelihood estimation of univariate Gaussian mixtures with EM. Statist. Probab. Lett. 61 (2003) 373-382
6. Burden R.L., and Faires J.D. Numerical Analysis (1985), Prindle, Weber & Schmidt, Boston
7. Celeux G., and Govaert G. Gaussian parsimonious clustering models. Pattern Recognition 28 (1995) 781-793
8. Ciuperca G., Ridolfi A., and Idier J. Penalized maximum likelihood estimator for normal mixtures. Scand. J. Statist. 30 (2003) 45-59
9. Frayley C., and Raftery A.E. Model-based clustering, discriminant analysis and density estimation. J. Amer. Statist. Assoc. 97 (2002) 611-631
10. Hathaway R.J. A constrained formulation of maximum-likelihood estimation for normal mixture distributions. Ann. Statist. 13 (1985) 795-800
11. Horn R.A., and Johnson C.R. Matrix Analysis (1999), Cambridge University Press, New York
12. Ingrassia S. A likelihood-based constrained algorithm for multivariate normal mixture models. Statist. Methods Appl. 13 (2004) 151-166
13. Ingrassia S., and Rocci R. Monotone constrained EM algorithms for multinormal mixture models. In: Zani S., Cerioli A., Riani M., and Vichi M. (Eds). Data Analysis, Classification and the Forward Search (2006), Springer, Berlin 111-118
14. McLachlan G.J., and Krishnan T. The EM Algorithm and Extensions (1997), Wiley, New York
15. McLachlan G.J., and Peel D. Finite Mixture Models (2000), Wiley, New York
16. Meng X.L., and Rubin D.B. Maximum likelihood estimation via the ECM algorithm: a general framework. Biometrika 80 (1993) 267-278
17. Snoussi H., and Mohammad-Djafari A. Penalized maximum likelihood for multivariate Gaussian mixture. Bayesian Inference and Maximum Entropy Methods (MaxEnt) (2001), American Institute of Physics, New York 36-46
18. Theobald C.M. An inequality with applications to multivariate analysis. Biometrika 62 (1975) 461-466