On the correct convergence of the em algorithm for Gaussian mixtures

Pattern Recognition

Volumn 38, Issue 12, 2005, Pages 2602-2611

  Ma, Jinwen ^a   Fu, Shuqun ^b  

^a PEKING UNIVERSITY   (China)

^b Medical Affairs Department of Changning District Health Committee   (China)

Author keywords

Correct convergence; EM algorithm; Gaussian mixture; Maximum likelihood estimate; Overlap measure

Indexed keywords

ALGORITHMS; COMPUTER SIMULATION; DATA REDUCTION; MAPPING; MAXIMUM LIKELIHOOD ESTIMATION; PARAMETER ESTIMATION;

CORRECT CONVERGENCE; EM ALGORITHM; GAUSSIAN MIXTURES; MAXIMUM LIKELIHOOD ESTIMATE; OVERLAP MEASURES;

CONVERGENCE OF NUMERICAL METHODS;

EID: 25144432981     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2005.03.010     Document Type: Article

References (16)

1. A.P. Dempster, N.M. Laird, and D.B. Rubin Maximum likelihood from incomplete data via the EM algorithm J. R. Statist. Soc. B 39 1977 1 38
2. C.F.J. Wu On the convergence properties of the EM algorithm Ann. Statist. 11 1983 95 103
3. R.A. Redner, and H.F. Walker Mixture densities, maximum likelihood, and the EM algorithm SIAM Rev. 26 1984 195 239
4. X.L. Meng On the rate of convergence of the ECM algorithm Ann. Statist. 22 1994 326 339
5. C. Liu, and D.B. Rubin The ECME algorithm: a simple extension of EM and ECM with faster monotone convergence Biometrika 81 1994 633 648
6. X.L. Meng, and D. van Dyk The EM algorithm - an old folk-song sung to a fast new tune J. R. Statist. Soc. B 59 1997 511 567
7. B. Delyon, M. Lavielle, and E. Moulines Convergence of a stochastic approximation version of the EM algorithm Ann. Statist. 27 1999 94 128
8. N. Laird, N. Lange, and D. Stram Maximizing likelihood computations with repeated measures: application of the EM algorithm J. Amer. Statist. Assoc. 82 1987 97 105
9. M. Jamshidian, and R.I. Jennrich Conjugate gradient acceleration of the EM algorithm J. Am. Statist. Assoc. 88 1993 221 228
10. K. Lange A quasi-Newtonian acceleration of the EM algorithm Statistica Sinica 5 1995 1 18
11. C. Liu, D.B. Rubin, and Y. Wu Parameter expansion to accelerate EM: the PX-EM algorithm Biometrika 85 1998 755 770
12. L. Xu, and M.I. Jordan On convergence properties of the EM algorithm for Gaussian mixtures Neural Comput. 8 1996 129 151
13. J. Ma, L. Xu, and M.I. Jordan Asymptotic convergence rate of the EM algorithm for Gaussian mixtures Neural Comput. 12 2000 2881 2907
14. J. Ma, L. Xu, Asymptotic convergence properties of the EM algorithm with respect to the overlap in the mixture, Neurocomputing, in press.
15. L. Xu Comparative analysis on convergence rates of the EM algorithms and its two modifications for Gaussian mixtures Neural Processing Lett. 6 1997 69 76
16. S.R. Gerald, Matrix derivatives, in: Lecture Notes in Statistics, vol. 2, Marcel Dekker, New York, 1980.