Choosing starting values for the EM algorithm for getting the highest likehood in multivariate Gaussian mixture models

Computational Statistics and Data Analysis

Volumn 41, Issue 3-4, 2003, Pages 561-575

  Biernacki, Christophe ^a   Celeux, Gilles ^b   Govaert, Gérard ^c  

^a Supmicrotech ENSMM   (France)

^b INRIA RHÔNE ALPES   (France)

^c UNIVERSITÉ DE TECHNOLOGIE DE COMPIÈGNE   (France)

Author keywords

Classification EM; EM algorithm; Initialization strategies; Mutivariate Gaussian mixture; Optimization; Stochastic EM

Indexed keywords

ALGORITHMS; COMPUTER SIMULATION; MAXIMUM LIKELIHOOD ESTIMATION; PARAMETER ESTIMATION;

MULTIVARIATE GAUSSIAN MIXTURES;

DATA REDUCTION;

NUMERICAL MODEL;

EID: 0037469122     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0167-9473(02)00163-9     Document Type: Article

References (18)

1. Akaike, H., 1974. A new look at the statistical identification model. IEEE Trans. Automat. Control 19, 716-723.
2. Böhning, D., 1999. Computer-Assisted Analysis of Mixtures and Applications: Meta-Analysis, Disease Mapping and Others. Chapman & Hall, New York.
3. Celeux, G., Govaert, G., 1992. A classification EM algorithm and two stochastic versions. Comput. Stat. Data Anal. 14, 315-332.
4. Celeux, G., Chrétien, S., Forbes, F., Mkhadri, A., 2001. A component-wise EM algorithm for mixtures. J. Comput. Graph. Stat. 10, 699-712.
5. Dasgupta, A., Raftery, A.E., 1998. Detecting features in spatial point process with clutter viamodel-based clustering. J. Am. Stat. Assoc. 93, 294-302.
6. Dempster, A.P., Laird, N.M., Rubin, D.B., 1977. Maximum likelihood from incomplete data via the EM algorithm (with discussion) J. Roy Stat. Soc. B 39, 1-38.
7. Lindsay, B.G., 1995. Mixture Models: Theory, Geometry and Applications. NSF-CBMS Regional Conference Series in Probability and Statistics, Vol. 5. Institute of Mathematical Statistics, California.
8. Liu, C., Sun, D.X., 1997. Acceleration of EM algorithm for mixtures models using ECME. ASA Proceedings of The Stat. Comp. Session, pp. 109-114.
9. MacQueen, J., 1967. Some methods for classi4cation and Analysis of multivariate observations. In: LeCam, L.M., Neyman, J. (Eds.), Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability. University of California Press, CA, pp. 281-297.
10. McLachlan, G.J., Krishnam, T., 1997. The EM algorithm and Extensions. Wiley, New York.
11. McLachlan, G.J., Peel, D., 2000. Finite Mixture Models. Wiley, New York.
12. Meila, M., Heckerman, D., 2001. An experimental comparison of model-based clustering methods. Mach. Learning 42, 9-29.
13. Pilla, R.S., Lindsay, B.G., 2001. Alternative EM methods for nonparametric finite mixture models. Biometrika 88, 535-550.
14. Sandor, G., 1976. Sémiologie Biologique des Protéines Sériques. Maloine, Paris.
15. Soubiran, C., 1993. Kinematics of the Galaxy's steller population from a proper motion survey. Astronom. Astrophys. 274, 181-188.
16. Ueda, N., Nakano, R., 1998. Deterministic annealing EM algorithm. Neural Networks 11, 271-282.
17. Venables, W.N., Ripley, B.D., 1994. Modern Applied Statistics with S-plus. Springer, New York.
18. Wei, G.C.G., Tanner, M.A., 1990. A Monte Carlo Implementation of the EM Algorithm and the Poor Man's Data Augmentation Algorithms. J. Am. Stat. Assoc. 85, 699-704.