Computational aspects of fitting mixture models via the expectation-maximization algorithm

Computational Statistics and Data Analysis

Volumn 56, Issue 12, 2012, Pages 3843-3864

  O'Hagan, Adrian ^a   Murphy, Thomas Brendan ^a   Gormley, Isobel Claire ^a  

^a UNIVERSITY COLLEGE DUBLIN   (Ireland)

Author keywords

Convergence rate; Expectation maximization algorithm; Hierarchical clustering; mclust; Model based clustering; Multimodal likelihood

Indexed keywords

CONVERGENCE RATES; EXPECTATION-MAXIMIZATION ALGORITHMS; HIER-ARCHICAL CLUSTERING; MCLUST; MODEL-BASED CLUSTERING; MULTI-MODAL;

APPROXIMATION THEORY; MAXIMUM LIKELIHOOD ESTIMATION; OPTIMAL SYSTEMS;

CLUSTERING ALGORITHMS;

EID: 84864120602     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2012.05.011     Document Type: Article

References (43)

1. A. Aitken On Bernoulli's numerical solution of algebraic equations Proceedings of the Royal Society of Edinburgh 46 1926 289 305
2. M. Aitkin, and I. Aitkin A hybrid EM/Gauss-Newton algorithm for maximum likelihood in mixture distributions Statistics and Computing 6 1996 127 130
3. J.L. Andrews, P.D. McNicholas, and S. Subedi Model-based classification via mixtures of multivariate t-distributions Computational Statistics and Data Analysis 55 2011 520 529
4. J.D. Banfield, and A.E. Raftery Model-based Gaussian and non-Gaussian clustering Biometrics 49 1993 803 821
5. K. Basford, and G. McLachlan Likelihood estimation with normal mixture models Journal of the Royal Statistical Society. Series C (Applied Statistics) 34 1985 282 289
6. K. Basford, G. McLachlan, and M. York Modelling the distribution of stamp paper thickness via finite normal mixtures: the 1872 Hidalgo stamp issue of Mexico revisited Journal of Applied Statistics 24 1997 169 180
7. H. Bensmail, and G. Celeux Regularized Gaussian discriminant analysis through eigenvalue decomposition Journal of the American Statistical Association 91 1996 1743 1748
8. C. Biernacki, G. Celeux, and G. Govaert Choosing starting values for the EM algorithm for getting the highest likelihood in multivariate Gaussian mixture models Computational Statistics and Data Analysis 41 2003 561 575
9. D. Böhning, E. Dietz, R. Schaub, P. Schlattmann, and B. Lindsay The distribution of the likelihood ratio for mixtures of densities from the one-parameter exponential family Annals of the Institute of Statistical Mathematics 46 1994 373 388
10. D. Böhning, and W. Siedel Editorial: recent developments in mixture models Computational Statistics and Data Analysis 41 2003 349 357
11. D. Böhning, W. Siedel, M. Alfó, B. Garel, V. Patilea, and W. Günther Editorial: advances in mixture models Computational Statistics and Data Analysis 51 2007 5205 5210
12. G. Celeux, and G. Govaert Gaussian parsimonious clustering models Pattern Recognition 28 1995 781 793
13. D. Chickering, and D. Heckerman Efficient approximations for the marginal likelihood of Bayesian networks with hidden variables Machine Learning 29 1997 181 212
14. Cook, and Weisberg An Introduction to Regression Graphics 1994 John Wiley and Sons New York
15. A.P. Dempster, N.M. Laird, and D.B. Rubin Maximum likelihood from incomplete data via the EM algorithm Journal of the Royal Statistical Society. Series B. Methodological 39 1977 1 38 (With discussion)
16. B. Efron An Introduction to the Bootstrap 1994 Chapman and Hall London
17. B. Everitt Maximum likelihood estimation of the parameters in a mixture of two univariate normal distributions; a comparison of different algorithms The Statistician 33 1984 205 215
18. B. Everitt, and D. Hand Finite Mixture Distributions 1981 Chapman and Hall London
19. R. Fisher The use of multiple measurements in taxonomic problems Annals of Eugenics 7 1936 179 188
20. C. Fraley, and A.E. Raftery Mclust: software for model-based clustering Journal of Classification 16 1999 297 306
21. C. Hennig Breakdown points for maximum likelihood-estimators of location-scale mixtures The Annals of Statistics 32 2004 1313 1340
22. A. Izenman, and C. Somner Philatelic mixtures and multimodal densities Journal of the American Statistical Association 83 1988 941 953
23. N. Jewell Mixtures of exponential distributions The Annals of Statistics 10 1962 479 484
24. D. Karlis, and E. Xekalaki Choosing initial values for the EM algorithm for finite mixtures Computational Statistics and Data Analysis 41 2003 577 590
25. L. Kitchens Basic Statistics and Data Analysis 2003 Duxbury
26. B. Lindsay Mixture Models: Theory, Geometry and Applications NSF-CBMS Regional Conference Series in Probability and Statistics 1995 Institute of Mathematical Statistics
27. R. Maitra, and V. Melnykov Simulating data to study performance of finite mixture modeling and clustering algorithms Journal of Computational and Graphical Statistics 2 2010 354 376
28. G.J. McLachlan The classification and mixture maximum likelihood approaches to cluster analysis Handbook of Statistics 2 1982 199 208
29. G.J. McLachlan, and T. Krishnan The EM Algorithm and Extensions 1997 Wiley Interscience New York
30. G.J. McLachlan, and D. Peel Finite Mixture Models 2000 Wiley Interscience New York
31. P.D. McNicholas, T.B. Murphy, A.F. McDaid, and D. Frost Serial and parallel implementations of model-based clustering via parsimonious Gaussian mixture models Computational Statistics & Data Analysis 54 2010 711 723
32. X.L. Meng, and D.B. Rubin Recent extensions of the EM algorithm (with discussion) Bayesian Statistics 4 1992 Oxford University Press 307 320
33. X.L. Meng, and D.B. Rubin Maximum likelihood estimation via the ECM algorithm: a general framework Biometrika 80 1993 267 278
34. R.M. Neal, and G.E. Hinton A view of the EM algorithm that justifies incremental, sparse, and other variants M.I. Jordan, Learning in Graphical Models 1999 MIT Press Cambridge, MA, USA 355 368
35. R Development Core Team, 2007. R: a language and environment for statistical computing. R Foundation for Statistical Computing. Vienna, Austria. ISBN: 3-900051-07-0.
36. R. Redner, and H. Walker Mixture densities, maximum likelihood, and the EM algorithm Society for Industrial and Applied Mathematics Review 26 1984 195 329
37. K. Roeder Density estimation with confidence sets exemplified by superclusters and voids in galaxies Journal of the American Statistical Association 85 1990 617 624
38. G. Schwarz Estimating the dimension of a model Annals of Statistics 6 1978 461 464
39. W. Seidel, and H. Ševčíková Types of likelihood maxima in mixture models and their implication on the performance of tests Annals of the Institute of Statistical Mathematics 56 2004 631 654
40. R. Surajit, and B. Lindsay The topography of multivariate normal mixtures The Annals of Statistics 33 2005 2042 2065
41. Vermunt, J.; Madison, J.; 2005. Technical Guide for Latent GOLD 4.0: Basic and Advanced.
42. L. Wasserman All of Statistics first ed. 2004 Springer-Verlag
43. H. Zhou, and K.L. Lange On the bumpy road to the dominant mode Scandinavian Journal of Statistics 37 2010 612 631