Serial and parallel implementations of model-based clustering via parsimonious Gaussian mixture models

Computational Statistics and Data Analysis

Volumn 54, Issue 3, 2010, Pages 711-723

  McNicholas, P D ^a   Murphy, T B ^b   McDaid, A F ^c   Frost, D ^c  

^a UNIVERSITY OF GUELPH   (Canada)

^b UNIVERSITY COLLEGE DUBLIN   (Ireland)

^c TRINITY COLLEGE DUBLIN   (Ireland)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN INFORMATION CRITERION; CONVERGENCE CRITERION; COVARIANCE STRUCTURES; DATA SETS; EFFICIENT ALGORITHM; EM ALGORITHMS; EXPECTATION-MAXIMIZATION ALGORITHMS; FACTOR ANALYSIS; GAUSSIAN MIXTURE MODEL; MASTER-SLAVE; MODEL SELECTION; MODEL-BASED CLUSTERING; PARALLEL COMPUTING; PARALLEL IMPLEMENTATIONS; PARALLELIZATIONS; SIMULATION STUDIES;

BLIND SOURCE SEPARATION; COMMUNICATION CHANNELS (INFORMATION THEORY); PARALLEL ALGORITHMS; PARALLEL ARCHITECTURES; SIMULATORS;

CLUSTERING ALGORITHMS;

EID: 70549109507     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2009.02.011     Document Type: Article

References (45)

1. Banfield J.D., and Raftery A.E. Model-based Gaussian and non-Gaussian clustering. Biometrics 49 3 (1993) 803-821
2. Böhning D., Dietz E., Schaub R., Schlattmann P., and Lindsay B. The distribution of the likelihood ratio for mixtures of densities from the one-parameter exponential family. Annals of the Institute of Statistical Mathematics 46 (1994) 373-388
3. Campbell N.A., and Mahon R.J. A multivariate study of variation in two species of rock crab of genus leptograpsus. Australian Journal of Zoology 22 (1974) 417-425
4. Celeux G., and Govaert G. Gaussian parsimonious clustering models. Pattern Recognition 28 (1995) 781-793
5. Cheeseman P., and Stutz J. Bayesian Classification (AutoClass): Theory and Results (1996), American Association for Artificial Intelligence, Menlo Park, CA, USA pp. 153-180
6. Dean, N., Raftery, A.E., 2006. The clustvarsel package. R Package Version 0.2-4
7. Dempster A.P., Laird N.M., and Rubin D.B. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society. Series B 39 1 (1977) 1-38
8. Forina M., Armanino C., Castino M., and Ubigli M. Multivariate data analysis as a discriminating method of the origin of wines. Vitis 25 (1986) 189-201
9. Fraley C., and Raftery A.E. How many clusters? Which clustering methods? Answers via model-based cluster analysis. The Computer Journal 41 8 (1998) 578-588
10. Fraley C., and Raftery A.E. Model-based clustering, discriminant analysis, and density estimation. Journal of the American Statistical Association 97 (2002) 611-631
11. Fraley C., and Raftery A.E. Enhanced software for model-based clustering, density estimation, and discriminant analysis: MCLUST. Journal of Classification 20 (2003) 263-286
12. Gatu C., Yanev P., and Kontoghiorghes E. A graph approach to generate all possible regression submodels. Computational Statistics and Data Analysis 52 2 (2007) 799-815
13. Ghahramani, Z., Hinton, G.E., 1997. The EM algorithm for factor analyzers. Technical Report CRG-TR-96-1, University of Toronto, Toronto
14. Gropp W., Lusk E., and Skjellum A. Using MPI: Portable Parallel Programming with the Message-Passing Interface. 2nd ed. (1999), MIT Press, Cambridge, MA
15. Hubert L., and Arabie P. Comparing partitions. Journal of Classification 2 (1985) 193-218
16. Kass R.E., and Raftery A.E. Bayes factors. Journal of the American Statistical Association 90 (1995) 773-795
17. Keribin C. Consistent estimation of the order of mixture models, Sankhyā. The Indian Journal of Statistics. Series A 62 1 (2000) 49-66
18. Kontoghiorghes E.J. Parallel algorithms for linear models: Numerical methods and estimation problems. Advances in Computational Economics vol. 15 (2000), Kluwer Academic Publishers, Boston, MA
19. Leroux B.G. Consistent estimation of a mixing distribution. The Annals of Statistics 20 (1992) 1350-1360
20. Lindsay B.G. Mixture models: Theory, geometry and applications. NSF-CBMS Regional Conference Series in Probability and Statistics vol. 5 (1995), Institute of Mathematical Statistics, Hayward, California
21. Lindstrom M.J., and Bates D.M. Newton-Raphson and EM algorithms for linear mixed-effects models for repeated-measures data. Journal of the American Statistical Association 83 404 (1988) 1014-1022
22. Lopes H.F., and West M. Bayesian model assessment in factor analysis. Statistica Sinica 14 (2004) 41-67
23. McLachlan G.J., and Krishnan T. The EM Algorithm and Extensions. 2nd ed. (2008), Wiley, New York
24. McLachlan G.J., and Peel D. Robust cluster analysis via mixtures of multivariate t-distributions. Lecture Notes in Computer Science vol. 1451 (1998), Springer-Verlag, Berlin 658-666
25. McLachlan G.J., and Peel D. Finite Mixture Models (2000), John Wiley & Sons, New York
26. McLachlan G.J., and Peel D. Mixtures of factor analyzers. In: Langley P. (Ed). Seventh International Conference on Machine Learning (2000), Morgan Kaufmann, San Francisco 599-606
27. McLachlan G.J., Peel D., and Bean R.W. Modelling high-dimensional data by mixtures of factor analyzers. Computational Statistics & Data Analysis 41 3-4 (2003) 379-388
28. McNicholas, P.D., Murphy, T.B., 2005. Parsimonious Gaussian mixture models. Technical Report 05/11, Department of Statistics, Trinity College, Dublin
29. McNicholas P.D., and Murphy T.B. Parsimonious Gaussian mixture models. Statistics and Computing 18 3 (2008) 285-296
30. Meng X.L., and Rubin D.B. Maximum likelihood estimation via the ECM algorithm: A general framework. Biometrika 80 (1993) 267-278
31. Meng X.L., and van Dyk. The EM algorithm - An old folk song sung to the fast tune (with discussion). Journal of the Royal Statistical Society. Series B 59 (1997) 511-567
32. Milidiú R.L., and Rentera R.P. Dpls and ppls: Two pls algorithms for large data sets. Computational Statistics and Data Analysis 48 1 (2005) 125-138
33. Pizzuti C., and Talia D. P-autoclass: Scalable parallel clustering for mining large data sets. IEEE Transactions on Knowledge and Data Engineering 15 3 (2003) 629-641
34. Press W.H., Teukolsky S.A., Vetterling W.T., and Flannery B.P. Numerical Recipes in C - The Art of Scientific Computation. 2nd ed. (1992), Cambridge University Press
35. R Development Core Team. R: A Language and Environment for Statistical Computing (2008), R Foundation for Statistical Computing, Vienna, Austria
36. Racine J. Parallel distributed kernel estimation. Computational Statistics & Data Analysis 40 2 (2002) 293-302
37. Raftery A.E., and Dean N. Variable selection for model-based clustering. Journal of the American Statistical Association 101 473 (2006) 168-178
38. Rand W.M. Objective criteria for the evaluation of clustering methods. Journal of the American Statistical Association 66 (1971) 846-850
39. Ripley B.D. Pattern Recognition and Neural Networks (1996), Cambridge University Press, Cambridge, UK
40. Schwartz G. Estimating the dimension of a model. The Annals of Statistics 6 (1978) 31-38
41. Spearman C. The proof and measurement of association between two things. American Journal of Psychology 15 (1904) 72-101
42. Tipping T.E., and Bishop C.M. Mixtures of probabilistic principal component analysers. Neural Computation 11 2 (1999) 443-482
43. Titterington D.M., Smith A.F.M., and Makov U.E. Statistical Analysis of Finite Mixture Distributions (1985), John Wiley & Sons, Chichester
44. Venables W.N., and Ripley B.D. Modern Applied Statistics with S-PLUS. 4th ed. (2002), Springer, New York
45. Yanev P., and Kontoghiorghes E.J. Efficient algorithms for estimating the general linear model. Parallel Computing 32 2 (2006) 195-204