Evaluating Mixture Modeling for Clustering: Recommendations and Cautions

Psychological Methods

Volumn 16, Issue 1, 2011, Pages 63-79

  Steinley, Douglas ^a   Brusco, Michael J ^b  

^a UNIVERSITY OF MISSOURI   (United States)

^b FLORIDA STATE UNIVERSITY   (United States)

Author keywords

Cluster analysis; K means clustering; Mixture modeling

Indexed keywords

ARTICLE; BEHAVIORAL RESEARCH; CLUSTER ANALYSIS; HUMAN; METHODOLOGY; MONTE CARLO METHOD; MULTIVARIATE ANALYSIS; SAMPLE SIZE; STATISTICAL ANALYSIS; STATISTICAL MODEL;

BEHAVIORAL RESEARCH; CLUSTER ANALYSIS; DATA INTERPRETATION, STATISTICAL; HUMANS; MODELS, STATISTICAL; MONTE CARLO METHOD; MULTIVARIATE ANALYSIS; SAMPLE SIZE;

EID: 79952595368     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0022673     Document Type: Article

References (106)

1. Arabie P., Hubert L. Combinatorial data analysis. Annual Review of Psychology 1992, 43:169-203.
2. Balakrishnan P.V., Cooper M.C., Jacob V.S., Lewis P.A. A study of classification capabilities of neural networks using unsupervised learning: A comparison with K-means clustering. Psychometrika 1994, 59:509-525.
3. Banerjee T., Paul S.R. An extension of Morel-Nagaraj's finite mixture distribution for modelling multinomial clustered data. Biometrika 1999, 86:723-727.
4. Banfield J.D., Raftery A.E. Model-based Gaussian and non-Gaussian clustering. Biometrics 1993, 49:803-821.
5. Bartholomew D.J., Knott M. Latent variable models and factor analysis 1999, Arnold, London, England.
6. Beadnell B., Morrison D.M., Wilsdon A., Wells E.A., Murowchick E., Hoppe M., Nahom D. Condom use, frequency of sex, and number of partners: Multidimensional characterization of adolescent sexual risk-taking. Journal of Sex Research 2005, 42:192-202.
7. Beauchaine T.P., Beauchaine R.J. A comparison of maximum covariance and K-means cluster analysis in classifying cases into known taxon groups. Psychological Methods 2002, 7:245-261.
8. Blashfield R.K. Mixture model tests of cluster analysis: Accuracy of four agglomerative hierarchical methods. Psychological Bulletin 1976, 83:377-388.
9. Brusco M.J. Clustering binary data in the presence of masking variables. Psychological Methods 2004, 9:510-523.
10. Brusco M.J., Cradit J.D. A variable-selection heuristic for K-means clustering. Psychometrika 2001, 66:249-270.
11. Brusco M.J., Steinley D. A comparison of heuristic procedures for minimum within-cluster sums of squares partitioning. Psychometrika 2007, 72:583-600.
12. Calinski R.B., Harabasz J. A dendrite method for cluster analysis. Communications in Statistics 1974, 3:1-27.
13. Carpenter K.M., Liu X., Hasin D.S. The type A-type B classification in a community sample of problem drinkers: Structural and predictive validity. Addictive Behaviors 2006, 31:15-30.
14. Cleland C.M., Rothschild L., Haslam N. Detecting latent taxa: Monte Carlo comparison of taxometric, mixture model, and clustering procedures. Psychological Reports 2000, 87:37-47.
15. Cormack R.M. A review of classification. Journal of the Royal Statistical Society A 1971, 134:321-367.
16. Dasgupta A., Raftery A.E. Detecting features in spatial point processes with clutter via model-based clustering. Journal of the American Statistical Association 1998, 93:294-302.
17. Day N.E. Estimating the components of a mixture of normal distributions. Biometrika 1969, 56:463-474.
18. De Boeck P., Wilson M., Acton G.S. A conceptual and psychometric framework for distinguishing categories and dimensions. Psychological Review 2005, 112:129-158.
19. de Craen S., Commandeur J.J.F., Frank L.E., Heiser W.J. Effects of group size and lack of sphericity on the recovery of clusters in K-means cluster analysis. Multivariate Behavioral Research 2006, 41:127-145.
20. Dempster A.P., Laird N.M., Rubin D.B. Maximum likelihood from incomplete data via the E-M algorithm. Journal of the Royal Statistical Society B 1977, 39:1-38.
21. Dick N.P., Bowden D.C. Maximum likelihood estimation for mixtures of two normal distributions. Biometrics 1973, 29:781-790.
22. Ding C.S. Multidimensional scaling modelling approach to latent profile analysis in psychological research. International Journal of Psychology 2006, 41:226-238.
23. Donoghue J.R. The effects of within-group covariance structure on recovery in cluster analysis: I. The bivariate case. Multivariate Behavioral Research 1995, 30:227-254.
24. Everitt B.S. A Monte Carlo investigation of the likelihood ratio test for the number of components in a mixture of normal distributions. Multivariate Behavioral Research 1981, 16:171-180.
25. Fraley C. Algorithms for model-based Gaussian hierarchical clustering. SIAM Journal on Scientific Computing 1998, 20:270-281.
26. Fraley C., Raftery A.E. How many clusters? Which clustering method? Answers via model-based cluster analysis. Computer Journal 1998, 41:578-588.
27. Ganesalingam S. Classification and mixture approach to clustering via maximum likelihood. Applied Statistics 1989, 38:455-466.
28. Gibson W.A. Three multivariate models: Factor analysis, latent structure analysis and latent profile analysis. Psychometrika 1959, 24:229-252.
29. Gold E.M., Hoffman P.J. Flange detection cluster analysis. Multivariate Behavioral Research 1976, 11:217-235.
30. Hartigan J.A. Statistical theory in clustering. Journal of Classification 1985, 2:63-76.
31. Helsen K., Green P.E. A computational study of replicated clustering with an application to market segmentation. Decision Sciences 1991, 22:1124-1141.
32. Hicks B.M., Markon K.E., Patrick C.J., Kreuger R.F., Newman J.P. Identifying psychopathy subtypes on the basis of personality structure. Psychological Assessment 2004, 16:276-288.
33. Hoijtink H., Notenboom A. Model based clustering of large data sets: Tracing the development of spelling ability. Psychometrika 2004, 69:481-498.
34. Hubert L.J., Arabie P. Comparing partitions. Journal of Classification 1985, 2:193-218.
35. Hwang H., Dillon W.R., Takane Y. An extension of multiple correspondence analysis for identifying heterogeneous subgroups of respondents. Psychometrika 2006, 71:161-171.
36. Iqbal K., Flory M., Khatoon S., Soininen H., Pirttila T., Lehtovirta M., Grundke-Iqbal I. Subgroups of Alzheimer's disease based on cerebrospinal fluid molecular markers. Annals of Neurology 2005, 58:748-757.
37. Johnson R.A., Wichern D.W. Applied multivariate statistical analysis 2002, Prentice Hall, Upper Saddle River, NJ.
38. Knotkova H., Clark W.C., Keohan M.L., Kuhl J.P., Winer R.T., Wharton R.N. Validation of the multidimensional affect and pain survey (MAPS). Journal of Pain 2006, 7:161-169.
39. Kogan J. Introduction to clustering large and high-dimensional data 2007, Cambridge University Press, New York, NY.
40. Kuiper F.K., Fisher L. A Monte Carlo comparison for six clustering procedures. Biometrics 1975, 31:777-784.
41. Larsson G., Kempe C., Starrin B. Appraisal and coping processes in acute time-limited stressful situations: A study of police officers. European Journal of Personality 1988, 2:259-276.
42. Law M.H.C., Figueiredo M.A.T., Jain A.K. Simultaneous feature selection and clustering using mixture models. IEEE Transactions on Pattern Analysis and Machine Intelligence 2004, 26:1154-1166.
43. Lazarsfeld P.F. The logical and mathematical foundations of latent structure analysis. Measurement and prediction 1950, 362-412. Princeton University Press, Princeton, NJ. S.A. Stouffer (Ed.).
44. Lazarsfeld P.F., Henry N.W. Latent structure analysis 1968, Houghton-Mifflin, New York, NY.
45. Leese M., Landau S. Model-based clustering using S-PLUS. International Journal of Methods in Psychiatric Research 2006, 15:146-156.
46. Lenzenweger M.F., McLachlan G., Rubin D.B. Resolving the latent structure of schizophrenia endophenotypes using expectation-maximization-based finite mixture modeling. Journal of Abnormal Psychology 2007, 116:16-29.
47. Muthén B. Second-generation structural equation modeling with a combination of categorical and continuous variables: New opportunities for latent class/latent growth modeling. New methods for the analysis of change 2001, 291-322. American Psychological Association, Washington, DC. L.M. Collins, A. Sayer (Eds.).
48. Muthén B. Beyond SEM: General latent variable modeling. Behaviormetrika 2002, 29:81-117.
49. Lubke G.H., Muthén B. Investigating population heterogeneity with factor mixture models. Psychological Methods 2005, 10:21-39.
50. Lubke G.H., Neale M.C. Distinguishing between latent classes and continuous factors: Resolution by maximum likelihood?. Multivariate Behavioral Research 2006, 41:499-532.
51. MacQueen J. Some methods of classification and analysis of multivariate observations. Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability 1967, 1:281-297. University of California Press, Berkeley, CA. L.M. Le Cam, J. Neyman (Eds.).
52. Markatou M. Mixture models, robustness, and the weighted likelihood methodology. Biometrics 2000, 56:483-486.
53. Markon K.E., Krueger R. Information-theoretic latent distribution modeling: Distinguishing discrete and continuous latent variable models. Psychological Methods 2006, 11:228-243.
54. Martinez W.L., Martinez A.R. Exploratory data analysis with MATLAB 2005, Chapman & Hall/CRC, Boca Raton, FL.
55. McCrae J.S., Chapman M.V., Christ S.L. Profile of children investigated for sexual abuse: Association with psychopathology symptoms and services. American Journal of Orthopsychiatry 2006, 76:468-481.
56. McDonald R.P. Nonlinear factor analysis (Psychometric Monographs No. 15) 1967, Psychometric Corporation, Richmond, VA.
57. McLachlan G.J. On the choice of starting values for the EM algorithm in fitting mixture models. Statistician 1988, 37:417-425.
58. McLachlan G.J., Basford K.E. Mixture models: Inference and applications to clustering 1988, Marcel Dekker, New York, NY.
59. McLachlan G.J., Khan N. On a resampling approach for test on the number of clusters with mixture model-based clustering of tissue samples. Journal of Multivariate Analysis 2004, 90:90-105.
60. McLachlan G.J., Krishnan T. The EM algorithm and extensions 1997, Wiley, New York, NY.
61. McLachlan G.J., Peel D. Finite mixture models 2000, Wiley, New York, NY.
62. Meila M., Heckerman D. An experimental comparison of model-based clustering methods. Machine Learning 2001, 42:9-29.
63. Milligan G.W. An examination of the effect of six types of error perturbation on fifteen clustering algorithms. Psychometrika 1980, 45:325-342.
64. Milligan G.W. Clustering validation, results and implications for applied analysis. Clustering and classification 1996, 341-375. World Scientific, River Edge, NJ. P. Arabie, L.J. Hubert, G. De Soete (Eds.).
65. Milligan G.W., Cooper M.C. An examination of procedures for determining the number of clusters in a data set. Psychometrika 1985, 50:159-179.
66. Milligan G.W., Cooper M.C. A study of the comparability of external criteria for hierarchical cluster analysis. Multivariate Behavioral Research 1986, 21:441-458.
67. Milligan G.W., Cooper M.C. A study of standardization of variables in cluster analysis. Journal of Classification 1988, 5:181-204.
68. Milligan G.W., Sokol L.M. A two-stage clustering algorithm with robust recovery characteristics. Educational & Psychological Measurement 1980, 40:755-759.
69. Milligan G.W., Soon S.C., Sokol L.M. The effect of cluster size, dimensionality, and the number of clusters on recovery of true cluster structure. IEEE Transactions on Pattern Analysis and Machine Intelligence 1983, 5:40-47.
70. Molenaar P.C.M., von Eye A. On the arbitrary nature of latent variables. Latent variable analysis 1994, 226-242. Sage, Thousand Oaks, CA. A. von Eye, C.C. Clogg (Eds.).
71. Morris S.B., DeShon R.P. Combining effect size estimates in meta-analysis with repeated measures and independent groups designs. Psychological Methods 2002, 7:105-125.
72. Mun E.Y., von Eye A., Bates M.E., Vaschillo E.G. Finding groups using model-based cluster analysis: Heterogeneous emotional self-regulatory processes and heavy alcohol use risk. Developmental Psychology 2008, 44:481-495.
73. Mun E.Y., Windle M., Schainker L.M. A model-based cluster analysis approach to adolescent problem behaviors and young adult outcomes. Development and Psychopathology 2008, 20:291-318.
74. Neumann J., von Cramon D.Y., Lohmann G. Model-based clustering of meta-analytic functional imaging data. Human Brain Mapping 2008, 29:177-192.
75. Oxford M.L., Gilchrist L.D., Lohr M.J., Gillmore M.R., Morrison D.M., Spieker S.J. Life course heterogeneity in the transition from adolescence to adulthood among adolescent mothers. Journal of Research on Adolescence 2005, 15:479-504.
76. Pastor D.A., Barron K.E., Miller B.J., Davis S.L. A latent profile analysis of college students' achievement goal orientation. Contemporary Educational Psychology 2007, 32:8-47.
77. Pearson K. Contributions to the theory of mathematical evolution. Philosophical Transactions of the Royal Society of London A 1894, 185:71-110.
78. Raftery A.E., Dean N. Variable selection for model-based clustering. Journal of the American Statistical Association 2006, 101:168-178.
79. Rao C.R. The utilization of multiple measurements in problems of biological classification. Journal of the Royal Statistical Association B 1948, 10:159-193.
80. Richardson J.T.E. Mental models of learning in distance education. British Journal of Educational Psychology 2007, 77:253-270.
81. Roeder K. A graphical technique for determining the number of components in a mixture of normals. Journal of the American Statistical Association 1994, 89:487-495.
82. Ryan R., Martin A., Brooks-Gunn J. Is one good parent enough? Patterns of mother and father parenting and child cognitive outcomes at 24 and 36 months. Parenting: Science and Practice 2006, 6:211-228.
83. Schwarz G. Estimating the dimension of a model. Annals of Statistics 1978, 6:461-464.
84. Skeem J., Johansson P., Andershed H., Kerr M., Louden J.E. Two subtypes of psychopathic violent offenders that parallel primary and secondary variants. Journal of Abnormal Psychology 2007, 116:395-409.
85. Steinley D. Local optima in K-means clustering: What you don't know may hurt you. Psychological Methods 2003, 8:294-304.
86. Steinley D. Properties of the Hubert-Arabie adjusted Rand index. Psychological Methods 2004, 9:386-396.
87. Steinley D. Standardizing variables in K-means clustering. Classification, clustering, and data mining applications 2004, 53-60. Springer, New York, NY. D. Banks, L. House, F.R. McMorris, P. Arabie, W. Gaul (Eds.).
88. Steinley D. Curse of dimensionality. Encyclopedia of measurement and statistics 2006, 209-211. Sage, Thousand Oaks, CA. N.J. Salkind (Ed.).
89. Steinley D. K-means clustering: A half-century synthesis. British Journal of Mathematical and Statistical Psychology 2006, 59:1-34.
90. Steinley D. Profiling local optima in K-means clustering: Developing a diagnostic technique. Psychological Methods 2006, 11:178-192.
91. Steinley D., Brusco M.J. Initializing K-means batch clustering: A critical evaluation of several techniques. Journal of Classification 2007, 24:99-121.
92. Steinley D., Brusco M.J. A new variable weighting and selection procedure for K-means cluster analysis. Multivariate Behavioral Research 2008, 43:77-108.
93. Steinley D., Brusco M.J. Selection of variables in cluster analysis: An empirical comparison of eight procedures. Psychometrika 2008, 73:125-144.
94. Steinley D., Henson R. OCLUS: An analytic method for generating clusters with known overlap. Journal of Classification 2005, 22:221-250.
95. Steinley D., McDonald R.P. Examining factor score distributions to determine the nature of latent spaces. Multivariate Behavioral Research 2007, 42:133-156.
96. Stephens M. Dealing with label switching in mixture models. Journal of the Royal Statistical Society B 2000, 62:795-809.
97. Thorndike R.L. Who belongs in the family?. Psychometrika 1953, 18:267-276.
98. Tibshirani R., Walther G., Hastie T. Estimating the number of clusters in a dataset via the Gap statistic. Journal of the Royal Statistical Society B 2001, 63:411-423.
99. Tonidandel S., Overall J.E. Determining the number of clusters by sampling with replacement. Psychological Methods 2004, 9:238-249.
100. Velicer W.F., Redding C.A., Anatchkova M.D., Fava J.L., Prochaska J.O. Identifying clusters subtypes for the prevention of adolescent smoking acquisition. Addictive Behaviors 2007, 32:228-247.
101. Vermunt J., Magdison J. Latent class cluster analysis. Applied latent class analysis 2002, 89-106. Cambridge University Press, Cambridge, England. J.A. Hagenaars, A.L. McCutcheon (Eds.).
102. Wade T.D., Crosby R.D., Martin N.G. Use of latent profile analysis to identify eating disorder phenotypes in an adult Australian twin cohort. Archives of General Psychiatry 2006, 63:1377-1384.
103. Waller N.G., Kaiser H.A., Illian J.B., Manry M. A comparison of the classification capabilities of the 1-dimensional Kohonen neural network with two partitioning and three hierarchical cluster analysis algorithms. Psychometrika 1998, 63:5-22.
104. Ward J.H. Hierarchical grouping to optimize an objective function. Journal of the American Statistical Association 1963, 58:236-244.
105. Williamson J.R. A constructive, incremental-learning network for mixture modeling and classification. Neural Computation 1997, 9:1517-1543.
106. Wolfe J.H. Pattern clustering by multivariate mixture analysis. Multivariate Behavioral Research 1970, 5:329-350.