Profiling local optima in K-means clustering: Developing a diagnostic technique

Psychological Methods

Volumn 11, Issue 2, 2006, Pages 178-192

  Steinley, Douglas ^a  

^a UNIVERSITY OF MISSOURI   (United States)

Author keywords

Cluster validation; K means clustering; Local optima

Indexed keywords

ALGORITHM; ARTICLE; CLUSTER ANALYSIS; COMPUTER PROGRAM; FACTORIAL ANALYSIS; HUMAN; MATHEMATICAL COMPUTING; MONTE CARLO METHOD; NONPARAMETRIC TEST; PSYCHOLOGY; STATISTICAL ANALYSIS; STATISTICS;

ALGORITHMS; CLUSTER ANALYSIS; DATA INTERPRETATION, STATISTICAL; FACTOR ANALYSIS, STATISTICAL; HUMANS; MATHEMATICAL COMPUTING; MONTE CARLO METHOD; PSYCHOLOGY; SOFTWARE; STATISTICS, NONPARAMETRIC;

EID: 33745700805     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/1082-989X.11.2.178     Document Type: Article

References (52)

1. Agresti, A. (1996). An introduction to categorical data analysis. New York: Wiley.
2. Anderberg, M. R. (1973). Cluster analysis for applications. New York: Academic Press.
3. Atlas, R. S., & Overall, J. E. (1994). A comparative evaluation of two superior stopping rules for hierarchical cluster analysis. Psychometrika, 59, 581-591.
4. Bartholomew, D. J., & Knott, M. (1999). Latent variable models and factor analysis. London: Arnold.
5. Baync, C. K., Bcauchamp, J. J., Begovich, C. L., & Kane, V. E. (1980). Monte Carlo comparisons of selected clustering procedures. Pattern Recognition, 12, 51-62.
6. Beauchaine, T. P., & Beauchaine, R. J. (2002). A comparison of maximum covariance and K-means cluster analysis in classifying cases into known taxon groups. Psychological Methods, 7, 245-261.
7. Blashfield, R. K., & Aldenderfer, M. S. (1988). The methods and problems of cluster analysis. In J. Nesselroade & R. B. Cattell (Eds.), Handbook of multivariate experimental psychology (2nd ed., pp. 447-474). New York: Plenum Press.
8. Brusco, M. J. (2004). Clustering binary data in the presence of masking variables. Psychological Methods, 9, 510-523.
9. Bruseo. M. J. (in press). A repetitive branch-and-bound algorithm for minimum within-cluster sum of squares partitioning. Psychometrika.
10. Brusco, M. J., & Cradit. J. D. (2001). A variable-selection heuristic for K-means clustering. Psychometrika, 66, 249-270.
11. Brusco, M. J., & Cradit, J. D. (2005). Bicriterion methods for partitioning dissimilarity matrices. British Journal of Mathematical and Statistical Psychology, 58, 333-343.
12. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
13. Donoghue, J. R. (1995). The effects of within-group covariance structure on recovery in cluster analysis: I. The bivariate case. Multivariate Behavioral Research, 30, 227-254.
14. Du Merle, O., Hansen, P.. Jaumard, B., & Mladenovic. N. (2000). An interior point algorithm for minimum sum-of-squares clustering. SIAM Journal on Scientific Computing, 21, 1485-1505.
15. Falkenauer, E., & Marchand, A. (2001, June). Using K-means? Consider ArrayMiner. Paper presented at. the annual International Conference on Mathematics and Engineering Techniques in Medicine and Biological Sciences, Las Vegas, NV.
16. Fisher, R. A. (1936). The use of multiple measurements in taxonomic problems. Annals of Eugenics, 7, 179-188.
17. Gold, E. M., & Hoffman. P. J. (1976). Flange detection cluster analysis. Multivariate Behavioral Research, II, 217-235.
18. Hartigan, J. A. (1975). Clustering algorithms. New York: Wiley.
19. Hartigan, J. A., & Wong. M. A. (1979). Algorithm AS136: A K-means clustering algorithm. Applied Statistics, 28, 100-108.
20. Henson, R., & Douglas, J. (2005). Test, construction for cognitive diagnosis. Applied Psychological Measurement, 29, 262-277.
21. Hubert. L. (1987). Assignment methods in combinatorial analysis. New York: Marcel Dekker.
22. Hubert, L., & Arabie, P. (1985). Comparing partitions. Journal of Classification, 2, 193-218.
23. Hubert, L., Arabie, P.. & Meulman, J. (2001). Combinatorial data analysis: Optimization by dynamic programming. Philadelphia: Society for Industrial and Applied Mathematics.
24. Hubert, L., Arabie, P.. & Meulman, J. (2002). Linear unidimensional scaling in the L2 norm: Basic optimization methods using MATLAB. Journal of Classification, 19, 303-328.
25. Hubert, L., Arabie, P., & Meulman, J. (2006). The structural representation of proximity matrices with MATLAB. Philadelphia: Society for Industrial and Applied Mathematics.
26. Jancey, R. C. (1966). Multidimensional group analysis. Australian Journal of Botany. 14. 127-130.
27. Krieger, A. M., & Green, P. F. (1999). A cautionary note on using internal cross validation to select the number of clusters. Psychometrika, 64, 341-353.
28. Kuiper, F. K., & Fisher, L. (1975). A Monte Carlo comparison for six. clustering procedures. Biometrics, 31, 777-784.
29. MacQueen, J. (1967). Some methods of classification and analysis of multivariate observations. In L. M. Le Cam & J. Neyman (Fkls.), Proceedings of the fifth Berkeley symposium on mathematical statistics and probability (Vol. 1, pp. 281-297). Berkeley: University of California Press.
30. Makarenkov, V., & Legendre, P. (2001). Optimal variable weighting for ultrametric and additive trees and K-means partitioning: Methods and software. Journal of Classification. 18, 245-271.
31. Maitinez, W. L., & Martinez, A. R. (2002). Computational statistics handbook with MATLAB. Boca Ralon, FL: Chapman & Hall.
32. Martinez, W. L., & Martinez, A. R. (2005). Exploratory data analysis with MATLAB. Boca Raton, FL: Chapman & Hall.
33. MathWorks. (2004). Using MATLAB (Version 7) [Computer software manual], Natick, MA: Author.
34. Mclntyre, R. M., & Blashfield, R. K. (1980). A nearest-centroid technique for evaluating the minimum-variance clustering procedure. Multivariate Behavioral Research, 15, 225-238.
35. Milligan. G. W. (1980). An examination of the effect of six types of error perturbation on fifteen clustering algorithms. Psychometrika. 45, 325-342.
36. Milligan, G. W. (1985). An algorithm for generating artificial test clusters. Psychom.etrika, 50. 123-127.
37. Milligan, G. W. (1996). Clustering validation, results and implications for applied analysis. In P. Arabie, L. J. Hubert, & G. De Soete (Eds.), Clustering and classification (pp. 341-375). River Edge, NJ: World Scientific.
38. Milligan, G. W., & Cooper, M. C. (1985). An examination of procedures for determining the number of clusters in a data set. Psychometrika, 50, 159-179.
39. Milligan. G. W., & Cooper, M. C. (1986). A study of the comparability of external criteria for hierarchical cluster analysis. Multivariate Behavioral Research, 21, 441-458.
40. Milligan. G. W., & Cooper, M. C. (1988). A study of variable standardization. Journal of Classification, 5, 181-204.
41. Morey, L. C., Blashfield, R. K., & Skinner, H. A. (1983). A comparison of cluster analysis techniques within a sequential validation framework. Multivariate Behavioral Research, 18, 309-329.
42. Price, L. J. (1993). Identifying cluster overlap wilh NORMIX population membership probabilities. Multivariate Behavioral Research, 28, 235-262.
43. Steinley, D. (2003). K-means clustering: What you don't know may hurl you. Psychological Methods, 8, 294-304.
44. Stanley, D. (2004a). Properties of the Hubert-Arabie adjusted Rand index. Psychological Methods, 9, 386-396.
45. Steinley, D. (2004b). Standardizing variables in K-means clustering. In D. Banks, L. House, F. R. McMorris, P. Arabie, & W. Gaul (Eds.), Classification, clustering, and data mining applications (pp. 53-60). New York: Springer.
46. Steinley, D. (in press). K-means clustering: A half-century synthesis. British Journal of Mathematical and Statistical Psychology.
47. Steinley, D., & Brusco, M. J. (2005). Initializing K-means clustering: A critical analysis of several techniques. Manuscript submitted for publication.
48. Steinley, D., & Henson, R. (2005). OCLUS: An analytic method for generating clusters with known overlap. Journal of Classification, 22, 221-250.
49. Tibshirani, R., Wallher, G., & Hastie, T. (2001). Estimating the number of clusters in a data set via the gap statistic. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 63, 411-423.
50. Tonidandel, S., & Overall, J. E. (2004). Determining the number of clusters by sampling with replacement. Psychological Methods, 9, 238-249.
51. Walker, I., & Milne, S. (2005). Exploring function estimators as an alternative to regression in psychology. Behavior Research Mettwds, 37, 23-36.
52. Waller, N. G., Kaiser, H. A., Illian. J. B., & Manry, M. (1998). A comparison of the classification capabilities of the 1-dimensional Kohonen neural network with two partitioning and three hierarchical cluster analysis algorithms. Psychometrika, 63, 5-22.