Consistent selection of the number of clusters via crossvalidation

Biometrika

Volumn 97, Issue 4, 2010, Pages 893-904

  Wang, Junhui ^a  

^a UNIVERSITY OF ILLINOIS AT CHICAGO   (United States)

Author keywords

Cluster analysis; Crossvalidation; k means; Selection consistency; Spectral clustering; Stability

Indexed keywords

EID: 78651282047     PISSN: 00063444     EISSN: 14643510     Source Type: Journal    
DOI: 10.1093/biomet/asq061     Document Type: Article

References (23)

1. BEN-DAVID, S., VON LUXBURG, U. & PAL, D. (2006). A sober look at stability of clustering. In Proc. 19th Ann. Conf. Learn. Theory (COLT 2006), Ed. G. Lugosi and H. Simon, pp. 5-19. Berlin: Springer.
2. BEN-HUR, A., ELISSEEFF, A. & GUYON, I. (2002). A stability based method for discovering structure in clustered data. In Pac. Symp. Biocomp. 2002, 6-17.
3. BURMAN, P. (1989). A comparative study of ordinary cross-validation, v-fold crossvalidation and the repeated learningtesting methods. Biometrika 76, 503-14.
4. CALINSKI, R. B. & HARABASZ, J. (1974). A dendrite method for cluster analysis. Commun. Statist. 3, 1-27.
5. GEISSER, S. (1975). The predictive sample reuse method with applications. J. Am. Statist. Assoc. 70, 320-8.
6. HARTIGAN, J. A. (1975). Clustering Algorithms. New York: Wiley.
7. JANSON, S. (2004). Large deviations for sums of partly dependent random variables. Random Struct. Algor. 24, 234-48.
8. KAUFMAN, L. & ROUSSEEUW, P. (1990). Finding Groups in Data: An Introduction to Cluster Analysis. New York: Wiley.
9. KRIEGER, A. M. & GREEN, P. E. (1999). A cautionary note on using internal crossvalidation to select the number of clusters. Psychometrika 64, 341-53.
10. KRZANOWSKI, W. J. & LAI, Y. T. (1985). A criterion for determining the number of clusters in a data set. Biometrics 44, 23-34.
11. LANGE, T., ROTH, V., BRAUN, M. & BUHMANN, J. (2004). Stability-based validation of clustering solutions. Neural Comp. 16, 1299-323.
12. MCCULLAGH, P. & YANG, J. (2008). How many clusters? Bayesian Anal. 3, 101-20.
13. NG, A., JORDAN, M. & WEISS, Y. (2001). On spectral clustering: analysis and an algorithm. In Adv. Neural. Info. Processing Sys. (NIPS2001), Ed. T. Dietterich, S. Becker and Z. Ghahramani, pp. 849-56. Cambridge: MIT Press.
14. PEDRYCZ, W. (2005). Interpretation of clusters in the framework of shadowed sets. Pat. Recog. Lett. 26, 2439-49.
15. SHAMIR, O. & TISHBY, T. (2007). Cluster stability for finite samples. In Adv. Neural Info. Processing Sys. (NIPS2007), Ed. J. Platt, D. Koller, Y. Singer and S. Roweis, pp. 1297-304. Cambridge: MIT Press.
16. SHAO, J. (1993). Linear model selection by cross-validation. J. Am. Statist. Assoc. 88, 486-94.
17. SUGAR, C. & JAMES, G. (2003). Finding the number of clusters in a data set: an information theoretic approach. J. Am. Statist. Assoc. 98, 750-63.
18. TIBSHIRANI, R., WALTHER, G., BOTSTEIN, D. & BROWN, P. (2001a). Cluster validation by prediction strength. J. Comp. Graph. Statist. 14, 511-528.
19. TIBSHIRANI, R., WALTHER, G. & HASTIE, T. (2001b). Estimating the number of clusters in a data set via the gap statistic. J. R. Statist. Soc. B 63, 411-23.
20. VON LUXBURG, U., BELKIN, M. & BOUSQUET, O. (2008). Consistency of spectral clustering. Ann. Statist. 36, 555-86.
21. YANG, Y. (2006). Comparing learning methods for classification. Statist. Sinica 16, 635-57.
22. YANG, Y. (2007). Consistency of crossvalidation for comparing regression procedures. Ann. Statist. 35, 2450-73.
23. ZHANG, P. (1993). Model selection via multifold crossvalidation. Ann. Statist. 21, 299-313.