An empirical comparison of four initialization methods for the K-Means algorithm

Pattern Recognition Letters

Volumn 20, Issue 10, 1999, Pages 1027-1040

  Pena J M ^a   Lozano, J A ^a   Larranaga P ^a  

^a Dept Comp Sci and Artif Intell   (Spain)

Author keywords

Genetic algorithms; K Means algorithm; K Means initialization; Partitional clustering

Indexed keywords

CONVERGENCE OF NUMERICAL METHODS; ERROR ANALYSIS; GENETIC ALGORITHMS;

PARTITIONAL CLUSTERING;

PATTERN RECOGNITION;

EID: 0033204902     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0167-8655(99)00069-0     Document Type: Article

References (30)

1. Anderberg M.R. Cluster Analysis for Applications. 1973;Academic Press, New York.
2. Banfield J., Raftery A. Model-based Gaussian and non-Gaussian Clustering. Biometrics. 49:1993;803-821.
3. Bishop C. Neural Networks for Pattern Recognition. 1995;Oxford University Press, Oxford.
4. Bradley, P.S., Fayyad, U.M., 1998. Refining initial points for K-Means clustering. In: Proceedings of the 15th International Conference on Machine Learning, Morgan Kaufmann, San Francisco, CA, pp. 91-99.
5. Chandon J.L., Pinson S. Analyse Typologique. Théories et applications. 1980;Masson, Paris.
6. Cheeseman, P., Stutz, J., 1995. Bayesian classification (AutoClass): Theory and results. In: Advances in Knowledge Discovery and Data Mining. AAAI Press, Menlo Park, CA, pp. 153-180.
7. Davis, L., 1985. Applying adaptive algorithms to epistatic domains. In: Proceedings of the International Joint Conference on Artificial Intelligence, pp. 162-164.
8. Fisher D. Knowledge acquisition via incremental conceptual clustering. Machine Learning. 2:1987;139-172.
9. Fisher D. Iterative optimization and simplification of hierarchical clusterings. J. Artificial Intell. Res. 4:1996;147-179.
10. Fisher, D., Xu, L., Zard, N., 1992. Ordering effects in clustering. In: Proceedings of the Ninth International Conference on Machine Learning. Morgan Kaufmann, San Mateo, CA, pp. 163-168.
11. Forgy E. Cluster analysis of multivariate data: Efficiency vs. interpretability of classifications. Biometrics. 21:1965;768.
12. Fukunaga K. Introduction to Statistical Pattern Recognition. 1990;Academic Press, San Diego, CA.
13. Goldberg D.E. Genetic Algorithms in Search, Optimization and Machine Learning. 1989;Addison-Wesley, Reading, MA.
14. Hartigan J.A. Clustering Algorithms. 1975;Wiley, New York.
15. Higgs R.E., Bemis K.G., Watson I.A., Wikel J.H. Experimental designs for selecting molecules from large chemical databases. J. Chem. Inf. Comput. Sci. 37:1997;861-870.
16. Holland J.H. Adaptation in Natural and Artificial Systems. 1975;University of Michigan Press, Michigan.
17. Jain A.K., Dubes R.C. Algorithms for Clustering Data. 1988;Prentice-Hall, Englewood Cliffs, NJ.
18. Kaufman L., Rousseeuw P.J. Finding Groups in Data. An Introduction to Cluster Analysis. 1990;Wiley, Canada.
19. Kruskal, W.H., Wallis, W.A., 1952. Use of ranks in one-criterion analysis of variance. J. Amer. Statist. Assoc. 47, 583-621; errata, ibid., 48, 907-911.
20. Kruskal, W.H., Wallis, W.A., 1952. Use of ranks in one-criterion analysis of variance. J. Amer. Statist. Assoc. 47, 583-621; errata, ibid., 48, 907-911.
21. MacQueen, J.B., 1967. Some methods for classification and analysis of multivariate observations. In: Proceedings of the Symposium on Mathematics and Probability, 5th, Berkely, Vol. 1, AD 669871. University of California Press, Berkeley, CA, pp. 281-297.
22. McLachlan G.J., Basford K.E. Mixture Models. 1988;Marcel Dekker, New York.
23. Meila, M., Heckerman, D., 1998. An experimental comparison of several clustering and initialization methods. In: Proceedings of the 14th Conference on Uncertainty in Artificial Intelligence. Morgan Kaufmann, San Francisco, CA, pp. 386-395.
24. Merz, C., Murphy, P., Aha, D., 1997. UCI repository of Machine Learning databases. Department of Information and Computer Science, University of California, Irvine. http://www.ics.uci.edu/mlearn/MLRepository.html.
25. Milligan G.W. An examination of the effect of six types of error perturbation on fifteen clustering algorithms. Psychometrika. 45:1980;325-342.
26. Roure, J., Talavera, L., 1998. Robust incremental clustering with bad instance orderings: a new strategy. In: Helder Coelho (Eds.), Proceedings of the 6th Iberoamerican Conference on Artificial Intelligence, Lisbon, pp. 136-147.
27. Selim S.Z., Ismail M.A. K-Means-type algorithms: a generalized convergence theorem and characterization of local optimality. IEEE Trans. Pattern Anal. Machine Intell. 6:1984;81-87.
28. Snarey M., Terrett N.K., Willet P., Wilton D.J. Comparison of algorithms for dissimilarity-based compound selection. J. Mol. Graphics and Modelling. 15:1997;372-385.
29. Tou J., González R. Pattern Recognition Principles. 1974;Addison-Wesley, Reading, MA.
30. Ward J.H. Hierarchical grouping to optimize an objective function. J. Amer. Statist. Assoc. 58:1963;236-244.