Agglomerative fuzzy K-Means clustering algorithm with selection of number of clusters

IEEE Transactions on Knowledge and Data Engineering

Volumn 20, Issue 11, 2008, Pages 1519-1534

  Li, Mark Junjie ^a   Ng, Michael K ^a   Cheung, Yiu Ming ^b   Huang, Joshua Zhexue ^b  

^a HONG KONG BAPTIST UNIVERSITY   (Hong Kong)

^b UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Agglomerative; Cluster validation; Fuzzy K Means clustering; Number of clusters

Indexed keywords

ALGORITHMS; CHLORINE COMPOUNDS; CLUSTER ANALYSIS; FLOW OF SOLIDS; FUZZY CLUSTERING; SET THEORY; STANDARDS; TWO DIMENSIONAL; WATER SUPPLY SYSTEMS; WINE;

AGGLOMERATIVE; CLUSTER VALIDATION; CLUSTERING PROCESSES; DATA SETS; FUZZY K-MEANS; FUZZY K-MEANS ALGORITHM; FUZZY K-MEANS CLUSTERING; INITIAL CLUSTER CENTERS; K-MEANS CLUSTERING; NEW ALGORITHM; NUMBER OF CLUSTERS; NUMERICAL DATA; OBJECTIVE FUNCTION; PENALTY TERM; SYNTHETIC DATA SETS;

CLUSTERING ALGORITHMS;

EID: 52949101047     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2008.88     Document Type: Article

References (39)

1. A.K. Jain and R.C. Dubes, Algorithms for Clustering Data. Prentice Hall, 1988.
2. M.R. Anderberg, Cluster Analysis for Applications. Academic, 1973.
3. G.H. Ball and D.J. Hall, "A Clustering Technique for Summarizing Multivariate Data," Behavioral Science, vol. 12, pp. 153-155, 1967.
4. E.R. Ruspini, "A New Approach to Clustering," Information Control, vol. 19, pp. 22-32, 1969.
5. J.B. MacQueen, "Some Methods for Classification and Analysis of Multivariate Observations," Proc. Fifth Symp. Math. Statistics and Probability, vol. 1, AD 669871, pp. 281-297, 1967.
6. J.C. Bezdek, "A Convergence Theorem for the Fuzzy ISODATA Clustering Algorithms," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 2, pp. 1-8, 1980.
7. F. Höppner, F. Klawonn, and R. Kruse, "Fuzzy Cluster Analysis: Methods for Classification," Data Analysis, and Image Recognition. Wiley, 1999.
8. R. Krishnapuram, H. Frigui, and O. Nasraoui, "Fuzzy and Possibilistic Shell Clustering Algorithms and Their Application to Boundary Detection and Surface Approximation - Part I and II," IEEE. Trans. Fuzzy Systems, vol. 3, no. 4, pp. 29-60, 1995.
9. F. Hoppner, "Fuzzy Shell Clustering Algorithms in Image Processing: Fuzzy c-Rectangular and 2-Rectangular Shells," IEEE. Trans. Fuzzy Systems, vol. 5, no. 4, pp. 599-613, 1997.
10. G. Hamerly and C. Elkan, "Learning the k in k-Means," Proc. 17th Ann. Conf. Neural Information Processing Systems (NIPS '03), Dec. 2003.
11. Z. Huang, M. Ng, H. Rong, and Z. Li, "Automated Variable Weighting in k-Means Type Clustering," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 5, pp. 657-668, May 2005.
12. G.P. Babu and M.N. Murty, "A Near-optimal Initial Seed Value Selection for K-Means Algorithm Using Genetic Algorithm," Pattern Recognition Letters, vol. 14, pp. 763-769, 1993.
13. K. Krishna and M.N. Murty, "Genetic K-Means Algorithm," IEEE Trans. Systems, Man, and Cybernetics, vol. 29, no. 3, 1999.
14. M. Laszlo and S. Mukherjee, "A Genetic Algorithm Using Hyper-Quadtrees for Low-Dimensional K-Means Clustering," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 4, pp. 533-543, Apr. 2006.
15. M. Laszlo and S. Mukherjee, "A Genetic Algorithm That Exchanges Neighboring Centers for K-Means Clustering," Pattern Recognition Letters, vol. 28, no. 16, pp. 2359-2366, 2007.
16. D. Arthur and S. Vassilvitskii, "K-Means++: The Advantages of Careful Seeding," Proc. 18th Ann. ACM-SIAM Symp. Discrete Algorithms (SODA '07), pp. 1027-1035, 2007.
17. G.W. Mulligan and M.C. Cooper, "An Examination of Procedures for Determining the Number of Clusters in a Data Set," Psychometrika, vol. 50, pp. 159-179, 1985.
18. R. Nikhil and C. James, "On Cluster Validity for the Fuzzy c-Means Model," IEEE Trans. Fuzzy Systems, vol. 3, no. 3, pp. 370-379, 1995.
19. I. Gath and A. Geve, "Unsupervised Optimal Fuzzy Clustering," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 7, pp. 773-781, July 1989.
20. H. Sun, S. Wang, and Q. Jiang, "FCM-Based Model Selection Algorithms for Determining the Number of Clusters," Pattern Recognition, vol. 37, pp. 2027-2037, 2004.
21. M. Rezaee, B. Lelieveldt, and J. Reiber, "A New Cluster Validity Index for the Fuzzy c-Mean," Pattern Recognition Letters, vol. 19, pp. 237-246, 1998.
22. H. Akaike, "A New Look at the Statistical Model Identification, " IEEE Trans. Automatic Control, vol. 19, no. 6, pp. 716-722, 1974.
23. G. Schwarz, "Estimating the Dimension of a Model," Annals of Statistics, vol. 6, pp. 461-464, 1978.
24. B.G. Leroux, "Consistent Estimation of a Mixing Distribution," Annals of Statistics, vol. 20, pp. 1350-1360, 1992.
25. W. Pan, "Booststrapping Likelihood for Model Selection with Small Samples," J. Computational and Graphical Statistics, vol. 8, pp. 225-235, 1999.
26. S. Padhraic, "Model Selection for Probabilistic Clustering Using Cross-Validated Likelihood," Statistics and Computing, vol. 10, pp. 63-72, 2000.
27. M. Windham and A. Cutler, "Information Ratios for Validating Mixture Analyses," Statistical Assoc., vol. 87, pp. 1188-1192, 1992.
28. H. Bozdogan, "Choosing the Number of Component Clusters in the Mixture-Model Using a New Informational Complexity Criterion of the Inverse-Fisher Information Matrix," Information and Classification, pp. 40-54, 1993.
29. M. Geoffrey and P. David, Finite Mixture Models, pp. 202-207, 2000.
30. Y. Cheung, "Maximum Weighted Likelihood via Rival Penalized EM for Density Mixture Clustering with Automatic Model Selection," IEEE Trans. Knowledge and Data Eng., vol. 17, no. 6, pp. 750-761, June 2005.
31. L. Xu, "Rival Penalized Competitive Learning, Finite Mixture, and Multisets Clustering," Pattern Recognition Letters, vol. 18, nos. 11-13, pp. 1167-1178, 1997.
32. L. Xu, "How Many Clusters?: A Ying-Yang Machine Based Theory for a Classical Open Problem in Pattern Recognition," Proc. IEEE Int'l Conf. Neural Networks (ICNN '96), vol. 3, pp. 1546-1551, 1996.
33. P. Guo, C.L. Chen, and M.R. Lyu, "Cluster Number Selection for a Small Set of Samples Using the Bayesian Ying-Yang Model," IEEE Trans. Neural Networks, vol. 13, no. 3, pp. 757-763, 2002.
34. H. Frigui and R. Krishnapuram, "Clustering by Competitive Agglomeration," Pattern Recognition, vol. 30, no. 7, pp. 1109-1119, 1997.
35. S. Miyamoto and M. Mukaidono, "Fuzzy c-means as a Regularization and Maximum Entropy Approach," Proc Seventh Int'l Fuzzy Systems Assoc. World Congress (IFSA '97), vol. 2, pp. 86-92, 1997.
36. W. Rand, "Objective Criteria for the Evaluation of Clustering Methods," J. Am. Statistical Assoc., vol. 66, pp. 846-850, 1971.
37. T. Zhang, R. Ramakrishnan, and M. Livny, "BIRCH: A New Data Clustering Algorithm and Its Applications," Data Mining and Knowledge Discovery, vol. 1, pp. 141-182, 1997.
38. B. Zhang, M. Hsu, and U. Dayal, "K-Harmonic Means - A Data Clustering Algorithm," Technical Report HPL-1999-124, Hewlett-Packard Labs, 1999.
39. G. Hamerly and C. Elkan, "Alternatives to the K-Means Algorithm That Find Better Clusterings," Proc. 11th Int'l Conf. Information and Knowledge Management (IKM '02), pp. 600-607, 2002.