Understanding and enhancement of internal clustering validation measures

IEEE Transactions on Cybernetics

Volumn 43, Issue 3, 2013, Pages 982-994

  Liu, Yanchi ^a,b   Li, Zhongmou ^b   Xiong, Hui ^b   Gao, Xuedong ^c   Wu, Junjie ^d   Wu, Sen ^c  

^a NEW JERSEY INSTITUTE OF TECHNOLOGY   (United States)

^b RUTGERS UNIVERSITY   (United States)

^c University of Science and Technology Beijing   (China)

^d BEIHANG UNIVERSITY   (China)

Author keywords

Clustering validation index based on nearest neighbors (CVNN); Internal clustering validation measure; k nearest neighbor (kNN)

Indexed keywords

APPLICATION SCENARIO; CLUSTERING APPLICATIONS; INTERNAL CLUSTERING VALIDATION MEASURE; K NEAREST NEIGHBOR (KNN); MULTIPLE OBJECTS; NEAREST NEIGHBORS; SYNTHETIC DATA; VALIDATION INDEX;

ALGORITHM; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; CLUSTER ANALYSIS; COMPUTER SIMULATION; PROCEDURES; STATISTICAL ANALYSIS; STATISTICAL MODEL; VALIDATION STUDY; ARTICLE; METHODOLOGY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; CLUSTER ANALYSIS; COMPUTER SIMULATION; DATA INTERPRETATION, STATISTICAL; MODELS, STATISTICAL; PATTERN RECOGNITION, AUTOMATED;

EID: 84890434201     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2012.2220543     Document Type: Article

References (45)

1. Y. Liu, Z. Li, H. Xiong, X. Gao, and J. Wu, "Understanding of internal clustering validation measures," in Proc. IEEE Int. Conf. Data Mining, 2010, pp. 911-916.
2. N. Guan, D. Tao, Z. Luo, and B. Yuan, "NeNMF: An optimal gradient method for nonnegative matrix factorization," IEEE Trans. Signal Process., vol. 60, no. 6, pp. 2882-2898, Jun. 2012.
3. T. Zhou, D. Tao, and X. Wu, "Manifold elastic net: A unified framework for sparse dimension reduction," Data Mining Knowl. Discov., vol. 20, no. 3, pp. 340-371, May 2011.
4. N. Guan, D. Tao, Z. Luo, and B. Yuan, "Online non-negative matrix factorization with robust stochastic approximation," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 7, pp. 1087-1099, Jul. 2012.
5. U.Maulik and S. Bandyopadhyay, "Performance evaluation of some clustering algorithms and validity indices," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 12, pp. 1650-1654, Dec. 2002.
6. A. K. Jain and R. C. Dubes, Algorithms for Clustering Data. Upper Saddle River, NJ: Prentice-Hall, 1988.
7. J. Wu, H. Xiong, and J. Chen, "Adapting the right measures for k-means clustering," in Proc. ACM SIGKDD, 2009, pp. 877-886.
8. P.-N. Tan, M. Steinbach, and V. Kumar, Introduction to Data Mining, 1st ed. Boston, MA: Addison-Wesley, 2005.
9. M. Brun, C. Sima, J. Hua, J. Lowey, B. Carroll, E. Suh, and E. R. Dougherty, "Model-based evaluation of clustering validation measures," Pattern Recogn., vol. 40, no. 3, pp. 807-824, Mar. 2007.
10. M. J. Song and L. Zhang, "Comparison of cluster representations from partial second- to full fourth-order cross moments for data stream clustering," in Proc. IEEE ICDM, 2008, pp. 560-569.
11. H. Kremer, P. Kranen, T. Jansen, T. Seidl, A. Bifet, G. Holmes, and B. Pfahringer, "An effective evaluation measure for clustering on evolving data streams," in Proc. ACM SIGKDD, 2011, pp. 868-876.
12. W. Sheng, S. Swift, L. Zhang, and X. Liu, "A weighted sum validity function for clustering with a hybrid niching genetic algorithm," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 35, no. 6, pp. 1156-1167, Dec. 2005.
13. G. W. Milligan, "A Monte Carlo study of thirty internal criterion measures for cluster analysis," Psychometrika, vol. 46, no. 2, pp. 187-199, Jun. 1981.
14. Y. Zhao and G. Karypis, "Evaluation of hierarchical clustering algorithms for document datasets," in Proc. CIKM, 2002, pp. 515-524.
15. J. M. Kraus, C. Müssel, G. Palm, and H. A. Kestler, "Multi-objective selection for collecting cluster alternatives," Comput. Stat., vol. 26, no. 2, pp. 341-353, Jun. 2011.
16. S. Sharma, Applied Multivariate Techniques. New York: Wiley, 1996.
17. M. Halkidi, Y. Batistakis, and M. Vazirgiannis, "On clustering validation techniques," J. Intell. Inf. Syst., vol. 17, no. 2/3, pp. 107-145, Dec. 2001.
18. L. Hubert and P. Arabie, "Comparing partitions," J. Classification, vol. 2, no. 1, pp. 193-218, Dec. 1985.
19. T. Calinski and J. Harabasz, "A dendrite method for cluster analysis," Commun. Stat., vol. 3, no. 1, pp. 1-27, 1974.
20. J. Dunn, "Well separated clusters and optimal fuzzy partitions," Cybern. Syst., vol. 4, no. 1, pp. 95-104, 1974.
21. P. Rousseeuw, "Silhouettes: A graphical aid to the interpretation and validation of cluster analysis," J. Comput. Appl. Math., vol. 20, no. 1, pp. 53-65, Nov. 1987.
22. D. Davies and D. Bouldin, "A cluster separation measure," IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-1, no. 2, pp. 224-227, Apr. 1979.
23. X. L. Xie and G. Beni, "A validity measure for fuzzy clustering," IEEE Trans. Pattern Anal. Mach. Intell., vol. 13, no. 8, pp. 841-847, Aug. 1991.
24. M. Kim and R. S. Ramakrishna, "New indices for cluster validity assessment," Pattern Recogn. Lett., vol. 26, no. 15, pp. 2353-2363, Nov. 2005.
25. M. Halkidi, M. Vazirgiannis, and Y. Batistakis, "Quality scheme assessment in the clustering process," in Proc. PKDD, 2000, pp. 265-276.
26. M. Halkidi and M. Vazirgiannis, "Clustering validity assessment: Finding the optimal partitioning of a data set," in Proc. IEEE Int. Conf. Data Mining, 2001, pp. 187-194.
27. S. Saha and S. Bandyopadhyay, "Application of a new symmetry-based cluster validity index for satellite image segmentation," IEEE Geosci. Remote Sens. Lett., vol. 5, no. 2, pp. 166-170, Apr. 2002.
28. M. Halkidi and M. Vazirgiannis, "Clustering validity assessment using multi-representatives," in Proc. SETN, 2002, pp. 237-248.
29. R. Tibshirani, G. Walther, and T. Hastie, "Estimating the number of clusters in a data set via the gap statistic," J. R. Stat. Soc., Ser. B (Stat. Methodology), vol. 63, no. 2, pp. 411-423, 2001.
30. B. S.Y. Lam and H.Yan, "A new cluster validity index for data with merged clusters and different densities," in Proc. IEEE ICSMC, 2005, pp. 798-803.
31. J. MacQueen, "Some methods for classification and analysis of multivariate observations," in Proc. BSMSP, 1967, pp. 281-297.
32. G. Karypis, Cluto-Software for Clustering High-Dimentional Datasets. Minneapolis, MN: Karypis Lab, 2006, version 2.1.2.
33. H. Xiong, J.Wu, and J. Chen, "K-means clustering versus validation measures: A data distribution perspective," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 39, no. 2, pp. 318-331, Apr. 2009.
34. M. Ester, H.-P. Kriegel, J. Sander, and X. Xu, "A density-based algorithm for discovering clusters in large spatial databases with noise," in Proc. KDD, 1996, pp. 226-231.
35. G. Karypis, E.-H. S. Han, and V. Kumar, "Chameleon: Hierarchical clustering using dynamic modeling," Computer, vol. 32, no. 8, pp. 68-75, Aug. 1999.
36. G. Karypis, Karypis Lab. [Online]. Available: http://glaros.dtc.umn.edu/ gkhome/
37. J. C. Bezdek and N. R. Pal, "Some new indexes of cluster validity," IEEE Trans. Syst.,Man,Cybern. B, Cybern., vol. 28, no. 3, pp. 301-315, Jun.1998.
38. T. Lange, V. Roth, M. L. Braun, and J. M. Buhmann, "Stability-based validation of clustering solutions," Neural Comput., vol. 16, no. 6, pp. 1299-1323, Jun. 2004.
39. S. Yue, J.-S. Wang, T. Wu, and H. Wang, "A new separation measure for improving the effectiveness of validity indices," Inf. Sci., vol. 180, no. 5, pp. 748-764, Mar. 2010.
40. C. Ding and X. He, "K-nearest-neighbor consistency in data clustering: Incorporating local information into global optimization," in Proc. SAC, New York, 2004, pp. 584-589.
41. E. Fix and J. J. L. Hodges, "Discriminatory analysis, nonparametric discrimination: Consistency properties," USAF Sch. Aviation Med., Randolph Field, TX, Tech. Rep. 4, 1951.
42. N. R. Pal and J. C. Bezdek, "On cluster validity for the fuzzy c-means model," IEEE Trans. Fuzzy Syst., vol. 3, no. 3, pp. 370-379, Aug. 1995.
43. J. L. Bentley, "Multidimensional binary search trees used for associative searching," Commun. ACM, vol. 18, no. 9, pp. 509-517, Sep. 1975.
44. A. Guttman, "R-trees: A dynamic index structure for spatial searching," in Proc. ACM SIGMOD Int. Conf. Manage. Data, 1984, pp. 47-57.
45. A. Frank and A. Asuncion, UCI Machine Learning Repository. Irvine, CA: Univ. California, Irvine, 2010. [Online]. Available: http://archive.ics.uci.edu/ ml