SMART: A subspace clustering algorithm that automatically identifies the appropriate number of clusters

International Journal of Data Mining, Modelling and Management

Volumn 1, Issue 2, 2009, Pages 149-177

  Jing, Liping ^a   Li, Junjie ^a   Ng, Michael K ^a   Cheung, Yiu Ming ^a   Huang, Joshua ^b  

^a HONG KONG BAPTIST UNIVERSITY   (Hong Kong)

^b UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Cluster numbers; Data mining; Subspace clustering; Weighting; means

Indexed keywords

EID: 84863337579     PISSN: 17591163     EISSN: 17591171     Source Type: Journal    
DOI: 10.1504/IJDMMM.2009.026074     Document Type: Article

References (43)

1. Aggarwal, C., Procopiuc, C., Wolf, J., Yu, P. and Park, J. (1999) 'Fast algorithms for projected clustering', Proc. of ACM SIGMOD, pp.61-72. (Pubitemid 129597324)
2. Agrawal, R., Gehrke, J., Gunopulos, D. and Raghavan, P. (1998) 'Automatic subspace clustering of high dimensional data for data mining applications', Proc. of ACM SIGMOD, pp.94-105. (Pubitemid 128655960)
3. Alizadeh, A., Eisen, M., Davis, R., Ma, C., Lossos, I., Rosenwald, A., Boldrick, J., Sabet, H., Tran, T., Yu, X., Powell, J., Yang, L., Marti, G., Moore, T., Hudson, J., Lu, L., Lewis, D., Tibshirani, R., Sherlock, G., Chan, W., Greiner, S T., Weisenburger, D., Armitage, J., Warnke, R., Levy, R., Wilson, W., Grever, M., Byrd, J., Botstein, D., Brown, P. and Staudt, L. (2000) 'Distinct types of diffuse large b-cell lymphoma identified by gene expression profiling', Nature, Vol. 403, No. 6769, pp.503-511. (Pubitemid 30082188)
4. Boutsinas, B., Tasoulis, D. and Vrahatis, M. (2006) 'Estimating the number of clusters using a windowing technique', Journal of Pattern Recognition an Image Analysis, Vol. 16, No. 2, pp.143-154. (Pubitemid 44072312)
5. Cai, D., He, X. and Han, J. (2005) 'Document clustering using locality preserving indexing', IEEE Transactions on Knowledge and Data Engineering, Vol. 17, No. 12, pp.1624-1637. (Pubitemid 43060413)
6. Chan, Y., Ching, K., Ng, M. and Huang, Z. (2004) 'An optimization algorithm for clustering using weighted dissimilarity measures', Pattern Recognition, Vol. 37, No. 5, pp.943-952. (Pubitemid 38473837)
7. Cheng, C., Fu, A. and Zhang, Y. (1999) 'Entropy-based subspace clustering for mining numerical data', Proc. of ACM SIGKDD, pp.84-93.
8. Cheung, Y. and Church, G. (2000) 'Biclustering of expression data', Proc. of the 8th ISMB.
9. Desarbo, W., Carroll, J., Clark, L. and Green, P. (1984) 'Synthesized clustering: a method for amalgamating clustering bases with differential weighting variables', Psychometrika, Vol. 49, pp.57-78.
10. Domeniconi, C. (2002) 'Locally adaptive techniques for pattern classification', PhD thesis.
11. Domeniconi, C., Papadopoulos, D., Gunopulos, D. and Ma, S. (2004) 'Subspace clustering of high dimensional data', Proc. of SIAM International Conference on Data Mining.
12. Dubes, R. (1993) Cluster Analysis and Related Issues in Handbook of Pattern Recognition and Computer Vision, World Scientific Publishing Company, pp.3-32.
13. Everitt, B. (1979) 'Unresolved problems in cluster analysis', Biometrics, Vol. 35, pp.169-181. (Pubitemid 9136573)
14. Fanty, M. and Cole, R. (1991) 'Spoken letter recognition', Advances in Neural Information Processing Systems, Morgan Kaufmann, pp.385-390.
15. Friedman, J. and Meulman, J. (2004) 'Clustering objects on subsets of attributes', J.R.Statist. Soc. B, Vol. 66, No. 4, pp.815-849.
16. Frigui, H. and Nasraoui, O. (2004) 'Unsupervised learning of prototypes and attribute weights', Pattern Recognition, Vol. 37, No. 3, pp.567-581. (Pubitemid 38003094)
17. Getz, G., Levine, E. and Domany, E. (2000) 'Coupled two-way clustering analysis of gene microarray data', Proc. of the Natl. Acad. Sci., Vol. 97, No. 22, pp.12079-12084.
18. Goil, S., Nagesh, H. and Choudhary, A. (1999) Mafia: Efficient and Scalable Subspace Clustering for Very Large Data Sets, Tech. rep., Northwest University, Evanton IL.
19. Huang, Z., Ng, M., Rong, H. and Li, Z. (2005) 'Automated variable weighting in k-means type clustering', IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 27, No. 5, pp.1-12.
20. Jain, A. and Dubes, R. (1988) Algorithms for Clustering Data, Prentice-Hall, Englewood Cliffs, NJ, USA.
21. Jain, A., Duin, R. and Mao, J. (2000) 'Statistical pattern recognition: a review', IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 22, No. 2, pp.4-38.
22. Jain, A., Murty, M. and Flynn, P. (1999) 'Data clustering: a review', ACM Computering Surveys, Vol. 31, No. 3, pp.264-323.
23. Jing, L., Ng, M. and Huang, Z. (2007) 'An entropy weighting k-means algorithm for subspace clustering of high-dimensional and sparse data', IEEE Transactions on Knowledge and Data Engineering, Vol. 19, No. 8, pp.1026-1041. (Pubitemid 47000341)
24. Jing, L., Ng, M., Xu, J. and Huang, Z. (2005) 'Subspace clustering of text documents with feature weighting κ-means algorithm', Proc. of the 9th Pacific-Asia Conference on Knowledge Discovery and Data Mining, pp.802-812.
25. Khan, J., Wei, J., Ringner, M., Saal, L., Ladanyi, M., Westermann, F., Berthold, F., Schwab, M., Antonescu, C., Peterson, C. and Meltzer, P. (2001) 'Classification and diagnostic prediction of cancers using gene expression profiling and artificial neural networks', Nature Medicine, Vol. 7, No. 6, pp.673-679. (Pubitemid 32588022)
26. Law, M., Figueiredo, M. and Jain, A. (2004) 'Simultaneous feature selection and clustering using mixture models', IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 26, pp.1-17.
27. Lu, W. and Traore, I. (2005) 'A new evolutionary algorithm for determining the optimal number of clusters', Proc. of the International Conference on Computational Intelligence for Modelling, Control and Automation, pp.648-653.
28. McCallum, A. (1996) Bow: A Toolkit for Statistical Language Modeling, Text Retrieval, Classification and Clustering.
29. Milligan, G. (1989) 'A validation study of a variable weighting algorithm for cluster analysis', Journal of Classification, Vol. 6, pp.53-71.
30. Modha, D. and Spangler, W. (2003) 'Feature weighting in k-means clustering', Machine Learning, Vol. 52, pp.217-237.
31. Murphy, P. and Aha, D. (1994) Uci Repository of Machine Learning Databases.
32. Parsons, L., Haque, E. and Liu, H. (2004) 'Subspace clustering for high dimensional data: a review', SIGKDD Explorations, Vol. 6, No. 1, pp.90-105.
33. Pelleg, D. and Moore, A. (2000) 'X-means: extending k-means with efficient estimation of the number of clusters', Proc. of the 17th International Conference on Machine Learning, pp.727-734.
34. Penalver, A. and Escolano, J. (2003) 'An entropy maximization approach to optimal model selection in Gaussian mixtures', Proc. of the 8th Iberoamerican Congress on Pattern Recognition, pp.423-439.
35. Rezae, M., Letlieveldt, B. and Reiber, J. (1998) 'A new cluster validity index for the fuzzy c-means', Pattern Recognition Letter, Vol. 19, No. 3, pp.237-246. (Pubitemid 128383121)
36. Richardson, S. and Green, P. (1997) 'On Bayesian analysis of mixtures with an unknown number of components (with discussion)', Journal of the Royal Statistical Society: Series B, Vol. 59, No. 4, pp.731-792. (Pubitemid 127686979)
37. Salvador, S. and Chan, P. (2004) 'Determining the number of clusters/segments in hierarchical clustering/segmentation algorithms', Proc. of the 16th IEEE International Conference on Tools with Artificial Intelligence, pp.576-584. (Pubitemid 40455065)
38. Sun, H., Wang, S. and Jiang, Q. (2004) 'Fcm-based model selection algorithms for determining the number of clusters', Pattern Recognition, Vol. 37, pp.2027-2037.
39. Swanson, D. (1990) 'Medical literature as a potential source of new knowledge', Bull Med. Libr. Assoc., Vol. 78, No. 1, pp.29-37. (Pubitemid 20100877)
40. Vlassis, N. and Likas, A. (1999) 'A kurtosis-based dynamic approach to Gaussian mixture modeling', IEEE Transaction on Systems, Man, and Cybernetics, Vol. 29, No. 4, pp.393-399.
41. Yip, K., Cheung, D. and Ng, M. (2004) 'A practical projected clustering algorithm', IEEE Transactions on Knowledge and Data Engineering, Vol. 16, No. 11, pp.1387-1397.
42. Yu, H. (1998) 'Determining number of clusters', Information Retrieval, Final Report CMU-CS11-741.
43. Zait, M. and Messatfa, H. (1997) 'A comparative study of clustering methods', Future Generation Computer Systems, Vol. 13, pp.149-159. (Pubitemid 127403229)