An entropy weighting k-means algorithm for subspace clustering of high-dimensional sparse data

IEEE Transactions on Knowledge and Data Engineering

Volumn 19, Issue 8, 2007, Pages 1026-1041

  Jing, Liping ^a   Ng, Michael K ^b   Huang, Joshua Zhexue ^a  

^a UNIVERSITY OF HONG KONG   (Hong Kong)

^b HONG KONG BAPTIST UNIVERSITY   (Hong Kong)

Author keywords

High dimensional data; K means clustering; Subspace clustering; Text clustering; Variable weighting

Indexed keywords

COMPUTATIONAL METHODS; DATA REDUCTION; PROBLEM SOLVING; TEXT PROCESSING;

HIGH-DIMENSIONAL DATA; K-MEANS CLUSTERING; KEYWORDS; SUBSPACE CLUSTERING;

CLUSTERING ALGORITHMS;

EID: 34347228671     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2007.1048     Document Type: Article

References (39)

1. X. Zhang, J.Z. Huang, D. Qian, J. Xu, and L. Jing, "Supplier Categorization with k-Means Type Subspace Clustering," Proc. Eighth Asia Pacific Web Conf., 2006.
2. A.K. Jain, M.N. Murty, and P.L. Flynn, "Data Clustering: A Review," ACM Computing Surveys, vol. 31, no. 3, pp. 264-323, 1999.
3. M. Steinbach, L. Ertoz, and V. Kumar, The Challenges of Clustering High Dimensional Data, http://www-users.cs.umn.edu/~ertoz/papers/ clustering_chapter.pdf, 2003.
4. D. Cai, X. He, and J. Han, "Document Clustering Using Locality Preserving Indexing," IEEE Trans. Knowledge and Data Eng., vol. 17, no. 12, Dec. 2005.
5. D.R. Swanson, "Medical Literature as a Potential Source of New Knowledge," Bull. Medical Library Assoc., vol. 78, no. 1, Jan. 1990.
6. R. Agrawal, J. Gehrke, D. Gunopulos, and P. Raghavan, "Automatic Subspace Clustering of High Dimensional Data for Data Mining Applications," Proc. ACM SIGMOD Int'l Conf. Management of Data, pp. 94-105, 1998.
7. C. Aggarwal, C. Procopiuc, J.L. Wolf, P.S. Yu, and J.S. Park, "Fast Algorithms for Projected Clustering," Proc. ACM SIGMOD Int'l Conf. Management of Data, pp. 61-72, 1999.
8. C.C. Aggarwal and P.S. Yu, "Finding Generalized Projected Clusters in High Dimensional Spaces," Proc. ACM SIGMOD Int'l Conf. Management of Data, pp. 70-81, 2000.
9. K. Chakrabarti and S. Mehrotra, "Local Dimensionality Reduction: A New Approach to Indexing High Dimensional Spaces," Proc. 26th Int'l Conf. Very Large Data Bases, pp. 89-100, 2000.
10. C.M. Procopiuc, M. Jones, P.K. Agarwal, and T.M. Murali, "A Monte Carlo Algorithm for Fast Projective Clustering," Proc. ACM SIGMOD Int'l Conf. Management of Data, pp. 418-427, 2002.
11. K.Y. Yip, D.W. Cheung, and M.K. Ng, "A Practical Projected Clustering Algorithm," IEEE Trans. Knowledge and Data Eng., vol. 16, no. 11, pp. 1387-1397, Nov. 2004.
12. K.Y. Yip, D.W. Cheung, and M.K. Ng, "On Discovery of Extremely Low-Dimensional Clusters Using Semi-Supervised Projected Clustering," Proc. 21st Int'l Conf. Data Eng., pp. 329-340, 2005.
13. W.S. Desarbo, J.D. Carroll, L.A. Clark, and P.E. Green, "Synthesized Clustering: A Method for Amalgamating Clustering Bases with Differential Weighting Variables," Psychometrika, vol. 49, pp. 57-78, 1984.
14. G.W. Milligan, "A Validation Study of a Variable Weighting Algorithm for Cluster Analysis," J. Classification, vol. 6, pp. 53-71, 1989.
15. D.S. Modha and W.S. Spangler, "Feature Weighting in k-Means Clustering," Machine Learning, vol. 52, pp. 217-237, 2003.
16. Y. Chan, W. Ching, M.K. Ng, and J.Z. Huang, "An Optimization Algorithm for Clustering Using Weighted Dissimilarity Measures," Pattern Recognition, vol. 37, no. 5, pp. 943-952, 2004.
17. H. Frigui and O. Nasraoui, "Unsupervised Learning of Prototypes and Attribute Weights," Pattern Recognition, vol. 37, no. 3, pp. 567-581, 2004.
18. H. Frigui and O. Nasraoui, "Simultaneous Clustering and Dynamic Keyword Weighting for Text Documents," Survey of Text Mining, Michael Berry, ed., pp. 45-70, Springer, 2004.
19. C. Domeniconi, D. Papadopoulos, D. Gunopulos, and S. Ma, "Subspace Clustering of High Dimensional Data," Proc. SIAM Int'l Conf. Data Mining, 2004.
20. J.H. Friedman and J.J. Meulman, "Clustering Objects on Subsets of Attributes," J. Royal Statistical Soc. B, vol. 66, no. 4, pp. 815-849, 2004.
21. J.Z. Huang, M.K. Ng, H. Rong, and Z. Li, "Automated Variable Weighting in k-Means Type Clustering," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 5, pp. 1-12, May 2005.
22. L. Jing, M.K. Ng, J. Xu, and J.Z. Huang, "Subspace Clustering of Text Documents with Feature Weighting k-Means Algorithm," Proc. Ninth Pacific-Asia Conf. Knowledge Discovery and Data Mining, pp. 802-812, 2005.
23. L. Parsons, E. Haque, and H. Liu, "Subspace Clustering for High Dimensional Data: A Review," SIGKDD Explorations, vol. 6, no. 1, pp. 90-105, 2004.
24. C.H. Cheng, A.W. Fu, and Y. Zhang, "Entropy-Based Subspace Clustering for Mining Numerical Data," Proc. Fifth ACM SIGKDD Int'l Conf. Knowledge and Data Mining, pp. 84-93, 1999.
25. S. Goil, H. Nagesh, and A. Choudhary, "Mafia: Efficient and Scalable Subspace Clustering for Very Large Data Sets," Technical Report CPDC-TR-9906-010, Northwest Univ., 1999.
26. R.T. Ng and J. Han, "Efficient and Effective Clustering Methods for Spatial Data Mining," Proc. 20th Int'l Conf. Very Large Data Bases, pp. 144-155, Sept. 1994.
27. K.G. Woo and J.H. Lee, "Findit: A Fast and Intelligent Subspace Clustering Algorithm Using Dimension Voting," PhD dissertation, Korea Advanced Inst. of Science and Technology, 2002.
28. J. Yang, W. Wang, H. Wang, and P. Yu, "δ-Clusters: Capturing Subspace Correlation in a Large Data Set," Proc. 18th Int'l Conf. Data Eng., pp. 517-528, 2002.
29. E. Keogh, K. Chakrabarti, S. Mehrotra, and M. Pazzani, "Local Adaptive Dimensionality Reduction for Indexing Large Time Series Databases," Proc. ACM SIGMOD Int"l Conf. Management of Data, 2001.
30. G. De Soete, "Optimal Variable Weighting for Ultrametric and Additive Tree Clustering," Quality and Quantity, vol. 20, pp. 169-180, 1986.
31. G. De Soete, "OVWTRE: A Program for Optimal Variable Weighting for Ultrametric and Additive Tree Fitting," J. Classification, vol. 5, pp. 101-104, 1988.
32. V. Makarenkov and P. Legendre, "Optimal Variable Weighting for Ultrametric and Additive Trees and k-Means Partitioning: Methods and Software," J. Classification, vol. 18, pp. 245-271, 2001.
33. C. Domeniconi, "Locally Adaptive Techniques for Pattern Classification," PhD dissertation, 2002.
34. L. Jing, M.K. Ng, J. Xu, and J.Z. Huang, "On the Performance of Feature Weighting k-Means for Text Subspace Clustering," Proc. Sixth Int'l Conf. Web-Age Information Management, pp. 502-512, 2005.
35. M. Zait and H. Messatfa, "A Comparative Study of Clustering Methods," Future Generation Computer Systems, vol. 13, pp. 149-159, 1997.
36. M. Steinbach, G. Karypis, and V. Kumar, "A Comparison of Document Clustering Techniques," Proc. KDD Workshop Text Mining, 2000.
37. A.K. McCallum, "Bow: A Toolkit for Statistical Language Modeling, Text Retrieval, Classification and Clustering," http://www.cs.cmu.edu/ mccallum/bow, 1996.
38. Y. Zhao and G. Karypis, "Comparison of Agglomerative and Partitional Document Clustering Algorithms," Technical Report #02-014, Univ. of Minnesota, 2002.
39. S. Zhong and J. Ghosh, "A Comparative Study of Generative Models for Document Clustering," Proc. SDW Workshop Clustering High-Dimensional Data and Its Applications, May 2003.