Developing a feature weight self-adjustment mechanism for a K-means clustering algorithm

Computational Statistics and Data Analysis

Volumn 52, Issue 10, 2008, Pages 4658-4672

  Tsai, Chieh Yuan ^a   Chiu, Chuang Cheng ^a  

^a YUAN ZE UNIVERSITY   (Taiwan)

Author keywords

[No Author keywords available]

Indexed keywords

MATHEMATICAL MODELS; SET THEORY;

CLUSTERING QUALITY; FEATURE WEIGHT SELF-ADJUSTMENT (FWSA) MECHANISM;

CLUSTERING ALGORITHMS;

EID: 44349127297     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2008.03.002     Document Type: Article

References (45)

1. Alpaydin E. Introduction to Machine Learning (2004), The MIT Press, Cambridge pp. 133-150
2. Blum A.L., and Rivest R.L. Training a 3-node neural networks is NP-complete. Neural Netw. 5 (1992) 117-127
3. Brusco M.J., and Cradit J.D. A variable-selection heuristic for K-means clustering. Psychometrika 66 (2001) 249-270
4. Chan E.Y., Ching W.K., Ng M.K., and Huang J.Z. An optimization algorithm for clustering using weighted dissimilarity measures. Pattern Recognit. 37 (2004) 943-952
5. Dash, M., Choi, K., Scheuermann, P., Liu, H., 2002. Feature selection for clustering - a filter solution. In: Proceedings of the 2002 IEEE International Conference on Data Mining, Maebashi, Japan, pp. 115-122
6. De Soete G. Optimal variable weighting for ultrametric and additive tree clustering. Quality Quantity 20 (1986) 169-180
7. De Soete G. OVWTRE: A program for optimal variable weighting for ultrametric and additive tree fitting. J. Classif. 5 (1988) 101-104
8. Desarbo W.S., Carroll J.D., Clark L.A., and Green P.E. Synthesized clustering: A method for amalgamating clustering bases with differential weighting variables. Psychometrika 49 (1984) 57-78
9. Devaney, M., Ram, A., 1997. Efficient feature selection in conceptual clustering. In: Proceedings of the Fourteenth International Conference on Machine Learning, Nashville, pp. 92-97
10. Domeniconi C., Gunopulos D., Ma S., Yan B., and Papadopoulos D. Locally adaptive metrics for clustering high dimensional data. Data Min. Knowl. Discov. 14 (2007) 63-97
11. Dy, J.G., Brodley, C.E., 2000. Feature subset selection and order identification for unsupervised learning. In: Proceedings of the Seventeenth International Conference on Machine Learning, Stanford, pp. 247-254
12. Fayyad, U., Reina, C., Bradley, P.S, 1998. Initialization of iterative refinement clustering algorithms. In: Proceedings of the 4th International Conference on Knowledge Discovery and Data Mining, New York, pp. 194-198
13. Forgy E.W. Cluster analyses of multivariate data: Efficiency versus interpretability of classifications. Biometrics 21 (1965) 768-769
14. Fowlkes E.B., Gnanadesikan R., and Kettenring J.R. Variable selection in clustering. J. Classif. 5 (1988) 205-228
15. Friedman J.H., and Meulman J.J. Clustering objects on subsets of attributes. J. R. Stat. Soc. Ser. B-Stat. Methodol. 66 (2004) 1-25
16. Gnanadesikan R., Kettenring J.R., and Tsao S.L. Weighting and selection of variables for cluster analysis. J. Classif. 12 (1995) 113-136
17. Hand D.J., and Krzanowski W.J. Optimising K-means clustering results with standard software packages. Comput. Statist. Data Anal. 49 (2005) 969-973
18. Hansen P., and Mladenovi'c N. J-Means: A new local search heuristic for minimum sum of squares clustering. Pattern Recognit. 34 (2001) 405-413
19. Hartigan J.A. Clustering Algorithms (1975), Wiley, New York
20. He Y., Pan W., and Lin J. Cluster analysis using multivariate normal mixture models to detect differential gene expression with microarray data. Comput. Statist. Data Anal. 51 (2006) 641-658
21. Hillier F.S., and Lieberman G.J. Introduction to Operation Research (2001), McGraw-Hill, New York
22. Huang J.Z., Ng M.K., Rong H., and Li Z. Automated variable weighting in k-means type clustering. IEEE Trans. Pattern Anal. Mach. Intell. 27 (2005) 657-668
23. Hubert L., and Arabie P. Comparing partitions. J. Classif. 2 (1985) 193-218
24. Jing L., Ng M.K., and Huang J.Z. An entropy weighting k-Means algorithm for subspace clustering of high-dimensional sparse data. IEEE Trans. Knowl. Data Eng. 19 (2007) 1026-1041
25. Kim, Y., Street, W.N., Menczer, F., 2000. Feature selection in unsupervised learning via evolutionary search. In: Proceedings of the 6th International Conference on Knowledge Discovery and Data Mining, Boston, pp. 365-369
26. Law M.H., Figueiredo M.A., and Jain A.K. Simultaneous feature selection and clustering using mixture models. IEEE Trans. Pattern Anal. Mach. Intell. 26 (2004) 1154-1166
27. Li, C., Yu, J., 2006. A novel duzzy c-Means clustering algorithm. In: Proceedings of the First International Conference on Rough Set and Knowledge Technology, Chongquing, China, pp. 510-515
28. Liu H., and Yu L. Toward integrating feature selection algorithms for classification and clustering. IEEE Trans. Knowl. Data Eng. 17 (2005) 491-502
29. McQueen, J., 1967. Some methods for classification and analysis of multivariate observations. In: Proceedings of the 5th Berkeley Symposium on Mathematical Statistics and Probability, pp. 281-297
30. Makarenkov V., and Legendre P. Optimal variable weighting for ultrametric and additive trees and K-means partitioning methods and software. J. Classif. 18 (2001) 245-271
31. Maulik U., and Bandyopadhyay S. Performance evaluation of some clustering algorithms and validity indices. IEEE Trans. Pattern Anal. Mach. Intell. 24 (2002) 301-312
32. McLachlan G.J., and Krishnan T. The EM Algorithm and Extensions (1997), Wiley, New York
33. Mitra P., Murthy C.A., and Pal S.K. Unsupervised feature selection using feature similarity. IEEE Trans. Pattern Anal. Mach. Intell. 24 (2002) 301-312
34. Modha D.S., and Spangler W.S. Feature weighting in K-means clustering. Mach. Learn. 52 (2003) 217-237
35. Newman, D.J., Hettich, S., Blake, C.L., Merz, C.J., 1998. UCI Repository of Machine Learning Databases. URL (http://www.ics.uci.edu/~mlearn /MLSummary.html)
36. Pakhira M.K., Bandyopadhyay S., and Maulik U. Validity index for crisp and fuzzy clusters. Pattern Recognit. 37 (2004) 487-501
37. Pelleg, D., Moore, A.W., 2000. X-means: Extending K-means with efficient estimation of the number of clusters. In: Proceedings of the 17th International Conference on Machine Learning, pp. 727-734
38. Polak E. Computational Methods for Optimization (1971), Academic Press, New York pp. 44-66
39. Raftery A.E., and Dean N. Variable selection for model-based clustering. J. Am. Stat. Assoc. 101 (2006) 168-178
40. Tan P.N., Steinbach M., and Kumar V. Introduction to Data Mining (2005), Addison-Wesley, Boston pp. 487-559
41. Webb A. Statistical Pattern Recognition (2002), John Wiley & Sons, New Jersey pp. 361-406
42. Wettschereck D., Aha D.W., and Mohri T. A review and empirical evaluation of feature weighting methods for a class of lazy learning algorithms. Artif. Intell. Rev. 11 (1997) 1-5
43. Wu W., Xiong H., and Shekhar S. Clustering and Information Retrieval (2003), Kluwer Academic Publisher, Netherlands
44. Yu J. General C-means clustering model. IEEE Trans. Pattern Anal. Mach. Intell. 27 (2005) 1197-1211
45. Zhang, B., Hsu, M., Dayal, U., 1999. K-harmonic means-a data clustering algorithm. Technical Report HPL-1999-124, Hewlett Packard Laboratories, Oct. 29 1999