Minkowski metric, feature weighting and anomalous cluster initializing in K-Means clustering

Pattern Recognition

Volumn 45, Issue 3, 2012, Pages 1061-1075

  Cordeiro De Amorim, Renato ^a   Mirkin, Boris ^a,b  

^a UNIVERSITY OF LONDON   (United Kingdom)

^b NATIONAL RESEARCH UNIVERSITY HIGHER SCHOOL OF ECONOMICS   (Russian Federation)

Author keywords

Anomalous cluster; Feature weights; K means; Minkowski metric; Noise features

Indexed keywords

ANOMALOUS CLUSTER; FEATURE WEIGHT; K-MEANS; MINKOWSKI; NOISE FEATURES;

EID: 80055024879     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2011.08.012     Document Type: Article

References (49)

1. A. Jain, and R. Dubes Algorithms for Clustering Data 1988 Prentice-Hall
2. I.H. Witten, and E. Frank Data Mining: Practical Machine Learning Tools 2005 Morgan and Kaufmann
3. B. Mirkin Clustering for Data Mining: A Data Recovery Approach 2005 Chapman and Hall/CRC Press Boca Raton FL, USA
4. R.M. Haralick, and L.G. Shapiro Image regimentation techniques Computer Vision, Graphics and Image Processing 29 1 1985 100 132
5. J.Z. Huang, J. Xu, M. Ng, and Y. Ye Weighting method for feature selection in K-means H. Liu, H. Motoda, Computational Methods of Feature Selection 2008 Chapman & Hall/CRC 193 209
6. Y. Chan, W.K. Ching, M.K. Ng, and J.Z. Huang An optimization algorithm for clustering using weighted dissimilarity measures Pattern Recognition 37 5 2004 943 952 (Pubitemid 38473837)
7. Z. Huang, M.K. Ng, H. Rong, and Z. Li Automated variable weighting in k-means type clustering IEEE Transactions on Pattern Analysis and Machine Learning 27 5 2005 657 668 (Pubitemid 40608400)
8. J.C. Bezdek Pattern Recognition with Fuzzy Objective Function Algorithms 1981 Plenum Press New York
9. V. Makarenkov, and P. Legendre Optimal variable weighting for ultrametric and additive trees and K-Means partitioning Journal of Classification 18 2001 245 271 (Pubitemid 33587487)
10. M.M. Chiang, and B. Mirkin Intelligent choice of the number of clusters in k-means clustering: an experimental study with different cluster spreads Journal of Classification 27 1 2010 1 38
11. A. Asuncion, D.J. Newman, UCI Machine Learning Repository 〈http://www.ics.uci.edu/∼mlearn/MLRepository.html〉. Irvine, CA: University of California, School of Information and Computer Science, 2007.
12. A.K. Jain Data clustering: 50 years beyond K-means Pattern Recognition Letters 31 8 2010 651 666
13. E. Mueller, S. Guennemann, I. Assent, and T. Seidl Evaluating clustering in subspace projections of high dimensional data Proceedings of the VLDB Endowment 2 1 2009 1270 1281
14. E.P. Xing, A.Y. Ng, M.I. Jordan, S. Russell, Distance metric learning with application to clustering with side-information, in: Proceedings of the Conference on Advances in Neural Information Processing Systems, Vancouver, Canada, December 911, 2003.
15. M. Bilenko, S. Basu, R.J. Mooney, Integrating constraints and metric learning in semi-supervised clustering, in: Proceedings of the 21st International Conference on Machine Learning (ICML-2004) (2004), pp. 8188. (Pubitemid 40290795)
16. D.S. Modha, and W.S. Spangler Feature weighting in K-Means clustering Machine Learning 52 2003 217 237
17. C.Y. Tsai, and C.C. Chiu Developing a feature weight adjustment mechanism for a K-Means clustering algorithm Computational Statistics and Data Analysis 52 2008 4658 4672
18. H. Frigui, and O. Nasraoui Unsupervised learning of prototypes and attribute weights Pattern Recognition 37 2004 567 581 (Pubitemid 38003094)
19. K.A.J. Doherty, R.G. Adams, N. Davey, Non-Euclidean norms and data normalization, in: Proceedings of European Symposium on Artificial Neural Networks (2004), pp. 181186.
20. B. Rudin The P-Norm Push: a simple convex ranking algorithm that concentrates at the top of the list Journal of Machine Learning Research 10 2009 2233 2271
21. D. Francois, V. Wertz, and M. Verleysen The concentration of fractional distances IEEE Transactions on Knowledge and Data Engineering 19 7 2007 873 886 (Pubitemid 46853307)
22. J. Kivinen, M.K. Warmuth, and B. Hassibi The p-Norm generalization of the LMS algorithm for adaptive filtering IEEE Transactions on Signal Processing 54 5 2006 1782 1793
23. A. Banerjee, S. Merugu, I. Dhillon, and J. Ghosh Clustering with Bregman divergences Journal of Machine Learning Research 6 2005 1705 1749
24. M. Filippone, F. Camastra, and F.S. Rovetta A survey of kernel and spectral methods for clustering Pattern Recognition 41 2008 176 190 (Pubitemid 47284212)
25. A. Strehl, J. Ghosh, R.J. Mooney, Impact of similarity measures on web-page clustering, in: Proceedings of AAAI Workshop on AI for Web Search, Texas, USA, July 30August 1 2000.
26. D. Steinley, and M.J. Brusco Initializing K-means batch clustering: a critical evaluation of several techniques Journal of Classification 24 2007 99 121
27. R. Tibshirani, G. Walther, and T. Hastie Estimating the number of clusters in a dataset via the Gap statistics Journal of the Royal Statistical Society B 63 2001 411 423
28. S. Monti, P. Tamayo, J. Mesirov, and T. Golub Consensus clustering: a resampling-based method for class discovery and visualization of gene expression microarray data Machine Learning 52 2003 91 118
29. G.J. McLachlan, and N. Khan On a resampling approach for tests on the number of clusters with mixture model-based clustering of tissue samples Journal of Multivariate Analysis 2004 90 1005
30. R. Mojena Hierarchical grouping methods and stopping rules: an evaluation The Computer Journal 20 4 1977 359 363
31. D. Pelleg, A. Moore, Xmeans: extending kmeans with efficient estimation of the number of clusters, in: Proceeding of the Seventeenth International Conference on Machine Learning (2000), pp. 727734.
32. J. Hartigan Clustering Algorithms 1975 Wiley NewYork
33. L. Kaufman, and P.J. Rousseeuw Finding Groups in Data: An Introduction to Cluster Analysis 1990 Wiley-Interscience
34. D. Arthur, and S. Vassilvitskii Worst-case and smoothed analysis of the ICP Algorithm, with an application to the k-means method SIAM Journal on Computing 39 2009 766 782
35. Netlab Neural Network software, 〈http://www.ncrg.aston.ac.uk/netlab/ index.php〉, accessed 3 April 2010.
36. L. Zhong, Y. Jinsha, Z. Weihua, Fuzzy C-Mean Algorithm with Morphology Similarity Distance, in: Proceedings of the Sixth International Conference on Fuzzy Systems and Knowledge Discovery 3 (2009) 9094.
37. J. Fan, M. Han, and J. Wang Single point iterative weighted fuzzy C-means clustering algorithm for remote sensing image segmentation Pattern Recognition 42 11 2009 2527 2540
38. H. Blockeel, L. De Raedt, J. Ramon, Top-down induction of clustering trees, in: J. Shavlik (Ed.) Proceedings of the Fifteenth International Conference on Machine Learning (1998), 5563.
39. Y. Hong, S. Kwong, Y. Chang, and Q. Ren Unsupervised feature selection using clustering ensembles and population based incremental learning algorithm Pattern Recognition 41 9 2008 2742 2756
40. R. Koggalage, and S. Halgamuge Reducing the number of training samples for fast Support Vector Machine classification Neural Information Processing 2 3 2004 57 65
41. Y. Chen, M. Rege, M. Dong, and J. Hua Non-negative matrix factorization for semi-supervised data clustering Knowledge Information Systems 17 3 2008 355 379
42. J. Kim, K. H. Shim, S. Choi, Soft geodesic kernel k-means, in: Proceedings of the 32nd IEEE International Conference on Acoustics, Speech, and Signal Processing (2007), pp. 429432.
43. F. Cao, J. Liang, and G. Jiang An initialization method for the K-Means algorithm using neighborhood model Computers and Mathematics with Applications 58 3 2009 474 483
44. Z. Zainuddin, and W.K. Lye Improving RBF networks classification performance by using K-harmonic means World Academy of Science, Engineering and Technology 62 2010 983 986
45. N. Belacel, H.B. Raval, and A.P. Punnen Learning multicriteria fuzzy classification method PROAFTN from data Computers & Operations Research 34 2007 1885 1898 (Pubitemid 44879762)
46. N.M. Zeidat, C.F. Eick, K-medoid-style clustering algorithms for supervised summary generation, in: Proceedings of the International Conference on Machine Learning (2004), pp. 932938. (Pubitemid 40155432)
47. C.C. Aggarwal, A. Hinneburg, D. Keim, On the surprising behavior of distance metrics in high dimensional space, in: Proceedings of the Eighth International Conference on Database Theory (2001), pp. 420434. (Pubitemid 33213340)
48. R.C. Amorim, B. Mirkin, J. Gan, A Method for Classifying Mental Tasks in the Space of EEG Transforms. Technical Report BBKS-10-01, Birkbeck University of London, London, 2010.
49. R.C. Amorim An adaptive spell checker based on PS3M: Improving the clusters of replacement words M. Kurzynski, M. Wozniak, Computer Recognition Systems vol. 3 2009 Springer Berlin/Heidelberg 519 526