Robust clustering

Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery

Volumn 2, Issue 1, 2012, Pages 29-59

  Banerjee, Amit ^a   Davé, Rajesh N ^b  

^a PENNSYLVANIA STATE UNIVERSITY   (United States)

^b NEW JERSEY INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLUSTER ANALYSIS; STATISTICS;

CLUSTERING METHODS; CLUSTERING PROBLEMS; REAL-WORLD DATASETS; REPRESENTATIVE SAMPLE; ROBUST CLUSTERING METHODS; ROBUST MODEL FITTING; ROBUST STATISTICAL METHOD; ROBUST STATISTICS;

CLUSTERING ALGORITHMS;

EID: 84873252175     PISSN: 19424787     EISSN: 19424795     Source Type: Journal    
DOI: 10.1002/widm.49     Document Type: Review

References (136)

1. Jain AK, Dubes RC. Algorithms for Clustering Data. Englewood Cliffs, NJ: Prentice Hall; 1988.
2. Xu R, Wunsch DC. Survey of clustering algorithms. IEEE Trans Neural Netw 2005, 16:645-678.
3. Huber PJ. Robust Statistics. New York: John Wiley & Sons; 1981.
4. MacQueen JB. Some methods for classification and analysis of multivariate observations. In: Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability. Berkeley, CA: University of California Press; 1967, 281-297.
5. Hampel FR, Ronchetti EM, Rousseeuw PJ, Stahel WA. Robust Statistics: the Approach Based on Influence Functions. New York: John Wiley & Sons; 1986.
6. Hubert M, Rousseeuw PJ, van Aelst S. Highbreakdown robust multivariate methods. Stat Sci 2008, 23:92-119.
7. Zhang T, Ramakrishnan R, Livny M. BIRCH: a new data clustering algorithm and its applications. Data Min Knowl Discov 1997, 1:141-182.
8. Guha S, Rastogi R, Shim K. CURE: an efficient clustering algorithm for large databases. Inform Syst 2001, 26:35-58.
9. Guha S, Rastogi R, Shim K. ROCK: a robust clustering algorithm for categorical attributes. Inform Syst 2000, 25:345-366.
10. Karypis G, Han E-H, Kumar V. Chameleon: hierarchical clustering using dynamic modeling. Computer 1999, 32:68-75.
11. Ball G, Hall D. A clustering technique for summarizing multivariate data. Behav Sci 1967, 12:153-155.
12. Kaufman L, Rousseeuw PJ. Finding Groups in Data: An Introduction to Cluster Analysis. New York: John Wiley & Sons; 1990.
13. Gustafson EE, Kessel WC, Fuzzy clustering with a fuzzy covariance matrix. In: Proc. IEEE Conference on Decision and Control. San Diego, CA; 1978, 761- 766.
14. Klawonn F, Kruse R, Timm H. Fuzzy shell cluster analysis. In: Della Riccia G, Lenz H-J, Kruse R, eds. Learning, Networks and Statistics. Berlin: Springer; 1997, 105-120.
15. Bezdek JC. Pattern Recognition with Fuzzy Objective Function Algorithms. New York: Plenum; 1981.
16. Ḧ oppner F, Klawonn F, Kruse R, Runkler T. Fuzzy Cluster Analysis. Chichester: John Wiley & Sons; 1999.
17. Dav́e RN. Characterization and detection of noise in clustering. Pattern Recognit Lett 1991, 12:657-664.
18. Dav́e RN, Sen S. On generalizing the noise clustering algorithms. Invited Paper, 7th IFSA World Congress. Prague, Czech Republic; 1997, 205-210.
19. Dav́e RN, Sen S. Generalized noise clustering as a robust fuzzy c-M-estimators model. In: Proc. Conference of the North American Fuzzy Information Processing Society. Pensacola Beach, FL; 1998, 256-260.
20. Klawonn F. Noise clustering with a fixed fraction of noise. Advances in Soft Computing: Applications and Science in Soft Computing. Berlin/Heidelberg: Springer-Verlag; 2004, 133-138.
21. Rehm F, Klawonn F, Kruse R. A novel approach to noise clustering for outlier detection. Soft Comput 2007, 11:489-494.
22. Klawonn F, Ḧ oppner F. What is fuzzy about fuzzy clustering? Understanding and improving the concept of the fuzzifier. In: Advances in Intelligent Data Analysis V. Berlin: Springer, 2003; 254-264.
23. Krishnapuram R, Keller JM. A possibilistic approach to clustering. IEEE Trans Fuzzy Syst 1993, 1:98-110.
24. Dubois D. Possibility theory and statistical reasoning. Comput Stat Data Anal 2006, 51:47-69.
25. Krishnapuram R, Keller JM. The possibilistic cmeans algorithm: insights and recommendations. IEEE Trans Fuzzy Syst 1996, 4:385-393.
26. Barni M, Cappellini V, Mecocci A. Comments on a possibilistic approach to clustering. IEEE Trans Fuzzy Syst 1996, 4:393-396.
27. Masulli F, Rovetta S. Soft transition from probabilistic to possibilistic fuzzy clustering. IEEE Trans Fuzzy Syst 2006, 14:516-527.
28. Pal NR, Pal K, Keller JM, Bezdek JC. Possibilistic fuzzy c-means clustering. IEEE Trans Fuzzy Syst 2005, 13:508-516.
29. Zhang JS, Luang YW. Robust clustering by pruning outliers. IEEE Trans SystMan Cybern 2003, 33:983- 999.
30. Timm H, Borgelt C, D̈ oring C, Kruse R. An extension to possibilistic fuzzy cluster analysis. Fuzzy Sets Syst 2004, 147:3-16.
31. Jajuga K. L1-norm based fuzzy clustering. Fuzzy Sets Syst 1991, 39:43-50.
32. Kersten PR. Fuzzy order statistics and their application to fuzzy clustering. IEEE Trans Fuzzy Syst 1999, 7:708-712.
33. Hathaway RJ, Bezdek JC, Hu Y. Generalized fuzzy cmeans clustering strategies using Lp norm distances. IEEE Trans Fuzzy Syst 2000, 8:576-582.
34. Frigui H, Krishnapuram R. A robust clustering algorithm based on competitive agglomeration and soft rejection of outliers. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition. San Francisco, CA; 1996, 550-555.
35. Wu KL, Yang MS. Alternative c-means clustering algorithms. Pattern Recognit 2002, 35: 2267-2278.
36. Yang MS, Wu KL. A similarity-based robust clustering method. IEEE Trans Pattern Anal Mach Intell 2004, 26:434-448.
37. Łȩski J. Towards a robust fuzzy clustering. Fuzzy Sets Syst 2003, 137:215-233.
38. Rousseeuw PJ, Leroy AM. Robust regression and outlier detection. New York: John Wiley & Sons; 1987.
39. Bassett GW. Equivariant, monotonic, 50% breakdown estimators. Am Stat 1991, 45:135-137.
40. Kim J, Krishnapuram R, Dav́e RN. Application of the least trimmed squares technique to prototypebased clustering. Pattern Recognit Lett 1996, 17:633- 64l.
41. Nasraoui O, Krishnapuram R. Clustering using a genetic fuzzy least median of squares algorithm. In: Proc. Conference of North American Fuzzy Information Processing Society. Syracuse, NY; 1997.
42. Dav́e RN, Krishnapuram R. Robust clustering methods: a unified view. IEEE Trans Fuzzy Syst 1997, 5:270-293.
43. Honda K, Notsu A, Ichihashi H. Fuzzy PCA-Guided robust k-means clustering. IEEE Trans Fuzzy Syst 2010, 18:67-79.
44. Hathaway RJ, Devenport JW, Bezdek JC. Relational duals of the c-means clustering algorithms. Pattern Recognit 1988, 22:205-212.
45. Hathaway RJ, Bezdek JC. NERF c-means: non-Euclidean relational fuzzy clustering. Pattern Recognit 1994, 27:429-437.
46. Dav́e RN, Sen S. Robust fuzzy clustering of relational data. IEEE Trans Fuzzy Syst 2002, 10:713-727.
47. Wemmert X, Puissant A, Forestier G, Gançarski P. Multiresolution remote sensing image clustering. IEEE Geosci Remote Sens Lett 2009, 6:533-537.
48. Ester M, Kriegel H-P, Sander J, Xu X. A densitybased algorithm for discovering clusters in large spatial databases with noise. In: Proc. Second International Conference on Knowledge Discovery and Data Mining. Portland, OR; 1996, 226-231.
49. Ankerst M, Breunig M, Kriegel H, Sander J. OPTICS: ordering points to identify the clustering structure. In: Proc. ACM SIGMOD International Conference on Management of Data. Philadelphia, PA; 1999, 49- 60.
50. Xu X, Ester M, Kriegel H, Sander J. A distributionbased clustering algorithm for mining in large spatial databases. In: Proc. InternationalConference on Data Engineering. Orlando, FL; 1998, 324-331.
51. Duda R, Hart P, Stork D. Pattern Classification. New York: John Wiley & Sons; 2001.
52. Fraley C, Raftery AE. Model-based clustering, discriminant analysis, and density estimation. J Am Stat Assoc 2002, 97:611-631.
53. Zhuang X, Huang Y, Palaniappan K. Gaussian mixture density modeling, decomposition, and applications. IEEE Trans Image Process 1996, 5:1293-1302.
54. Medasani S, Krishnapuram R. Robust mixture decomposition via maximization of trimmed loglikelihood with application to image database organization. In: Proc. Conference of North American Fuzzy Information Society. Pensacola Beach, FL; 1998, 237-241.
55. Cuesta-Albertos JA, Gordaliza A, Matr ́an C. Trimmed k-means: an attempt to robustify quantizers. Ann Stat 1997, 25:553-576.
56. Cuesta-Albertos JA, Matŕan C, Mayo-Iscar A. Robust estimation in the normal mixture model based on robust clustering. J R Stat Soc 2008, 70:779-802.
57. McLachlan GJ, Peel D. Robust cluster analysis via mixtures of multivariate t-distributions. Advances in Pattern Recognition. Berlin/Heidelberg: Springer-Verlag; 1998, 658-666.
58. Wang H, Zhang Q, Luo B, Wei S. Robust mixture modelling using multivariate t-distribution with missing information. Pattern Recognit Lett 2004, 25:701- 710.
59. Peel D, McLachlan GJ. Robust mixture modelling using the t-distribution. Stat Comput 2000, 10:339- 348.
60. Shoham S. Robust clustering bydeterministic agglomeration EM of mixtures of multivariate tdistributions. Pattern Recognit 2002, 35:1127- 1142.
61. de Ridder D, Franc V. Robust subspace mixture models using t-distributions. In: Proc. British Machine Vision Conference. Norwich, UK; 2003, 319-328.
62. McLachlan GJ, Ng SK, Bean R. Robust cluster analysis via mixture models. Austrian J Stat 2006, 35:157- 174.
63. Archambeau C, Verleysen M. Robust Bayesian clustering. Neural Netw 2007, 20:129-138.
64. Cord A, Ambroise C, Cocquerez JP. Feature selection in robust clustering based on Laplacemixture. Pattern Recognit Lett 2005, 27:627-635.
65. Gao J. Robust L1 principal component analysis and its Bayesian variational inference. Neural Comput 2008, 20:555-572.
66. Falkenauer E. Genetic algorithms and grouping problems. Chichester: John Wiley & Sons; 1998.
67. Hruschka ER, Campello RJGB, Frietas AA, deCarvalho ACPLF. A survey of evolutionary algorithms for clustering. IEEE Trans Syst Man Cybern C: Appl Rev 2009, 39:133-154.
68. van der Merwe DW, Engelbrecht AP. Data clustering using particle swarm optimization. In: Proc. IEEE Congress on Evolutionary Computation. Canberra, Australia; 2003, 215-220.
69. Runkler TA. Wasp swarm optimization of the cmeans clustering model. Int J Intell Syst 2008, 23:269-285.
70. Runkler TA. Ant colony optimization of clustering models. Int J Intell Syst 2005, 20:1233-1261.
71. Handl J, Knowles J, Dorigo M. Strategies for the increased robustness of ant-based clustering. In: Di Marzo Serugendo G, Karegeorgos A, Rana OF, Zambonelli F, eds. Engineering Self Organizing Systems. Berlin/Heidelberg: Springer-Verlag; 2004, 90- 104.
72. Nasraoui O, Krishnapuram R. A novel approach to unsupervised robust clustering using genetic niching. In: Proc. 9th International Conference on Fuzzy Systems. San Antonio, TX; 2000, 170-175.
73. Deb K. Multi-Objective Optimization Using Evolutionary Optimization. Chichester: John Wiley & Sons; 2001.
74. Banerjee A. Robust fuzzy clustering as a multiobjective optimization procedure. In: Proc. 28th Annual Conference of North American Fuzzy Information Processing Society. Cincinnati, OH; 2009.
75. Banerjee A. An improved genetic algorithm for robust fuzzy clustering with unknown number of clusters. In: Proc. 29th Annual Conference of North American Fuzzy Information Processing Society. Toronto, Canada; 2010.
76. Shi J, Malik J. Normalized cuts and image segmentation. IEEE Trans Pattern Anal Mach Intell 2000, 22:888-905.
77. Zelinik-Manor L, Perona P. Self-tuning spectral clustering. Adv Neural Inform Process Syst 2004, 17:1601-1608.
78. Chang H, Yeung D-Y. Robust path-based spectral clustering. Pattern Recognit 2008, 41:191-203.
79. Haykin S. Neural networks: a comprehensive foundation. Englewood Cliffs, NJ: Prentice-Hall; 1999.
80. Ben-Hur A, Horn D, Siegelmann HT, Vapnik V. Support vector clustering. J Mach Learn Res 2002, 2:125-137.
81. Chiang J-H, Hao P-Y. A new kernel-based fuzzy clustering approach: support vector clustering with cell growing. IEEE Trans Fuzzy Syst 2003, 11:518-527.
82. Li Z, Liu J, Chen S, Tang X. Noise robust spectral clustering. In: Proc. 11th International Conference on Computer Vision. Rio de Janeiro, Brazil; 2007.
83. Kohonen T. Self-Organization and associative memory. In: Springer Information Science Series. New York: Springer-Verlag; 1989.
84. Carpenter G, Grossberg S. ART3: hierarchical search using chemical transmitters in self-organizing pattern recognition architectures. Neural Netw 1990, 3:129- 152.
85. Mitra S, Dutta S, Perkins T, Michailidis G. Introduction to machine learning and bioinformatics. In:Computer Science and Data Analysis Series, New York: Chapman and Hall/CRC Press; 2008.
86. Desieno D. Adding a conscience to competitive learning. In: Proc. IEEE International Conference on Neural Networks. San Diego, CA; 1988, 117-124.sxst
87. Tsao ECK, Bezdek JC, Pal, NR. Fuzzy Kohonen clustering networks. Pattern Recognit 1994, 27:757-764.
88. Karayiannis N, Bezdek JC, Pal NR, Hathaway RJ, Pai P-I. Repairs to GLVQ: a new family of competitive learning schemes. IEEE Trans Neural Netw 1996, 7:1062-1071.
89. Yang TN, Wang SD. Competitive algorithms for the clustering of noisy data. Fuzzy Sets Syst 2004, 141:281-299.
90. Moore B. ART1 and pattern clustering. In: Proc. Connectionist Models Summer School. Pittsburg, PA; 1988, 174-185.
91. Milligan GW. 1980. An examination of the effect of six types of error perturbation on fifteen clustering algorithms. Psychometrika 1980, 45:325-342.
92. Pena JM, Lozano JA, Larranaga P. An empirical comparison of four initialization methods for the K-Means algorithm. Pattern Recognit Lett 1999, 20:1027-1040.
93. He J, Lan M, Tan CL, Sung SY, Low HB. Initialization of cluster refinement algorithms: a review and comparative study. In: Proc. IEEE International Joint Conference on Neural Networks. Budapest, Hungary; 2004, 297-302.
94. Tao CW. Unsupervised fuzzy clustering with multicenter clusters. Fuzzy Sets Syst 2002, 128:305- 322.
95. Kaymak U, Setnes M. Fuzzy clustering with volume prototypes and adaptive cluster merging. IEEE Trans Fuzzy Syst 2002, 10:705-712.
96. Kothari R, Pitts D. On finding the number of clusters. Pattern Recognit Lett 1999, 20:405-416.
97. Khan SS, Ahmad A. Cluster center initialization algorithm for K-means clustering. Pattern Recognit Lett 2004, 25:1293-1302.
98. Arthur D, Vassilvitskii S. k-means++: the advantages of careful seeding. In: Proc. 18th Annual ACM-SIAM symposium on Discrete algorithms. New Orleans, LA; 2007, 1027-1035.
99. Dav́e RN, Fu T. Robust shape detection using fuzzy clustering: practical applications. Fuzzy Sets Syst 1994, 65:161-185.
100. Frigui H, Krishnapuram R. A robust competitive clustering algorithmwith applications in computer vision. IEEE Trans Pattern Anal Mach Intell 1999, 21:450- 465.
101. Jolion JM, Meer P, Bataouche S. Robust clustering with applications in computer vision. IEEE Trans Pattern Recognit Mach Intell 1991, 13:791-802.
102. Yang XL, Song Q, Wu YL. A robust deterministic annealing algorithm for data clustering. Data Knowl Eng 2007, 62:84-100.
103. Jain AK, Topchy A, LawMHC, Buhmann JM. Landscape of clustering algorithms. In: Proc. International Conference on Pattern Recognition. Cambridge, UK; 2004, 260-263.
104. Hubert L, Arabie P. Comparing partitions. J Classif 1985, 2:193-218.
105. Rocke DM, Ideker T, Troyanskaya O, Quackenbush J, Dopazo J. Papers on normalization, variable selection, classification or clustering of microarray data. Bioinformatics 2009, 25:701-702.
106. Krinidis S, Chatzis V. A robust fuzzy local information c-means clustering algorithm. IEEE Trans Image Process 2010, 19:1328-1337.
107. Tolias Y, Panas S. Image segmentation by a fuzzy clustering algorithm using adaptive spatially constrained membership functions. IEEE Trans Syst Man Cybern 1998, 28:359-369.
108. Yang M, Hu YJ, Lin K, Lin CC. Segmentation techniques for tissue differentiation in MRI of ophthalmology using fuzzy clustering algorithms. Magn Resonance Imaging 2002, 20:173-179.
109. Karmakar G, Dooley L. A generic fuzzy rule based image segmentation algorithm. Pattern Recognit Lett 2002, 23:1215-1227.
110. Ahmed M, Yamany S, Mohamed N, Farag A, Moriarty T. A modified fuzzy c-means algorithm for bias field estimation and segmentation ofMRI data. IEEE Trans Med Imaging 2002, 21:193-199.
111. Pham D. An adaptive fuzzy c-means algorithm for image segmentation in the presence of intensity inhomogeneities. Pattern Recognit Lett 1999, 20:57-68.
112. Chen S, Zhang D. Robust image segmentation using FCM with spatial constraints based on new kernelinduced distance measure. IEEE Trans Syst Man Cybern 2004, 34:1907-1916.
113. Cai W, Chen S, Zhang D. Fast and robust fuzzy cmeans clustering algorithms incorporating local information for image segmentation. Pattern Recognit 2007, 40:825-838.
114. Stein B, Busch M. Density-based cluster algorithms in low-dimensional and high-dimensional applications. In: Proc. 2nd InternationalWorkshop on Text-Based Information Retrieval. Koblenz, Germany; 2005, 45- 55.
115. Yang Z, Chung F-L, Shitong W. Robust fuzzy clustering-based image segmentation. Appl Soft Comput 2009, 9:80-84.
116. Hoppner F, Klawonn F. Improved fuzzy partitions for fuzzy regression models. Int J Approx Reason 2003, 32:85-102.
117. Wu X et al. Top 10 algorithms in data mining. Knowl Inform Syst 2008, 14:1-37.
118. Berkhin P. A survey of clustering data mining techniques. In: Kogan J, Nicholas C, Teboulle M, eds. Grouping Multidimensional Data. Berlin/Heidelberg: Springer-Verlag; 2006, 25-72.
119. Quiroz A, Gnanasambandam N, Parashar M, Sharma N. Robust clustering analysis for the management of self-monitoring distributed systems. Cluster Comput 2009, 12:73-85.
120. Agarwal R, Gehrke J, Gunopulos D, Raghavan P. Automatic subspace clustering of high-dimensional data. Data Min Knowl Discov 2005, 11:5-33.
121. Bandyopadhyay S, Gianella C, Maulik U, Kargupta H, Liu K, Datta S. Clustering data streams in peer-topeer environments. Inform Sci 2006, 176:1952-1985.
122. Januzaj E, Kriegel HP, Pfeifle M. DBDC: densitybased distribution clustering. In: Proc. International Conference on Extending Database Technology. Heraklion, Greece; 2004, 88-105.
123. Li M, Lee G, Lee WC, Sivasubramaniam A. PENS: an algorithm for density-based clustering in peer-to-peer systems. In: Proc. International Conference on Scalable Information Systems. Hong Kong, China; 2006.
124. Li J, Wang K, Xu L. Chameleon based on clustering feature tree and its application in customer segmentation. Ann Operat Res 2009, 168:225-245.
125. Andreopoulos B, An A, Wang X, Schroeder M. A roadmap of clustering algorithms: finding a match for a biomedical application. Brief Bioinform 2009, 10:297-214.
126. Bickel DR. Robust cluster analysis of microarray gene expression data with the number of clusters determined biologically. Bioinformatics 2003, 19:818- 824.
127. Jiang D, Pei J, Zhang A. DHC: a density-based hierarchical clustering method for time series gene expression data. In: Proc. 3rd Symposium on Bioinformatics and Bioengineering. Bethesda, MD; 2003, 393-400.
128. Ma PCH, Chan KCC, Yao X, Chiu DKY. An evolutionary clustering algorithm for gene expression microarray data analysis. IEEE Trans Evolut Comput 2006, 10:296-314.
129. Knorr EM, Ng RT, Tucakov V. Distance-based outliers: algorithms and applications. VLDB J 2000, 8:237-253.
130. Ramaswamy S, Rastogi R, Shim K. Efficient algorithms for mining outliers from large datasets. Sigmoid Record 2000, 29:427-438.
131. Shawe-Taylor J, Cristianini N. Kernel Methods for Pattern Analysis. Cambridge, UK: Cambridge University Press; 2004.
132. Sch ̈ olkopf B, Smola AJ, Williamson RC, Bartlett PL. New support vector algorithms. Neural Comput 2000, 12:1207-1245.
133. Hodge V, Austin J. A survey of outlier detection methodologies. Artif Intell Rev 2004, 22:85-126.
134. Chandola V, Banerjee A, Kumar V. Anomaly detection: a survey. ACM Comput Surv 2009, 41:1- 58.
135. Jain AK. Data clustering: 50 years beyond k-means. Pattern Recognit Lett 2010, 31:651-666.
136. Jain AK, Murty MN, Flynn PJ. Data clustering: a review. ACM Comput Surv 1999, 31:265-323.