Recent developments in clustering algorithms

ESANN 2012 proceedings, 20th European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning

Volumn , Issue , 2012, Pages 447-458

  Bouveyron, C ^a   Hammer, B ^b   Villmann, T ^c  

^a UNIVERSITÉ PARIS 1 PANTHÉON SORBONNE   (France)

^b BIELEFELD UNIVERSITY   (Germany)

^c UNIVERSITY OF APPLIED SCIENCES MITTWEIDA   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; ARTIFICIAL INTELLIGENCE; LEARNING SYSTEMS; NEURAL NETWORKS;

CLUSTERING EVALUATION; LARGE DATASETS; METRIC ADAPTATION; NON-EUCLIDEAN; THEORETICAL FOUNDATIONS;

CLUSTERING ALGORITHMS;

EID: 84883240273     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (102)

1. M. Ackerman, S. Ben-David, and D. Loker. Towards property-based classification of clustering paradigms. In Lafferty et al.[59], pages 10-18.
2. C. C. Aggarwal. A framework for clustering massive-domain data streams. In ICDE, pages 102-113, 2009.
3. B. Arnonkijpanich, A. Hasenfuss, and B. Hammer. Local matrix adaptation in topographic neural maps. Neurocomputing, 74(4):522-539, 2011.
4. P. Awasthi and R. B. Zadeh. Supervised clustering. In Lafferty et al. [59], pages 91-99.
5. M. Badoiu, S. Har-Peled, and P. Indyk. Approximate clustering via core-sets. In STOC, pages 250-257, 2002.
6. S. Ben-david. A framework for statistical clustering with a constant time approximation algorithms for k-median clustering. In In COLT, pages 415-426. Springer, 2004.
7. S. Ben-David and M. Ackerman. Measures of clustering quality: A working set of axioms for clustering. In Koller et al. [56], pages 121-128.
8. J. Bezdek. Cluster validity with fuzzy sets. Journal of Cybernetics, 3:58-73, 1974.
9. J. Bezdek. Pattern Recognition with Fuzzy Objective Function Algorithms. Plenum, New York, 1981.
10. M. Blatt, S. Wiseman, and E. Domany. Superparamagnetic clustering of data. Phys Rev Lett, 76(18):3251-3254, 1996.
11. R. Boulet. Disjoint unions of complete graphs characterized by their laplacian spectrum. The Electronic journal of Linear Algebra, 18:773-783, 2009.
12. R. Boulet, B. Jouve, F. Rossi, and N. Villa. Batch kernel som and related laplacian methods for social network analysis. Neurocomputing, 71(7-9):1257-1273, 2008.
13. C. Bouveyron, S. Girard, and C. Schmid. High-Dimensional Data Clustering. Computational Statistics and Data Analysis, 52(1):502-519, 2007.
14. C. Bouveyron and J. Jacques. Model-based clustering of time series in group-specific functional subspaces. Advances in Data Analysis and Classification, 5(4):281-300, 2011.
15. F. Camastra and A. Verri. A novel kernel method for clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(5):801-805, 2005.
16. G. Carlsson and F. Mémoli. Characterization, stability and convergence of hierarchical clustering methods. J. Mach. Learn. Res., 11:1425-1470, August 2010.
17. B. Conan-Guez and F. Rossi. Dissimilarity clustering by hierarchical multi-level refinement. In ESANN’12, 2012.
18. M. Cottrell, B. Hammer, A. Hasenfuss, and T. Villmann. Batch and median neural gas. Neural Networks, 19:762-771, 2006.
19. D. Davies and D. Bouldin. A cluster separation measure. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1(2):224-227, 1979.
20. A. Delaigle and P. Hall. Defining pobability density for a distribution of random functions. The Annals of Statistics, 38:1171-1193, 2010.
21. I. Dhillon, Y. Guan, and B. Kulis. Weighted graph cuts without eigenvectors a multilevel approach. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(11):1944-1957, 2007.
22. I. S. Dhillon, S. Mallela, and D. S. Modha. Information-theoretic co-clustering. In Proceedings of The Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining(KDD-2003), pages 89-98, 2003.
23. J. Dunn. Well separated clusters and optimal fuzzy partitions. Journal of Cybernetics, 4(1):1974, 95-104.
24. M. Durut, B. Patra, and F. Rossi. A discussion on parallelization schemes for stochastic vector quantization algorithms. In ESANN’12, 2012.
25. M. K. el Mahrsi and F. Rossi. Modularity-based clustering for network-constrained trajectories. In ESANN’12, 2012.
26. E. Elhamifar and R. Vidal. Sparse manifold clustering and embedding. In J. Shawe-Taylor, R. Zemel, P. Bartlett, F. Pereira, and K.Weinberger, editors, Advances in Neural Information Processing Systems 24, pages 55-63. 2011.
27. F. Ferraty and P. Vieu. Nonparametric functional data analysis. Springer Series in Statistics. Springer, New York, 2006.
28. R. L. Ferreira Cordeiro, C. Traina, Junior, A. J. Machado Traina, J. López, U. Kang, and C. Faloutsos. Clustering very large multi-dimensional datasets with mapreduce. In Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining, KDD’11, pages 690-698, New York, NY, USA, 2011. ACM.
29. C. Fowlkes, S. Belongie, F. Chung, and J. Malik. Spectral grouping using the nyström method. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(2):214-225, 2004.
30. C. Fraley and A. Raftery. Model-based clustering, discriminant analysis and density estimation. J. Amer. Statist. Assoc., 97:611-631, 2002.
31. B. J. Frey and D. Dueck. Clustering by passing messages between data points. Science, 315:972-976, 2007.
32. S. Frühwirth-Schnatter and S. Kaufmann. Model-based clustering of multiple time series. Journal of Business and Economic Statistics, 26:78-89, 2008.
33. T. Geweniger, M. Kaestner, M. Lamge, and T. Villmann. Modified conn-index for the evaluation of fuzzy clusterings. In ESANN’12, 2012.
34. T. Geweniger, D. Zühlke, B. Hammer, and T. Villmann. Median fuzzy c-means for clustering dissimilarity data. Neurocomputing, 73(7-9):1109-1116, 2010.
35. M. Girolami. Mercer kernel-based clustering in feature space. IEEE Transactions on Neural Networks, 13(3):780-784, 2002.
36. A. Gisbrecht, D. Sovilj, B. Hammer, and A. Lendasse. Relevance learning for time series inspection. In ESANN’12, 2012.
37. I. Givoni, C. Chung, and B. Frey. Hierarchical affinity propagation. In Proceedings of the Twenty-Seventh Conference Annual Conference on Uncertainty in Artificial Intelligence (UAI-11), pages 238-246, Corvallis, Oregon, 2011. AUAI Press.
38. E. Gokcay and J. Principe. Information theoretic clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(2):158-171, 2002.
39. S. Guha, A. Meyerson, N. Mishra, R. Motwani, and L. O’Callaghan. Clustering data streams: Theory and practice. IEEE Transactions on Knowledge and Data Engineering, 15(3):515-528, 2003.
40. I. Guyon, U. V. Luxburg, and R. C. Williamson. Clustering: Science or art. In NIPS 2009 Workshop on Clustering Theory, 2009.
41. B. Hammer and A. Hasenfuss. Topographic mapping of large dissimilarity datasets. Neural Computation, 22(9):2229-2284, 2010.
42. B. Hammer, A. Micheli, A. Sperduti, and M. Strickert. A general framework for unsupervised processing of structured data. Neurocomputing, 57:3-35, 2004.
43. J. A. Hartigan. Clustering algorithms. Wiley New York, 1975.
44. R. Hathaway and J. Bezdek. Nerf c-means: Non-euclidean relational fuzzy clustering. Pattern Recognition, 27(3):429-437, 1994.
45. T. Hofmann and J. Buhmann. Pairwise data clustering by deterministic annealing. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(1):1-14, 1997. cited By (since 1996) 179.
46. J. Huang, M. Ng, H. Rong, and Z. Li. Automated variable weighting in k-means type clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(5):657-668, 2005.
47. Z. Huang and M. Ng. A fuzzy k-modes algorithm for clustering categorical data. IEEE Transactions on Fuzzy Systems, 7(4):446-452, 1999.
48. J. Jacques and C. Preda. Curves clustering with approximation of the density of functional random variables. In ESANN, 2012.
49. A. K. Jain. Data clustering: 50 years beyond k-means. Pattern Recognition Letters, 31(8):651-666, 2010.
50. G. James and C. Sugar. Clustering for sparsely sampled functional data. J. Amer. Statist. Assoc., 98(462):397-408, 2003.
51. T. Kanungo, D. Mount, N. Netanyahu, C. Piatko, R. Silverman, and A. Wu. An efficient k-means clustering algorithms: Analysis and implementation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(7):881-892, 2002.
52. S. Khan and A. Ahmad. Cluster center initialization algorithm for k-means clustering. Pattern Recognition Letters, 25(11):1293-1302, 2004.
53. D.-W. Kim, K. Lee, and D. Lee. On cluster validity index for estimation of the optimal number of fuzzy clusters. Pattern Recognition, 37(10):2009-2025, 2004.
54. J. M. Kleinberg. An impossibility theorem for clustering. In NIPS, pages 446-453, 2002.
55. T. Kohonen, M. R. Schroeder, and T. S. Huang, editors. Self-Organizing Maps. Springer-Verlag New York, Inc., Secaucus, NJ, USA, 3rd edition, 2001.
56. D. Koller, D. Schuurmans, Y. Bengio, and L. Bottou, editors. Advances in Neural Information Processing Systems 21, Proceedings of the Twenty-Second Annual Conference on Neural Information Processing Systems, Vancouver, British Columbia, Canada, December 8-11, 2008. Curran Associates, Inc., 2009.
57. S. Kpotufe and U. von Luxburg. Pruning nearest neighbor cluster trees. In L. Getoor and T. Scheffer, editors, ICML, pages 225-232. Omnipress, 2011.
58. S. Kwon. Cluster validity index for fuzzy clustering. Electronics Letters, 34(22):2176-2177, 1998.
59. J. D. Lafferty, C. K. I. Williams, J. Shawe-Taylor, R. S. Zemel, and A. Culotta, editors. Advances in Neural Information Processing Systems 23: 24th Annual Conference on Neural Information Processing Systems 2010. Proceedings of a meeting held 6-9 December 2010, Vancouver, British Columbia, Canada. Curran Associates, Inc., 2010.
60. A. Likas, N. Vlassis, and J. J. Verbeek. The global k-means clustering algorithm. Pattern Recognition, 36(2):451-461, 2002.
61. F. Lin and W. W. Cohen. Power iteration clustering. In J. Fürnkranz and T. Joachims, editors, ICML, pages 655-662. Omnipress, 2010.
62. H. Liu and L. Yu. Toward integrating feature selection algorithms for classification and clustering. IEEE Transactions on Knowledge and Data Engineering, 17(4):491-502, 2005.
63. U. V. Luxburg. A tutorial on spectral clustering. Statistics and Computing, 17(4):395-416, 2007.
64. M. Mahajan, P. Nimbhorkar, and K. Varadarajan. The planar k-means problem is np-hard. In Lecture Notes in Computer Science 5431, pages 274-285. Springer, 2009.
65. M. Maier, U. von Luxburg, and M. Hein. Influence of graph construction on graph-based clustering measures. In Koller et al.[56], pages 1025-1032.
66. T. M. Martinetz, S. G. Berkovich, and K. J. Schulten.’neural-gas’ network for vector quantization and its application to time-series prediction. IEEE Transactions on Neural Networks, 4(4):558-569, 1993.
67. C. Maugis, G. Celeux, and M.-L. Martin-Magniette. Variable selection for Clustering with Gaussian Mixture Models. Biometrics, 65(3):701-709, 2009.
68. U. Maulik and S. Bandyopadhyay. Genetic algorithm-based clustering technique. Pattern Recognition, 33(9):1455-1465, 2000.
69. U. Maulik and S. Bandyopadhyay. Performance evaluation of some clustering algorithms and validity indices. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(12):1650-1654, 2002.
70. G. McLachlan and D. Peel. Finite Mixture Models. Wiley Interscience, New York, 2000.
71. G. McLachlan, D. Peel, and R. Bean. Modelling high-dimensional data by mixtures of factor analyzers. Computational Statistics and Data Analysis, (41):379-388, 2003.
72. P. McNicholas and B. Murphy. Parsimonious Gaussian mixture models. Statistics and Computing, 18(3):285-296, 2008.
73. M. Meila. Comparing clusterings: an axiomatic view. In L. D. Raedt and S. Wrobel, editors, ICML, volume 119 of ACM International Conference Proceeding Series, pages 577-584. ACM, 2005.
74. R. Ng and J. Han. Clarans: A method for clustering objects for spatial data mining. IEEE Transactions on Knowledge and Data Engineering, 14(5):1003-1016, 2002.
75. M. Pakhira, S. Bandyopadhyay, and U. Maulik. Validity index for crisp and fuzzy clusters. Pattern Recognition, 37(3):487-501, 2004.
76. N. Pal, K. Pal, J. Keller, and J. Bezdek. A possibilistic fuzzy c-means clustering algorithm. IEEE Transactions on Fuzzy Systems, 13(4):517-530, 2005.
77. W. Pan and X. Shen. Penalized model-based clustering with application to variable selection. Journal of Machine Learning Research, 8:1145-1164, 2007.
78. A. Raftery and N. Dean. Variable selection for model-based clustering. Journal of the American Statistical Association, 101(473):168-178, 2006.
79. J. O. Ramsay and B. W. Silverman. Functional data analysis. Springer Series in Statistics. Springer, New York, second edition, 2005.
80. K. Rose, E. Gurewitz, and G. Fox. A deterministic annealing approach to clustering. Pattern Recognition Letters, 11(9):589-594, 1990.
81. D. Rubin and D. Thayer. EM algorithms for ML factor analysis. Psychometrika, 47(1):69-76, 1982.
82. J. Sander, M. Ester, H.-P. Kriegel, and X. Xu. Density-based clustering in spatial databases: The algorithm gdbscan and its applications. Data Mining and Knowledge Discovery, 2:169-194, 1998.
83. S. Z. Selim and M. Ismail. K-means-type algorithms: A generalized convergence theorem and characterization of local optimality. IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-6(1):81-87, 1984.
84. M. Shindler, A. Wong, and A. W. Meyerson. Fast and accurate k-means for large datasets. In J. Shawe-Taylor, R. Zemel, P. Bartlett, F. Pereira, and K. Weinberger, editors, Advances in Neural Information Processing Systems 24, pages 2375-2383. 2011.
85. T. Tarpey and K. Kinateder. Clustering functional data. J. Classification, 20(1):93-114, 2003.
86. K. Tasdemir and E. Merényi. A validity index for prototype-based clustering of data sets with complex cluster structures. IEEE Transactions on Systems, Man, and Cybernetics, 41(4):1039--1053, 2011.
87. E. Tipping and C. Bishop. Mixtures of Probabilistic Principal Component Analysers. Neural Computation, 11(2):443-482, 1999.
88. A. Ukkonen. Clustering algorithms for chains. Journal of Machine Learning Research, 12:1389-1423, 2011.
89. A. Vattani. k-means requires exponentially many iterations even in the plane. Discrete and Computational Geometry, 45(4):596-616, 2011.
90. J. Vesanto and E. Alhoniemi. Clustering of the self-organizing map. IEEE Transactions on Neural Networks, 11(3):586-600, 2000.
91. U. von Luxburg. A tutorial on spectral clustering. Technical Report 149, Max Planck Institute for Biological Cybernetics, Aug. 2006.
92. U. von Luxburg. Clustering Stability: An Overview. Foundations and Trends in Machine Learning, 2(3):235-274, July 2010.
93. U. von Luxburg, O. Bousquet, and M. Belkin. Limits of spectral clustering. In L. K. Saul, Y. Weiss, and L. Bottou, editors, Advances in Neural Information Processing Systems 17, pages 857-864. MIT Press, Cambridge, MA, 2005.
94. G. Wahba. Spline models for observational data. SIAM, Philadelphia, 1990.
95. T. Warren Liao. Clustering of time series data-a survey. Pattern Recognition, 38:1857-1874, 2005.
96. D. Witten and R. Tibshirani. A framework for feature selection in clustering. Journal of the American Statistical Association, 150(490):713-726, 2010.
97. X. L. Xie and G. Beni. A validity measure for fuzzy clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence, 13(8):841-847, 1991.
98. R. Xu and D. Wunsch II. Survey of clustering algorithms. IEEE Transactions on Neural Networks, 16(3):645-678, 2005.
99. H. Yin. On the equivalence between kernel self-organising maps and self-organising mixture density networks. Neural Networks, 19(6-7):780-784, 2006.
100. K. Zalik. Validity index for clusters of different sizes and densities. Pattern Recognition Letters, 32:221-2234, 2011.
101. S. Zhong and J. Ghosh. A unified framework for model-based clustering. JMLR, 4:1001-1037, 2003.
102. D. Zhou, J. Li, and H. Zha. A new mallows distance based metric for comparing clusterings. In Proceedings of the 22nd international conference on Machine learning, pages 1028-1035. ACM, 2005