A robust deterministic annealing algorithm for data clustering

Data and Knowledge Engineering

Volumn 62, Issue 1, 2007, Pages 84-100

  Yang, Xu Lei ^a   Song, Qing ^a   Wu, Yi Lei ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Data clustering; Deterministic annealing; Noise clustering; Robust clustering; Structural risk minimization; VC bound

Indexed keywords

DATA REDUCTION; NUMBER THEORY; OPTIMAL CONTROL SYSTEMS; RISK ASSESSMENT; SET THEORY;

DATA CLUSTERING; DETERMINISTIC ANNEALING; NOISE CLUSTERING (NC); ROBUST CLUSTERING; STRUCTURAL RISK MINIMIZATION (SRM); VC-BOUND;

CLUSTERING ALGORITHMS;

EID: 34247170075     PISSN: 0169023X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.datak.2006.07.006     Document Type: Article

References (32)

1. Ben-Hur A., Horn D., Siegelmann H.T., and Vapnik V.N. Support vector clustering. J. Machine Learn. Res. 2 (2001) 125-137
2. Bezdek J.C. Pattern Recognition with Fuzzy Objective Function Algorithms (1981), Plenum Press, New York
3. Dave R.N. Fuzzy shell-clustering and applications to circle detection in digital images. Int. J. General Syst. 16 4 (1990) 343-355
4. Dave R.N. Characterization and detection of noise in clustering. Pattern Recognit. Lett. 12 11 (1991) 657-664
5. Dave R.N., and Fu T. Robust shape detection using fuzzy clustering: practical applications. Fuzzy Sets Syst. 65 2-3 (1994) 161-185
6. Dave R.N., and Krishnapuram R. Robust clustering methods: a unified view. IEEE Trans. Fuzzy Syst. 5 2 (1997) 270-293
7. Dave R.N., and Sen S. Robust fuzzy clustering of relational data. IEEE Trans. Fuzzy Syst. 10 5 (2002) 713-727
8. Dunn J.C. A fuzzy relative of the ISODATA process and its use in detecting compact well-separated cluster. J. Cybernet. 3 3 (1974) 32-57
9. E.E. Gustafson, W.C. Kessel, Fuzzy clustering with a fuzzy covariance matrix, in: Proc. IEEE Conf. Decision Contr., San Diego, CA, 1979, pp. 761-766.
10. Gath I., and Geva A.B. Unsupervised optimal fuzzy clustering. IEEE Trans. Pattern Anal. Mach. Intell. 11 7 (1989) 773-781
11. Geman S., Bienenstock E., and Doursat R. Neural networks and the bias/variance dilemma. Neural Comput. 4 1 (1992) 1-58
12. Girolami M. Mercer kernel-based clustering in feature space. IEEE Trans. Neural Networks 13 3 (2002) 780-784
13. Graepel T., Burger M., and Obermayer K. Self-organizing maps: generalizations and new optimization techniques. Neurocomputing 21 1-3 (1998) 173-190
14. Krishnapuram R., Nasraoui O., and Frigui H. The fuzzy c-spherical shells algorithm: a new approach. IEEE Trans. Neural Networks 3 5 (1992) 663-671
15. Krishnapuram R., and Keller J.M. A possibilistic approach to clustering. IEEE Trans. Fuzzy Syst. 1 2 (1993) 98-110
16. MacQueen S. Some methods for classification and analysis of multivariate observations. Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability vol. 1 (1967), University of California Press 281-297
17. Miller D., and Rose K. Hierarchical unsupervised learning with growing via phase transitions. Neural Comput. 8 2 (1996) 427-452
18. Pal N.R., and Bezdek J.C. On cluster validity for the fuzzy cmeans model. IEEE Trans. Fuzzy Syst. 3 3 (1995) 370-379
19. Richardson S., and Green P.J. On Bayesian analysis of mixtures with an unknown number of components (with discussion). J. Royal Stat. Soc. Ser. B 59 4 (1997) 731-792
20. Roberts S.J., Holmes C., and Denison D. Minimum-entropy data partitioning using reversible jump Markov chain Monte Carlo. IEEE Trans. Pattern Anal. Mach. Intell. 23 8 (2001) 909-914
21. Rose K., Gurewitz E., and Fox G.C. Statistical mechanics and phase transitions in clustering. Phys. Rev. Lett. 65 8 (1990) 945-948
22. Rose K., Gurewitz E., and Fox G.C. Constrained clustering as an optimization method. IEEE Trans. Pattern Anal. Mach. Intell. 15 8 (1993) 785-794
23. Rose K. Deterministic annealing for clustering, compression, classification, regression, and related optimization problems. Proc. IEEE 86 11 (1998) 2210-2239
24. Scholkopf B., Smola A.J., and Muller K.R. Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput. 10 5 (1998) 1299-1319
25. Song Q. A robust information clustering algorithm. Neural Comput. 17 12 (2005) 2672-2698
26. Y.W. Teh, M.I. Jordan, M.J. Beal, D.M. Blei, Hierarchical Dirichlet Processes, J. Am. Stat. Assoc., in press. Available from: .
27. UCI Benchmark repository: a huge collection of artificial and real world data sets, University of California Irvine. .
28. Vapnik V.N. Statistical Learning Theory (1998), John Wiley and Sons Inc., New York
29. Wu K.L., and Yang M.S. Alternative c-means clustering algorithms. Pattern Recognit. 35 10 (2002) 2267-2278
30. Xie X.L., and Beni G. A validity measure for fuzzy clustering. IEEE Trans. Pattern Anal. Mach. Intell. 13 8 (1991) 841-847
31. Yang M.S., and Wu K.L. A similarity-based robust clustering method. IEEE Trans. Pattern Anal. Mach. Intell. 26 4 (2004) 434-448
32. Zhang J.S., and Leung Y.W. Robust clustering by pruning outliers. IEEE Trans. Syst., Man, Cybernet. 33 6 (2003) 983-999