A generalized fuzzy clustering regularization model with optimality tests and model complexity analysis

IEEE Transactions on Fuzzy Systems

Volumn 15, Issue 5, 2007, Pages 904-915

  Yu, Jain ^a   Yang, Miin Shen ^b  

^a BEIJING JIAOTONG UNIVERSITY   (China)

^b CHUNG YUAN CHRISTIAN UNIVERSITY   (Taiwan)

Author keywords

Fuzzy c means (FCM); Fuzzy clustering algorithms; Generalized fuzzy clustering regularization (GFCR) model; Model complexity; Occam's razor principle; Optimality test; Parameter selection

Indexed keywords

CLUSTERING ALGORITHMS; MATHEMATICAL MODELS; OPTIMIZATION;

FUZZY C-MEANS; FUZZY CLUSTERING ALGORITHMS; GENERALIZED FUZZY CLUSTERING REGULARIZATION; MODEL COMPLEXITY; OCCAM'S RAZOR PRINCIPLE; OPTIMALITY TEST; PARAMETER SELECTION;

FUZZY CLUSTERING;

EID: 35348845206     PISSN: 10636706     EISSN: None     Source Type: Journal    
DOI: 10.1109/TFUZZ.2006.889957     Document Type: Article

References (36)

1. J. C. Bezdek, Pattern Recognition with Fuzzy Objective Function Algorithms. New York: Plenum, 1981.
2. M. S. Yang, "A survey of fuzzy clustering", Math. Comput. Model. vol. 18, pp. 1-16, 1993.
3. F. Hoppner, F. Klawonn, R. Kruse, and T. Runkler, Fuzzy Cluster Analysis: Methods for Classification Data Analysis and Image Recognition New York: Wiley, 1999.
4. A. Baraldi and P. Blonda, "A survey of fuzzy clustering algorithms for pattern recognition I and II", IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 29, no. 6, pp. 778-801, Dec. 1999.
5. E. Ruspini, "A new approach to clustering", Inform. Control, vol. 15, pp. 22-32, 1969.
6. J. C. Dunn, "A fuzzy relative ofthe ISODATA process and its use in detecting compact, well-separated clusters", J. Cybern., vol. 3, pp. 32-57, 1974.
7. J. C. Bezdek, "A convergence theorem for the fuzzy ISODATA clustering algorithms", IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-2, no. 1, pp. 1-8, Feb. 1980.
8. J. C. Bezdek, R. J. Hathaway, M. J. Sabin, and W. Tucker, "Convergence theory for fuzzy c-means: Counter-examples and repairs,", IEEE Trans. Syst., Man, Cybern., vol. SMC-17, no. 5, pp. 873-877, Sep. 1987.
9. S. Z. Selim and M. A. Ismail, "On the local optimality of fuzzy ISO-DATA clustering algorithm", IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-8, no. 2, pp. 284-288, Apr. 1986.
10. M. A. Ismail and S. Z. Selim, "Fuzzy c-means: Optimality of the solutions and effective termination of the algorithm,", Pattern Recogn., vol. 19, no. 6, pp. 481-485, 1986.
11. T. Kim, J. C. Bezdek, and R. J. Hathaway, "Optimality tests for fixed points of the fuzzy c-means algorithm," Pattern Recogn., vol. 21, no. 6, pp. 651-663, 1988.
12. W. Wei and J. M. Mendel, "Optimality tests for the fuzzy c-means algorithms", Pattern Recogn., vol. 27, pp. 1567-1573, 1994.
13. R. L. Cannon, J. V. Dave, and J. C. Bezdek, "Efficient implementation of the fuzzy c-means clustering algorithms", IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-8, no. 2, pp. 248-255, Apr. 1986.
14. J. Yu, Q. Cheng, and H. Huang, "Analysis of the weighting exponent in the FCM", IEEE Trans. Syst., Man, Cybern., B, Cybern., vol. 34, no. 1, pp. 634-638, Feb. 2004.
15. M. S. Yang, "On a class of fuzzy classification maximum likelihood procedures", Fuzzy Sets Syst., vol. 57, pp. 365-375, 1993.
16. M. S. Yang, "Conditional fuzzy c-means", Pattern Recogn. Lett., vol. 17, pp. 625-632, 1996.
17. W. Pedrycz, "Conditional fuzzy clustering in the design of radial basis function neural networks", IEEE Trans. Neural Netw., vol. 9, no. 4, pp. 601-612, Jul. 1998.
18. R. N. Dave and R. Krishnapuram, "Robust clustering methods: A unified view", IEEE Trans. Fuzzy Syst., vol. 5, no. 2, pp. 270-293, May 1997.
19. J. S. Lin, "Fuzzy clustering using a compensated fuzzy Hopfield network", Neural Process. Lett., vol. 10, no. 1, pp. 35-48, 1999.
20. D. Özdemir and L. Akarun, "Fuzzy algorithms for combined quantization and dithering", IEEE Trans. Image Process., vol. 10, no. 6, pp. 923-931, Jun. 2001.
21. D. Özdemir and L. Akarun, "A fuzzy algorithm for color quantization of images" Pattern Recogn., vol. 35, pp. 1785-1791, 2002.
22. K. L. Wu and M. S. Yang, "Alternative c-means clustering algorithms", Pattern Recogn., vol. 35, pp. 2267-2278, 2002.
23. J. Yu and M. S. Yang, "Optimality test for generalized FCM and its application to parameter selection", IEEE Trans. Fuzzy Syst., vol. 13, no. 2, pp. 164-176, Apr. 2005.
24. K. Rose, E. Gurewitz, and G. Fox, "A deterministic annealing approach to clustering", Pattern Recogn. Lett., vol. 11, pp. 589-594, 1990.
25. N. B. Karayiannis, "MECA: Maximum entropy clustering algorithm," in Proc. 3rd IEEE Int. Conf. Fuzzy Systems., Yokohama, Japan, 1994, vol. 1, pp. 630-635.
26. R. P. Li and M. Mukaidono, "A maximum entropy to fuzzy clustering", in Proc. 4th IEEE Int. Conf. Fuzzy Syst., Yokohama, Japan, Mar. 20-24, 1995, pp. 2227-2232.
27. S. Miyamoto and K. Umayahara, "Fuzzy clustering by quadratic regularization", in Proc. IEEE Int. Conf. Fuzzy Syst. IEEE World Congr. Comput. Intell., May 4-9, 1998, vol. 2, pp. 1394-1399.
28. M. Yasuda, T. Furuhashi, M. Matsuzaki, and S. Okuma, "Fuzzy clustering using deterministic annealing method and its statistical mechanical characteristics", in Proc. 10th IEEE Int. Conf. Fuzzy Syst., 2001, vol. 2, pp. 797-800.
29. C. Wei and C. Fahn, "The multisynapse neural network and its application to fuzzy clustering", IEEE Trans. Neural Netw., vol. 13, no. 3, pp. 600-618, May 2002.
30. J. C. Bezdek and R. J. Hathaway, "Visual cluster validity (VCV) displays for prototype generator clustering methods", in Proc. 12th IEEE Int. Conf. Fuzzy Syst., 2003, vol. 2, pp. 875-880.
31. M. Menard, V. Courboulay, and P. Dardignac, "Possibistic and probabilistic fuzzy clustering: Unification within the framework of the non-extensive thermostatistics", Pattern Recogn., vol. 36, no. 6, pp. 1325-1342, 2003.
32. A. Blumer, A. Ehrenfeucht, D. Haussler, and M. K. Warmuth, "Occam's razor", Inform. Process. Lett., vol. 24, pp. 377-380, 1987.
33. P. M. Murphy and M. J. Pazzarti, "Exploring the decision forest: An empirical investigation of Occam's razor in decision tree induction" J. Artif. Intell. Res., vol. 1, pp. 257-275, 1994.
34. J. Yu, H. Huang, and S. Tian, "An efficient optimality test for the fuzzy c-means algorithm" in Proc. IEEE Int. Conf. Fuzzy Syst., Honolulu, HL 2002, pp. 98-103.
35. N. R. Pal and J. C. Bezdek, "On cluster validity for the fuzzy c-means model", IEEE Trans. Fuzzy Syst., vol. 3, no. 3, pp. 370-379, Jun. 1995.
36. X. L. Xie and G. Beni, "A validity measure for fuzzy clustering", IEEE Trans. Pattern Anal. Machine Intell., vol. 13, no. 8, pp. 841-847, Aug. 1991.