Optimality test for generalized FCM and its application to parameter selection

IEEE Transactions on Fuzzy Systems

Volumn 13, Issue 1, 2005, Pages 164-176

  Yu, Jian ^a   Yang, Miin Shen ^b  

^a BEIJING JIAOTONG UNIVERSITY   (China)

^b CHUNG YUAN CHRISTIAN UNIVERSITY   (Taiwan)

Author keywords

Fixed point; Fuzzy c means (FCM); Fuzzy clustering; Hessian matrix; Local minimum; Optimality test; Parameter selection

Indexed keywords

ALGORITHMS; MATHEMATICAL MODELS; MATRIX ALGEBRA; MEMBERSHIP FUNCTIONS; PATTERN RECOGNITION;

FIXED POINT; FUZZY C-MEANS (FCM) CLUSTERING ALGORITHM; FUZZY CLUSTERING; HESSIAN MATRIX; LOCAL MINIMUM; OPTIMALITY TEST; PARAMETER SELECTION;

FUZZY SETS;

EID: 14644432442     PISSN: 10636706     EISSN: None     Source Type: Journal    
DOI: 10.1109/TFUZZ.2004.836065     Document Type: Article

References (42)

1. L. A. Zadeh, "Fuzzy sets," Inf. Control, vol. 8, pp. 338-353, 1965.
2. J. C. Bezdek, Pattern Recognition with Fuzzy Objective Function Algorithms. New York, NY: Plenum, 1981.
3. F. Hoppner, F. Klawonn, R. Kruse, and T. Runkler, Fuzzy Cluster Analysis: Methods for Classification Data Analysis and Image Recognition New York: Wiley, 1999.
4. M. S. Yang, "A survey of fuzzy clustering," Math. Comput. Model. vol. 18, pp. 1-16, 1993.
5. J. C. Bezdek, R. J. Hathaway, M. J. Sabin, and W. Tucker, "Convergence theory for fuzzy c-means: Counter-examples and repairs," IEEE Trans. Syst., Man, Cybern., vol. SMC-17, no. 5, pp. 873-877, Oct. 1987.
6. S. Z. Selim and M. A. Ismail, "On the local optimality of fuzzy ISODATA clustering algorithm," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-8, no. 2, pp. 284-288, Apr. 1986.
7. M. A. Ismail and S. Z. Selim, "Fuzzy c-means: Optimality of the solutions and effective termination of the algorithm," Pattern Recogn., vol. 19, no. 6, pp. 481-485, 1986.
8. T. Kim, J. C. Bezdek, and R. J. Hathaway, "Optimality tests for fixed points of the fuzzy c-means algorithm," Pattern Recogn., vol. 21, no. 6, pp. 651-663, 1988.
9. W. Wei and J. M. Mendel, "Optimality tests for the fuzzy c-means algorithm," Pattern Recogn., vol. 27, no. 11, pp. 1567-1573, 1994.
10. H. Imai, A. Tanaka, and M. Miyakoshi, "A method of identifying influential data in fuzzy clustering," IEEE Trans. Fuzzy Syst., vol. 6, no. 1, pp. 90-101, Feb. 1998.
11. J. Yu, Q. Cheng, and H. Huang, "Analysis of the weighting exponent in the FCM," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 1, pp. 634-638, Feb. 2004.
12. J. C. Bezdek, "A physical interpretation of fuzzy ISODATA," IEEE Trans. Syst., Man, Cybern., vol. SMC-6, pp. 387-390, May 1976.
13. N. R. Pal and J. C. Bezdek, "On cluster validity for the fuzzy c-means model," IEEE Trans. Fuzzy Syst., vol. 3, no. 3, pp. 370-379, Jun. 1995.
14. M. J. Fadili, S. Ruan, D. Bloyet, and B. Mayoyer, "On the number of clusters and the fuzziness index for unsupervised FCA application to BOLD fMRI time series," Med. Image Anal., vol. 5, pp. 55-67, 2001.
15. A. M. Bensaid, L. O. Hall, J. C. Bezdek, L. P. Clarke, M. L. Silbiger, J. A. Arrington, and R. F. Murtagh, "Validity-guided (re)clustering with applications to image segmentation," IEEE Trans. Fuzzy Syst. vol. 4, no. 2, pp. 112-123; Apr. 1996.
16. R. L. Cannon, J. V. Dave, and J. C. Bezdek, "Efficient implementation of the fuzzy c-means clustering algorithms," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-8, no. 2, pp. 248-255, Apr. 1986.
17. M. S. Yang, "On a class of fuzzy classification maximum likelihood procedures," Fuzzy Sets Syst., vol. 57, pp. 365-375, 1993.
18. K. L. Wu and M. S. Yang, "Alternative c-means clustering algorithms," Pattern Recogn., vol. 35, pp. 2267-2278, 2002.
19. W. Pedrycz, "Conditional fuzzy c-means," Pattern Recogn. Lett., vol. 17, pp. 625-632, 1996.
20. D. Özdemir and L. Akarun, "Fuzzy algorithms for combined quantization and dithering," IEEE Trans. Image Processing, vol. 10, no. 6, pp. 923-931, Jun. 2001.
21. D. Özdemir and L., Akarun, "A fuzzy algorithm for color quantization of images," Pattern Recogn., vol. 35, pp. 1785-1791, 2002.
22. R. P. Li and M. Mukaidono, "A maximum entropy to fuzzy clustering," in Proc. 4th IEEE Int. Conf. Fuzzy Systems, Yokohama, Japan, Mar. 20-24, 1995, pp. 2227-2232.
23. K. Rose, E. Gurewitz, and G. Fox, "A deterministic annealing approach to clustering," Pattern Recogn. Lett., vol. 11, pp. 589-594.
24. S. Miyamoto and K. Umayahara, "Fuzzy clustering by quadratic regularization," in Proc. 1998 IEEE Int. Conf. Fuzzy Systems and IEEE World Congr. Computational Intelligence, vol. 2, May 4-9, 1998, pp. 1394-1399.
25. S. Miyamoto and K. Umayahara, "Two methods of fuzzy c-means and classification functions," in Proc. 6th Conf. Int. Fed. Classification Societies, 1998, pp. 105-110.
26. Y. Ohashi, "Fuzzy clustering and robust estimation," in 9th Meet. SAS Users Grp. Int., Hollywood Beach, FL, 1984.
27. R. Dave, "Characterization and detection of noise in clustering," Pattern Recogn. Len., vol. 12, no. 11, pp. 657-664, 1991.
28. D. Tran and M. Wagner, "Fuzzy entropy clustering," Proc. FUZZ IEEE 2000. vol. 1, pp. 152-157, 2002.
29. M. Menard, V. Courboulay, and P. Dardignac, "Possibistic and probabilistic fuzzy clustering: Unification within the framework of the nonextensive thermostatistics," Pattern Recogn., vol. 36, no. 6, pp. 1325-1342, 2003.
30. J. Yu, H. Huang, and S. Tian, "An efficient optimality test for the fuzzy c-means algorithm," in Proc. 2002 IEEE Int. Conf. Fuzzy Systems, Honolulu, HI, 2002, pp. 98-103.
31. J. S. Lin, "Fuzzy clustering using a compensated fuzzy Hopfield network," Neural Processing Lett., vol. 10, no. 1, pp. 35-48, 1999.
32. M. S. Yang, Y. J. Hu, K. C. R. Lin, and C. C. L. Lin, "Segmentation techniques for tissue differentiation in MRI of ophthalmology using fuzzy clustering algorithms," Magn. Reson. Imag., vol. 20, pp. 173-179, 2002.
33. W. Pedrycz, "Conditional fuzzy clustering in the design of radial basis function neural networks," IEEE Trans. Neural Networks, vol. 9, no. 4, pp. 601-612, Jul. 1998.
34. J. Yu and M. S. Yang, "A note on the ICS algorithm with corrections and theoretical analysis," IEEE Trans. Image Processing, 2005, to be published
35. R. N. Dave, "Validating fuzzy partitions obtained through c-shells clustering," Pattern Recogn. Lett., vol. 17, pp. 613-623, 1996.
36. [Online]. Available: http://www.ics.uci.edu/~mlearn/MLRepository.html
37. J. S. Lin, K. S. Cheng, and C. W. Mao, "Segmentation of multispectral magnetic resonance image using penalized fuzzy competitive learning network," Comput. Biomed. Res., vol. 29, pp. 314-326, 1996.
38. S. H. Liu and J. S. Lin, "Vector quantization in DCT domain using fuzzy possibilistic c-means based on penalized and compensated constraints," Pattern Recogn., vol. 35, pp. 2201-2211, 2002.
39. M. S. Yang and N. Y. Yu, "Estimation of parameters in latent class models using fuzzy clustering algorithms," Eur. J. Oper. Res., vol. 160, pp. 515-531, 2005.
40. K. Urahama, "Convergence of alternative c-means clustering algorithms," IEICE Trans. Inf. Syst., vol. E86D, pp. 752-754, 2003.
41. H. Frigui and R. Krishnapuram, "A robust algorithm for automatic extraction of an unknown number of clusters from noisy data," Pattern Recogn. Lett., vol. 17, pp. 1223-1232, 1996.
42. R. J. Hathaway, J. C. Bezdek, and Y. Hu, "Generalized fuzzy c-means clustering strategies using Lp norm distances fuzzy systems," IEEE Trans. Fuzzy Syst., vol. 8, no. 5, pp. 576-582, Oct. 2000.