A generalization of distance functions for fuzzy c-means clustering with centroids of arithmetic means

IEEE Transactions on Fuzzy Systems

Volumn 20, Issue 3, 2012, Pages 557-571

  Wu, Junjie ^a   Xiong, Hui ^b   Liu, Chen ^c   Chen, Jian ^d  

^a BEIHANG UNIVERSITY   (China)

^b RUTGERS UNIVERSITY   (United States)

^c University of California   (United States)

^d Tsinghua University   (China)

Author keywords

Convex function; Fuzzy c means (FCM); Lp norm; Point to centroid distance (P2C D)

Indexed keywords

CONTINUOUSLY DIFFERENTIABLE; CONVEX FUNCTIONS; FUZZY C MEANS CLUSTERING; FUZZY C-MEANS; FUZZY CLUSTERING METHOD; GLOBAL CONVER-GENCE; LP-NORM; POINT-TO-CENTROID DISTANCE (P2C-D);

FUNCTIONS; FUZZY CLUSTERING;

FUZZY SYSTEMS;

EID: 84885576449     PISSN: 10636706     EISSN: None     Source Type: Journal    
DOI: 10.1109/TFUZZ.2011.2179659     Document Type: Article

References (57)

1. A. Jain and R. Dubes, Algorithms for Clustering Data. Englewood Cliffs, NJ: Prentice-Hall, 1988.
2. P.-N. Tan, M. Steinbach, and V. Kumar, Introduction to Data Mining. New York: Addison-Wesley, 2005.
3. T. Tu and Y. Chen, "Stream data clustering based on grid density and attraction," ACM Trans. Knowl. Discov. Data, vol. 1, no. 1, 2008.
4. Y. Chen, "Clustering parallel data streams," in Data Mining and Knowledge Discovery in Real Life Applications, J. Ponce and A. Karahoca, Eds. Vienna, Austria: I-Tech, 2009.
5. T. Liu, K. Ting, and Z.-H. Zhou, "On detecting clustered anomalies using sciforest," in Proc. Eur. Conf. Mach. Learn. Principles Pract. Knowl. Discov. Databases, 2010, pp. 274-290.
6. J. Fan, A. Elmagarmid, X. Zhu, W. Aref, and L. Wu, "Clusterview: Hierarchical video shot classification, indexing and accessing," IEEE Trans. Multimedia, vol. 16, no. 1, pp. 70-86, Feb. 2004.
7. C.-H. Li, B.-C. Kuo, and C.-T. Lin, "Lda-based clustering algorithm and its application to an unsupervised feature extraction," IEEE Trans. Fuzzy Syst., vol. 19, no. 1, pp. 152-163, Feb. 2011.
8. J. Dunn, "A fuzzy relative of the isodata process and its use in detecting compact well-separated clusters," J. Cybern., vol. 3, pp. 32-57, 1973.
9. J. Bezdek, Pattern Recognition with Fuzzy Objective Function Algoritms. New York: Plenum, 1981.
10. W. Pedrycz, V. Loia, and S. Senatore, "Fuzzy clustering with viewpoints," IEEE Trans. Fuzzy Syst., vol. 18, no. 2, pp. 274-284, Apr. 2010.
11. K. Honda,A.Notsu, and H. Ichihashi, "Fuzzy PCA-guided robust k-means clustering," IEEE Trans. Fuzzy Syst., vol. 18, no. 1, pp. 67-79, Feb. 2010.
12. W. Zangwill, Nonlinear Programming: AUnified Approach. Englewood Cliffs, NJ: Prentice-Hall, 1969.
13. D. Luenberger and Y. Ye, Linear and Nonlinear Programming, 3rd ed. ed. New York: Springer-Verlag, 2008.
14. R. Hathaway, J. Bezdek, and W. Tucker, "An improved convergence theory for the fuzzy c-means clustering algorithms," in Analysis of Fuzzy Information, vol. 3, J. Bezdek, Ed. Boca Raton, FL: CRC, 1987, pp. 123-131.
15. J. Bezdek, "A convergence theorem for the fuzzy isodata clustering algorithms," IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-2, no. 1, pp. 1-8, Jan. 1980.
16. L. Bobrowski and J. Bezdek, "C-means clustering with the l1 and l' norms," IEEE Trans. Syst., Man, Cybern., vol. 21, no. 3, pp. 545-554, May/Jun. 1991.
17. R. J. Hathaway, J. C. Bezdek, and Y. Hu, "Generalized fuzzy c-means clustering strategies using lp norm distances," IEEE Trans. Fuzzy Syst., vol. 8, no. 5, pp. 576-582, Oct. 2000.
18. F. Klawonn and A. Keller, "Fuzzy clustering based on modified distance measures," in Proc. 3rd Int. Symp. Adv. Intell. Data Anal., 1999, pp. 291-302.
19. S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge, U.K.: Cambridge Univ. Press, 2004.
20. H. Flanders, Differential Forms with Applications to the Physical Sciences. New York: Dover, 1989.
21. M. Karoubi and C. Leruste, Algebraic Topology via DifferentialGeometry. Cambridge, U.K.: Cambridge Univ. Press, 1987.
22. L. Bregman, "The relaxation method of finding the common points of convex sets and its application to the solution of problems in convex programming," USSR Comput. Math. Math. Phys., vol. 7, pp. 200-217, 1967.
23. A. Banerjee, S. Merugu, I. Dhillon, and J.Ghosh, "Clusteringwith bregman divergences," J. Mach. Learn. Res., vol. 6, pp. 1705-1749, 2005.
24. Y. Zhao and G. Karypis, "Criterion functions for document clustering: Experiments and analysis," Mach. Learn., vol. 55, no. 3, pp. 311-331, 2004.
25. B.-K. Yi and C. Faloutsos, "Fast time sequence indexing for arbitrary lp norms," in Proc. 26th Very Large DataBases Conf., Cairo, Egypt, 2000, pp. 385-394.
26. L. Chen and R. Ng, "On the marriage of lp-norms and edit distance," in Proc. 30th Very Large DataBases Conf., Toronto, ON, Canada, 2004, pp. 792-803.
27. G. Golub and C. van Loan, Matrix Computations, 3rd ed. ed. Baltimore, MD: Johns Hopkins, 1996.
28. I. Sledge, J. Bezdek, T. Havens, and J. Keller, "Relational generalizations of cluster validity indices," IEEE Trans. Fuzzy Syst., vol. 18, no. 4, pp. 771-786, Aug. 2010.
29. J. Wu, H. Xiong, and J. Chen, "Adapting the right measures for k-means clustering," in Proc. 15th ACM SIGKDD Int. Conf. Knowl. Discov. Data Mining, 2009, pp. 877-886.
30. M. Meila, "Comparing clusterings-An axiomatic view," in Proc. Int. Conf. Mach. Learning, 2005, pp. 577-584.
31. R. Dav́e, "Characterization and detection of noise in clustering," Pattern Recognit. Lett., vol. 12, no. 11, pp. 657-664, 1991.
32. Y. Ohashi, "Fuzzy clustering and robust estimation," presented at the 9th SAS Users Group Int. Meet., Hollywood Beach, FL, 1984.
33. P. Kersten, "Fuzzy order statistics and their application to fuzzy clustering," IEEE Trans. Fuzzy Syst., vol. 7, no. 6, pp. 708-712, Dec. 1999.
34. S. Miyamoto and Y. Agusta, "An efficient algorithm for l1 fuzzy c-means and its termination," Control Cybern., vol. 24, no. 4, pp. 421-436, 1995.
35. K. Jajuga, "l1 norm-based fuzzy clustering," Fuzzy Sets Syst., vol. 39, pp. 43-50, 1991.
36. J. Bezdek, R. Hathaway, and V. Huggins, "Parametric estimation for normal mixtures," Pattern Recognit. Lett., vol. 3, pp. 79-84, 1985.
37. W. Tucker, "Counterexamples to the convergence theorem for fuzzy isodata clustering algorithm," in Analysis of Fuzzy Information, vol. 3, J. Bezdek, Ed. Boca Raton, FL: CRC, 1987, pp. 109-122.
38. F. Hoppner, F. Klawonn, R. Kruse, and T. Runkler, Fuzzy Cluster Analysis. New York: Wiley, 1999.
39. L. Groll and J. Jakel, "A new convergence proof of fuzzy c-means," IEEE Trans. Fuzzy Syst., vol. 13, no. 5, pp. 717-720, Oct. 2005.
40. R. Hathaway and J. Bezdek, "Local convergence of the fuzzy c-means algorithms," Pattern Recognit., vol. 19, pp. 477-480, 1986.
41. T. Kim, J. Bezdek, and R. Hathaway, "Optimality tests for fixed points of the FCM algorithm," Pattern Recognit., vol. 21, no. 6, pp. 651-663, 1988.
42. M. Ismail and S. Selim, "Fuzzy c-means: Optimality of solutions and effective termination of the algorithm," Pattern Recognit., vol. 19, pp. 481-485, 1984.
43. S. Selim and M. Ismail, "On the local optimality of the fuzzy isodata clustering algorithm," IEEE Trans. Pattern Anal.Mach. Intell., vol. PAMI-8, no. 2, pp. 284-288, Mar. 1986.
44. F. Hoppner and F. Klawonn, "A contribution to convergence theory of fuzzy c-means and derivatives," IEEE Trans. Fuzzy Syst., vol. 11, no. 5, pp. 682-694, Oct. 2003.
45. R. Hathaway and J. Bezdek, "Recent convergence results for the fuzzy c-means clustering algorithms," J. Classif., vol. 5, pp. 237-247, 1988.
46. M. Yang, "On a class of fuzzy classification maximum likelihood procedures," Fuzzy Sets Syst., vol. 57, pp. 365-375, 1993.
47. K.Wu andM. Yang, "Alternative c-means clustering algorithms," Pattern Recognit., vol. 35, pp. 2267-2278, 2002.
48. W. Pedrycz, "Conditional fuzzy c-means," Pattern Recognit. Lett., vol. 17, pp. 625-632, 1996.
49. J. M. Leski, "Generalized weighted conditional fuzzy clustering," IEEE Trans. Fuzzy Syst., vol. 11, no. 6, pp. 709-715, Dec. 2003.
50. R. Li and M. Mukaidono, "A maximum entropy to fuzzy clustering," in Proc. 4th IEEE Int. Conf. Fuzzy Syst., Yokohama, Japan, 1995, pp. 2227-2232.
51. K. Rose, E. Gurewitz, and G. Fox, "A deterministic annealing approach to clustering," Pattern Recognit. Lett., vol. 11, pp. 589-594, 1990, pp. 589-594.
52. S. Miyamoto and K. Umayahara, "Fuzzy clustering by quadratic regularization," in Proc. 7th IEEE Int. Conf. Fuzzy Syst., 1998, pp. 394-1399.
53. M. Menard,V.Courboulay, and P. Dardignac, "Possibilistic and probabilistic fuzzy clustering: Unification within the framework of the nonextensive thermostatistics," Pattern Recognit., vol. 36, no. 6, pp. 1325-1342, 2003.
54. J. Yu and M.-S. Yang, "Optimality test for generalized FCM and its application to parameter selection," IEEE Trans. Fuzzy Syst., vol. 13, no. 1, pp. 164-176, Feb. 2005.
55. J. Yu and M.-S. Yang, "A generalized fuzzy clustering regularization model with optimality tests and model complexity analysis," IEEE Trans. Fuzzy Syst., vol. 15, no. 5, pp. 904-915, Oct. 2007.
56. Teboulle, "A unified continuous optimization framework for center-based clustering methods," J. Mach. Learn. Res., vol. 8, pp. 65-102, 2007.
57. S. Miyamoto, H. Ichihashi, and K. Honda, Algorithms for Fuzzy Clustering: Methods in c-Means Clustering with Applications. NewYork: Springer-Verlag, 2008.