Alternating cluster estimation: A new tool for clustering and function approximation

IEEE Transactions on Fuzzy Systems

Volumn 7, Issue 4, 1999, Pages 377-393

  Runkler, Thomas A ^a   Bezdek, James C ^b,c  

^a SIEMENS AG   (Germany)

^b UNIVERSITY OF WEST FLORIDA   (United States)

^c IEEE

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; MEMBERSHIP FUNCTIONS; OPTIMIZATION;

ALTERNATING CLUSTER ESTIMATION (ACE); ALTERNATING OPTIMIZATION (AO) ALGORITHMS;

FUZZY SETS;

EID: 0032595185     PISSN: 10636706     EISSN: None     Source Type: Journal    
DOI: 10.1109/91.784198     Document Type: Article

References (74)

1. G. P. Babu and M. N. Murty, "Clustering with evolutionary strategies," Pattern Recognition, vol. 27, no. 2, pp. 321-329, 1994.
2. B. A. Barsky and D. P. Greenberg, "Determining a set of B-spline control vertices to generate an interpolating surface," Comput. Graphics Image Processing, vol. 14, no. 3, pp. 203-226, Nov. 1980.
3. A. Bastian, "A genetic algorithm for tuning membership functions," in Proc. Eur. Congress Intell. Tech. Soft Computing, Aachen, Germany, Sept. 1996, vol. 1, pp. 494-498.
4. J. C. Bezdek, Pattern Recognition with Fuzzy Objective Function Algorithms. New York: Plenum, 1981.
5. J. C. Bezdek, C. Coray, R. Gunderson, and J. Watson, "Detection and characterization of cluster substructure, I linear structure: Fuzzy c-lines," SIAM J. Appl Math., vol. 40, no. 2, pp. 339-357, Apr. 1981.
6. _, "Detection and characterization of cluster substructure, II fuzzy c-varieties and convex combinations thereof," SIAM J. Appl. Math., vol. 40, no. 2, pp. 358-372, Apr. 1981.
7. J. C. Bezdek, R. J. Hathaway, and N. R. Pal, "Norm induced shell prototype (NISP) clustering," Neural, Parallel, Scientific Computat., vol. 3, pp. 431-450, 1995.
8. J. C. Bezdek and N. R. Pal, "Two soft relatives of learning vector quantization," Neural Networks, vol. 8, no. 5, pp. 729-743, 1995.
9. B. M. Chung and J. H. Oh, "Autotuning method of membership function in a fuzzy learning controller," J. Intell. Fuzzy Syst., vol. 1, no. 4, pp. 335-349, 1994.
10. F. L. Chung and T. Lee, "A fuzzy learning model for membership function estimation and pattern classification," in Proc. IEEE Int. Conf. Fuzzy Syst., Orlando, FL, June 1994, vol. 1, pp. 426-431.
11. R. N. Dave, "Fuzzy shell clustering and application to circle detection in digital images," Int. J. General Syst., vol. 16, pp. 343-355, 1990.
12. _, "Characterization and detection of noise in clustering," Pattern Recognition Lett., vol. 12, pp. 657-664, 1991.
13. D. Driankov, H. Hellendoorn, and R. Palm, "Some research directions in fuzzy control," in Theoretical Aspects of Fuzzy Control, H. T. Nuyen, M. Sugeno, R. Tong, and R. R. Yager, Eds. New York: Wiley, 1995, ch. 11, pp. 281-312.
14. D. Driankov, H. Hellendoorn, and M. Reinfrank, An Introduction to Fuzzy Control. Berlin, Germany: Springer-Verlag, 1993.
15. J. C. Dunn, "A fuzzy relative of the isodata process and its use in detecting compact, well separated clusters," J. Cybern., vol. 3, pp. 32-57, 1974.
16. D. P. Filev and R. R. Yager, "A generalized defuzzification method via BAD distributions," Int. J. Intell. Syst., vol. 6, pp. 687-697, 1991.
17. I. Gath and A. B. Geva, "Unsupervised optimal fuzzy clustering," IEEE Trans. Pattern Anal. Machine Intell., vol. 11, pp. 773-781, July 1989.
18. I. Gath and D. Hoory, "Fuzzy clustering of elliptic ring-shaped clusters," Pattern Recognition Lett., vol. 16, pp. 727-741, 1995.
19. H. Genther and M. Glesner, "Automatic generation of a fuzzy classification system using fuzzy clustering methods," in Proc. ACM Symp. Appl. Computing (SAC'94), Phoenix, AZ, Mar. 1994, pp. 180-183.
20. D. E. Goldberg, Genetic Algorithms in Search, Optimization, and Machine Learning. Reading, MA: Addison-Wesley, 1989.
21. E. E. Gustafson and W. C. Kessel, "Fuzzy clustering with a covariance matrix," in Proc. IEEE Conf. Decision Contr., San Diego, CA, 1979, pp. 761-766.
22. S. K. Halgamuge and M. Glesner, "Neural networks in designing fuzzy systems for real world applications," Fuzzy Sets Syst., vol. 65, no. 1, pp. 1-12, 1994.
23. S. K. Halgamuge, W. Pöchmüller, and M. Glesner, "An alternative approach for generation of membership functions and fuzzy rules based on radial and cubic basis function networks," Int. J. Approximate Reasoning, vol. 12, nos. 3/4, pp. 279-298, 1995.
24. S. K. Halgamuge, T. A. Runkler, and M. Glesner, "A hierarchical hybrid fuzzy controller for realtime reverse driving support of vehicles with long trailers," in Proc. IEEE Int. Conf. Fuzzy Syst., Orlando, FL, June 1994, pp. 1207-1210.
25. R. J. Hathaway and J. C. Bezdek, "Switching regression models and fuzzy clustering," IEEE Trans. Fuzzy Syst., vol. 1, pp. 195-204, Aug. 1993.
26. R. J. Hathaway and J. C. Bezdek, "Optimization of clustering criteria by reformulation," IEEE Trans. Fuzzy Syst., vol. 3, pp. 241-245, May 1995.
27. R. Hecht-Nielsen, Neurocomputing. Reading, MA: Addison-Wesley, 1990.
28. A. Homaifar and E. McCormick, "Simultaneous design of membership functions and rule sets for fuzzy controllers using genetic algorithms," IEEE Trans. Fuzzy Syst., vol. 3, pp. 129-139, May 1995.
29. F. Höppner, "Fuzzy shell clustering algorithms in image processing - Fuzzy c-rectangular and two rectangular shells," IEEE Trans. Fuzzy Syst., vol. 5, pp. 599-613, Nov. 1997.
30. F. Höppner, F. Klawonn, R. Kruse, and T. Runkler, Fuzzy Cluster Analysis - Methods for Image Recognition, Classification, and Data Analysis. New York: Wiley, 1999.
31. H. Ichihashi, T. Miyoshi, K. Nagasaka, M. Tokunaga, and T. Wakamatsu, "A neurofuzzy approach to variational problems by using Gaussian membership functions," Int. J. Approximate Reasoning, vol. 13, no. 4, pp. 287-302, 1995.
32. H. Ishibushi, K. Nozaki, N. Yamamoto, and H. Tanaka, "Construction of fuzzy classification systems with rectangular fuzzy rules using genetic algorithms," Fuzzy Sets Syst., vol. 64, no. 2, pp. 237-270, 1994.
33. J. S. R. Jang, "ANFIS: Adaptive-network-based fuzzy inference system," IEEE Trans. Syst., Man, Cybern., vol. 23, pp. 665-685, May 1993.
34. M. S. Kamel and S. Z. Selim, "A thresholded fuzzy c-means algorithm for semi-fuzzy clustering," Pattern Recognition, vol. 24, no. 9, pp. 825-833, 1991.
35. A. Kaufmann and M. M. Gupta, Introduction to Fuzzy Arithmetic. New York: Remhold, 1985.
36. W. E. Kelly and J. H. Painter, "Hypertrapezoidal membership functions," in Proc. IEEE Int. Conf. Fuzzy Syst., New Orleans, LA, Sept. 1996, vol. 2, pp. 1279-1290.
37. S. J. Kim, W. D. Kim, and N. S. Goo, "Identification of nonlinear membership function for failure of structural material and its application to structural optimization," Fuzzy Sets Syst., vol. 66, no. 1, pp. 15-24, 1994.
38. F. Klawonn and A. Keller, "Fuzzy clustering and fuzzy rules," in IFSA'97, Prague, Czechoslovakia, 1997, vol. 1, pp. 193-198.
39. F. Klawonn and R. Kruse, "Constructing a fuzzy controller from data," Fuzzy Sets Syst., vol. 85, no. 1, 1997.
40. R. Krishnapuram and J. M. Keller, "A possibilistic approach to clustering," IEEE Trans. Fuzzy Syst., vol. 1, pp. 98-110, May 1993.
41. R. Krisnapuram, H. Frigui, and O. Nasroui, "Fuzzy and possibilistic shell clustering algorithms and their application to boundary detection and surface approximation," IEEE Trans. Fuzzy Syst., vol. 3, no. 1, pp. 29-60, 1995.
42. A. Kroll, "Identification of functional fuzzy models using multidimensional reference fuzzy sets," Fuzzy Sets Syst., vol. 80, no. 2, pp. 149-158, 1996.
43. L. I. Kuncheva, "Editing for the k-nearest neighbors rule by a genetic algorithm," Pattern Recognition Lett., vol. 16, pp. 809-814, 1995.
44. A. Lotfi and A. C. Tsoi, "Importance of membership functions: A comparative study on different learning methods for fuzzy inference systems," in Proc. IEEE Int. Conf. Fuzzy Syst., Orlando, FL, June 1994, vol. 3, pp. 1791-1796.
45. E. H. Mamdani and S. Assilian, "An experiment in linguistic synthesis with a fuzzy logic controller," Int. J. Man-Machine Studies, vol. 7, no. 1, pp. 1-13, 1975.
46. I. Man and I. Gath, "Detection and separation of ring-shaped clusters using fuzzy clustering," IEEE Trans. Pattern Anal. Mach. Intell., vol. 16, pp. 855-861, 1994.
47. S. Mitaim and B. Kosko, "What is the best shape for a fuzzy set in function approximation?," in Proc. IEEE Int. Conf. Fuzzy Syst., New Orleans, LA, Sept. 1996, vol. 2, pp. 1237-1243.
48. H. Narazaki and A. L. Ralescu, "An improved synthesis method for multilayered neural networks using qualitative knowledge," IEEE Trans. Fuzzy Syst., vol. 1, pp. 125-137, May 1993.
49. N. R. Pal, K. Pal, and J. C. Bezdek, "A mixed c-means clustering model," in Proc. IEEE Int. Conf. Fuzzy Syst., Barcelona, Spain, July 1997, vol. 1, pp. 11-21.
50. W. Pedrycz, "Why triangular membership functions?," Fuzzy Sets Syst., vol. 64, no. 1, pp. 21-30, 1994.
51. N. Pfluger, J. Yen, and R. Langari, "A defuzzification strategy for a fuzzy logic controller employing prohibitive information in command formulation," in Proc. IEEE Int. Conf. Fuzzy Syst., San Diego, CA, Mar. 1992, pp. 717-723.
52. Z. Pingan and L. Renhou, "A new approach to fuzzy identification for complex systems," in Proc. IEEE Int. Conf. Fuzzy Syst., New Orleans, LA, Sept. 1996, vol. 2, pp. 1308-1313.
53. L. Rondeau, E. Levrat, and J. Brémont, "An analytical formulation of the influence of memberfunctions shape," in Proc. IEEE Int. Conf. Fuzzy Syst., New Orleans, LA, Sept. 1996, vol. 2, pp. 1314-1319.
54. T. A. Runkler, "Selection of appropriate defuzzification methods using application specific properties," IEEE Trans. Fuzzy Syst., vol. 5, no. 1, pp. 72-79, 1997.
55. T. A. Runkler and J. C. Bezdek, "Living clusters: An application of the El Farol algorithm to the fuzzy c-means model," in Proc. Eur. Congress Intell. Tech. Soft Computing, Aachen, Germany, Sept. 1997, pp. 1678-1682.
56. _, "RACE: Relational alternating cluster estimation and the wedding table problem," in Fuzzy-Neuro-Syst. '98 Proc. Artificial Intell., München, Germany Mar. 1998, vol. 7, pp. 330-337.
57. _, "Regular alternating cluster estimation," in Proc. Eur. Congress Intell. Tech. Soft Computing, Aachen, Germany, Sept. 1998, pp. 1355-1359.
58. _, "Function approximation with polynomial membership functions and alternating cluster estimation," Fuzzy Sets Syst., vol. 101, no. 2, pp. 207-218, 1999.
59. T. A. Runkler and M. Glesner, "Efficient algorithms for high resolution fuzzy controllers with piecewise linearities," in Proc. IEEE Int. Conf. Fuzzy Syst., Orlando, FL, June 1994, pp. 189-192.
60. _, "Multidimensional defuzzification - Fast algorithms for the determination of crisp characteristic subsets," in Proc. ACM Symp. Appl. Computing (SAC'95), Nashville, TN, Feb. 1995.
61. T. A. Runkler, J. Hollatz, H. Furumoto, E. Jünnemann, and K. Villforth, "Compression of industrial process data using fast alternating cluster estimation (FACE)," in GI Jahrestagung Informatik, Workshop Data Mining, Magdeburg, Germany, Sept. 1998, pp. 71-80.
62. T. A. Runkler and R. H. Palm, "Identification of nonlinear systems using regular fuzzy c-elliptotype clustering," in Proc. IEEE Int. Conf. Fuzzy Syst., New Orleans, LA, Sept. 1996, pp. 1026-1030.
63. B. Schweizer and A. Sklar, "Associative functions and statistical triangle inequalities," Publicationes Mathematicae Debrecen, vol. 8, pp. 169-186, 1961.
64. K. Shimojima, T. Fukuda, and F. Arai, "Self-tuning fuzzy inference based on spline function," in Proc. IEEE Int. Conf. Fuzzy Syst., Orlando, FL, June 1994, vol. 1, pp. 690-695.
65. C. Stutz and T. A. Runkler, "Fuzzy c-mixed prototype clustering," in Fuzzy-Neuro-Syst. '98 Proc. Artificial Intell., München, Germany, Mar. 1998, vol. 7, pp. 122-129.
66. M. Sugeno and T. Yasukawa, "A fuzzy-logic-based approach to qualitative modeling," IEEE Trans. Fuzzy Syst., vol. 1, pp. 7-31, Feb. 1993.
67. T. Takagi and M. Sugeno, "Fuzzy identification of systems and its application to modeling and control," IEEE Trans. Syst., Man, Cybern., vol. 15, pp. 116-132, July 1985.
68. C. H. Wang, W. Y. Wang, T. T. Lee, and P. S. Tseng, "Fuzzy B-spline membership function (BMF) and its applications in fuzzy-neural control," IEEE Trans. Syst., Man, Cybern., vol. 25, pp. 841-851, Dec. 1995.
69. T. Waschek, T. A. Runkler, S. Levegrün, R. Egenhart, M. Glesner, W. Schlegel, and M. van Kampen, "Application of the subset defuzzification to fuzzy target volumes in radiotherapy," in Proc. Eur. Congress Intell. Tech. Soft Computing, Aachen, Germany, Aug. 1995, pp. 1643-1647.
70. R. R. Yager and D. P. Filev, "SLIDE: A simple adaptive defuzzification method," IEEE Trans. Fuzzy Syst., vol. 1, pp. 69-78, Feb. 1993.
71. L. A. Zadeh, "Fuzzy sets," Inform. Contr., vol. 8, pp. 338-353, 1965.
72. D. Zhang, M. Kamel, and M. I. Elmasry, "Fuzzy clustering neural network (FCNN): Competitive learning and parallel architecture," J. Intell. Fuzzy Syst., vol. 2, no. 4, pp. 290-298, 1994.
73. J. Zhang and K. V. Le, "Self-optimization of a fuzzy controller with B-spline models," in Proc. Eur. Congress Intell. Tech. Soft Computing, Aachen, Germany, Sept. 1996, vol. 2, pp. 1041-1045.
74. J. Zižka, "Learning control rules for Takagi-Sugeno fuzzy controllers using genetic algorithms," in Proc. Eur. Congress Intell. Tech. Soft Computing, Aachen, Germany, Sept. 1996, vol. 2, pp. 960-964.