A gradient-descent-based approach for transparent linguistic interface generation in fuzzy models

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 40, Issue 5, 2010, Pages 1219-1230

  Chen, Long ^a   Chen, C L Philip ^a   Pedrycz, Witold ^b  

^a University of Texas at San Antonio   (United States)

^b SYSTEMS RESEARCH INSTITUTE   (Poland)

Author keywords

Fuzzy clustering; fuzzy decision tree; fuzzy systems; linguistic interface; membership functions; transparency and interpretability

Indexed keywords

CLASSIFICATION RATES; DATA SETS; FUZZY DECISION TREES; FUZZY DESCRIPTION; FUZZY MODELS; GRADIENT-DESCENT; INTERFACE GENERATION; INTERPRETABILITY; LINGUISTIC TERMS; MACHINE-LEARNING DATABASE; TREE SIZE; UNIVERSITY OF CALIFORNIA;

DECISION TREES; FUZZY CLUSTERING; FUZZY SETS; FUZZY SYSTEMS; LINGUISTICS; TRANSPARENCY;

MEMBERSHIP FUNCTIONS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER SIMULATION; DECISION SUPPORT SYSTEM; FUZZY LOGIC; LINGUISTICS; METHODOLOGY; THEORETICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; DECISION SUPPORT TECHNIQUES; FUZZY LOGIC; LINGUISTICS; MODELS, THEORETICAL; PATTERN RECOGNITION, AUTOMATED;

EID: 77956686571     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2009.2036443     Document Type: Article

References (58)

1. L. A. Zadeh, "Fuzzy logic equals computing with words," IEEE Trans. Fuzzy Syst., vol.4, no.2, pp. 103-111, Apr. 1996.
2. W. Pedrycz, Granular Computing: An Emerging Paradigm. NewYork: Springer-Verlag, 2001.
3. F.-Y. Wang, "On the abstraction of conventional dynamic systems: From numerical analysis to linguistic analysis," Inf. Sci., vol.171, no.1-3, pp. 233-259, Mar. 2005.
4. Y. F. Yuan and M. J. Shaw, "Induction of fuzzy decision tree," Fuzzy Sets Syst., vol.69, no.2, pp. 125-139, Jan. 1995.
5. X.-Z. Wang, E. C. C. Tsang, and D. S. Yeung, "A comparative study on heuristic algorithms for generating fuzzy decision trees," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol.31, no.2, pp. 215-226, Apr. 2001.
6. X.-Z. Wang, J.-H. Zhai, and S.-X. Lu, "Induction of multiple fuzzy decision trees based on rough set technique," Inf. Sci., vol.178, no.16, pp. 3188-3202, Aug. 2008.
7. W. Pedrycz, "Logic-driven fuzzy modeling with fuzzy multiplexers," Eng. Appl. Artif. Intell., vol.17, no.4, pp. 383-391, Jun. 2004.
8. X.-Z. Wang and C. R. Dong, "Improving generalization of fuzzy IF-THEN rules by maximizing fuzzy entropy," IEEE Trans. Fuzzy Syst., vol.17, no.3, pp. 556-567, Jun. 2009.
9. W. Pedrycz, "Logic-oriented fuzzy neural networks," Int. J. Hybrid Intell. Syst., vol. 1, no. 1/2, pp. 3-11, Apr. 2004.
10. W. Pedrycz and F. Gomide, An Introduction to Fuzzy Sets: Analysis and Design. Boston, MA: MIT Press, 1998.
11. S. Medasani, J. Kim, and R. Krishnapuram, "An overview of membership function generation techniques for pattern recognition," Int. J. Approx. Reason., vol. 19, no. 3/4, pp. 391-417, Oct./Nov. 1998.
12. P. Guo, C. L. P. Chen, and M. R. Lyu, "Cluster number selection for a small set of samples using the Bayesian Ying-Yang model," IEEE Trans. Neural Netw., vol.13, no.3, pp. 757-763, May 2002.
13. S.-K. Oh, W. Pedrycz, and H.-S. Park, "Hybrid identification in fuzzyneural networks," Fuzzy Sets Syst., vol.138, no.2, pp. 399-426, Sep. 2003.
14. L. Chen and C. L. P. Chen, "Pre-shaped fuzzy c-means algorithm (PFCM) for transparent membership function generation," in Proc. IEEE Int. Conf. SMC, Montreal, QC, Canada, Oct. 2007, pp. 789-794.
15. T. W. Liao, A. K. Celmins, and R. J. Hammell, II, "A fuzzy c-means variant for the generation of fuzzy term sets," Fuzzy Sets Syst., vol.135, no.2, pp. 241-257, Apr. 2003.
16. R. Krishnapuram, "Generation of membership functions via possibilistic clustering," in Proc. 3rd IEEE Conf. Fuzzy Syst., Orlando, FL, Jun. 26-29, 1994, pp. 902-908.
17. S. M. Zhou and J. Q. Gan, "Low-level interpretability and high-level interpretability: A unified view of data-driven interpretable fuzzy system modelling," Fuzzy Sets Syst., vol.159, no.23, pp. 3091-3131, Dec. 2008.
18. C. Mencar, "Theory of fuzzy information granulation: Contributions to interpretability issues," Ph.D. dissertation, Univ. Bari, Bari, Italy, 2005.
19. J. C. Bezdek, Pattern Recognition With Fuzzy Objective Function Algorithms. New York: Plenum, 1981.
20. C. S. Herrman, "Symbolical reasoning about numerical data: A hybrid approach," Appl. Intell., vol.7, no.4, pp. 339-354, Nov. 1997.
21. W. Pedrycz and J. V. de Oliveira, "A development of fuzzy encoding and decoding through fuzzy clustering," IEEE Trans. Instrum. Meas., vol.57, no.4, pp. 829-837, Apr. 2008.
22. J. V. de Oliveira, "Semantic constraints for membership function optimization," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol.29, no.1, pp. 128-138, Jan. 1999.
23. M. Dissanayake, L. Chen, W. Pedrycz, A. Fayek, and A. Russell, "Fuzzy logic modeling of causal relationships-case study: Reasoning about construction performance," in Proc. NAFIPS Annu. Meeting North Amer. Fuzzy Inf. Process. Soc.: Fuzzy Sets Heart Can. Rockies, Banff, AB, Canada, Jun. 27-30, 2004, pp. 605-610.
24. J. C. Bezdek, "Numerical taxonomy with fuzzy sets," J. Math. Biol., vol.1, no.1, pp. 57-71, May 1974.
25. X. L. L. Xie and G. Beni, "A validity measure for fuzzy clustering," IEEE Trans. Pattern Anal. Mach. Intell., vol.13, no.8, pp. 841-847, Aug. 1991.
26. C. Merz and P. Murphy, UCI Repository of Machine Learning Databases, 1996. [Online]. Available: ftp://ftp.ics.uci.edu/pub/machinelearning-databases
27. K. Nozaki, H. Ishibuchi, and H. Tanaka, "A simple but powerful heuristic method for generating fuzzy rules from numerical data," Fuzzy Sets Syst., vol.86, no.3, pp. 251-270, Mar. 16, 1997.
28. A. Riid and E. Rustern, "Transparent fuzzy systems and modelling with transparency protection," in Proc. IFAC Symp. AIRTC, Kidlington, U.K., Oct. 2-4, 2000, pp. 225-230
29. S. Guillaume, "Designing fuzzy inference systems from data: An interpretability-oriented review," IEEE Trans. Fuzzy Syst., vol.9, no.3, pp. 426-443, Jun. 2001.
30. M. S. Chen and S. W. Wang, "Fuzzy clustering analysis for optimizing fuzzy membership functions," Fuzzy Sets Syst., vol.103, no.2, pp. 239-254, Apr. 16, 1999.
31. F. Hoppner, Fuzzy Cluster Analysis: Methods for Classification, Data Analysis, and Image Recognition. New York: Wiley, 1999.
32. T. A. Runkler and J. C. Bezdek, "Alternating cluster estimation: A new tool for clustering and function approximation," IEEE Trans. Fuzzy Syst., vol.7, no.4, pp. 377-393, Aug. 1999.
33. S. Mitra, K. M. Konwar, and S. K. Pal, "Fuzzy decision tree, linguistic rules and fuzzy knowledge-based network: Generation and evaluation," IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol.32, no.4, pp. 328-339, Nov. 2002.
34. J. Eggermont, "Evolving fuzzy decision trees with genetic programming and clustering," in Proc. 5th EuroGP, Berlin, Germany, Apr. 3-5, 2002, pp. 71-82.
35. L. Chen, W. Pedrycz, and C. L. P. Chen, "Computational intelligence techniques for building transparent construction performance models," in Proc. IEEE Int. Conf. SMC, Taipei, Taiwan, Oct. 2006, pp. 1166-1171.
36. H. Ishibuchi, T. Nakashima, and M. Nii, Classification and Modeling With Linguistic Information Granules: Advanced Approaches to Linguistic Data Mining. New York: Springer-Verlag, 2005.
37. W. Pedrycz, "Why triangular membership functions," Fuzzy Sets Syst., vol.64, no.1, pp. 21-30, May 25, 1994.
38. L. Rondeau, E. Levrat, and J. Bremont, "An analytical formulation of the influence of membership functions shape," in Proc. IEEE 5th Int. Fuzzy Syst., New York, Sep. 8-11, 1996, pp. 1314-1319.
39. Y. C. Hu, R. S. Chen, and G. H. Tzeng, "Discovering fuzzy association rules using fuzzy partition methods," Knowl.-Based Syst., vol.16, no.2, pp. 137-147, Apr. 2003.
40. T. A. Runkler and J. C. Bezdek, "Function approximation with polynomial membership functions and alternating cluster estimation," Fuzzy Sets Syst., vol.101, no.2, pp. 207-218, Jan. 16, 1999.
41. T. P. Hong and C. Y. Lee, "Induction of fuzzy rules and membership functions from training examples," Fuzzy Sets Syst., vol.84, no.1, pp. 33-47, Nov. 1996.
42. Y.W. Teng andW. J.Wang, "Constructing a user-friendly GA-based fuzzy system directly from numerical data," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol.34, no.5, pp. 2060-2070, Oct. 2004.
43. J. Espinosa and J. Vandewalle, "Constructing fuzzy models with linguistic integrity from numerical data-AFRELI algorithm," IEEE Trans. Fuzzy Syst., vol.8, no.5, pp. 591-600, Oct. 2000.
44. B.-J. Park,W. Pedrycz, and S.-K. Oh, "Identification of fuzzy models with the aid of evolutionary data granulation," Proc. Inst. Elect. Eng.-Control Theory Appl., vol.148, no.5, pp. 406-418, Sep. 2001.
45. H. Verlinde, M. D. Cock, and R. Boute, "Fuzzy versus quantitative association rules: A fair data-driven comparison," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol.36, no.3, pp. 679-684, Jun. 2006.
46. W. Pedrycz, "Logic-based fuzzy neurocomputing with unineurons," IEEE Trans. Fuzzy Syst., vol.14, no.6, pp. 860-873, Dec. 2006.
47. L. Chen and C. L. P. Chen, "Transparent linguistic interface generation and its application in fuzzy decision trees," in Proc. IEEE Int. Conf. SMC, Singapore, Oct. 2008, pp. 1337-1342.
48. W. Pedrycz, M. Reformat, and K. Li, "OR/AND neurons and the development of interpretable logic models," IEEE Trans. Neural Netw., vol.17, no.3, pp. 636-658, May 2006.
49. S. M. Zhou and J. Q. Gan, "Extracting Takagi-Sugeno fuzzy rules with interpretable submodels via regularization of linguistic modifiers," IEEE Trans. Knowl. Data Eng., vol.21, no.8, pp. 1191-1204, Aug. 2009.
50. M. S. Bazaraa, H. D. Sherali, and C. M. Shetty, Nonlinear Programming: Theory and Algorithms., 2nd ed. New York: Wiley, 1993.
51. P. Dadone and H. F. VanLandingham, "On the non-differentiability of fuzzy logic systems," in Proc. IEEE Int. Conf. SMC, Nashville, TN, Oct. 2000, pp. 2703-2708.
52. H. Nomura, I. Hayashi, and N. Wakami, "A learning method of fuzzy inference rules by descent method," in Proc. IEEE Int. Conf. Fuzzy Syst. FUZZ-IEEE, San Diego, CA, Mar. 8-12, 1992, pp. 203-210.
53. P. S. Vishnupad and Y. C. Shin, "Adaptive tuning of fuzzy membership functions for non-linear optimization using gradient descent method," J. Intell. Fuzzy Syst., vol.7, no.1, pp. 13-25, Jan. 1999.
54. Y. Shi and M. Mizumoto, "Some considerations on conventional neurofuzzy learning algorithms by gradient descent method," Fuzzy Sets Syst., vol.112, no.1, pp. 51-63, May 2000.
55. X. Zhang, C. C. Hang, S. Tan, and P. Z. Wang, "The min-max function differentiation and training of fuzzy neural networks," IEEE Trans. Neural Netw., vol.7, no.5, pp. 1139-1150, Sep. 1996.
56. N. J. Redding and T. Downs, "Learning in feedforward networks with nonsmooth functions: I example," in Proc. IEEE IJCNN, Singapore, Nov. 18-21, 1991, pp. 947-952.
57. X. D. Liu and W. Pedrycz, "The development of fuzzy decision trees in the framework of axiomatic fuzzy set logic," Appl. Soft Comput., vol.7, no.1, pp. 325-342, Jan. 2007.
58. G. Castellano, A. M. Fanelli, and C. Mencar, "A compact Gaussian representation of fuzzy information granules," in Proc. Joint 1st Int. Conf. SCIS, 3rd ISIS, Tsukuba, Japan, 2002, pp. 21-25.