Improving generalization of fuzzy IF-THEN rules by maximizing fuzzy entropy

IEEE Transactions on Fuzzy Systems

Volumn 17, Issue 3, 2009, Pages 556-567

  Wang, Xi Zhao ^a   Dong, Chun Ru ^a  

^a HEBEI UNIVERSITY   (China)

Author keywords

Classification; Fuzzy entropy; Fuzzy IF THEN rules; Maximum entropy principle; Parametric fuzzy IF THEN rules; Rule based reasoning

Indexed keywords

CLASSIFICATION; FUZZY ENTROPY; FUZZY IF-THEN RULES; MAXIMUM ENTROPY PRINCIPLE; PARAMETRIC FUZZY IF--THEN RULES; RULE-BASED REASONING;

FUZZY RULES; MAXIMUM PRINCIPLE; OPTIMIZATION; STRUCTURES (BUILT OBJECTS);

ENTROPY;

EID: 67149088596     PISSN: 10636706     EISSN: None     Source Type: Journal    
DOI: 10.1109/TFUZZ.2008.924342     Document Type: Article

References (49)

1. D. Ruan and E. Kerre, Eds., Fuzzy IF-THEN Rules in Computational Intelligence. Norwell, MA: Kluwer, 2000.
2. H. Ishibuchi, K. Nozaki, and H. Tanaka, "Distributed representation of fuzzy rules and its application to pattern classification," Fuzzy Sets Syst., vol. 52, no. 1, pp. 21-32, Nov. 1992.
3. S. Abe and M.-S. Lan, "A method for fuzzy rules extraction directly from numerical data and its application to pattern classification," IEEE Trans. Fuzzy Syst., vol. 3, no. 1, pp. 18-28, Feb. 1995.
4. K. Nozaki, H. Ishibuchi, and H. Tanaka, "A simple but powerful heuristic method for generating fuzzy rules from numerical data," Fuzzy Sets Syst., vol. 86, no. 3, pp. 251-270, Mar. 1997.
5. X.-Z. Wang, Y.-D. Wang, X.-F. Xu, W.-D. Ling, and D.-S. Yeung, "A new approach to fuzzy rule generation: Fuzzy extension matrix," Fuzzy Sets Syst., vol. 123, no. 3, pp. 291-306, Nov. 2001.
6. C. Huang and C. Moraga, "Extracting fuzzy if-then rules by using the information matrix technique," J. Comput. Syst. Sci., vol. 70, no. 1, pp. 26-52, Feb. 2005.
7. Y. Yuan and M. Shaw, "Induction of fuzzy decision trees," Fuzzy Sets Syst., vol. 69, no. 2, pp. 125-139, Jan. 1995.
8. X.-Z. Wang, E.-C.-C. Tsang, and D.-S. Yeung, "A comparative study on heuristic algorithms for generating fuzzy decision trees," IEEE Trans. Syst., Man, Cybern., B, vol. 31, no. 2, pp. 215-226, Apr. 2001.
9. N. Kasabov, "Learning fuzzy rules and approximate reasoning in fuzzy neural networks and hybrid systems," Fuzzy Sets Syst., vol. 82, no. 2, pp. 135-149, Sep. 1996.
10. D. Nauck and R. Kruse, "A neuro-fuzzy method to learn fuzzy classification rules from data," Fuzzy Sets Syst., vol. 89, no. 3, pp. 77-288, Aug. 1997.
11. E.-C.-C. Tsang, X.-Z. Wang, and D.-S. Yeung, "Improving learning accuracy of fuzzy decision trees by hybrid neural networks," IEEE Trans. Fuzzy Syst., vol. 8, no. 5, pp. 601-614, Oct. 2000.
12. V. Uebele, S. Abe, and M.-S. Lan, "A neural network based fuzzy classifier," IEEE Trans. Syst., Man, Cybern., vol. 25, no. 2, pp. 353-361, Feb. 1995.
13. S. Mitra and L. I. Kuncheva, "Improving classification performance using fuzzy MLP and two level selective partitioning of the feature space," Fuzzy Sets Syst., vol. 70, no. 1, pp. 1-13, Feb. 1995.
14. S. Mitra and Y. Hayashi, "Neuro-fuzzy rule generation: Survey in soft computing framework," IEEE Trans. Neural Netw., vol. 11, no. 3, pp. 748-768, May 2000.
15. P.-P. Angelov and R.-A. Buswell, "Automatic generation of fuzzy rule based models from data by genetic algorithms," Inf. Sci., vol. 150, no. 1-2, pp. 17-31, Mar. 2003.
16. J.-A. Roubos, M. Setnes, and J. Abonyi, "Learning fuzzy classification rules from labeled data," Inf. Sci., vol. 150, pp. 77-93, 2003.
17. A. Gonzalez and R. Perez, "SLAVE: A genetic learning system based on an iterative approach," IEEE Trans. Fuzzy Syst., vol. 7, no. 2, pp. 176-191, Apr. 1999.
18. H. Ishibuchi, T. Murata, and I. B. Turksen, "Single-objective and two-objective genetic algorithms for selecting linguistic rules for pattern classification problems," Fuzzy Sets Syst., vol. 89, no. 2, pp. 135-149, Jul. 1997.
19. H. Ishibuchi and T. Yamamoto, "Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining," Fuzzy Sets Syst., vol. 141, pp. 59-88, 2004.
20. T.-P. Hong, T.-T. Wang, S.-L. Wang, and B.-C. Chien, "Learning a coverage set of maximally general fuzzy rules by rough sets," Exp. Syst. Appl., vol. 19, no. 2, pp. 97-103, Aug. 2000.
21. Y.-C. Hu, R.-S. Chen, and G.-H. Tzeng, "Finding fuzzy classification rules using data mining techniques," Pattern Recogn. Lett., vol. 24, pp. 509-519, 2003.
22. H. Ishibuchi and T. Yamamoto, "Heuristic extraction of fuzzy classification rules using data ming techniques: An empirical study on benchmark data sets," in Proc. IEEE Int. Conf. Fuzzy Syst., 25-29, Jul. 2004, vol. 1, pp. 161-167.
23. F. Guély, R. La, and P. Siarry, "Fuzzy rule base learning through simulated annealing," Fuzzy Sets Syst., vol. 105, no. 3, pp. 353-363, Aug. 1999.
24. M.-A. Kbir, H. Benkirane, K. Maalmi, and R. Benslimane, "Hierarchical fuzzy partition for pattern classification with fuzzy if-then rules," Pattern Recogn. Lett., vol. 21, no. 6-7, pp. 503-509, Jun. 2000.
25. J.-L. Castro, L.-D. Flores-Hidalgo, C.-J. Mantas, and J.-M. Puche, "Extraction of fuzzy rules from support vector machines," Fuzzy Sets Syst., vol. 158, no. 18, pp. 2057-2077, 2007.
26. J. Zhang, S. Köper, and A. Knoll, "Extracting compact fuzzy rules based on adaptive data approximation using B-splines," Inf. Sci., vol. 142, no. 1-4, pp. 227-248, May 2002.
27. H. Ishibuchi and T. Nakashima, "Effect of rule weights in fuzzy rule-based classification systems," IEEE Trans. Fuzzy Syst., vol. 9, no. 4, pp. 506-515, Aug. 2001.
28. H. Ishibuchi and T. Yamamoto, "Rule weight specification in fuzzy rule-based classification systems," IEEE Trans. Fuzzy Syst., vol. 13, no. 4, pp. 428-435, Aug. 2005.
29. R. Ramakrishnan and C.-J.-M. Rao, "The fuzzy weighted additive rule," Fuzzy Sets Syst., vol. 46, pp. 177-187, 1992.
30. K.-S. Park and S.-H. Kim, "A note on the fuzzy weighted additive rule," Fuzzy Sets Syst., vol. 77, pp. 315-320, 1996.
31. A. Blanco, M. Delgado, and I. Requena, "A learning procedure to identify weighted rules by neural networks," Fuzzy Set Syst., vol. 69, pp. 29-36, 1995.
32. M.-J. Zolghadri and E.-G. Mansoori, "Weighting fuzzy classification rules using receiver operating characteristics (ROC) analysis," Inf. Sci., vol. 177, pp. 2296-2307, 2007.
33. P. Lau and C.-W. Chan, "An enhanced weighted fuzzy reasoning algorithm for engineering applications," Comput. Math. Appl., vol. 34, no. 1, pp. 81-87, 1997.
34. D. S. Yeung and E.-C.-C. Tsang, "Weighted fuzzy production rules," Fuzzy Sets Syst., vol. 88, pp. 299-313, 1997.
35. E.-C.-C. Tsang, D.-S. Yeung, J.-W.-T. Lee, D.-M. Huang, and X.-Z. Wang, "Refinement of generated fuzzy production rules by using a fuzzy neural network," IEEE Trans. Syst., Man Cybern., B, vol. 34, no. 1, pp. 409-418, Feb. 2004.
36. H.-D. Cheng, Y.-H. Chen, and X.-H. Jiang, "Thresholding using two-dimensional histogram and fuzzy entropy principle," IEEE Trans. Image Process., vol. 9, no. 4, pp. 732-735, Apr. 2000.
37. W.-B. Tao, J.-W. Tian, and J. Liu, "Image segmentation by three-level thresholding based on maximum fuzzy entropy and genetic algorithm," Pattern Recogn. Lett., vol. 24, no. 16, pp. 3069-3078, Dec. 2003.
38. D. Dubois and H. Prade, Eds., "Fundamentals of fuzzy sets," in The Handbooks of Fuzzy Sets, vol. 7. Boston, MA: Kluwer, 2000.
39. D.-S. Yeung, X.-Z. Wang, and E.-C.-C. Tsang, "Handling interaction in fuzzy production rule reasoning," IEEE Trans. Syst., Man Cybern., B vol. 34, no. 5, pp. 1979-1987, Oct. 2004.
40. C.-E. Shannon, "A mathematical theory of communication," Bell Syst. Tech., vol. 27, pp. 379-423 and 623-656, Jun, 1948.
41. A.-D. Luca and S. Termin, "A definition of a nonprobabilistic entropy in the setting of fuzzy sets theory," Int. J. Control, vol. 20, pp. 301-312, 1972.
42. UCI repository of machine learning databases and domain theories, FTP address: [OnlinF]. Available: ftp://ftp.ics.uci.edu/pub/ machine-learning-databases.
43. R.-A. Fisher, "The use of multiple measurements in taxonomic problems," Ann. Eugenics, vol. 7, pp. 179-188, 1936.
44. S.-K. Pal, "Fuzzy set theoretic measures for automatic feature evaluation," Inf. Sci., vol. 64, pp. 165-179, 1992.
45. M.-L. Raymer, W.-F. Punch, E.-D. Goodman, L.-A. Kuhn, and A.-K. Jain, "Dimensionality reduction using genetic algorithms," IEEE Trans. Evol. Comput., vol. 4, no. 2, pp. 164-171, Jul. 2000.
46. P. Angelov, X. Zhou, and F. Klawonn, "Evolving fuzzy rule-based classifiers," in Proc. 1st 2007 IEEE Int. Conf. Comput. Intell. Appl. Signal Image Process., Honolulu, HI, Apr. 1-5, pp. 220-225.
47. M. Setnes and H. Roubos, "GA-fuzzy modeling and classification: Complexity and performance," IEEE Trans. Fuzzy Syst., vol. 8, no. 5, pp. 509-522, Oct. 2000.
48. T. M. Mitchell, Machine Learning. New York: McGraw-Hill, 1997.
49. J. R. Quinlan, C4.5: Programs for Machine Learning. San Mateo, CA: Morgan Kaufmann, 1993.