Evolutionary multiobjective design of fuzzy rule-based systems

Proceedings of the 2007 IEEE Symposium on Foundations of Computational Intelligence, FOCI 2007

Volumn , Issue , 2007, Pages 9-16

  Ishibuchi, Hisao ^a  

^a Osaka Prefecture University

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL COMPLEXITY; COMPUTATIONAL LINGUISTICS; EVOLUTIONARY ALGORITHMS; LOGIC PROGRAMMING; MULTIOBJECTIVE OPTIMIZATION;

ACCURACY IMPROVEMENT; FUZZY RULE BASED SYSTEMS; INTERPRETABILITY; LINGUISTIC VALUES;

FUZZY RULES;

EID: 34548823478     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/FOCI.2007.372141     Document Type: Conference Paper

References (79)

1. S. Horikawa, T. Furuhashi, and Y. Uchikawa, "On fuzzy modeling using fuzzy neural networks with the back-propagation algorithm," IEEE Trans. on Neural Networks 3 (5) 801-806, 1992.
2. J. -S. R. Jang, "ANFIS: Adaptive-network-based fuzzy inference system," IEEE Trans. on Systems, Man, and Cybernetics 23 (3) 665-685, 1993.
3. C. L. Karr and E. J. Gentry, "Fuzzy control of pH using genetic algorithms," IEEE Trans. on Fuzzy Systems 1 (1) 46-53, 1993.
4. D. Nauck, F. Klawonn, and R. Kruse, Foundations of Neuro-Fuzzy Systems, John Wiley & Sons, 1997.
5. S. Abe, Pattern Classification: Neuro-fuzzy Methods and Their Comparison, Springer, 2001.
6. O. Cordon, F. Herrera, F. Hoffman, and L. Magdalena, Genetic Fuzzy Systems, World Scientific, 2001.
7. O. Cordon, F. Gomide, F. Herrera, F. Hoffmann, and L. Magdalena, "Ten years of genetic fuzzy systems: Current framework and new trends," Fuzzy Sets and Systems 141 (1)5-31, 2004.
8. J. H. Holland, Adaptation in Natural and Artificial Systems, University of Michigan Press, 1975.
9. D. E. Goldberg, Genetic Algorithms in Search, Optimization, and Machine Learning, Addison-Wesley, MA, 1989.
10. D. E. Rumelhart, J. L. McClelland, and the PDP Research Group, Parallel Distributed Processing, MIT Press, 1986.
11. B. Kosko, "Fuzzy systems as universal approximators," Proc. of FUZZ-IEEE 1992, 1153-1162.
12. L. X. Wang and J. M. Mendel, "Fuzzy basis functions, universal approximation, and orthogonal least-squares learning," IEEE Trans. on Neural Networks 3 (5) 807-814, 1992.
13. J. M. Mendel, "Fuzzy-logic systems for engineering - A tutorial," Proceedings of IEEE 83 (3) 345-377, 1995.
14. K. Funahashi, "On the approximate realization of continuous-mappings by neural networks," Neural Networks 2 (3) 183-192, 1989.
15. K. Hornik, M. Stinchcombe, and H. White, "Multilayer feedforward networks are universal approximators," Neural Networks 2 (5) 359-366, 1989.
16. K. Hornik, "Approximation capabilities of multilayer feedforward networks," Neural Networks 4 (2) 251-257, 1991.
17. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification, John Wiley & Sons, 2001.
18. V. Cherkassky and F. Mulier, Learning from Data: Concepts, Theory, and Methods, John Wiley & Sons, New York, 1998.
19. H. Ishibuchi, K. Nozaki, N. Yamamoto, and H. Tanaka, "Selecting fuzzy if-then rules for classification problems using genetic algorithms," IEEE Trans. on Fuzzy Systems 3 (3) 260-270, 1995.
20. M. Setnes, R. Babuska, and B. Verbruggen, "Rule-based modeling: Precision and transparency," IEEE Trans. on Systems, Man, and Cybernetics - Part C 28 (1) 165-169, 1998.
21. J. Yen, L. Wang, and G. W. Gillespie, "Improving the interpretability of TSK fuzzy models by combining global learning and local learning," IEEE Trans. on Fuzzy Systems 6 (4)530-537, 1998.
22. 3 fuzzy rule systems from data using evolution strategies," IEEE Trans. on Systems, Man, and Cybernetics - Part B 29 (6) 829-845, 1999.
23. D. Nauck and R. Kruse, "Obtaining interpretable fuzzy classification rules from medical data," Artificial Intelligence in Medicine 16(2) 149-169, 1999.
24. Y. Jin, "Fuzzy modeling of high-dimensional systems: Complexity reduction and interpretability improvement," IEEE Trans. on Fuzzy Systems 8 (2) 212-221, 2000.
25. M. Setnes and H. Roubos, "GA-based modeling and classification: Complexity and performance," IEEE Trans. on Fuzzy Systems 8 (5) 509-522, 2000.
26. L. Castillo, A. Gonzalez, and R. Perez, "Including a simplicity criterion in the selection of the best rule in a genetic fuzzy learning algorithm," Fuzzy Sets and Systems 120 (2) 309-321, 2001.
27. H. Roubos and M. Setnes, "Compact and transparent fuzzy models and classifiers through iterative complexity reduction," IEEE Trans. on Fuzzy Systems 9 (4) 516-524, 2001.
28. J. Abonyi, J. A. Roubos, and F. Szeifert, "Data-driven generation of compact, accurate, and linguistically sound fuzzy classifiers based on a decision-tree initialization," International Journal of Approximate Reasoning 32 (1) 1-21, 2003.
29. R. Alcala, J. R. Cano, O. Cordon, F. Herrera, P. Villar, and I. Zwir, "Linguistic modeling with hierarchical systems of weighted linguistic rules," International Journal of Approximate Reasoning 32 (2-3) 187-215, 2003.
30. Y. C. Hu, R. S. Chen, and G. H. Tzeng, "Finding fuzzy classification rules using data mining techniques," Pattern Recognition Letters 24 (1-3) 509-519, 2003.
31. J. Casillas, O. Cordon, M. J. del Jesus, and F. Herrera, "Genetic tuning of fuzzy rule deep structures preserving interpretability and its interaction with fuzzy rule set reduction," IEEE Trans. on Fuzzy Systems 13(1) 13-29, 2005.
32. K. Deb, Multi-Objective Optimization Using Evolutionary Algorithms, John Wiley & Sons, 2001.
33. X. Llora and D. E. Goldberg, "Bounding the effect of noise in multiobjective learning classifier systems," Evolutionary Computation 11 (3) 278-297, 2003.
34. H. Ishibuchi, T. Murata, and I. B. Turksen, "Single-objective and two-objective genetic algorithms for selecting linguistic rules for pattern classification problems," Fuzzy Sets and Systems 89 (2) 135-150, 1997.
35. H. Ishibuchi, T. Nakashima, and T. Murata, "Three-objective genetics-based machine learning for linguistic rule extraction," Information Sciences 136 (1-4) 109-133, 2001.
36. F. Jimenez, A. F. Gomez-Skarmeta, G. Sanchez, H. Roubos, and R. Babuska, "Accurate, transparent and compact fuzzy models for function approximation and dynamic modeling through multi-objective evolutionary optimization," Proc. of EMO 2001, 653-667.
37. H. Ishibuchi and T. Yamamoto, "Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining," Fuzzy Sets and Systems 141 (1) 59-88, 2004.
38. H. Wang, S. Kwong, Y. Jin, W. Wei, and K. F. Man, "Agent-based evolutionary approach for interpretable rule-based knowledge extraction," IEEE Trans. on Systems, Man, and Cybernetics - Part C 35 (2) 143-155, 2005.
39. H. Wang, S. Kwong, Y. Jin, W. Wei, and K. F. Man, "Multi-objective hierarchical genetic algorithm for interpretable fuzzy rule-based knowledge extraction," Fuzzy Sets and Systems 149 (1) 149-186, 2005.
40. H. Ishibuchi and Y. Nojima, "Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning," International Journal of Approximate Reasoning 44 (1) 4-31, 2007.
41. J. Casillas, O. Cordon, F. Herrera, and L. Magdalena (eds.), Interpretability Issues in Fuzzy Modeling, Springer, 2003.
42. J. Casillas, O. Cordon, F. Herrera, and L. Magdalena (eds.), Accuracy Improvements in Linguistic Fuzzy Modeling, Springer, 2003.
43. J. D. Schaffer, "Multiple objective optimization with vector evaluated genetic algorithms," Proc. of ICGA 1985, 93-100.
44. C. A. Coello Coello, D. A. van Veldhuizen, and G. B. Lamont, Evolutionary Algorithms for Solving Multi-Objective Problems, Kluwer, 2002.
45. C. A. Coello Coello and G. B. Lamont, Applications of Multi-Objective Evolutionary Algorithms, World Scientific, 2004.
46. K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan, "A fast and elitist multiobjective genetic algorithm: NSGA-II," IEEE Trans. on Evolutionary Computation 6 (2) 182-197, 2002.
47. H. Ishibuchi, K. Nozaki, and H. Tanaka, "Distributed representation of fuzzy rules and its application to pattern classification," Fuzzy Sets and Systems 52 (1) 21-32, 1992.
48. H. Ishibuchi and T. Nakashima, "Effect of rule weights in fuzzy rule-based classification systems," IEEE Trans. on Fuzzy Systems 9 (4) 506-515, 2001.
49. H. Ishibuchi and T. Yamamoto, "Rule weight specification in fuzzy rule-based classification systems," IEEE Trans. on Fuzzy Systems 13(4)428-435, 2005.
50. O. Cordon, M. J. del Jesus, and F. Herrera, "A proposal on reasoning methods in fuzzy rule-based classification systems," International Journal of Approximate Reasoning 20 (1) 21-45, 1999.
51. H. Ishibuchi, T. Nakashima, and T. Morisawa, "Voting in fuzzy rule-based systems for pattern classification problems," Fuzzy Sets and Systems 103 (2) 223-238, 1999.
52. L. I. Kuncheva, Fuzzy Classifier Design, Physica-Verlag, 2000.
53. H. Ishibuchi, T. Nakashima, and M. Nii, Classification and Modeling with Linguistic Information Granules: Advanced Approaches to Linguistic Data Mining, Springer, 2004.
54. T. P. Hong, C. S. Kuo, and S. C. Chi, "Trade-off between computation time and number of rules for fuzzy mining from quantitative data," International Journal of Uncertainty Fuzziness and Knowledge-based Systems 9 (5) 587-604, 2001.
55. H. Ishibuchi, T. Yamamoto, and T. Nakashima, "Fuzzy data mining: Effect of fuzzy discretization," Proc. of ICDM 2001, 241-248.
56. R. Agrawal, H. Mannila, R. Srikant, H. Toivonen, and A. I. Verkamo, "Fast discovery of association rules," in U. M. Fayyad, G. Piatetsky-Shapiro, P. Smyth, and R. Uthurusamy (eds.), Advances in Knowledge Discovery and Data Mining, AAAI Press, Menlo Park, 307-328, 1996.
57. B. Liu, W. Hsu, and Y. Ma, "Integrating classification and association rule mining," Proc. of KDD 1998, 80-86.
58. H. Ishibuchi and T. Yamamoto, "Comparison of heuristic criteria for fuzzy rule selection in classification problems," Fuzzy Optimization and Decision Making 3 (2) 119-139, 2004.
59. F. Coenen, P. Leng, and L. Zhang, "Threshold tuning for improved classification association rule mining," Proc. of PAKDD 2005, 216-225.
60. F. Coenen and P. Leng, "Obtaining best parameter values for accurate classification," Proc. of ICDM 2005, 549-552.
61. B. de la Iglesia, M. S. Philpott, A. J. Bagnall, and V. J. Rayward-Smith, "Data mining rules using multi-objective evolutionary algorithms," Proc. of CEC 2003, 1552-1559.
62. B. de la Iglesia, A. Reynolds, and V. J. Rayward-Smith, "Developments on a multi-objective metaheuristic (MOMH) algorithm for finding interesting sets of classification rules," Proc. of EMO 2005, 826-840.
63. A. Reynolds and B. de la Iglesia, "Rule induction using multi-objective metaheuristics: Encouraging rule diversity," Proc. of IJCNN 2006, 6375-6382.
64. H. Ishibuchi, I. Kuwajima, and Y. Nojima, "Relation between Pareto-optimal fuzzy rules and Pareto-optimal fuzzy rule set," Proc. of IEEE MCDM 2007 (in press).
65. H. Ishibuchi and T. Yamamoto, "Effect of fuzzy discretization in fuzzy rule-based systems for classification problems with continuous attributes," Archives of Control Sciences 12 (4) 351-378, 2002.
66. K. Nozaki, H. Ishibuchi, and H. Tanaka, "Adaptive fuzzy rule-based classification systems," IEEE Trans. on Fuzzy Systems 4 (3) 238-250, 1996.
67. S. Guillaume, "Designing fuzzy inference systems from data: An interpretability-oriented review," IEEE Trans. on Fuzzy Systems 9 (3) 426-443, 2001.
68. R. Mikut, J. Jakel, and L. Groll, "Interpretability issues in data-based learning of fuzzy systems," Fuzzy Sets and Systems 150 (2) 179-197, 2005.
69. J. Handl and J. Knowles, "Evolutionary multiobjective clustering," Proc. of PPSN 2004, 1081-1091.
70. A. Ghosh and B. T. Nath, "Multi-objective rule mining using genetic algorithms," Information Sciences 163 (1-3) 123-133, 2004.
71. M. Kaya, "Multi-objective genetic algorithm based approaches for mining optimized fuzzy association rules," Soft Computing 10 (7) 578-586, 2006.
72. A. A. Freitas, Data Mining and Knowledge Discovery with Evolutionary Algorithms, Springer, 2002.
73. J. R. Cano, F. Herrera, and M. Lozano, "Stratification for scaling up evolutionary prototype selection," Pattern Recognition Letters 26 (7) 953-963, 2005.
74. Y. Jin (ed.), Multi-Objective Machine Learning, Springer, Berlin, 2006.
75. A. Ghosh, S. Dehuri and S. Ghosh (Eds.), Multi-Objective Evolutionary Algorithms for Knowledge Discovery from Data Bases, Springer, Berlin (to appear).
76. A. Jaszkiewicz, "On the performance of multiple-objective genetic local search on the 0/1 knapsack problem - A comparative experiment," IEEE Trans. on Evolutionary Computation 6 (4) 402-412, 2002.
77. A. Jaszkiewicz, "On the computational efficiency of multiple objective metaheuristics: The knapsack problem case study," European Journal of Operational Research 158 (2) 418-433, 2004.
78. K. Deb and J. Sundar, "Reference point based multi-objective optimization using evolutionary algorithms," Proc. of GECCO 2006, 635-642.
79. H. Ishibuchi and Y. Nojima, "Optimization of scalarizing functions through evolutionary multiobjective optimization," Proc. of EMO 2007 (in press).