Multiobjective genetic fuzzy systems: Review and future research directions

IEEE International Conference on Fuzzy Systems

Volumn , Issue , 2007, Pages

  Ishibuchi, Hisao ^a,b  

^a IEEE

^b Osaka Prefecture University   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

DESIGN OF EXPERIMENTS; EVOLUTIONARY ALGORITHMS; FUZZY LOGIC; MULTIOBJECTIVE OPTIMIZATION;

BENCHMARK DATA; COMPUTATIONAL EXPERIMENTS; EVOLUTIONARY MULTIOBJECTIVE ALGORITHMS; FUTURE RESEARCH DIRECTIONS; GENETIC FUZZY SYSTEMS; INTERNATIONAL CONFERENCES; INTERPRETABILITY; MULTI OBJECTIVES; MULTI-OBJECTIVE DESIGN; TRADE-OFF ANALYSIS;

FUZZY SYSTEMS;

EID: 50249084601     PISSN: 10987584     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/FUZZY.2007.4295487     Document Type: Conference Paper

References (107)

1. B. Kosko, "Fuzzy systems as universal approximators," Proc. of FUZZ-IEEE 1992, 1153-1162.
2. L. X. Wang and J. M. Mendel, "Fuzzy basis functions, universal approximation, and orthogonal least-squares learning," IEEE Trans. on Neural Networks 3 (5) 807-814, 1992.
3. J. M. Mendel, "Fuzzy-logic systems for engineering - A tutorial," Proceedings of IEEE 83 (3) 345-377, 1995.
4. K. Funahashi, "On the approximate realization of continuous-mappings by neural networks," Neural Networks 2 (3) 183-192, 1989.
5. K. Hornik, M. Stinchcombe, and H. White, "Multilayer feedforward networks are universal approximators," Neural Networks 2 (5) 359-366, 1989.
6. K. Hornik, "Approximation capabilities of multilayer feedforward networks," Neural Networks A (2) 251-257, 1991.
7. O. Cordon, F. Herrera, F. Hoffmann, and L. Magdalena, Genetic Fuzzy Systems, World Scientific, 2001.
8. O. Cordon, F. Gomide, F. Herrera, F. Hoffmann, and L. Magdalena, "Ten years of genetic fuzzy systems: Current framework and new trends," Fuzzy Sets and Systems 141 (1) 5-31, 2004.
9. F. Herrera, "Genetic fuzzy systems: Status, critical considerations and future directions," International Journal of Computational Intelligence Research 1 (1) 59-67, 2005.
10. M. Valenzuela-Rendon, "The fuzzy classifier system: A classifier system for continuously varying variables," Proc. of 4th ICGA, 346-353, 1991.
11. C. L. Karr, "Design of an adaptive fuzzy logic controller using a genetic algorithm," Proc. of 4th ICGA, 450-457, 1991.
12. P. Thrift, "Fuzzy logic synthesis with genetic algorithms," Proc. of 4th ICGA, 509-513, 1991.
13. A. Parodi and P. Bonelli, "A new approach to fuzzy classifier systems," Proc. of 5th ICGA, 223-230, 1993.
14. D. S. Feldman, "Fuzzy network synthesis with genetic algorithms," Proc. of 5th ICGA, 312-317, 1993.
15. C. L. Karr and E. J. Gentry, "Fuzzy control of pH using genetic algorithms," IEEE Trans. on Fuzzy Systems 1 (1) 46-53, 1993.
16. S. Horikawa, T. Furuhashi, and Y. Uchikawa, "On fuzzy modeling using fuzzy neural networks with the back-propagation algorithm," IEEE Trans. on Neural Networks 3 (5) 801-806, 1992.
17. J. -S. R. Jang, "ANFIS: Adaptive-network-based fuzzy inference system," IEEE Trans. on Systems, Man, and Cybernetics 23 (3) 665-685, 1993.
18. D. Nauck, F. Klawonn, and R. Kruse, Foundations of Neuro-Fuzzy Systems, John Wiley & Sons, 1997.
19. S. Abe, Pattern Classification: Neuro-fuzzy Methods and Their Comparison, Springer, 2001.
20. M. Setnes, R. Babuska, and B. Verbruggen, "Rule-based modeling: Precision and transparency," IEEE Trans. on Systems, Man, and Cybernetics - PartC 28(1) 165-169, 1998.
21. J. Yen, L. Wang, and G. W. Gillespie, "Improving the interpretability of TSK fuzzy models by combining global learning and local learning," IEEE Trans. on Fuzzy Systems 6 (4) 530-537, 1998.
22. 3 fuzzy rule systems from data using evolution strategies," IEEE Trans. on Systems, Man, and Cybernetics - Part B 29 (6) 829-845, 1999.
23. D. Nauck and R. Kruse, "Obtaining interpretable fuzzy classification rules from medical data," Artificial Intelligence in Medicine 16 (2) 149-169, 1999.
24. Y. Jin, "Fuzzy modeling of high-dimensional systems: Complexity reduction and interpretability improvement," IEEE Trans. on Fuzzy Systems 8 (2) 212-221, 2000.
25. M. Setnes and H. Roubos, "GA-based modeling and classification: Complexity and performance," IEEE Trans. on Fuzzy Systems 8 (5) 509-522, 2000.
26. L. Castillo, A. Gonzalez, and R. Perez, "Including a simplicity criterion in the selection of the best rule in a genetic fuzzy learning algorithm," Fuzzy Sets and Systems 120 (2) 309-321, 2001.
27. H. Roubos and M. Setnes, "Compact and transparent fuzzy models and classifiers through iterative complexity reduction," IEEE Trans on Fuzzy Systems 9 (4) 516-524, 2001.
28. J. Abonyi, J. A. Roubos, and F. Szeifert, "Data-driven generation of compact, accurate, and linguistically sound fuzzy classifiers based on a decision-tree initialization," International Journal of Approximate Reasoning 32 (1)1-21, 2003.
29. R. Alcala, J. R. Cano, O. Cordon, F. Herrera, P. Villar, and I. Zwir, "Linguistic modeling with hierarchical systems of weighted linguistic rules," International Journal of Approximate Reasoning 32 (2-3) 187-215, 2003.
30. Y. C. Hu, R. S. Chen, and G. H. Tzeng, "Finding fuzzy classification rules using data mining techniques," Pattern Recognition Letters 24 (1-3)509-519, 2003.
31. J. Casillas, O. Cordon, M. J. del Jesus, and F. Herrera, "Genetic tuning of fuzzy rule deep structures preserving interpretability and its interaction with fuzzy rule set reduction," IEEE Trans. on Fuzzy Systems 13 (1)13-29, 2005.
32. H. Ishibuchi, K. Nozaki, N. Yamamoto, and H. Tanaka, "Selecting fuzzy if-then rules for classification problems using genetic algorithms," IEEE Trans. on Fuzzy Systems 3 (3)260-270, 1995.
33. H. Ishibuchi, T. Murata, and I. B. Turksen, "Single-objective and two-objective genetic algorithms for selecting linguistic rules for pattern classification problems," Fuzzy Sets and Systems 89 (2) 135-150, 1997.
34. H. Ishibuchi, T. Nakashima, and T. Murata, "Three-objective geneticsbased machine learning for linguistic rule extraction," Information Sciences 136 (1-4) 109-133, 2001.
35. K. Deb, Multi-Objective Optimization Using Evolutionary Algorithms, John Wiley & Sons, Chichester, 2001.
36. C. A. Coello Coello, D. A. van Veldhuizen, and G. B. Lamont, Evolutionary Algorithms for Solving Multi-Objective Problems, Kluwer Academic Publishers, Boston, 2002.
37. C. A. Coello Coello and G. B. Lamont, Applications of Multi-Objective Evolutionary Algorithms, World Scientific, Singapore, 2004.
38. K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan, "A fast and elitist multiobjective genetic algorithm: NSGA-II," IEEE Trans. on Evolutionary Computation 6 (2) 182-197, 2002.
39. E. Zitzler and L. Thiele, "Multiobjective evolutionary algorithms: A comparative case study and the strength Pareto approach," IEEE Trans. on Evolutionary Computation 3 (4) 257-271, 1999.
40. E. Zitzler, M. Laumanns, and L. Thiele, "SPEA2: Improving the strength Pareto evolutionary algorithms," TIK-Report 103, Computer Engineering and Networks Laboratory (TIK), Swiss Federal Institute of Technology (ETH) Zurich, 2001.
41. K. Miettinen, Nonlinear Multiobjective Optimization, Kluwer, Boston, 1998.
42. J. Casillas, O. Cordon, F. Herrera, and L. Magdalena (eds.), Interpretability Issues in Fuzzy Modeling, Springer, 2003.
43. J. Casillas, O. Cordon, F. Herrera, and L. Magdalena (eds.), Accuracy Improvements in Linguistic Fuzzy Modeling, Springer, 2003.
44. Y. Jin (ed.), Multi-Objective Machine Learning, Springer, Berlin, 2006.
45. A. Ghosh, S. Dehuri, and S. Ghosh (Eds.), Multi-Objective Evolutionary Algorithms for Knowledge Discovery from Data Bases, Springer, Berlin (to appear).
46. H. Ishibuchi and T. Yamamoto, "Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining," Fuzzy Sets and Systems 141 (1) 59-88, 2004.
47. H. Ishibuchi and S. Namba, "Evolutionary multiobjective knowledge extraction for high-dimensional pattern classification problems," LNCS 3242.-PPSN VIII, 1123-1132, 2004.
48. D. E. Goldberg, Genetic Algorithms in Search, Optimization, and Machine Learning, Addison-Wesley, Reading, MA 1989.
49. L. B. Booker, D. E. Goldberg, and J. H. Holland, "Classifier systems andgenetic algorithms," Artificial Intelligence 40 (1-3) 235-282, 1989.
50. A. A. Freitas, Data Mining and Knowledge Discovery with Evolutionary Algorithms, Springer, Berlin, 2002.
51. H. Ishibuchi, T. Nakashima, and M. Nii, Classification and Modeling with Linguistic Information Granules: Advanced Approaches to Linguistic Data Mining, Springer, Berlin, November 2004.
52. O. Cordon, M. J. del Jesus, F. Herrera, and M. Lozano, "MOGUL: A methodology to obtain genetic fuzzy rule-based systems under the iterative rule learning approach," International Journal of Intelligent Systems 14(11)1123-1153, 1999.
53. A. Gonzalez and R. Perez, "SLAVE: A genetic learning system based on an iterative approach," IEEE Trans on Fuzzy Systems 7 (2) 176-191, 1999.
54. H. Ishibuchi, T. Yamamoto, and T. Nakashima, "Hybridization of fuzzy GBML approaches for pattern classification problems," IEEE Trans. on Systems, Man, and Cybernetics - Part B 35 (2) 359-365, 2005.
55. H. Ishibuchi and Y. Nojima, "Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning," International Journal of Approximate Reasoning 44 (1)4-31, 2007.
56. H. Wang, S. Kwong, Y. Jin, W. Wei, and K. F. Man, "Agent-based evolutionary approach for interpretable rule-based knowledge extraction," IEEE Trans. on Systems, Man, and Cybernetics - Part C 35(2)143-155, 2005.
57. H. Wang, S. Kwong, Y. Jin, W. Wei, and K. F. Man, "Multi-objective hierarchical genetic algorithm for interpretable fuzzy rule-based knowledge extraction," Fuzzy Sets and Systems 149 (1) 149-186, 2005.
58. X. Llora and D. E. Goldberg, "Bounding the effect of noise in multiobjective learning classifier systems," Evolutionary Computation 11 (3)278-297, 2003.
59. R. Agrawal, H. Mannila, R. Srikant, H. Toivonen, and A. I. Verkamo, "Fast discovery of association rules," in U. M. Fayyad, G. Piatetsky-Shapiro, P. Smyth, and R. Uthurusamy (eds.), Advances in Knowledge Discovery and Data Mining, AAAI Press, Menlo Park, 307-328, 1996.
60. R. J. Bayardo Jr. and R. Agrawal, "Mining the most interesting rules," Proc.of KDD 1999, 145-153.
61. B. de la Iglesia, M. S. Philpott, A. J. Bagnall, and V. J. Rayward-Smith, "Data mining rules using multi-objective evolutionary algorithms," Proc of CEC 2003, 1552-1559.
62. B. de la Iglesia, G. Richards, M. S. Philpott, and V. J. Rayward-Smith, "The application and effectiveness of a multi-objective metaheuristic algorithm for partial classification," European Journal of Operational Research 169 (3) 898-917, 2006.
63. B. de la Iglesia, A. Reynolds, and V. J. Rayward-Smith, "Developments on a multi-objective metaheuristic (MOMH) algorithm for finding interesting sets of classification rules," LNCS 3410: EMO 2005, 826-840.
64. A. Reynolds and B. de la Iglesia, "Rule induction using multi-objective metaheuristics: Encouraging rule diversity," Proc. of IJCNN 2006, 6375-6382.
65. A. Ghosh and B. T. Nath, "Multi-objective rule mining using genetic algorithms," Information Sciences 163 (1-3) 123-133, 2004.
66. M. Kaya, "Multi-objective genetic algorithm based approaches for mining optimized fuzzy association rules," Soft Computing 10 (7) 578-586, 2006.
67. T. P. Hong, C. S. Kuo, and S. C. Chi, "Trade-off between computation time and number of rules for fuzzy mining from quantitative data," International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems 9 (5) 587-604, 2001.
68. H. Ishibuchi, I. Kuwajima, and Y. Nojima, "Relation between Pareto-optimal fuzzy rules and Pareto-optimal fuzzy rule sets," Proc. of 2007 IEEE MCDM, 4249.
69. H. Liu and H. Motoda, Feature Selection for Knowledge Discovery and Data Mining, Kluwer Academic Publishers, Norwell, 1998.
70. C. Emmanouilidis, A. Hunter, and J. MacIntyre, "A multiobjective evolutionary setting for feature selection and acommonality-based crossover operator," Proc. of CEC 2000, 309-316.
71. L. S. Oliveira, R. Sabourin, F. Bortolozzi, and C. Y. Suen, "A methodology for feature selection using multi-objective genetic algorithms for handwritten digit string recognition," International Journal of Pattern Recognition and Artificial Intelligence 17 (6) 903-930, 2003.
72. L. S. Oliveira, R. Sabourin, F. Bortolozzi, and C. Y. Suen, "Feature selection using multi-objective genetic algorithms for handwritten digit recognition," Proc. of ICPR 2002, 568-571.
73. O. Cordon, M. J. D. Jesus, F. Herrera, L. Magdalena, and P. Villar, "A multiobjective genetic learning process for joint feature selection and granularity and contexts learning in fuzzy rule-based classification systems," 79-99 in [42].
74. J. C. Bezdek, Pattern Recognition with Fuzzy Objective Function Algorithms, Plenum Press, New York, 1981.
75. J. Handl and J. Knowles, "Evolutionary multiobjective clustering," LNCS 3242 : PPSN VIII, 1081-1091, 2004.
76. J. Handl and J. Knowles, "Multiobjective clustering around medoids," Proc. of CEC 2005, 632-639.
77. J. Handl and J. Knowles, "Improving the scalability of multiobjective clustering," Proc CEC 2005, 2372-2379.
78. J. Handl and J. Knowles, "Exploiting the trade-off - The benefits of multiple objectives in data clustering," LNCS 3410: EMO 2005, 547-560.
79. E. Bauer and R. Kohavi, "An empirical comparison of voting classification algorithms: Bagging, boosting, and variants," Machine Learning 36(1-2) 105-139, 1999.
80. T. G. Dietterich, "An experimental comparison of three methods for constructing ensembles of decision trees: Bagging, boosting, and randomization," Machine Learning 40 (2) 139-157, 2000.
81. L. Breiman, "Bagging predictors," Machine Learning 24 (2) 123-140, 1996.
82. Y. Freund and R. E. Schapire, "A decision-theoretic generalization of on-line learning and an application to boosting," Journal of Computer and System Sciences 55 (1) 119-139, 1997.
83. H. A. Abbass, "Pareto neuro-evolution: Constructing ensemble of neural networks using multi-objective optimization," Proc. of CEC 2003, 2074-2080.
84. A. Chandra and X. Yao, "DIVACE: Diverse and accurate ensemble learning algorithm," UVCS 3177: IDEAL 2004, 619-625.
85. A. Chandra and X. Yao, "Evolutionary framework for the construction of diverse hybrid ensemble," Proc. of ESANN 2005, 253-258.
86. Y. Jin, T. Okabe, and B. Sendhoff, "Neural network regularization and ensembling using multi-objective evolutionary algorithms," Proc of CEC2004, 1-8.
87. H. Ishibuchi and T. Yamamoto, "Evolutionary multiobjective optimization for generating an ensemble of fuzzy rule-based classifiers," LNCS 2723: GECCO 2003, 1077-1088.
88. L. S. Oliveira, R. Sabourin, F. Bortolozzi, and C. Y. Suen, "Feature selection for ensembles: A hierarchical multi-objective genetic algorithm approach," Proc of ICDAR 2003, 676-680.
89. L. S. Oliveira, M. Morita, and R. Sabourin, "Multi-objective genetic algorithms to create ensemble of classifiers," UVCS 3410: EMO 2005, 592-606.
90. M. A. Kupinski and M. A. Anastasio, "Multiobjective genetic optimization of diagnostic classifiers with implications for generating receiver operating characteristic curve," IEEE Trans. on Medical Imaging 18 (8) 675-685, 1999.
91. J. Gonzalez, I. Rojas, J. Ortega, H. Pomares, F. J. Fernandez, and A. F. Diaz, "Multiobjective evolutionary optimization of the size, shape, and position parameters of radial basis function networks for function approximation," IEEE Trans. on Neural Networks 14 (6) 1478-1495, 2003.
92. H. A. Abbass, "Speeding up back-propagation using multiobjective evolutionary algorithms," Neural Computation 15 (11) 2705-2726, 2003.
93. K. Rodriguez-Vazquez, C. M. Fonseca, and P. J. Fleming, "Multiobjective genetic programming: A nonlinear system identification application," Proc. of GP-97LB, 207-212, 1997.
94. S. Bleuler, M. Brack, L. Thiele, and E. Zitzler, "Multiobjective genetic programming: Reducing bloat using SPEA2," Proc of CEC 2001, 536-543.
95. O. Cordon, E. Herrera-Viedma, and M. Luque, "Evolutionary learning of boolean queries by multiobjective genetic programming," UVCS 2439: PPSN VII, 710-719, 2002.
96. L. Araujo, "Multiobjective genetic programming for natural language parsing and tagging," LNCS 4193: PPSNIX, 433-442, 2006.
97. A. P. Reynolds and B. de la Iglesia, "Rule induction for classification using multi-objective genetic programming," LNCS4403: EMO 2007, 516-530.
98. H. Ishibuchi, Y. Nojima, and I. Kuwajima, "Finding simple fuzzy classification systems with high interpretability through multiobjective rule selection," UVCS 4252: KES 2006, 86-93.
99. S. Guillaume, "Designing fuzzy inference systems from data: An interpretability-oriented review," IEEE Trans. on Fuzzy Systems 9 (3) 426-443, 2001.
100. R. Mikut, J. Jakel, and L. Groll, "Interpretability issues in data-based learning of fuzzy systems," Fuzzy Sets and Systems 150 (2) 179-197, 2005.
101. A. Jaszkiewicz, "On the computational efficiency of multiple objective metaheuristics: The knapsack problem case study," European Journal of Operational Research 158 (2)418433, 2004.
102. E. J. Hughes, "Evolutionary many-objective optimization: many once or one many?" Proc of CEC 2005, 222-227.
103. V. Cherkassky andF. Mulier, Learning from Data Concepts, Theory, and Methods, John Wiley & Sons, New York, 1998.
104. Y. Jin, B. Sendhoff, and E. Koerner, "Evolutionary multi-objective optimization for simultaneous generation of signal-type and symbol-type representations," LNCS 3410: EMO 2005, 752-766.
105. K. Deb and J. Sundar, "Reference point based multi-objective optimization using evolutionary algorithms," Proc. of GECCO 2006, 635-642.
106. H. Ishibuchi and Y. Nojima, "Optimization of scalarizing functions through evolutionary multiobjective optimization," Proc. of EMO 2007 (in press).
107. J. R. Cano, F. Herrera, and M. Lozano, "Stratification for scaling up evolutionary prototype selection," Pattern Recognition Letters 26 (7) 953-963, 2005.