A multi-objective genetic optimization of interpretability-oriented fuzzy rule-based classifiers

Applied Soft Computing Journal

Volumn 38, Issue , 2016, Pages 118-133

  Rudziński, Filip ^a  

^a KIELCE UNIVERSITY OF TECHNOLOGY   (Poland)

Author keywords

Accuracy and interpretability of fuzzy rule based systems; Evolutionary computations; Fuzzy systems; Multi objective genetic optimization

Indexed keywords

CHROMOSOMES; CLASSIFICATION (OF INFORMATION); COMPUTATIONAL COMPLEXITY; EVOLUTIONARY ALGORITHMS; FUZZY RULES; FUZZY SETS; FUZZY SYSTEMS; MEAN SQUARE ERROR; MEMBERSHIP FUNCTIONS; MULTIOBJECTIVE OPTIMIZATION;

ACCURACY MEASURES; CLASSIFICATION TECHNIQUE; CROSSOVER AND MUTATION; FUZZY RULE-BASED CLASSIFIER; GENETIC OPTIMIZATION; INTERPRETABILITY; NSGA-II ALGORITHM; ROOT MEAN SQUARE ERRORS;

FUZZY INFERENCE;

EID: 84944790408     PISSN: 15684946     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.asoc.2015.09.038     Document Type: Article

References (94)

1. P. Pulkkinen, and H. Koivisto A dynamically constrained multiobjective genetic fuzzy system for regression problems IEEE Trans. Fuzzy Syst. 18 1 2010 161 177
2. M.J. Gacto, R. Alcalá, and F. Herrera Integration of an index to preserve the semantic interpretability in the multiobjective evolutionary rule selection and tuning of linguistic fuzzy systems IEEE Trans. Fuzzy Syst. 18 3 2010 515 531
3. M.J. Gacto, R. Alcalá, and F. Herrera Interpretability of linguistic fuzzy rule-based systems: an overview of interpretability measures Inf. Sci. 181 20 2011 4340 4360
4. C. Mencar, and A.M. Fanelli Interpretability constraints for fuzzy information granulation Inf. Sci. 178 24 2008 4585 4618
5. J.V. de Oliveira Semantic constraints for membership function optimization IEEE Trans. Syst. Man Cybern. (A) 29 1 1999 128 138
6. R. Mikut, J. Jkel, and L. Grll Interpretability issues in data-based learning of fuzzy systems Fuzzy Sets Syst. 150 2 2005 179 197
7. S.-M. Zhou, and J.Q. Gan Low-level interpretability and high-level interpretability: a unified view of data-driven interpretable fuzzy system modelling Fuzzy Sets Syst. 159 23 2008 3091 3131
8. H. Ishibuchi, and Y. Nojima Discussions on interpretability of fuzzy systems using simple examples Proceedings of IFSA-EUSFLAT World Congress 2009 1649 1654
9. S.F. Smith A Learning System Based on Genetic Adaptive Algorithms 1980 University of Pittsburgh Pittsburgh, PA, USA Ph.D. thesis
10. M.B. Gorzałczany, and F. Rudziński A modified Pittsburg approach to design a genetic fuzzy rule-based classifier from data L. Rutkowski, R. Scherer, R. Tadeusiewicz, L.A. Zadeh, J.M. Zurada, Artificial Intelligence and Soft Computing (ICAISC), Vol. 6113 of Lecture Notes in Computer Science 2010 Springer-Verlag Berlin, Heidelberg 88 96
11. M.B. Gorzałczany, and F. Rudziński Accuracy vs. interpretability of the fuzzy rule-based classifiers - an evolutionary approach L. Rutkowski, K. Marcin, R. Scherer, R. Tadeusiewicz, L.A. Zadeh, J.M. Zurada, Artificial Intelligence and Soft Computing (ICAISC), Vol. 7269 of Lecture Notes in Computer Science 2012 Springer-Verlag Berlin, Heidelberg 222 230
12. M.B. Gorzałczany, and F. Rudziński Genetic fuzzy rule-based modelling of dynamic systems using time series L. Rutkowski, K. Marcin, R. Scherer, R. Tadeusiewicz, L.A. Zadeh, J.M. Zurada, Artificial Intelligence and Soft Computing (ICAISC), Vol. 7269 of Lecture Notes in Computer Science 2012 Springer-Verlag Berlin, Heidelberg 231 239
13. M.B. Gorzałczany, and F. Rudziński Measurement data in genetic fuzzy modelling of dynamic systems Meas. Autom. Monit. 56 12 2010 1420 1423
14. E.H. Ruspini A new approach to clustering Inf. Control 15 1 1969 22 32
15. J.M. Alonso, O. Cordon, A. Quirin, and L. Magdalena Analyzing interpretability of fuzzy rule-based systems by means of fuzzy inference-grams 1st World Conference on Soft Computing San Francisco, CA, USA 2011 181.1 181.8
16. A. Gonzalez, R. Perez, and J.L. Verdegay Learning the structure of a fuzzy rule: a genetic approach Proceedings of the First European Congress on Fuzzy and Intelligent Technologies (EUFIT'93) Aachen, Germany 1993 814 819
17. L. Magdalena, and F. Monasterio Evolutionary-based learning applied to fuzzy controllers Proceedings of IEEE International Conference on Fuzzy Systems, vol. 3 1995 1111 1118
18. R. Alcalá, P. Ducange, F. Herrera, B. Lazzerini, and F. Marcelloni A multiobjective evolutionary approach to concurrently learn rule and data bases of linguistic fuzzy-rule-based systems IEEE Trans. Fuzzy Syst. 17 5 2009 1106 1122
19. F. Hoffmann, and G. Pfister Learning of a Fuzzy Control Rule Base Using Messy Genetic Algorithms, no. 8 in Studies in Fuzziness and Soft Computing 1996 Physica-Verlag Heidelberg 279 305
20. O. Cordon, F. Herrera, F. Hoffman, and L. Magdalena Genetic fuzzy systems: evolutionary tuning and learning of fuzzy knowledge bases Vol. 19 of Advances in Fuzzy Systems - Applications and Theory 2001 World Scientific Singapore, New Jersey, London, Hong Kong
21. R.S. Michalski A theory and methodology of inductive learning Artif. Intell. 20 2 1983 111 161
22. M.B. Gorzałczany A computational-intelligence-based approach to decision support H. Bunke, A. Kandel, Neuro-Fuzzy Pattern Recognition 2000 World Scientific Publishing Singapore, London 51 73
23. M.B. Gorzałczany Computational Intelligence Systems and Applications: Neuro-Fuzzy and Fuzzy Neural Synergisms Studies in Fuzziness and Soft Computing 2002 Physica-Verlag Heidelberg, New York
24. M.B. Gorzałczany, and A. Głuszek Neuro-fuzzy systems for rule-based modelling of dynamic processes H.-J. Zimmermann, G. Tselentis, M. Someren, G. Dounias, Advances in Computational Intelligence and Learning, Vol. 18 of International Series in Intelligent Technologies 2002 Springer Netherlands 135 146
25. D. Nauck, F. Klawonn, and R. Kruse Foundations of Neuro-Fuzzy Systems 1997 John Wiley & Sons, Inc. New York
26. T. Takagi, and M. Sugeno Fuzzy identification of systems and its applications to modeling and control IEEE Trans. Syst. Man Cybern. 1 1985 116 132
27. L. Rutkowski Flexible Neuro-Fuzzy Systems: Structures, Learning and Performance Evaluations 2004 Kluwer Academic Publisher Boston, Dordrecht
28. M.M. Gupta, and M.B. Gorzałczany Fuzzy neuro-computational technique and its application to modelling and control Proceedings of IEEE International Conference on Fuzzy Systems 1992 1271 1274
29. M.B. Gorzałczany On some idea of a neuro-fuzzy controller Inf. Sci. 120 1-4 1999 69 87
30. J. Yen, and L. Wang Simplifying fuzzy rule-based models using orthogonal transformation methods IEEE Trans. Syst. Man Cybern. (B) 29 1 1999 13 24
31. C.T. Chao, Y.J. Chen, and C.C. Teng Simplification of fuzzy-neural systems using similarity analysis IEEE Trans. Syst. Man Cybern. (B) 26 2 1996 344 354
32. Y. Jin Fuzzy modeling of high-dimensional systems: complexity reduction and interpretability improvement IEEE Trans. Fuzzy Syst. 8 2 2000 212 221
33. H. Roubos, and M. Setnes Compact and transparent fuzzy models and classifiers through iterative complexity reduction IEEE Trans. Fuzzy Syst. 9 4 2001 516 524
34. M. Setnes, R. Babuska, U. Kaymak, and H.R. van Nauta Lemke Similarity measures in fuzzy rule base simplification IEEE Trans. Syst. Man Cybern. (B) 28 3 1998 376 386
35. U. Kaymak, and R. Babuska Compatible cluster merging for fuzzy modeling Proceedings of IEEE International Conference on Fuzzy Systems 1995 897 904
36. M. Setnes, R. Babuska, and H.B. Verbruggen Rule-based modeling: precision and transparency IEEE Trans. Syst. Man Cybern. (C) 28 1 1998 165 169
37. M. Setnes, and H. Roubos GA-fuzzy modeling and classification: complexity and performance IEEE Trans. Fuzzy Syst. 8 5 2000 509 522
38. S. Guillaume Designing fuzzy inference systems from data: an interpretability-oriented review IEEE Trans. Fuzzy Syst. 9 3 2001 426 443
39. O. Cordón, F. Herrera, F. Gomide, F. Hoffmann, and L. Magdalena Ten years of genetic fuzzy systems: current framework and new trends Fuzzy Sets Syst. 141 1 2004 5 31
40. J.H. Holland, and J.S. Reitman Cognitive systems based on adaptive algorithms SIGART Bull. 63 1977 49
41. L.B. Booker Intelligent Behavior as an Adaptation to the Task Environment 1982 University of Michigan Ann Arbor, MI, USA Ph.D. thesis
42. H. Ishibuchi, K. Nozaki, N. Yamamoto, and H. Tanaka Selecting fuzzy if-then rules for classification problems using genetic algorithms IEEE Trans. Fuzzy Syst. 3 3 1995 260 270
43. H. Ishibuchi, T. Murata, and I.B. Türkşen Single-objective and two-objective genetic algorithms for selecting linguistic rules for pattern classification problems Fuzzy Sets Syst. 89 2 1997 135 150
44. H. Ishibuchi, T. Nakashima, and T. Murata Three-objective genetics-based machine learning for linguistic rule extraction Inf. Sci. 136 1-4 2001 109 133
45. H. Ishibuchi, and T. Yamamoto Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining Fuzzy Sets Syst. 141 1 2004 59 88
46. P. Meesad, and G. Yen Quantitative measures of the accuracy, comprehensibility, and completeness of a fuzzy expert system Proceedings of IEEE International Conference on Fuzzy Systems Honolulu, Hawaii 2002 284 289
47. R. Marler, and J. Arora Survey of multi-objective optimization methods for engineering Struct. Multidiscip. Optim. 26 2004 369 395
48. Y. Jin Multi-Objective Machine Learning, Vol. 16 of Studies in Computational Intelligence 2006 Springer-Verlag Berlin, Heidelberg
49. J. Yaochu, and B. Sendhoff Pareto-based multiobjective machine learning: an overview and case studies IEEE Trans. Syst. Man Cybern. (C) 38 3 2008 397 415
50. K. Deb Multi-Objective Optimization Using Evolutionary Algorithms 2001 John Wiley & Sons, Inc New York, NY, USA
51. C.A.C. Coello, G.B. Lamont, and D.A.V. Veldhuizen Evolutionary Algorithms for Solving Multi-Objective Problems, Vol. 5 of Genetic Algorithms and Evolutionary Computation 2002 Kluwer Academic Publishers Norwell, MA
52. H. Wang, S. Kwong, Y. Jin, W. Wei, and K.F. Man Multi-objective hierarchical genetic algorithm for interpretable fuzzy rule-based knowledge extraction Fuzzy Sets Syst. 149 1 2005 149 186
53. C.M. Fonseca, and P.J. Fleming Genetic algorithms for multiobjective optimization: formulation discussion and generalization Proceedings of the 5th International Conference on Genetic Algorithms 1993 416 423
54. E. Zitzler, and L. Thiele Multiobjective evolutionary algorithms: a comparative case study and the strength pareto approach IEEE Trans. Evol. Comput. 3 4 1999 257 271
55. N. Srinivas, and D.K. Multiobjective optimization using nondominated sorting in genetic algorithms Evol. Comput. 2 1994 221 248
56. E. Zitzler, M. Laumanns, and L. Thiele SPEA2: Improving the strength pareto evolutionary algorithm for multi-objetive optimization Proceedings of Evolutionary Methods for Design, Optimization and Control with Applications to Industrial Problems Barcelona, Spain 2001 95 100
57. K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan A fast and elitist multiobjective genetic algorithm: NSGA-II IEEE Trans. Evol. Comput. 6 2 2002 182 197
58. H. Ishibuchi, and Y. Nojima Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning Int. J. Approx. Reason. 44 1 2007 4 31
59. A. Marquez, F. Marquez, and A. Peregrin A multi-objective evolutionary algorithm with an interpretability improvement mechanism for linguistic fuzzy systems with adaptive defuzzification Proceedings of IEEE International Conference on Fuzzy Systems 2010 1 7
60. R. Alcalá, M.J. Gacto, F. Herrera, and J. Alcalá-Fdez A multi-objective genetic algorithm for tuning and rule selection to obtain accurate and compact linguistic fuzzy rule-based systems Int. J. Uncert. Fuzz. Knowl. Based Syst. 15 5 2007 539 557
61. L. Minqiang, and W. Zhichun A hybrid coevolutionary algorithm for designing fuzzy classifiers Inf. Sci. 179 12 2009 1970 1983
62. P. Ducange, B. Lazzerini, and F. Marcelloni Multi-objective genetic fuzzy classifiers for imbalanced and cost-sensitive datasets Soft Comput. 14 7 2010 713 728
63. M. Antonelli, P. Ducange, B. Lazzerini, and F. Marcelloni Learning concurrently data and rule bases of mamdani fuzzy rule-based systems by exploiting a novel interpretability index Soft Comput. 15 2011 1981 1998
64. C. Mencar, C. Castiello, R. Cannone, and A.M. Fanelli Design of fuzzy rule-based classifiers with semantic cointension Inf. Sci. 181 20 2011 4361 4377
65. C. Mencar, C. Castiello, R. Cannone, and A.M. Fanelli Interpretability assessment of fuzzy knowledge bases: a cointension based approach Int. J. Approx. Reason. 52 4 2011 501 518
66. E. Lughofer, J.-L. Bouchot, and A. Shaker On-line elimination of local redundancies in evolving fuzzy systems Evol. Syst. 2 2011 165 187
67. J. Casillas, O. Cordón, F. Herrera, and L. Magdalena Interpretability Issues in Fuzzy Modeling, Vol. 128 of Studies in Fuzziness and Soft Computing 2003 Springer Berlin, Heidelberg
68. J.M. Alonso, and L. Magdalena Special issue on interpretable fuzzy systems Inf. Sci. 181 20 2011 4331 4822
69. O. Cordón A historical review of evolutionary learning methods for Mamdani-type fuzzy rule-based systems: designing interpretable genetic fuzzy systems Int. J. Approx. Reason. 52 6 2011 894 913
70. M. Fazzolari, R. Alcala, Y. Nojima, H. Ishibuchi, and F. Herrera A review of the application of multiobjective evolutionary fuzzy systems: current status and further directions IEEE Trans. Fuzzy Syst. 21 1 2013 45 65
71. D. Dubois, H. Prade, and L. Ughetto A new perspective on reasoning with fuzzy rules Int. J. Intell. Syst. 18 5 2003 541 567
72. M. Freischlad, M. Schnellenbach-Held, and T. Pullmann Evolutionary generation of implicative fuzzy rules for design knowledge representation Proceedings the 13th International Conference on Intelligent Computing in Engineering and Architecture EG-ICE'06, Vol. 4200 of Lecture Notes in Artificial Intelligence Berlin, Heidelberg 2006 Springer-Verlag 222 229
73. D. Dubois, and H. Prade What are fuzzy rules and how to use them Fuzzy Sets Syst. 84 2 1996 169 185
74. D. Dubois, P. Hájek, and H. Prade Knowledge-driven versus data-driven logics J. Logic Lang. Inf. 9 1 2000 65 89
75. R.C. Purshouse, and P.J. Fleming Evolutionary many-objective optimisation: an exploratory analysis CEC '03. The 2003 Congress on Evolutionary Computation, vol. 3 2003 2066 2073
76. V. Khare, X. Yao, and K. Deb Performance scaling of multi-objective evolutionary algorithms C.M. Fonseca, P.J. Fleming, E. Zitzler, L. Thiele, K. Deb, Evolutionary Multi-Criterion Optimization, Vol. 2632 of Lecture Notes in Computer Science 2003 Springer Berlin Heidelberg 376 390
77. E. Hughes Evolutionary many-objective optimisation: many once or one many? The 2005 IEEE Congress on Evolutionary Computation, vol. 1 2005 222 227
78. H. Ishibuchi, N. Akedo, and Y. Nojima Behavior of multiobjective evolutionary algorithms on many-objective knapsack problems IEEE Trans. Evol. Comput. 19 2 2015 264 283
79. A. Cano, A. Zafra, and S. Ventura An interpretable classification rule mining algorithm Inf. Sci. 240 2013 1 20
80. J. Alcalá-Fdez, R. Alcalá, and F. Herrera A fuzzy association rule-based classification model for high-dimensional problems with genetic rule selection and lateral tuning IEEE Trans. Fuzzy Syst. 19 5 2011 857 872
81. S. Garca, D. Molina, M. Lozano, and F. Herrera A study on the use of non-parametric tests for analyzing the evolutionary algorithms' behaviour: a case study on the CEC'2005 special session on real parameter optimization J. Heuristics 15 2009 617 644
82. H.J. Zar Biostatistical Analysis 2010 Prentice-Hall/Pearson Upper Saddle River, NJ, USA
83. J.R. Quinlan Multi-Objective Machine Learning 1993 Morgan Kaufmann Publishers Inc. San Francisco, CA, USA
84. W. Cohen Fast effective rule induction Proceedings of the 12th International Conference on Machine Learning Morgan Kaufmann 1995 1 10
85. J. Bacardit, and N. Krasnogor Performance and efficiency of memetic Pittsburgh learning classifier systems Evol. Comput. 17 2009 307 342
86. R. Parpinelli, H. Lopes, and A. Freitas Data mining with an ant colony optimization algorithm IEEE Trans. Evol. Comput. 6 4 2002 321 332
87. K.C. Tan, Q. Yu, and J.H. Ang A coevolutionary algorithm for rules discovery in data mining Int. J. Syst. Sci. 37 12 2006 835 864
88. D. Carvalho, and A. Freitas A hybrid decision tree/genetic algorithm method for data mining Inf. Sci. 163 1-3 2004 13 35
89. L. Sánchez, I. Couso, and J. Corrales Combining GP operators with SA search to evolve fuzzy rule based classifiers Inf. Sci. 136 1-4 2001 175 192
90. S. Guan, and Z.F. An incremental approach to genetic-algorithms-based classification IEEE Trans. Syst. Man Cybern. (B) 35 2 2005 227 239
91. A. Gonzalez, and R. Perez SLAVE: a genetic learning system based on an iterative approach IEEE Trans. Fuzzy Syst. 7 2 1999 176 191
92. A. Gonzalez, and R. Perez Selection of relevant features in a fuzzy genetic learning algorithm IEEE Trans. Syst. Man Cybern. (B) 31 3 2001 417 425
93. H. Ishibuchi, T. Yamamoto, and T. Nakashima Hybridization of fuzzy GBML approaches for pattern classification problems IEEE Trans. Syst. Man Cybern. (B) 35 2 2005 359 365
94. E. Mansoori, M. Zolghadri, and S. Katebi SGERD: A steady-state genetic algorithm for extracting fuzzy classification rules from data IEEE Trans. Fuzzy Syst. 16 4 2008 1061 1071