GP-COACH: Genetic Programming-based learning of COmpact and ACcurate fuzzy rule-based classification systems for High-dimensional problems

Information Sciences

Volumn 180, Issue 8, 2010, Pages 1183-1200

  Berlanga, F J ^a   Rivera, A J ^b   del Jesus, M J ^b   Herrera, F ^c  

^a UNIVERSITY OF ZARAGOZA   (Spain)

^b UNIVERSITY OF JAÉN   (Spain)

^c UNIVERSITY OF GRANADA   (Spain)

Author keywords

Classification; Fuzzy rule based systems; Genetic fuzzy systems; Genetic programming; High dimensional problems; Interpretability accuracy trade off

Indexed keywords

COMPACT SETS; COMPETITION MECHANISM; COMPETITIVE LEARNING; DISJUNCTIVE NORMAL FORM; FUZZY RULE BASED CLASSIFICATION SYSTEMS; FUZZY RULE-BASED SYSTEMS; GENETIC FUZZY SYSTEMS; HIGH-DIMENSIONAL PROBLEMS; INTERPRETABILITY; NON-PARAMETRIC STATISTICAL TESTS; ONE-RULE; RULE BASE;

FUZZY RULES; FUZZY SYSTEMS; STATISTICAL TESTS;

GENETIC PROGRAMMING;

EID: 75149139352     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2009.12.020     Document Type: Article

References (72)

1. V. Akbarzadeh, A. Sadeghian, M.V.D. Santos, Derivation of relational fuzzy classification rules using evolutionary computation, in: Proceedings of the 2008 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE08), Hong Kong, China, 2008, pp. 1689-1693.
2. Akbarzadeh-T M., Kumbla K., Tunstel E., and Jamshidi M. Soft computing for autonomous robotic systems. Computers and Electrical Engineering 26 1 (2000) 5-32
3. Alba E., Cotta C., and Troya J. Evolutionary design of fuzzy logic controllers using strongly-typed GP. Mathware and Soft Computing 6 (1999) 109-124
4. Alcalá R., Alcalá-Fdez J., Herrera F., and Otero J. Genetic learning of accurate and compact fuzzy rule based systems based on the 2-tuples linguistic representation. International Journal of Approximate Reasoning 44 1 (2007) 45-64
5. Alcalá-Fdez J., Herrera F., Márquez F., and Peregrín A. Increasing fuzzy rules cooperation based on evolutionary adaptive inference systems. International Journal of Intelligent Systems 22 9 (2007) 1035-1064
6. A. Asuncion, D. Newman, UCI Machine Learning Repository, University of California, Irvine, School of Information and Computer Sciences, 2007, .
7. Berlanga F., del Jesus M., Gacto M., and Herrera F. A genetic-programming-based approach for the learning of compact fuzzy rule-based classification systems. 8th International Conference on Artificial Intelligence and Soft Computing (ICAISC'06). LNCS vol. 4029 (2006), Springer-Verlag 182-191
8. F. Berlanga, M. del Jesus, F. Herrera, Learning fuzzy rules using genetic programming: context-free grammar definition for high-dimensionality problems, in: Proceedings of the I Workshop on Genetic Fuzzy Systems (GFS'05), Granada, Spain, 2005, pp. 136-141.
9. In: Bezdek J., and Pal S. (Eds). Fuzzy Models for Pattern Recognition. Methods that Search for Structures in Data (1992), IEEE Press, New York
10. Botta A., Lazzerini B., Marcelloni F., and Stefanescu D. Context adaptation of fuzzy systems through a multi-objective evolutionary approach based on a novel interpretability index. Soft Computing 13 5 (2009) 437-449
11. Broekhoven E.V., Adriaenssens V., and Baets B.D. Interpretability-preserving genetic optimization of linguistic terms in fuzzy models for fuzzy ordered classification: an ecological case study. International Journal of Approximate Reasoning 44 1 (2007) 65-90
12. Cano J., Herrera F., and Lozano M. Evolutionary stratified training set selection for extracting classification rules with trade-off precision-interpretability. Data and Knowledge Engineering 60 (2007) 90-108
13. Carse B., and Pipe A. Introduction: genetic fuzzy systems. International Journal of Intelligent Systems 22 9 (2007) 905-907
14. Casillas J., and Carse B. Special issue on genetic fuzzy systems: recent developments and future directions. Soft Computing 13 5 (2009) 417-418
15. Casillas J., Carse B., and Bull L. Fuzzy-XCS: a michigan genetic fuzzy system. IEEE Transactions on Fuzzy Systems 15 4 (2007) 536-550
16. Casillas J., Cordón O., del Jesus M., and Herrera F. Genetic tuning of fuzzy rule deep structures preserving interpretability and its interaction with fuzzy rule set reduction. IEEE Transactions on Fuzzy Systems 13 1 (2005) 13-29
17. In: Casillas J., Cordón O., Herrera F., and Magdalena L. (Eds). Accuracy Improvements in Linguistic Fuzzy Modeling. Studies in Fuzziness and Soft Computing vol. 129 (2003), Springer-Verlag
18. In: Casillas J., Cordón O., Herrera F., and Magdalena L. (Eds). Interpretability Issues in Fuzzy Modeling. Studies in Fuzziness and Soft Computing vol. 128 (2003), Springer-Verlag
19. Casillas J., Herrera F., Pérez R., del Jesus M., and Villar P. Special issue on genetic fuzzy systems and the interpretability-accuracy trade-off. International Journal of Approximate Reasoning 44 1 (2007) 1-3
20. Chen M.-C., Chen L.-S., Hsu C.-C., and Zeng W.-R. An information granulation based data mining approach for classifying imbalanced data. Information Sciences 178 16 (2008) 3214-3227
21. Chi Z., Yan H., and Pham T. Fuzzy Algorithms with Applications to Image Processing and Pattern Recognition (1996), World Scientific
22. Chien B.-C., Lin J., and Hong T.-P. Learning discriminant functions with fuzzy attributes for classification using genetic programming. Expert Systems with Applications 23 1 (2002) 31-37
23. Combs W., and Andrews J. Combinatorial rule explosion eliminated by a fuzzy rule configuration. IEEE Transactions on Fuzzy Systems 6 1 (1998) 1-11
24. Cordón O., Alcalá R., Alcalá-Fdez J., and Rojas I. Genetic fuzzy systems: what's next? An introduction to the special section. IEEE Transactions on Fuzzy Systems 15 4 (2007) 533-535
25. Cordón O., del Jesus M., and Herrera F. A proposal on reasoning methods in fuzzy rule-based classification systems. International Journal of Approximate Reasoning 20 (1999) 21-45
26. Cordón O., del Jesus M., Herrera F., and Lozano M. MOGUL: a methodology to obtain genetic fuzzy rule-based systems under the iterative rule learning approach. International Journal of Intelligent Systems 14 11 (1999) 1123-1153
27. Cordón O., Herrera F., Hoffmann F., and Magdalena L. Genetic Fuzzy Systems. Evolutionary Tuning and Learning of Fuzzy Knowledge Bases (2001), World Scientific
28. Cordón O., Herrera F., and Villar P. Generating the knowledge base of a fuzzy rule-based system by the genetic learning of data base. IEEE Transactions on Fuzzy Systems 9 4 (2001) 664-667
29. Cordón O., Herrera F., and Zwir I. Linguistic modeling by hierarchical systems of linguistic rules. IEEE Transactions on Fuzzy Systems 10 1 (2002) 2-20
30. Delgado M., Nagai E., and de Arruda L.R. A neuro-coevolutionary genetic fuzzy system to build soft sensors. Soft Computing 13 5 (2009) 481-495
31. Demšar J. Statistical comparisons of classifiers over multiple data sets. Journal of Machine Learning Research 7 (2006) 1-30
32. Fernández A., García S., del Jesus M., and Herrera F. A study of the behaviour of linguistic fuzzy rule based classification systems in the framework of imbalanced data-sets. Fuzzy Sets and Systems 159 18 (2008) 2378-2398
33. Gacto M., Alcalá R., and Herrera F. Adaptation and application of multi-objective evolutionary algorithms for rule reduction and parameter tuning of fuzzy rule-based systems. Soft Computing 13 5 (2009) 419-436
34. García S., Molina D., Lozano M., and Herrera F. A study on the use of non-parametric tests for analyzing the evolutionary algorithms' behaviour: a case study on the CEC'2005 special session on real parameter optimization. Journal of Heuristics 15 (2009) 617-644
35. Geyer-Schulz A. Fuzzy Rule-Based Expert Systems and Genetic Machine Learning (1995), Physica-Verlag, Heidelberg
36. Goldberg D. Genetic Algorithms in Search, Optimization and Machine Learning (1989), Addison-Wesley, Reading, MA
37. Gómez-Skarmeta A., Jiménez F., and Sánchez G. Improving interpretability in approximative fuzzy models via multiobjective evolutionary algorithms. International Journal of Intelligent Systems 22 9 (2007) 943-969
38. González A., and Pérez R. Selection of relevant features in a fuzzy genetic learning algorithm. IEEE Transactions on Systems, Man and Cybernetics, Part B 31 3 (2001) 417-425
39. González J., Rojas I., Pomares H., Herrera L., Guillén A., Palomares J., and Rojas F. Improving the accuracy while preserving the interpretability of fuzzy function approximators by means of multi-objective evolutionary algorithms. International Journal of Approximate Reasoning 44 1 (2007) 32-44
40. Gunal S., and Edizkan R. Subspace based feature selection for pattern recognition. Information Sciences 178 19 (2008) 3716-3726
41. Herrera F. Genetic fuzzy systems: taxonomy, current research trends and prospects. Evolutionary Intelligence 1 (2008) 27-46
42. Hoffmann F., Schauten D., and Hölemann S. Incremental evolutionary design of TSK fuzzy controllers. IEEE Transactions on Fuzzy Systems 15 4 (2007) 563-577
43. Homaifar A., Battle D., Tunstel E., and Dozier G. Genetic programming design of fuzzy controllers for mobile robot path tracking. International Journal of Knowledge-Based Intelligent Engineering Systems 4 1 (2000) 33-52
44. Ishibuchi H., Nakashima T., and Morisawa T. Voting in fuzzy rule-based systems for pattern classification problems. Fuzzy Sets and Systems 103 2 (1999) 223-238
45. Ishibuchi H., Nakashima T., and Murata T. Design of accurate classifiers with a compact fuzzy-rule base using an evolutionary scatter partition of feature space. IEEE Transactions on Systems, Man and Cybernetics, Part B 29 5 (1999) 601-618
46. Ishibuchi H., Nakashima T., and Nii M. Classification and Modeling with Linguistic Information Granules: Advance Approaches to Linguistic Data Mining (2004), Springer-Verlag
47. Ishibuchi H., and Nojima Y. Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning. International Journal of Approximate Reasoning 44 1 (2007) 4-31
48. Ishibuchi H., and Yamamoto T. Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining. Fuzzy Sets and Systems 141 1 (2004) 59-88
49. Ishibuchi H., and Yamamoto T. Rule weight specification in fuzzy rule-based classification systems. IEEE Transactions on Fuzzy Systems 13 4 (2005) 428-435
50. Kohavi R., and John G. Wrappers for feature subset selection. Artificial Intelligence 97 1-2 (1997) 273-324
51. Kouchakpour P., Zaknich A., and Bräunl T. Population variation in genetic programming. Information Sciences 177 17 (2007) 3438-3452
52. Kouchakpour P., Zaknich A., and Bräunl T. Dynamic population variation in genetic programming. Information Sciences 179 8 (2009) 1078-1091
53. Koza J. Genetic Programming: On the Programming of Computers by Means of Natural Selection (1992), The MIT Press, Cambridge, MA,USA
54. Liu H., and Yu L. Toward integrating feature selection algorithms for classification and clustering. IEEE Transactions on Knowledge and Data Engineering 17 3 (2005) 491-502
55. Mendes R., de Voznika F.B., Freitas A., and Nievola J. A genetic-programming-based approach for the learning of compact fuzzy rule-based classification systems. Principles of Data Mining and Knowledge Discovery: 5th European Conference (PKDD'01). LNCS vol. 2168 (2001), Springer-Verlag 314-325
56. Mucientes M., Vidal J.C., Bugarín A., and Lama M. Processing time estimations by variable structure TSK rules learned through genetic programming. Soft Computing 13 5 (2009) 497-509
57. Nojima Y., Ishibuchi H., and Kuwajima I. Parallel distributed genetic fuzzy rule selection. Soft Computing 13 5 (2009) 511-519
58. Ravi V., Reddy P., and Zimmermann H. Pattern classification with principal component analysis and fuzzy rule bases. European Journal of Operational Research 126 3 (2000) 526-533
59. Ravi V., and Zimmermann H. Fuzzy rule based classification with FeatureSelector and modified threshold accepting. European Journal of Operational Research 123 1 (2000) 16-28
60. Sánchez L., and Corrales J. Niching scheme for steady state GA-P and its application to fuzzy rule based classifiers induction. Mathware and Soft Computing 7 2-3 (2000) 337-350
61. Sánchez L., and Couso I. Advocating the use of imprecisely observed data in genetic fuzzy systems. IEEE Transactions on Fuzzy Systems 15 4 (2007) 551-562
62. Sánchez L., Couso I., and Corrales J. Combining GP operators with SA search to evolve fuzzy rule based classifiers. Information Sciences 136 1-4 (2001) 175-191
63. Sánchez L., and Otero J. Boosting fuzzy rules in classification problems under single-winner inference. International Journal of Intelligent Systems 22 9 (2007) 1021-1034
64. Sánchez L., Otero J., and Couso I. Obtaining linguistic fuzzy rule-based regression models from imprecise data with multiobjective genetic algorithms. Soft Computing 13 5 (2009) 467-479
65. Setnes M., and Babuška R. Rule base reduction: some comments on the use of orthogonal transforms. IEEE Transactions on Systems, Man and Cybernetics, Part B 31 (2001) 199-206
66. S. Smith, A Learning System Based on Genetic Algorithms, Ph.D. Thesis, University of Pittsburgh, 1980.
67. P. Thrift, Fuzzy logic synthesis with genetic algorithms, in: Proceedings of the 4th International Conference on Genetic Algorithms (ICGA'91), San Diego, USA, 1991, pp. 509-513.
68. Tsakonas A. A comparison of classification accuracy of four genetic programming-evolved intelligent structures. Information Sciences 176 6 (2006) 691-724
69. Wang L., and Mendel J. Generating fuzzy rules by learning from examples. IEEE Transactions on Systems, Man, and Cybernetics 22 6 (1992) 1414-1427
70. Wilson S. Classifier fitness based on accuracy. Evolutionary Computation 3 2 (1995) 149-175
71. Wong M., and Leung K. Data Mining using Grammar based Genetic Programming and Applications (2000), Kluwer Academics Publishers
72. Zhang M.-L., Peña J.M., and Robles V. Feature selection for multi-label naive Bayes classification. Information Sciences 179 19 (2009) 3218-3229