Handling highly-dimensional classification tasks with hierarchical genetic fuzzy rule-based classifiers

International Journal of Uncertainty, Fuzziness and Knowldege-Based Systems

Volumn 20, Issue SUPPL. 2, 2012, Pages 73-104

  Stavrakoudis, Dimitris G ^a   Theocharis, John B ^a  

^a ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

Author keywords

Genetic fuzzy rule based classification systems (GFRBCS); genetic tuning; hierarchical fuzzy partitions; local feature selection; very highly dimensional classification problems

Indexed keywords

CLASSIFICATION (OF INFORMATION); FUZZY INFERENCE; FUZZY RULES;

CLASSIFICATION TASKS; FUZZY RULE BASED CLASSIFICATION SYSTEMS; FUZZY RULE-BASED CLASSIFIER; GENETIC FUZZY RULE-BASED CLASSIFICATION SYSTEM; GENETIC TUNING; GENETIC-FUZZY; HIERARCHICAL FUZZY PARTITIONS; LOCAL FEATURE SELECTIONS; PERFORMANCE; VERY HIGHLY-DIMENSIONAL CLASSIFICATION PROBLEMS;

HIERARCHICAL SYSTEMS;

EID: 84866385964     PISSN: 02184885     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0218488512400168     Document Type: Article

References (52)

1. O. Cordón, F. Herrera, F. Hoffmann and L. Magdalena, Genetic Fuzzy Systems: Evolutionary Tuning and Learning of Fuzzy Knowledge Bases (World Scientific, Singapore, 2001).
2. O. Cordón, F. Gomide, F. Herrera, F. Hoffmann and L. Magdalena, Ten years of genetic fuzzy systems: current framework and new trends, Fuzzy Sets Syst. 141(1) (2004) 5-31.
3. J. H. Holland, Adaptation in Natural and Artificial Systems (Univ. of Michigan Press, Ann Arbor, MI, 1975).
4. K. A. D. Jong, Evolutionary Computation: A Unified Approach (MIT Press, Cambridge, MA, 2006).
5. F. Herrera, Genetic fuzzy systems: taxonomy, current research trends and prospects, Evolutionary Intelligence 1(1) (2008) 27-46.
6. H. Ishibuchi, T. Nakashima and M. Nii, Classification and Modeling with Linguistic Information Granules: Advanced Approaches to Linguistic Data Mining (Springer, Berlin, 2004).
7. M. J. Gacto, R. Alcala and F. Herrera, Interpretability of linguistic fuzzy rule-based systems: An overview of interpretability measures, Inf. Sci. 181(20) (2011) 4340-4360.
8. J. M. Alonso and L. Magdalena, Special issue on Interpretable fuzzy systems, Inf. Sci. 181(20) (2011) 4331-4822.
9. S. M. Zhou and J. Q. Gan, Low-level interpretability and high-level interpretability: A unified view of data-driven interpretable fuzzy system modelling, Fuzzy Sets Syst. 159(23) (2008) 3091-3131.
10. J. M. Alonso, L. Magdalena and S. Guillaume, HILK: A new methodology for designing highly interpretable linguistic knowledge bases using the fuzzy logic formalism, Int. J. Intell. Syst. 23(7) (2008) 761-794.
11. J. M. Alonso and L. Magdalena, HILK++: an interpretability-guided fuzzy modeling methodology for learning readable and comprehensible fuzzy rule-based classifiers, Soft Comput. 15(10) (2011) 1959-1980.
12. M. Antonelli, P. Ducange, B. Lazzerini and F. Marcelloni, Learning knowledge bases of multi-objective evolutionary fuzzy systems by simultaneously optimizing accuracy, complexity and partition integrity, Soft Comput. 15(12) (2011) 2335-2354.
13. A. A. Marquez, F. A. Marquez and A. Peregrin, A mechanism to improve the interpretability of linguistic fuzzy systems with adaptive defuzzification based on the use of a multi-objective evolutionary algorithm, Int. J. Comput. Intell. Syst. 5(2) (2012) 297-321.
14. A. González and R. Pérez, SLAVE: a genetic learning system based on an iterative approach, IEEE Trans. Fuzzy Syst. 7(2) (1999) 176-191.
15. A. González and R. Pérez, Selection of relevant features in a fuzzy genetic learning algorithm, IEEE Trans. Syst. Man Cybern. Part B-Cybern. 31(3) (2001) 417-425.
16. H. Ishibuchi and T. Yamamoto, Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining, Fuzzy Sets Syst. 141(1) (2004) 59-88.
17. H. Ishibuchi, T. Yamamoto and T. Nakashima, Hybridization of fuzzy GBML approaches for pattern classification problems, IEEE Trans. Syst. Man Cybern. Part B-Cybern. 35(2) (2005) 359-365.
18. R. Alcalá, Y. Nojima, F. Herrera and H. Ishibuchi, Multiobjective genetic fuzzy rule selection of single granularity-based fuzzy classification rules and its interaction with the lateral tuning of membership functions, Soft Comput. 15(12) (2011) 2303-2318.
19. A. Fernandez, M. J. del Jesus and F. Herrera, Hierarchical fuzzy rule based classification systems with genetic rule selection for imbalanced data-sets, Int. J. Approx. Reasoning 50(3) (2009) 561-577.
20. A. Fernandez, M. J. del Jesus and F. Herrera, Analysing the hierarchical fuzzy rule based classification systems with genetic rule selection, in Proc. 4th Int. Workshop on Genetic and Evolutionary Fuzzy Systems (GEFS) (Mieres, Spain, 2010), pp. 69-74.
21. O. Cordón, F. Herrera and I. Zwir, Linguistic modeling by hierarchical systems of linguistic rules, IEEE Trans. Fuzzy Syst. 10(1) (2002) 2-20.
22. Z. Chi, H. Yan and T. Pham, Fuzzy Algorithms with Applications to Image Processing and Pattern Recognition (World Scientific, Singapore, 1996).
23. H. Ishibuchi, K. Nozaki, N. Yamamoto and H. Tanaka, Selecting fuzzy if-then rules for classification problems using genetic algorithms, IEEE Trans. Fuzzy Syst. 3(3) (1995) 260-270.
24. D. G. Stavrakoudis, G. N. Galidaki, I. Z. Gitas and J. B. Theocharis, Reducing the complexity of genetic fuzzy classifiers in highly-dimensional classification problems, Int. J. Comput. Intell. Syst. 5(2) (2012) 254-275.
25. H. Ishibuchi, T. Nakashima and T. Murata, Performance evaluation of fuzzy classifier systems for multidimensional pattern classification problems, IEEE Trans. Syst. Man Cybern. Part B-Cybern. 29(5) (1999) 601-618.
26. H. Ishibuchi and T. Yamamoto, Rule weight specification in fuzzy rule-based classification systems, IEEE Trans. Fuzzy Syst. 13(4) (2005) 428-435.
27. H. Ishibuchi, T. Nakashima and T. Morisawa, Voting in fuzzy rule-based systems for pattern classification problems, Fuzzy Sets Syst. 103(2) (1999) 223-238.
28. O. Cordón, M. J. del Jesus and F. Herrera, Analyzing the reasoning mechanisms in fuzzy rule-based classification systems, Mathware Soft Comput. 5(2-3) (1998) 321-332.
29. Y. Freund and R. Schapire, Experiments with a new boosting algorithm, in Proc. 13th Int. Conf. Machine Learning (Bari, Italy, 1996), pp. 148-156.
30. O. Cordón, M. J. del Jesús, F. Herrera and M. Lozano, MOGUL: a methodology to obtain genetic fuzzy rule-based systems under the iterative rule learning approach, Int. J. Intell. Syst. 14(11) (1999) 1123-1153.
31. F. Hoffmann, Combining boosting and evolutionary algorithms for learning of fuzzy classification rules, Fuzzy Sets Syst. 141(1) (2004) 47-58.
32. M. J. del Jesus, F. Hoffmann, L. J. Navascués and L. Sánchez, Induction of fuzzy-rule-based classifiers with evolutionary boosting algorithms, IEEE Trans. Fuzzy Syst. 12(3) (2004) 296-308.
33. D. G. Stavrakoudis, G. N. Galidaki, I. Z. Gitas and J. B. Theocharis, A Genetic Fuzzy-Rule-Based Classifier for Land Cover Classification From Hyperspectral Imagery, IEEE Trans. Geosci. Remote Sensing 50(1) (2012) 130-148.
34. S. P. Moustakidis, J. B. Theocharis and G. Giakas, Subject recognition based on ground reaction force measurements of gait signals, IEEE Trans. Syst. Man Cybern. Part B-Cybern. 38(6) (2008) 1476-1485.
35. S. P. Moustakidis and J. B. Theocharis, SVM-FuzCoC: A novel SVM-based feature selection method using a fuzzy complementary criterion, Pattern Recognit. 43(11) (2010) 3712-3729.
36. T. Bäck, Evolutionary Algorithms in Theory and Practice (Oxford University Press, Oxford, 1996).
37. A. Frank and A. Asuncion, UCI Machine Learning Repository (School of Information and Computer Science, University of California, Irvine, CA, 2010) [http://archive.ics.uci.edu/ml].
38. N. E. Mitrakis, C. A. Topaloglou, T. K. Alexandridis, J. B. Theocharis and G. C. Zalidis, Decision fusion of GA self-organizing neuro-fuzzy multilayered classifiers for land cover classification using textural and spectral features, IEEE Trans. Geosci. Remote Sens. 46(7) (2008) 2137-2152.
39. D. G. Stavrakoudis, J. B. Theocharis and G. C. Zalidis, A boosted genetic fuzzy classifier for land cover classification of remote sensing imagery, ISPRS-J. Photogramm. Remote Sens. 66(4) (2011) 529-544.
40. D. A. Landgrebe, Signal Theory Methods in Multispectral Remote Sensing (Wiley, Hoboken, NJ, 2003).
41. X. Huang, L. Zhang and P. Li, Classification and extraction of spatial features in urban areas using high-resolution multispectral imagery, IEEE Geosci. Remote Sens. Lett. 4(2) (2007) 260-264.
42. L. Zhang, X. Huang, B. Huang and P. Li, A pixel shape index coupled with spectral information for classification of high spatial resolution remotely sensed images, IEEE Trans. Geosci. Remote Sens. 44(10) (2006) 2950-2961.
43. S. Moustakidis, G. Mallinis, N. Koutsias, J. B. Theocharis and V. Petridis, SVM-based fuzzy decision trees for classification of high spatial resolution remote sensing images, IEEE Trans. Geosci. Remote Sensing 50(1) (2012) 149-169.
44. J. R. Quinlan, C4.5: Programs for Machine Learning (Morgan Kauffman, 1993).
45. W. W. Cohen, Fast effective rule induction, in Proc. 12th Int. Conf. Machine Learning (ML95) (California, 1995), pp. 115-123.
46. W. W. Cohen and Y. Singer, A simple, fast, and effective rule learner, in Proc. 16th National Conf. Artificial Intelligence (Orlando, Florida, USA, 1999), pp. 335-342.
47. J. Alcala-Fdez, L. Sanchez, S. Garcia, M. J. del Jesus, S. Ventura, J. M. Garrell, J. Otero, C. Romero, J. Bacardit, V. M. Rivas, J. C. Fernandez and F. Herrera, KEEL: A software tool to assess evolutionary algorithms to data mining problems, Soft Comput. 13(3) (2009) 307-318.
48. J. Alcala-Fdez, A. Fernandez, J. Luengo, J. Derrac, S. Garcia, L. Sanchez and F. Herrera, KEEL data-mining software tool: Data set repository, integration of algorithms and experimental analysis framework, J. Mult.-Valued Log. Soft Comput. 17(2-3) (2011) 255-287.
49. F. J. Berlanga, A. J. Rivera, M. J. del Jesus and F. Herrera, GP-COACH: Genetic programming-based learning of compact and accurate fuzzy rule-based classification systems for high-dimensional problems, Inf. Sci. 180(8) (2010) 1183-1200.
50. J. Demšar, Statistical comparisons of classifiers over multiple data sets, J. Mach. Learn. Res. 7 (2006) 1-30.
51. S. García, D. Molina, M. Lozano and F. Herrera, A study on the use of non-parametric tests for analyzing the evolutionary algorithms' behaviour: a case study on the CEC'2005 special session on real parameter optimization, J. Heuristics 15(6) (2009) 617-644.
52. J. Derrac, S. Garcia, D. Molina and F. Herrera, A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms, Swarm and Evolutionary Computation 1(1) (2011) 3-18.