On the combination of accuracy and diversity measures for genetic selection of bagging fuzzy rule-based multiclassification systems

ISDA 2009 - 9th International Conference on Intelligent Systems Design and Applications

Volumn , Issue , 2009, Pages 121-127

  Trawiński, Krzysztof ^a   Quirin, Arnaud ^a   Cordón, Oscar ^a  

^a EUROPEAN CENTRE FOR SOFT COMPUTING   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY MEASURES; BI-CRITERIA; DATA SETS; DIVERSITY MEASURE; FEATURE SELECTION; FITNESS FUNCTIONS; FUZZY CLASSIFIERS; FUZZY RULE BASED CLASSIFICATION SYSTEMS; GENETIC SELECTION; MULTI-CLASSIFICATION; MUTUAL INFORMATIONS;

FUNCTION EVALUATION; FUZZY RULES; INTELLIGENT SYSTEMS;

FEATURE EXTRACTION;

EID: 77949536389     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISDA.2009.123     Document Type: Conference Paper

References (25)

1. R. Battiti. Using mutual information for selecting features in supervised neural net learning. IEEE Transactions on Neural Networks, 5(4):537-550, 1994.
2. L. Breiman. Bagging predictors. Machine Learning, 24(2):123-140, 1996.
3. J. Canul-Reich, L. Shoemaker, and L. Hall. Ensembles of fuzzy classifiers. In IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), pages 1-6, London, 2007.
4. O. Cordón and A. Quirin. Comparing two genetic overproduce-and-choose strategies for fuzzy rule-based multiclassification systems generated by bagging and mutual information-based feature selection. International Journal of Hybrid Intelligent Systems, 2009. In press.
5. O. Cordón, A. Quirin, and L. Sánchez. A first study on bagging fuzzy rule-based classification systems with multicriteria genetic selection of the component classifiers. In Third International Workshop on Genetic and Evolving Fuzzy Systems (GEFS), pages 11-16, Witten-Bommerholz, 2008.
6. O. Cordón, A. Quirin, and L. Sánchez. On the use of bagging, mutual information-based feature selection and multicriteria genetic algorithms to design fuzzy rule-based classification ensembles. In International Conference on Hybrid Intelligent Systems (HIS), pages 549-554, Barcelona, 2008.
7. T. Dietterich. Approximate statistical test for comparing supervised classification learning algorithms. Neural Computation, 10(7):1895-1923, 1998.
8. T. Feo and M. Resende. Greedy randomized adaptive search procedures. Journal of Global Optimization, 6:109-133, 1995.
9. B. Gabrys and D. Ruta. Genetic algorithms in classifier fusion. Applied Soft Computing, 6(4):337-347, 2006.
10. S. Hadjitodorov and L. Kuncheva. Selecting diversifying heuristics for cluster ensembles. Lecture Notes in Computer Science, 4472:200-209, 2007.
11. T. Ho. The random subspace method for constructing decision forests. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(8):832-844, 1998.
12. H. Ishibuchi, T. Nakashima, and M. Nii. Classification and Modeling With Linguistic Information Granules. Springer, 2005.
13. L. Kuncheva. Combining Pattern Classifiers: Methods and Algorithms. Wiley, 2004.
14. L. I. Kuncheva and C. J. Whitaker. Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy. Machine Learning, 51(2):181-207, 2003.
15. G. Mart?́nez-Muñoz, D. Hernández-Lobato, and A. Suárez. Selection of decision stumps in bagging ensembles. Lecture Notes in Computer Science, 4668:319-328, 2007.
16. Z. Michalewicz. Genetic Algorithms + Data Structures = Evolution Programs. Springer, 1996.
17. L. Oliveira, M. Morita, R. Sabourin, and F. Bortolozzi. Multi-objective genetic algorithms to create ensemble of classifiers. Lecture Notes in Computer Science, 3410:592-606, 2005.
18. D. Optiz and R. Maclin. Popular ensemble methods: an empirical study. Journal of Artificial Intelligence Research, 11:169-198, 1999.
19. D. Partridge andW. Yates. Engineering multiversion neuralnet systems. Neural Computation, 8(4):869-893, 1996.
20. W. Pedrycz and K. Kwak. Boosting of granular models. Fuzzy Sets and Systems, 157(22):2934-2953, 2006.
21. D. Ruta and B. Gabrys. Classifier selection for majority voting. Information Fusion, 6(1):63-81, 2005.
22. E. D. Santos, R. Sabourin, and P. Maupin. Single and multiobjective genetic algorithms for the selection of ensemble of classifiers. In International Joint Conference on Neural Networks (IJCNN), pages 3070-3077, Vancouver, 2006.
23. E. D. Santos, R. Sabourin, and P. Maupin. A dynamic overproduce-and- choose strategy for the selection of classifier ensembles. Pattern Recognition, 41(10):2993-3009, 2008.
24. K. Trawiński, A. Quirin, and O. Cordón. Bi-criteria genetic selection of bagging fuzzy rule-based multiclassification systems. In IFSA World Congress-EUSFLAT Conference, Lisbon, 2009. In press.
25. A. Tsymbal, M. Pechenizkiy, and P. Cunningham. Diversity in search strategies for ensemble feature selection. Information Fusion, 6(1):83-98, 2005.