Investigating the influence of the choice of the ensemble members in accuracy and diversity of selection-based and fusion-based methods for ensembles

Pattern Recognition Letters

Volumn 28, Issue 4, 2007, Pages 472-486

  Canuto, Anne M P ^a   Abreu, Marjory C C ^a   de Melo Oliveira, Lucas ^a   Xavier Jr , João C ^a   Santos, Araken de M ^a  

^a FEDERAL UNIVERSITY OF RIO GRANDE DO NORTE   (Brazil)

Author keywords

Classifier ensembles; Diversity measures; Fusion based combination methods; Selection based combination methods

Indexed keywords

COMPUTATIONAL METHODS; COMPUTER SYSTEM RECOVERY; ERROR ANALYSIS; OPTIMIZATION; SENSOR DATA FUSION;

CLASSIFIER ENSEMBLES; DIVERSITY MEASURES; FUSION-BASED COMBINATION METHODS; SELECTION-BASED COMBINATION METHODS;

FEATURE EXTRACTION;

EID: 33845506212     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2006.09.001     Document Type: Article

References (27)

1. Banfield R.E., Hall L.O., Bowyer K.W., and Kegelmeyer W.P. Ensemble diversity measures and their application to thinning. Information Fusion 6 1 (2005) 49-62 (Special issue on Diversity in Multiple Classifier System)
2. Blake, C.L., Merz, C.J., 1998. UCI Repository of machine learning databases. University of California, Department of Information and Computer Science, Irvine, CA. .
3. Breiman L. Bagging predictors. Machine Learning 24 (1996) 123-140
4. Breiman, L., 1999. Using adaptive bagging to Debias regressions, Technical report 547, Dept. Statistics, University of California, Berkeley.
5. Canuto, A., 2001. Combining neural networks and fuzzy logic for applications in character recognition. Ph.D. thesis, University of Kent.
6. Canuto, A.M.P., Souto, M.C.P., Santos, A., Silva, S.M., Bezerra, V.S.A., 2005. Comparative analysis of the performance of hybrid and non-hybrid multi-classifier systems. In: Internat. Joint Conf. on Neural Networks (IJCNN), 2005, Montreal, Proc. of IJCNN 2005.
7. Canuto, A.M.P., Oliveira, L., Xavier Junior, J., Santos, A., Abreu, M., 2005. Performance and diversity evaluation in hybrid and non-hybrid structures of ensembles. In: 5th Internat. Conf. on Hybrid Intelligent Systems, pp. 285-290.
8. Czyz, J., Sadeghi, M., Kittler, J., Vandendorpe, L., 2004. Decision fusion for face authentication. In: Proc. First Internat. Conf. on Biometric Authentication, pp. 686-693.
9. Duin, R.P.W., Tax, D.M.J., 2000. Experiments with classifier combining rules. In: Proc. First Internat. Workshop on Multiple Classifier Systems. Lecture Notes in Computer Science, vol. 1857, pp. 16-29.
10. Freund W. Boosting a weak learning algorithm by majority. Inform. Comput. (1995)
11. Giacinto G., and Roli F. Design of effective neural network ensembles for image classification. Image Vis. Comput. J. 19 9-10 (2001) 697-705
12. Giacinto G., and Roli F. Dynamic classifier selection based on multiple classifier behaviour. Pattern Recognition 34 (2001) 1879-1881
13. Kuncheva L. Switching between selection and fusion in combining classifiers: An experiment. IEEE Trans. Systems Man Cybernet. - Part B 32 2 (2002) 146-155
14. Kuncheva L.I. Combining Pattern Classifiers. Methods and Algorithms (2004), Wiley
15. Kuncheva L., and Whitaker C. Measures of diversity in classifier ensembles. Machine Learning 51 (2003) 181-207
16. Kuncheva L.I., Skurichina M., and Duin R. An experimental study on diversity for bagging and boosting with linear classifier. Information Fusion 3 2 (2002) 245-258
17. Kuncheva L.I., Skurichina M., and Duin R.P.W. An experimental study on diversity for bagging and boosting with linear classifiers. Information Fusion 3 2 (2002) 245-258
18. Lemieux, A., Parizeau, M., 2003. Flexible multi-classifier architecture for face recognition systems. In: The 16th Internat. Conf. on Vision Interface.
19. Mitchell T. Machine Learning (1997), McGraw-Hill
20. Ruta D., and Gabrys B. Classifier selection for majority voting. Information Fusion 6 1 (2005) 49-62 (Special issue on Diversity in Multiple Classifier System)
21. Sharkey A.J.C. Multi-net system. In: Sharkey A.J.C. (Ed). Combining Artificial Neural Nets: Ensemble and Modular Multi-net Systems (1999), Spring-Verlag 1-30
22. Shipp C.A., and Kuncheva L.I. Relationships between combination methods and measures of diversity in combining classifiers. Information Fusion 3 2 (2002) 135-148
23. Shipp, C.A., Kuncheva, L.I., 2002. An investigation into how adaboost affects classifier diversity. In: Proc. IPMU, pp. 203-208.
24. Tsymbal A., Pechenizkiy M., and Cunningham P. Diversity in search strategies for ensemble feature selection. Information Fusion 6 1 (2005) 83-98 (Special issue on Diversity in Multiple Classifier System)
25. Windeatt T. Diversity measures for multiple classifier system analysis and design. Information Fusion 6 1 (2005) 21-36 (Special issue on Diversity in Multiple Classifier System)
26. Woods K., Kegelmeyer W., and Bowyer K. Combination of multiple classifiers using local accuracy estimates. IEEE Trans. Pattern Anal. Machine Intell. 19 4 (1997) 405-410
27. Zhou D., and Zhang J. Face recognition by combining several algorithms. Pattern Recognition 3 3 (2002) 497-500