META-DES: A dynamic ensemble selection framework using meta-learning

Pattern Recognition

Volumn 48, Issue 5, 2015, Pages 1925-1935

  Cruz, Rafael M O ^a   Sabourin, Robert ^a   Cavalcanti, George D C ^b   Ing Ren, Tsang ^b  

^a ÉCOLE DE TECHNOLOGIE SUPÉRIEURE   (Canada)

^b FEDERAL UNIVERSITY OF PERNAMBUCO   (Brazil)

Author keywords

Classifier competence; Dynamic ensemble selection; Ensemble of classifiers; Meta learning

Indexed keywords

PATTERN RECOGNITION; SOFTWARE ENGINEERING;

BASE CLASSIFIERS; CLASSIFICATION ACCURACY; DEGREE OF UNCERTAINTY; DYNAMIC ENSEMBLE SELECTIONS; ENSEMBLE OF CLASSIFIERS; META-LEARNING FRAMEWORKS; METALEARNING; SMALL-SAMPLE-SIZE CLASSIFICATIONS;

CLASSIFICATION (OF INFORMATION);

EID: 84921697002     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2014.12.003     Document Type: Article

References (42)

1. J. Kittler, M. Hatef, R.P.W. Duin, and J. Matas On combining classifiers IEEE Trans. Pattern Anal. Mach. Intell. 20 1998 226 239
2. L.I. Kuncheva Combining Pattern Classifiers: Methods and Algorithms 2004 Wiley-Interscience, New Jersey
3. A.S. Britto, Jr., R. Sabourin, L.E.S. de Oliveira, Dynamic selection of classifiers - a comprehensive review, Pattern Recognit. 47 (11) (2014) 3665-3680.
4. A.H.R. Ko, R. Sabourin, and A.S. Britto Jr. From dynamic classifier selection to dynamic ensemble selection Pattern Recognit. 41 2008 1735 1748
5. E.M. Dos Santos, R. Sabourin, and P. Maupin A dynamic overproduce-and-choose strategy for the selection of classifier ensembles Pattern Recognit. 41 2008 2993 3009
6. P.R. Cavalin, R. Sabourin, and C.Y. Suen Dynamic selection approaches for multiple classifier systems Neural Comput. Appl. 22 3-4 2013 673 688
7. P.R. Cavalin, R. Sabourin, and C.Y. Suen Logid an adaptive framework combining local and global incremental learning for dynamic selection of ensembles of HMMs Pattern Recognit. 45 9 2012 3544 3556
8. T. Woloszynski, and M. Kurzynski A probabilistic model of classifier competence for dynamic ensemble selection Pattern Recognit. 44 2011 2656 2668
9. J. Xiao, L. Xie, C. He, and X. Jiang Dynamic classifier ensemble model for customer classification with imbalanced class distribution Expert Syst. Appl. 39 2012 3668 3675
10. R.M.O. Cruz, G.D.C. Cavalcanti, T.I. Ren, A method for dynamic ensemble selection based on a filter and an adaptive distance to improve the quality of the regions of competence, in: Proceedings of the International Joint Conference on Neural Networks, 2011, pp. 1126-1133.
11. G. Giacinto, and F. Roli Dynamic classifier selection based on multiple classifier behaviour Pattern Recognit. 34 2001 1879 1881
12. K. Woods, W.P. Kegelmeyer Jr., and K. Bowyer Combination of multiple classifiers using local accuracy estimates IEEE Trans. Pattern Anal. Mach. Intell. 19 1997 405 410
13. L. Kuncheva Switching between selection and fusion in combining classifiers an experiment IEEE Trans. Syst. Man Cybern. 32 2 2002 146 156
14. X. Zhu, X. Wu, Y. Yang, Dynamic classifier selection for effective mining from noisy data streams, in: Proceedings of the 4th IEEE International Conference on Data Mining, 2004, pp. 305-312.
15. S. Singh, and M. Singh A dynamic classifier selection and combination approach to image region labelling Signal Process. Image Commun. 20 3 2005 219 231
16. P.C. Smits Multiple classifier systems for supervised remote sensing image classification based on dynamic classifier selection IEEE Trans. Geosci. Remote Sens. 40 4 2002 801 813
17. L.I. Kuncheva, Clustering-and-selection model for classifier combination, in: Fourth International Conference on Knowledge-Based Intelligent Information Engineering Systems & Allied Technologies, 2000, pp. 185-188.
18. R.G.F. Soares, A. Santana, A.M.P. Canuto, M.C.P. de Souto, Using accuracy and diversity to select classifiers to build ensembles, in: Proceedings of the International Joint Conference on Neural Networks, 2006, pp. 1310-1316.
19. L.I. Kuncheva A theoretical study on six classifier fusion strategies IEEE Trans. Pattern Anal. Mach. Intell. 24 2 2002 281 286
20. D.W. Corne, J.D. Knowles, No free lunch and free leftovers theorems for multiobjective optimisation problems, in: Evolutionary Multi-Criterion Optimization (EMO 2003) Second International Conference, 2003, pp. 327-341.
21. E.M. dos Santos, R. Sabourin, and P. Maupin A dynamic overproduce-and-choose strategy for the selection of classifier ensembles Pattern Recognit. 41 10 2008 2993 3009
22. R.M.O. Cruz, R. Sabourin, G.D.C. Cavalcanti, Analyzing dynamic ensemble selection techniques using dissimilarity analysis, in: Artificial Neural Networks in Pattern Recognition ANNPR, 2014, pp. 59-70.
23. J.H. Krijthe, T.K. Ho, M. Loog, Improving cross-validation based classifier selection using meta-learning, in: International Conference on Pattern Recognition, 2012, pp. 2873-2876.
24. G. Giacinto, and F. Roli Design of effective neural network ensembles for image classification purposes Image Vis. Comput. 19 9-10 2001 699 707
25. R.M.O. Cruz, G.D. Cavalcanti, I.R. Tsang, and R. Sabourin Feature representation selection based on classifier projection space and oracle analysis Exp. Syst. Appl. 40 9 2013 3813 3827
26. E.M. dos Santos, R. Sabourin, P. Maupin, Single and multi-objective genetic algorithms for the selection of ensemble of classifiers, in: Proceedings of the International Joint Conference on Neural Networks, 2006, pp. 3070-3077.
27. I. Partalas, G. Tsoumakas, I. Vlahavas, Focused ensemble selection: a diversity-based method for greedy ensemble selection, in: Proceeding of the 18th European Conference on Artificial Intelligence, 2008, pp. 117-121.
28. L.I. Kuncheva, J.C. Bezdek, and R.P.W. Duin Decision templates for multiple classifier fusion an experimental comparison Pattern Recognit. 34 2001 299 314
29. M. Sabourin, A. Mitiche, D. Thomas, G. Nagy, Classifier combination for handprinted digit recognition, in: Proceedings of the Second International Conference on Document Analysis and Recognition, 1993, pp. 163-166.
30. L. Didaci, G. Giacinto, F. Roli, and G.L. Marcialis A study on the performances of dynamic classifier selection based on local accuracy estimation Pattern Recognit. 38 11 2005 2188 2191
31. R.P.W. Duin, The combining classifier: to train or not to train?, in: Proceedings of the 16th International Conference on Pattern Recognition, vol. 2, 2002, pp. 765-770.
32. L. Breiman Bagging predictors Mach. Learn. 24 1996 123 140
33. M. Skurichina, and R.P.W. Duin Bagging for linear classifiers Pattern Recognit. 31 1998 909 930
34. K. Bache, M. Lichman, UCI machine learning repository (2013). URL 〈 http://archive.ics.uci.edu/ml 〉.
35. R.D. King, C. Feng, A. Sutherland, Statlog: comparison of classification algorithms on large real-world problems, 1995.
36. J. Alcalá-Fdez, A. Fernández, J. Luengo, J. Derrac, and S. García KEEL data-mining software tool data set repository, integration of algorithms and experimental analysis framework Multiple-Valued Logic Soft Comput. 17 2-3 2011 255 287
37. L. Kuncheva, Ludmila kuncheva collection (2004). URL 〈 http://pages.bangor.ac.uk/~mas00a/activities/real-data.htm 〉.
38. R.P.W. Duin, P. Juszczak, D. de Ridder, P. Paclik, E. Pekalska, D.M. Tax, Prtools, a matlab toolbox for pattern recognition, 2004. URL 〈 http://www.prtools.org 〉.
39. P.R. Cavalin, R. Sabourin, and C.Y. Suen Dynamic selection of ensembles of classifiers using contextual information Multiple Classif. Syst. (2010 145 154
40. E.M. dos Santos, R. Sabourin, Classifier ensembles optimization guided by population oracle, 2011, pp. 693-698.
41. D. Ruta, and B. Gabrys Classifier selection for majority voting Inf. Fusion 6 1 2005 63 81
42. Y. Freund, R.E. Schapire, A decision-theoretic generalization of on-line learning and an application to boosting, in: Proceedings of the Second European Conference on Computational Learning Theory, 1995, pp. 23-37.