From dynamic classifier selection to dynamic ensemble selection

Pattern Recognition

Volumn 41, Issue 5, 2008, Pages 1718-1731

  Ko, Albert H R ^a   Sabourin, Robert ^a   Britto, Jr , Alceu Souza ^b  

^a ÉCOLE DE TECHNOLOGIE SUPÉRIEURE   (Canada)

^b PONTIFICAL CATHOLIC UNIVERSITY OF PARANÁ   (Brazil)

Author keywords

Classifier selection; Combining classifiers; Ensemble of learning machines; Ensemble selection; Majority voting; Oracle; Pattern recognition

Indexed keywords

CHARACTER SETS; CLASSIFICATION (OF INFORMATION); LEARNING SYSTEMS;

COMBINING CLASSIFIERS; DYNAMIC SELECTION SCHEMES; ENSEMBLE OF LEARNING MACHINES; ENSEMBLE SELECTION; MAJORITY VOTING; MULTIPLE CLASSIFIER SYSTEMS;

PATTERN RECOGNITION;

EID: 38349135448     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2007.10.015     Document Type: Article

References (22)

1. Brown G., Wyatt J., Harris R., and Yao X. Diversity creation methods: a survey and categorisation. Int. J. Inf. Fusion 6 1 (2005) 5-20
2. Kittler J., Hatef M., Duin R., and Matas J. On combining classifiers. IEEE Trans. Pattern Anal. Mach. Intell. 20 3 (1998) 226-239
3. Kuncheva L.I., and Whitaker C.J. Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy. Mach. Learn. 51 2 (2003) 181-207
4. Ho T.K. The random space method for constructing decision forests. IEEE Trans. Pattern Anal. Mach. Intell. 20 8 (1998) 832-844
5. A. Grove, D. Schuurmans, Boosting in the limit: maximizing the margin of learned ensembles, in: Proceedings of the 15th National Conference on Artificial Intelligence, 1998, pp. 692-699.
6. Kuncheva L.I., Skurichina M., and Duin R.P.W. An experimental study on diversity for Bagging and Boosting with linear classifiers. Int. J. Inf. Fusion 3 2 (2002) 245-258
7. Schapire R.E., Freund Y., Bartlett P., and Lee W.S. Boosting the margin: a new explanation for the effectiveness of voting methods. Ann. Stat. 26 5 (1998) 1651-1686
8. D. Ruta, B. Gabrys, Classifier selection for majority voting, Int. J. Inf. Fusion (2005) 63-81.
9. Cao J., Ahmadi M., and Shridhar M. Recognition of handwritten numerals with multiple feature and multistage classifier. Pattern Recognition 28 2 (1995) 153-160
10. Didaci L., Giacinto G., Roli F., and Marcialis G.L. A study on the performances of dynamic classifier selection based on local accuracy estimation. Pattern Recognition 38 11 (2005) 2188-2191
11. L. Didaci, G. Giacinto, Dynamic classifier selection by adaptive K-nearest-neighbourhood rule, International Workshop on Multiple Classifier Systems (MCS 2004), 2004, pp. 174-183.
12. G. Giacinto, F. Roli, Methods for dynamic classifier selection, International Conference on Image Analysis and Processing (ICIAP 1999), 1999, pp. 659-664.
13. Gunes V., Ménard M., Loonis P., and Petit-Renaud S. Combination, cooperation and selection of classifiers: a state of the art. Int. J. Pattern Recognition Artif. Intell. 17 8 (2003) 1303-1324
14. Kuncheva L.I. Switching between selection and fusion in combining classifiers: an experiment. IEEE Trans. Syst. Man Cybern. Part B 32 2 (2002) 146-156
15. Woods K., Kegelmeyer Jr. W.P., and Bowyer K. Combination of multiple classifiers using local accuracy estimates. IEEE Trans. Pattern Anal. Mach. Intell. 19 4 (1997) 405-410
16. R.P.W. Duin, Pattern Recognition Toolbox for Matlab 5.0+, available free at: 〈ftp://ftp.ph.tn.tudelft.nl/pub/bob/prtools〉.
17. D. Whitley, Functions as permutations: regarding no free lunch, Walsh analysis and summary statistics, Parallel Problem Solving from Nature (PPSN 2000), 2000, pp. 169-178.
18. D.H. Wolpert, W.G. Macready, No free lunch theorems for search, IEEE Trans. Evol. Comput. 1 (1) (1997) 67-82.
19. G. Tremblay, R. Sabourin, P. Maupin, Optimizing nearest neighbour in Random Subspaces using a multi-objective genetic algorithm, in: Proceedings of the 17th International Conference on Pattern Recognition (ICPR 2004), 2004, pp. 208-211.
20. P. Radtke, T. Wong, R. Sabourin, An evaluation of over-fit control strategies for multi-objective evolutionary optimization, IEEE World Congress on Computational Intelligence (WCCI 2006)-International Joint Conference on Neural Networks (IJCNN 2006), 2006.
21. Oliveira L.S., Sabourin R., Bortolozzi F., and Suen C.Y. Automatic recognition of handwritten numerical strings: a recognition and verification strategy. IEEE Trans. Pattern Anal. Mach. Intell. 24 11 (2002) 1438-1454
22. J. Milgram, M. Cheriet, R. Sabourin, Estimating accurate multi-class probabilities with support vector machines, International Joint Conference on Neural Networks (IJCNN 05), 2005, pp. 1906-1911.