A dynamic overproduce-and-choose strategy for the selection of classifier ensembles

Pattern Recognition

Volumn 41, Issue 10, 2008, Pages 2993-3009

  Dos Santos, Eulanda M ^a   Sabourin, Robert ^a   Maupin, Patrick ^b  

^a ÉCOLE DE TECHNOLOGIE SUPÉRIEURE   (Canada)

^b DEFENCE RESEARCH AND DEVELOPMENT CANADA   (Canada)

Author keywords

Dynamic classifier selection; Measures of confidence; Optimization; Overproduce and choose strategy

Indexed keywords

AEROSPACE APPLICATIONS; CLASSIFICATION (OF INFORMATION); CLASSIFIERS; DYNAMIC PROGRAMMING; LEARNING SYSTEMS; MECHANICS; OPTIMIZATION; POPULATION STATISTICS; SET THEORY; STATISTICAL TESTS; TESTING;

CLASSIFIER ENSEMBLES; DEGREE OF CONFIDENCE; DYNAMIC CLASSIFIER SELECTION (DCS); DYNAMIC SELECTION; ELSEVIER (CO); EXPERIMENTAL RESULTS; LEVEL SELECTION; OPTIMIZATION LEVELS; SELECTION STRATEGIES; STATIC CLASSIFIER; TEST DATA;

DYNAMICS;

EID: 45549107002     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2008.03.027     Document Type: Article

References (39)

1. Zhu X., Wu X., and Yang Y. Dynamic selection for effective mining from noisy data streams. Proceedings of Fourth IEEE International Conference on Data Mining (2004) 305-312
2. Giacinto G., and Roli F. Dynamic classifier selection based on multiple classifier behaviour. Pattern Recognition 34 9 (2001) 1879-1881
3. Woods K., Kegelmeyer W.P., and Bowyer K. Combination of multiple classifiers using local accuracy estimates. IEEE Trans. Pattern Anal. Mach. Intell. 19 4 (1997) 405-410
4. Breiman L. Bagging predictors. Mach. Learn. 24 2 (1996) 123-140
5. Freund Y., and Schapire R. Experiments with a new boosting algorithm. Proceedings of XIII International Conference on Machine Learning (1996) 148-156
6. Ho T.K. The random subspace method for constructing decision forests. IEEE Trans. Pattern Anal. Mach. Intell. 20 8 (1998) 832-844
7. Kittler J., Hatef M., Duin R.P.W., and Matas J. On combining classifiers. IEEE Trans. Pattern Anal. Mach. Intell. 20 3 (1998) 226-238
8. Shin H.W., and Sohn S.Y. Selected tree classifier combination based on both accuracy and error diversity. Pattern Recognition 38 2 (2005) 191-197
9. Partridge D., and Yates W.B. Engineering multiversion neural-net systems. Neural Comput. 8 4 (1996) 869-893
10. Sharkey A.J.C., and Sharkey N.E. The "test and select" approach to ensemble combination. Proceedings of the First International Workshop on MCS (2000) 30-44
11. Dos Santos E.M., Sabourin R., and Maupin P. Single and multi-objective genetic algorithms for the selection of ensemble of classifiers. Proceedings of International Joint Conference on Neural Networks (2006) 5377-5384
12. Zhou Z.-H., Wu J., and Tang W. Ensembling neural networks: many could be better than all. Artif. Intell. 137 1-2 (2002) 239-263
13. Ruta D., and Gabrys B. Classifier selection for majority voting. Inform. Fusion 6 1 (2005) 163-168
14. Corne D., and Knowles J. No free lunch and free leftovers theorems for multiobjective optimization problems. Proceedings of Evolutionary Multi-Criterion Optimization (2003), Faro, Portugal 327-341
15. Deb K. Multi-Objective Optimization using Evolutionary Algorithms (2001), Wiley, UK
16. Dos Santos E.M., Sabourin R., and Maupin P. Ambiguity-guided dynamic selection of ensemble of classifiers. Proceedings of International Conference on Information Fusion (2007)
17. Hansen L.K., Liisberg C., and Salomon P. The error-reject tradeoff. Open Systems Inform. Dyn. 4 2 (1997) 159-184
18. Fagundes D., and Canuto A. Applying weights in the functioning of the dynamic classifier selection method. Proceedings of Ninth Brazilian Symposium on Neural Networks (2006)
19. Singh S., and Singh M. A dynamic classifier selection and combination approach to image region labelling. Signal Process.: Image Commun. 20 (2005) 219-231
20. Shin H.W., and Sohn S.Y. Combining both ensemble and dynamic classifier selection schemes for prediction of mobile internet subscribers. Expert Syst. Appl. 25 (2003) 63-68
21. Kuncheva L.I. Cluster-and-selection model for classifier combination. Proceedings of International Conference on Knowledge Based Intelligent Engineering Systems and Allied Technologies (2000) 185-188
22. Liu R., and Yuan B. Multiple classifier combination by clustering and selection. Inform. Fusion 2 (2001) 163-168
23. Kuncheva L.I. Switching between selection and fusion in combining classifiers: an experiment. IEEE Trans. Syst. Man, Cybern-Part B 32 2 (2002) 146-156
24. Gunes V., Menard M., and Loonis P. A multiple classifier system using ambiguity rejection for clustering-classification cooperation. Uncertainty, Fuzziness and Knowledge-Based Systems 8 6 (2000) 747-762
25. Ko A., Sabourin R., and Britto Jr. A. From Dynamic Classifier Selection to Dynamic Ensemble Selection. Pattern Recognition 41 5 (2008) 1718-1731
26. Canuto A.M.P., Soares R.G.F., Santana A., and de Souto M.C.P. Using accuracy and diversity to select classifiers to build ensembles. Proceedings of International Joint Conference on Neural Networks (2006) 2289-2295
27. Margineantu D.D., and Dietterich T.G. Pruning adaptive boosting. Proceedings of the International Conference on Machine Learning (1997) 358-366
28. Kuncheva L.I., and Whitaker C.J. Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy. Mach. Learn. 51 2 (2003) 181-207
29. Zenobi G., and Cunningham P. Using diversity in preparing ensembles of classifiers based on different feature subsets to minimize generalization error. Proceedings of European Conference on Machine Learning (2001) 576-587
30. Tremblay G., Sabourin R., and Maupin P. Optimizing nearest neighbour in random subspaces using a multi-objective genetic algorithm. Proceedings of ICPR (2004) 208-211
31. Grove A.J., and Schuurmans D. Boosting in the limit: maximizing the margin of learned ensembles. Proceedings of 15th National Conference on Artificial Intelligence (1998) 692-699
32. P.J. Gother, Nist special database 19-handprited forms and characters database, National Institute of Standard and Technology-NIST: database CD documentation, 1995.
33. Oliveira L.S., Sabourin R., Bortolozzi F., and Suen C.Y. Automatic recognition of handwritten numerical strings: a recognition and verification strategy. IEEE Trans. Pattern Anal. Mach. Intell. 24 11 (2002) 1438-1454
34. Serpico S.B., Bruzzone L., and Roli F. An experimental comparison of neural and statistical non-parametric algorithms for supervised classification of remote-sensing images. Pattern Recognition Lett. 17 13 (1996) 1331-1341
35. Park Y., and Sklansky J. Automated design of linear tree classiers. Pattern Recognition 23 12 (1990) 1393-1412
36. Quinlan J.R. Programs for Machine Learning (1993), Morgan Kaufmann, Los Altos, CA
37. Didaci L., Giacinto G., Roli F., and Marcialis G.L. A study on the performances of the dynamic classifier selection based on local accuracy estimation. Pattern Recognition 28 11 (2005) 2188-2191
38. Radtke P.V.W., Sabourin R., and Wong T. Classification system optimization with multi-objective genetic algorithms. Proceedings of 10th International Workshop on Frontiers in Handwriting Recognition (2006)
39. Rheaume F., Jousselme A.-L., Grenier D., Bosse E., and Valin P. New initial basic probability assignments for multiple classifiers. Proceedings of XI Signal Processing, Sensor Fusion, and Target Recognition (2002) 319-328