Dynamic selection of classifiers - A comprehensive review

Pattern Recognition

Volumn 47, Issue 11, 2014, Pages 3665-3680

  Britto, Alceu S ^a,b   Sabourin, Robert ^c   Oliveira, Luiz E S ^d  

^a PONTIFICAL CATHOLIC UNIVERSITY OF PARANÁ   (Brazil)

^b STATE UNIVERSITY OF PONTA GROSSA   (Brazil)

^c ÉCOLE DE TECHNOLOGIE SUPÉRIEURE   (Canada)

^d FEDERAL UNIVERSITY OF PARANÁ   (Brazil)

Author keywords

Data complexity; Dynamic selection of classifiers; Ensemble of classifiers

Indexed keywords

SOFTWARE ENGINEERING;

CLASSIFICATION APPROACH; CLASSIFICATION PERFORMANCE; DATA COMPLEXITY; DYNAMIC SELECTION; ENSEMBLE OF CLASSIFIERS; LITERATURE REVIEWS; MULTIPLE CLASSIFIER SYSTEMS; PROBLEM COMPLEXITY;

PATTERN RECOGNITION;

EID: 84904400137     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2014.05.003     Document Type: Article

References (43)

1. L.K. Hansen, and P. Salamon Neural network ensembles IEEE Trans. Pattern Anal. Mach. Intell. 12 October (10) 1990 993 1001
2. T.G. Dietterich, Ensemble methods in machine learning, in: Multiple Classifier Systems, Lecture Notes in Computer Science, vol. 1857, Springer, Berlin, Heidelberg, 2000, pp. 1-15.
3. T.K. Ho, and M. Basu Complexity measures of supervised classification problems IEEE Trans. Pattern Anal. Mach. Intell. 24 2002 289 300 (Pubitemid 35289347)
4. J.S. Sanchez, R.A. Mollineda, and J.M. Sotoca An analysis of how training data complexity affects the nearest neighbor classifiers Pattern Anal. Appl. 10 July (3) 2007 189 201
5. G.D.C. Cavalcanti, T.I. Ren, B.A. Vale, Data complexity measures and nearest neighbor classifiers: a practical analysis for meta-learning, in: IEEE 24th International Conference on Tools with Artificial Intelligence (ICTAI), 2012, vol. 1, 2012, pp. 1065-1069.
6. L.I. Kuncheva, and C.J. Whitaker Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy Mach. Learn. 51 May (2) 2003 181 207
7. G. Kumar, and K. Kumar The use of artificial-intelligence-based ensembles for intrusion detection a review Appl. Comput. Int. Soft Comput. 2012 2012 1 20
8. L. Breiman Bagging predictors Mach. Learn. 24 2 1996 123 140 (Pubitemid 126724382)
9. R.E. Schapire, Y. Freund, P. Bartlett, and W.S. Lee, Boosting the margin: a new explanation for the effectiveness of voting methods, in: Proceedings of 14th International Conference on Machine Learning, Nashville, USA, 1997, pp. 322-330.
10. T.K. Ho The random subspace method for constructing decision forests IEEE Trans. Pattern Anal. Mach. Intell. 20 8 1998 832 844 (Pubitemid 128741345)
11. K. Woods, W.P. Kegelmeyer Jr, and K. Bowyer Combination of multiple classifiers using local accuracy estimates IEEE Trans. Pattern Anal. Mach. Intell. 19 4 1997 405 410 (Pubitemid 127762896)
12. M. Sabourin, A. Mitiche, D. Thomas, G. Nagy, Classifier combination for hand-printed digit recognition, in: 1993 Proceedings of the Second International Conference on Document Analysis and Recognition, 1993, pp. 163-166.
13. G. Giacinto, F. Roli, Methods for dynamic classifier selection, in: 1999 Proceedings of 10th International Conference on Image Analysis and Processing, 1999, pp. 659-664.
14. M. Kurzynski, T. Woloszynski, R. Lysiak, On two measures of classifier competence for dynamic ensemble selection - experimental comparative analysis, in: 2010 International Symposium on Communications and Information Technologies (ISCIT), 2010, pp. 1108-1113.
15. G. Giacinto, and F. Roli Dynamic classifier selection based on multiple classifier behaviour Pattern Recognit. 34 2001 1879 1881
16. A. Nabiha, F. Nadir, New dynamic ensemble of classifiers selection approach based on confusion matrix for arabic handwritten recognition, in: 2012 International Conference on Multimedia Computing and Systems (ICMCS), 2012, pp. 308-313.
17. P.R. Cavalin, R. Sabourin, and C.Y. Suen Dynamic selection approaches for multiple classifier systems Neural Comput. Appl. 22 3-4 2013 673 688
18. L.I. Kuncheva, and J.J. Rodriguez Classifier ensembles with a random linear oracle IEEE Trans. Knowl. Data Eng. 19 4 2007 500 508
19. A.H.R. Ko, R. Sabourin, and A.S. Britto Jr. From dynamic classifier selection to dynamic ensemble selection Pattern Recognit. 41 5 2008 1718 1731
20. H.W. Shin, and S.Y. Sohn Combining both ensemble and dynamic classifier selection schemes for prediction of mobile internet subscribers Expert Syst. Appl. 25 1 2003 63 68
21. A. Santana, R.G.F. Soares, A.M.P. Canuto, M.C.P. de Souto, A dynamic classifier selection method to build ensembles using accuracy and diversity, in: 2006 Ninth Brazilian Symposium on Neural Networks, SBRN '06, 2006, pp. 36-41.
22. R. Lysiak, M. Kurzynski, and T. Woloszynski Probabilistic approach to the dynamic ensemble selection using measures of competence and diversity of base classifiers Emilio Corchado, Marek Kurzynski, Michal Wozniak, Hybrid Artificial Intelligent Systems, Lecture Notes in Computer Science vol. 6679 2011 Springer Berlin, Heidelberg 229 236
23. T.K. Ho, J.J. Hull, and S.N. Srihari Decision combination in multiple classifier systems IEEE Trans. Pattern Anal. Mach. Intell. 16 1 1994 66 75
24. E.M. dos Santos, R. Sabourin, and P. Maupin A dynamic overproduce-and-choose strategy for the selection of classifier ensembles Pattern Recognit. 41 October (10) 2008 2993 3009
25. J. Xiao, C. He, Dynamic classifier ensemble selection based on GMDH, in: 2009 International Joint Conference on Computational Sciences and Optimization, CSO 2009, vol. 1, 2009, pp. 731-734.
26. A.K. Jain, R.P.W. Duin, and J. Mao Statistical pattern recognition a review IEEE Trans. Pattern Anal. Mach. Intell. 22 1 2000 4 37
27. J. Kittler, M. Hatef, R.P.W. Duin, and J. Matas On combining classifiers IEEE Trans. Pattern Anal. Mach. Intell. 20 1998 226 239 (Pubitemid 128741312)
28. R.A. Jacobs, M.I. Jordan, S.J. Nowlan, and G.E. Hinton Adaptative mixtures of local experts Neural Comput. 3 1 1991 79 87
29. Jacobs Robert A Bias/variance analyses of mixtures-of-experts architectures Neural Comput. 9 February (2) 1997 369 383
30. L. Kuncheva Combining Pattern Classifiers, Methods and Algorithms 2004 Wiley New York
31. L.A. Rastrigin, R.H. Erenstein, Method of collective recognition, Energoizdat, 1981 (in Russian).
32. T. Woloszynski, and M. Kurzynski A probabilistic model of classifier competence for dynamic ensemble selection Pattern Recognit. 44 2011 2656 2668 (Semi-Supervised Learning for Visual Content Analysis and Understanding)
33. Y.S. Huang, and C.Y. Suen A method of combining multiple experts for the recognition of unconstrained handwritten numerals IEEE Trans. Pattern Anal. Mach. Intell. 17 1 1995 90 94
34. P.R. Cavalin, R. Sabourin, C.Y. Suen, Dynamic selection of ensembles of classifiers using contextual information, in: Proceedings of the 9th International Conference on Multiple Classifier Systems, Springer-Verlag, Berlin, Heidelberg, 2010, MCS'10, pp. 145-154.
35. E.M. dos Santos, R. Sabourin, P. Maupin, Ambiguity-guided dynamic selection of ensemble of classifiers, in: 2007 10th International Conference on Information Fusion, 2007, pp. 1-8.
36. A.G. Ivakhnenko Heuristic self-organization in problems of engineering cybernetics Automatica 6 2 1970 207 219
37. P.C. Smits Multiple classifier systems for supervised remote sensing image classification based on dynamic classifier selection IEEE Trans. Geosci. Remote Sens. 40 4 2002 801 813 (Pubitemid 34741654)
38. L.I. Kuncheva Switching between selection and fusion in combining classifiers an experiment Trans. Syst. Man Cybern. Part B 32 April (2) 2002 146 156 (Pubitemid 34249373)
39. J. Xiao, L. Xie, C. He, and X. Jiang Dynamic classifier ensemble model for customer classification with imbalanced class distribution Expert Syst. Appl. 39 February (3) 2012 3668 3675
40. L. Batista, E. Granger, and R. Sabourin Dynamic selection of generative-discriminative ensembles for off-line signature verification Pattern Recognit. 45 April (4) 2012 1326 1340
41. D.H. Wolpert The lack of a priori distinctions between learning algorithms Neural Comput. 8 October (7) 1996 1341 1390 (Pubitemid 126449973)
42. G. Giacinto, and F. Roli Adaptive selection of image classifiers Alberto Bimbo, Image Analysis and Processing, Lecture Notes in Computer Science vol. 1310 1997 Springer Berlin, Heidelberg 38 45 (Pubitemid 127124594)
43. N. Japkowicz, and M. Shah Evaluating Learning Algorithms: A Classification Perspective 2011 Cambridge University Press New York, NY, USA