Dynamic classifier selection for One-vs-One strategy: Avoiding non-competent classifiers

Pattern Recognition

Volumn 46, Issue 12, 2013, Pages 3412-3424

  Galar, Mikel ^a   Fernández, Alberto ^b   Barrenechea, Edurne ^a   Bustince, Humberto ^a   Herrera, Francisco ^c  

^a PUBLIC UNIVERSITY OF NAVARRE   (Spain)

^b UNIVERSITY OF JAÉN   (Spain)

^c UNIVERSITY OF GRANADA   (Spain)

Author keywords

Classifier selection; Decomposition strategies; Ensembles; Multi classification; One vs One; Pairwise learning

Indexed keywords

CLASSIFIER SELECTION; DECOMPOSITION STRATEGY; ENSEMBLES; MULTI-CLASSIFICATION; ONE VS ONES; PAIRWISE LEARNING;

LEARNING SYSTEMS;

PROBLEM SOLVING;

EID: 84881076155     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2013.04.018     Document Type: Article

References (61)

1. D.W. Aha, D. Kibler, and M.K. Albert Instance-based learning algorithms Machine Learning 6 1991 37 66
2. J. Alcalá-Fdez, A. Fernández, J. Luengo, J. Derrac, S. García, L. Sánchez, and F. Herrera KEEL data-mining software tool data set repository, integration of algorithms and experimental analysis framework Journal of Multiple-Valued Logic and Soft Computing 17 2010 255 287
3. J. Alcalá-Fdez, L. Sánchez, S. García, M.J. del Jesus, S. Ventura, J.M. Garrell, J. Otero, C. Romero, J. Bacardit, V.M. Rivas, J. Fernández, and F. Herrera KEEL a software tool to assess evolutionary algorithms for data mining problems Soft Computing 13 3 2008 307 318
4. E.L. Allwein, R.E. Schapire, and Y. Singer Reducing multi-class to binary a unifying approach for margin classifiers Journal of Machine Learning Research 1 2000 113 141
5. R. Avnimelech, and N. Intrator Boosted mixture of experts an ensemble learning scheme Neural Computation 11 2 1999 483 497
6. L. Batista, E. Granger, R. Sabourin, Dynamic selection of generative-discriminative ensembles for off-line signature verification, Pattern Recognition 45 (4), 1326-1340, 10.1016/j.patcog.2011.10.011.
7. V. Bolón-Canedo, N.S.-M. no, and A. Alonso-Betanzos An ensemble of filters and classifiers for microarray data classification Pattern Recognition 45 1 2012 531 539
8. A.M.P. Canuto, M.C.C. Abreu, L. de Melo Oliveira, J.C. Xavier Jr., and A.d.M. Santos Investigating the influence of the choice of the ensemble members in accuracy and diversity of selection-based and fusion-based methods for ensembles Pattern Recognition Letters 28 4 2007 472 486
9. P.R. Cavalin, R. Sabourin, and C.Y. Suen LoGID an adaptive framework combining local and global incremental learning for dynamic selection of ensembles of HMMs Pattern Recognition 45 9 2012 3544 3556
10. C.-C. Chang, and C.-J. Lin LIBSVM a library for support vector machines ACM Transactions on Intelligent Systems and Technology 2 2011 pp. 27:1-27:27. Available at http://www.csie.ntu.edu.tw/~cjlin/libsvm.
11. Y. Chen, and J.Z. Wang Support vector learning for fuzzy rule-based classification systems IEEE Transactions Fuzzy Systems 11 6 2003 716 728
12. P. Clark, R. Boswell, Rule induction with CN2: some recent improvements, in: EWSL'91: Proceedings of the European Working Session on Machine Learning, Springer-Verlag, London, UK, 1991.
13. J. Cohen A coefficient of agreement for nominal scales Educational and Psychological Measurement 20 1 1960 37 46
14. W.W. Cohen, Fast effective rule induction, in: ICML'95: Proceedings of the Twelfth International Conference on Machine Learning, 1995.
15. J. Demšar Statistical comparisons of classifiers over multiple data sets Journal of Machine Learning Research 7 2006 1 30
16. L. Didaci, G. Giacinto, F. Roli, and G. Marcialis A study on the performances of dynamic classifier selection based on local accuracy estimation Pattern Recognition 38 11 2005 2188 2191
17. T.G. Dietterich, and G. Bakiri Solving multi-class learning problems via error-correcting output codes Journal of Artificial Intelligence Research 2 1995 263 286
18. E. Dos Santos, R. Sabourin, and P. Maupin A dynamic overproduce-and- choose strategy for the selection of classifier ensembles Pattern Recognition 41 10 2008 2993 3009
19. E.M. Dos Santos, R. Sabourin, and P. Maupin A dynamic overproduce-and-choose strategy for the selection of classifier ensembles Pattern Recognition 41 10 2008 2993 3009
20. R.O. Duda, P.E. Hart, and D.G. Stork Pattern Classification 2nd edition 2001 John Wiley
21. A. Fernández, M. Calderón, E. Barrenechea, H. Bustince, and F. Herrera Solving multi-class problems with linguistic fuzzy rule based classification systems based on pairwise learning and preference relations Fuzzy Sets and Systems 161 23 2010 3064 3080
22. J.H. Friedman, Another Approach to Polychotomous Classification, Technical Report, Department of Statistics, Stanford University, 1996. URL http://www-stat.stanford.edu/~jhf/ftp/poly.ps.Z.
23. J. Fürnkranz Round robin classification Journal of Machine Learning Research 2 2002 721 747
24. M. Galar, A. Fernández, E. Barrenechea, H. Bustince, F. Herrera, Aggregation Schemes for Binarization Techniques Methods' Description, Technical Report, Research Group on Soft Computing and Intelligent Information Systems, 2011. URL http://sci2s.ugr.es/ovo-ova/AggregationMethodsDescription.pdf.
25. M. Galar, A. Fernández, E. Barrenechea, H. Bustince, and F. Herrera An overview of ensemble methods for binary classifiers in multi-class problems experimental study on one-vs-one and one-vs-all schemes Pattern Recognition 44 8 2011 1761 1776
26. M. Galar, A. Fernández, E. Barrenechea, H. Bustince, and F. Herrera A review on ensembles for the class imbalance problem bagging-, boosting-, and hybrid-based approaches IEEE Transactions on Systems, Man, and Cybernetics. Part C. Applications and Reviews 42 4 2012 463 484
27. S. García, J. Derrac, J. Cano, and F. Herrera Prototype selection for nearest neighbor classification taxonomy and empirical study IEEE Transactions on Pattern Analysis and Machine Intelligence 34 3 2012 417 435
28. S. García, and F. Herrera An extension on "statistical comparisons of classifiers over multiple data sets" for all pairwise comparisons Journal of Machine Learning Research 9 2008 2677 2694
29. N. Garcia-Pedrajas, and D. Ortiz-Boyer Improving multi-class pattern recognition by the combination of two strategies IEEE Transactions on Pattern Analysis and Machine Intelligence 28 6 2006 1001 1006
30. V. Gunes, M. Ménard, P. Loonis, and S. Petit-Renaud Combination cooperation and selection of classifiers a state of the art International Journal of Pattern Recognition and Artificial Intelligence 17 8 2003 1303 1324
31. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I.H. Witten The weka data mining software an update SIGKDD Explorations Newsletter 11 2009 10 18
32. T. Hastie, and R. Tibshirani Classification by pairwise coupling Annals of Statistics 26 2 1998 451 471
33. J.H. Hong, J.K. Min, U.K. Cho, and S.B. Cho Fingerprint classification using one-vs-all support vector machines dynamically ordered with naïve bayes classifiers Pattern Recognition 41 2 2008 662 671
34. C.W. Hsu, and C.J. Lin A comparison of methods for multi-class support vector machines IEEE Transactions on Neural Networks 13 2 2002 415 425
35. E. Hüllermeier, and S. Vanderlooy Combining predictions in pairwise classification an optimal adaptive voting strategy and its relation to weighted voting Pattern Recognition 43 1 2010 128 142
36. N.M. Khan, R. Ksantini, I.S. Ahmad, and B. Boufama A novel svm+nda model for classification with an application to face recognition Pattern Recognition 45 1 2012 66 79
37. S. Knerr, L. Personnaz, and G. Dreyfus Single-layer learning revisited a stepwise procedure for building and training a neural network F. Fogelman Soulié, J. Hérault, Neurocomputing Algorithms, Architectures and Applications, NATO ASI Series, vol. F68 1990 Springer-Verlag 41 50
38. A. Ko, R. Sabourin, and A. Britto Jr. From dynamic classifier selection to dynamic ensemble selection Pattern Recognition 41 5 2008 1735 1748
39. A.H.R. Ko, R. Sabourin, and A.S. Britto Jr. From dynamic classifier selection to dynamic ensemble selection Pattern Recognition 41 5 2008 1718 1731
40. L.I. Kuncheva Switching between selection and fusion in combining classifiers an experiment IEEE Transactions on Systems, Man, and Cybernetics. Part B. Cybernetics 32 2 2002 146 156
41. L.I. Kuncheva Combining Pattern Classifiers Methods and Algorithms 2004 Wiley-Interscience
42. B. Liu, Z. Hao, and E.C.C. Tsang Nesting one-against-one algorithm based on SVMs for pattern classification IEEE Transactions on Neural Networks 19 12 2008 2044 2052
43. R. Liu, and B. Yuan Multiple classifiers combination by clustering and selection Information Fusion 2 3 2001 163 168
44. A.C. Lorena, A.C. Carvalho, and J.M. Gama A review on the combination of binary classifiers in multi-class problems Artificial Intelligence Review 30 1-4 2008 19 37
45. J.G. Moreno-Torres, T. Raeder, R. Alaiz-Rodríguez, N.V. Chawla, and F. Herrera A unifying view on dataset shift in classification Pattern Recognition 45 1 2012 521 530
46. J.G. Moreno-Torres, J.A. Saez, and F. Herrera Study on the impact of partition-induced dataset shift on k-fold cross-validation IEEE Transactions on Neural Networks and Learning Systems 23 8 2012 1304 1312
47. X.-X. Niu, and C.Y. Suen A novel hybrid CNN-SVM classifier for recognizing handwritten digits Pattern Recognition 45 4 2012 1318 1325
48. J.C. Platt Fast Training of Support Vector Machines using Sequential Minimal Optimization 1999 MIT Press Cambridge, MA, USA
49. O. Pujol, S. Escalera, and P. Radeva An incremental node embedding technique for error correcting output codes Pattern Recognition 41 2 2008 713 725
50. J.R. Quinlan C4.5 Programs for Machine Learning 1st edition 1993 Morgan Kaufmann Publishers San Mateo-California
51. J. Quionero-Candela, M. Sugiyama, A. Schwaighofer, and N.D. Lawrence Dataset Shift in Machine Learning 2009 The MIT Press
52. R. Rifkin, and A. Klautau In defense of one-vs-all classification Journal of Machine Learning Research 5 2004 101 141
53. L. Rokach Ensemble-based classifiers Artificial Intelligence Review 33 2010 1 39
54. H. Shin, and S. Sohn Selected tree classifier combination based on both accuracy and error diversity Pattern Recognition 38 2 2005 191 197
55. V. Vapnik Statistical Learning Theory 1998 John Wiley New York
56. A. Verikas, A. Lipnickas, K. Malmqvist, M. Bacauskiene, and A. Gelzinis Soft combination of neural classifiers a comparative study Pattern Recognition Letters 20 4 1999 429 444
57. F. Wilcoxon Individual comparisons by ranking methods Biometrics Bulletin 1 6 1945 80 83
58. T. Woloszynski, and M. Kurzynski A probabilistic model of classifier competence for dynamic ensemble selection Pattern Recognition 44 10-11 2011 2656 2668
59. K. Woods, W. Philip Kegelmeyer, and K. Bowyer Combination of multiple classifiers using local accuracy estimates IEEE Transactions on Pattern Analysis and Machine Intelligence 19 4 1997 405 410
60. T.F. Wu, C.J. Lin, and R.C. Weng Probability estimates for multi-class classification by pairwise coupling Journal of Machine Learning Research 5 2004 975 1005
61. J.D. Zhou, X.D. Wang, H.J. Zhou, J.M. Zhang, and N. Jia Decoding design based on posterior probabilities in ternary error-correcting output codes Pattern Recognition 45 4 2012 1802 1818