Constructing a multi-class classifier using one-against-one approach with different binary classifiers

Neurocomputing

Volumn 149, Issue PB, 2015, Pages 677-682

  Kang, Seokho ^a   Cho, Sungzoon ^a   Kang, Pilsung ^b  

^a Seoul National University   (South Korea)

^b Seoul National University of Science and Technology   (South Korea)

Author keywords

Diversified one against one; Ensemble; Multi class classification; One against one

Indexed keywords

CLASSIFIERS; LEARNING SYSTEMS;

CLASSIFICATION ALGORITHM; CLASSIFICATION RESULTS; DIVERSIFIED ONE-AGAINST-ONE; ENSEMBLE; MULTI-CLASS CLASSIFICATION; MULTI-CLASS CLASSIFIER; MULTICLASS CLASSIFICATION PROBLEMS; ONE-AGAINST-ONE;

CLASSIFICATION (OF INFORMATION);

ACCURACY; ARTICLE; ARTIFICIAL NEURAL NETWORK; BINARY CLASSIFIER; CLASSIFICATION; CLASSIFICATION ALGORITHM; CLASSIFIER; DISCRIMINANT ANALYSIS; K NEAREST NEIGHBOR; LOGISTIC REGRESSION ANALYSIS; ONE AGAINST ONE CLASSIFIER; SUPPORT VECTOR MACHINE;

EID: 84922450521     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2014.08.006     Document Type: Article

References (27)

1. Galar M., Fernández A., Barrenechea E., Bustince H., Herrera F. An overview of ensemble methods for binary classifiers in multi-class problems. experimental study on one-vs-one and one-vs-all schemes. Pattern Recognit. 2011, 44:1761-1776.
2. Polat K., Güneş S. A novel hybrid intelligent method based on C4.5 decision tree classifier and one-against-all approach for multi-class classification problems. Expert Syst. Appl. 2009, 36:1587-1592.
3. Fürnkranz J. Round robin classification. J. Mach. Learn. Res. 2002, 2:721-747.
4. Knerr S., Personnaz L., Dreyfus G. Single-layer learning revisited. a stepwise procedure for building and training a neural network. Neurocomputing: Algorithms, Architectures and Applications, NATO ASI Series 1990, vol. 68:41-50. Springer-Verlag, Berlin Heidelberg.
5. Rokach L. Ensemble-based classifiers. Artif. Intell. Rev. 2010, 33:1-39.
6. Hsu C.-W., Lin C.-J. A comparison of methods for multiclass support vector machines. IEEE Trans. Neural Netw. 2002, 13:415-425.
7. Duan K.-B., Keerthi S. Which is the best multiclass SVM method? An empirical study. Multiple Classifier Systems, Lecture Notes in Computer Science 2005, vol. 3541:278-285. Springer, Berlin, Heidelberg.
8. Galar M., Fernández A., Barrenechea E., Bustince H., Herrera F. Dynamic classifier selection for one-vs-one strategy. avoiding non-competent classifiers. Pattern Recognit. 2013, 46:3412-3424.
9. Lorena, Carolina Ana, de Carvalho, André C.P.L.F., Gama, João M.P. A review on the combination of binary classifiers in multiclass problems. Artif. Intell. Rev. 2008, 30:19-37.
10. Xu L., Krzyzak A., Suen C. Methods of combining multiple classifiers and their applications to handwriting recognition. IEEE Trans. Syst. Man Cybern. 1992, 22:418-435.
11. Ho T.K., Hull J., Srihari S. Decision combination in multiple classifier systems. IEEE Trans. Pattern Anal. Mach. Intell. 1994, 16:66-75.
12. Kittler J., Hatef M., Duin R.P.W., Matas J. On combining classifiers. IEEE Trans. Pattern Anal. Mach. Intell. 1998, 20:226-239.
13. Lysiak R., Kurzynski M., Woloszynski T. Optimal selection of ensemble classifiers using measures of competence and diversity of base classifiers. Neurocomputing 2014, 126:29-35.
14. Sohn S.Y. Meta analysis of classification algorithms for pattern recognition. IEEE Trans. Pattern Anal. Mach. Intell. 1999, 21:1137-1144.
15. Lim T.-S., Loh W.-Y., Shih Y.-S. A comparison of prediction accuracy, complexity, and training time of thirty-three old and new classification algorithms. Mach. Learn. 2000, 40:203-228.
16. Kiang M.Y. A comparative assessment of classification methods. Decis. Support Syst. 2003, 35:441-454.
17. Woods K., Kegelmeyer W.P., Bowyer K. Combination of multiple classifiers using local accuracy estimates. IEEE Trans. Pattern Anal. Mach. Intell. 1997, 19:405-410.
18. Cavalin P., Sabourin R., Suen C. Dynamic selection approaches for multiple classifier systems. Neural Comput. Appl. 2013, 22:673-688.
19. Kuncheva L. Switching between selection and fusion in combining classifiers. an experiment. IEEE Trans. Syst. Man Cybern. Part B: Cybern. 2002, 32:146-156.
20. K. Bache, M. Lichman, UCI Machine Learning Repository, 2014.
21. Bishop C.M., Nasrabadi N.M. Pattern Recognition and Machine Learning 2006, Springer, New York.
22. Wu X., Kumar V., Ross Quinlan J., Ghosh J., Yang Q., Motoda H., McLachlan G., Ng A., Liu B., Yu P., Zhou Z.-H., Steinbach M., Hand D., Steinberg D. Top 10 algorithms in data mining. Knowl. Inform. Syst. 2008, 14:1-37.
23. Hastie T., Tibshirani R., Friedman J. The Elements of Statistical Learning. Data Mining, Inference, and Prediction 2009, Springer, New York. second ed.
24. Demšar J. Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 2006, 7:1-30.
25. García S., Herrera F. An extension on statistical comparisons of classifiers over multiple data sets for all pairwise comparisons. J. Mach. Learn. Res. 2008, 9:2677-2694.
26. García S., Fernández A., Luengo J., Herrera F. A study of statistical techniques and performance measures for genetics-based machine learning. accuracy and interpretability. Soft Comput. 2009, 13:959-977.
27. García S., Fernández A., Luengo J., Herrera F. Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining. experimental analysis of power. Inf. Sci. 2010, 180:2044-2064.