Optimal construction of one-against-one classifier based on meta-learning

Neurocomputing

Volumn 167, Issue , 2015, Pages 459-466

  Kang, Seokho ^a   Cho, Sungzoon ^a  

^a Seoul National University   (South Korea)

Author keywords

Diversified one against one; Meta learning; Multi class classification; Multiple classifier system; One against one; Optimally diversified one against one

Indexed keywords

CLASSIFIERS; LEARNING SYSTEMS;

DIVERSIFIED ONE-AGAINST-ONE; METALEARNING; MULTI-CLASS CLASSIFICATION; MULTIPLE CLASSIFIER SYSTEMS; ONE-AGAINST-ONE; OPTIMALLY DIVERSIFIED ONE-AGAINST-ONE;

CLASSIFICATION (OF INFORMATION);

ACCURACY; ARTICLE; ARTIFICIAL NEURAL NETWORK; CLASSIFICATION ALGORITHM; CLASSIFIER; DATA ANALYSIS; DECISION TREE; EXPERIMENTAL DESIGN; K NEAREST NEIGHBOR; LINEAR SYSTEM; MATHEMATICAL ANALYSIS; MATHEMATICAL MODEL; PRIORITY JOURNAL;

EID: 84952631941     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2015.04.048     Document Type: Article

References (50)

1. Xu L., Krzyzak A., Suen C.Y. Methods of combining multiple classifiers and their applications to handwriting recognition. IEEE Trans. Syst. Man Cybern. 1992, 22:418-435.
2. Ho T.K., Hull J.J., Srihari S.N. Decision combination in multiple classifier systems. IEEE Trans. Pattern Anal. Mach. Intell. 1994, 16:66-75.
3. Kittler J., Hatef M., Duin R.P.W., Matas J. On combining classifiers. IEEE Trans. Pattern Anal. Mach. Intell. 1998, 20:226-239.
4. Rokach L. Ensemble-based classifiers. Artif. Intell. Rev. 2010, 33:1-39.
5. Woźniak M., Graña M., Corchado E. A survey of multiple classifier systems as hybrid systems. Inf. Fusion 2014, 16:3-17.
6. T.G. Dietterich, Ensemble methods in machine learning, in: Multiple Classifier Systems, in: Lecture Notes in Computer Science, vol. 1857, Springer, Berlin, Heidelberg, 2000, pp. 1-15.
7. Lorena A.C., de Carvalho A.C.P.L.F., Gama J.M.P. A review on the combination of binary classifiers in multiclass problems. Artif. Intell. Rev. 2008, 30:19-37.
8. Galar M., Fernández A., Barrenechea E., Bustince H., Herrera F. An overview of ensemble methods for binary classifiers in multi-class problems. experimental study on one-vs-one and one-vs-all schemes. Pattern Recognit. 2011, 44:1761-1776.
9. Hsu C.-W., Lin C.-J. A comparison of methods for multiclass support vector machines. IEEE Trans. Neural Netw. 2002, 13:415-425.
10. Fürnkranz J. Round robin classification. J. Mach. Learn. Res. 2002, 2:721-747.
11. Knerr S., Personnaz L., Dreyfus G. Single-layer learning revisited: a stepwise procedure for building and training a neural network. Neurocomputing: Algorithms, Architectures and Applications, NATO ASI Series 1990, vol. 68:41-50. Springer, Berlin, Heidelberg. 10.1007/978-3-642-76153-9_5.
12. Polat K., Güneş S. A novel hybrid intelligent method based on C4.5 decision tree classifier and one-against-all approach for multi-class classification problems. Expert Syst. Appl. 2009, 36:1587-1592.
13. Kang S., Cho S., Kang P. Constructing a multi-class classifier using one-against-one approach with different binary classifiers. Neurocomputing 2015, 149:677-682.
14. D.H. Wolpert, The supervised learning no-free-lunch theorems, in: Proceedings of the 6th Online World Conference on Soft Computing in Industrial Applications, 2001, pp. 25-42.
15. Sohn S.Y. Meta analysis of classification algorithms for pattern recognition. IEEE Trans. Pattern Anal. Mach. Intell. 1999, 21:1137-1144.
16. Lim T.-S., Loh W.-Y., Shih Y.-S. A comparison of prediction accuracy, complexity, and training time of thirty-three old and new classification algorithms. Mach. Learn. 2000, 40:203-228.
17. Kiang M.Y. A comparative assessment of classification methods. Decis. Support Syst. 2003, 35:441-454.
18. Cawley G.C., Talbot N.L.C. On over-fitting in model selection and subsequent selection bias in performance evaluation. J. Mach. Learn. Res. 2010, 11:2079-2107.
19. Giacinto G., Roli F. An approach to the automatic design of multiple classifier systems. Pattern Recognit. Lett. 2001, 22:25-33.
20. Tsoumakas G., Angelis L., Vlahavas I. Selective fusion of heterogeneous classifiers. Intell. Data Anal. 2005, 9:511-525.
21. Wolpert D.H. Stacked generalization. Neural Netw. 1992, 5:241-259.
22. P. Juszczak, R.P.W. Duin, Combining one-class classifiers to classify missing data, in: F. Roli, J. Kittler, T. Windeatt (Eds.), Multiple Classifier Systems, Lecture Notes in Computer Science, vol. 3077, Springer, Berlin, Heidelberg, 2004, pp. 92-101. doi:10.1007/978-3-540-25966-4_9.
23. T. Ban, S. Abe, Implementing multi-class classifiers by one-class classification methods, in: Proceedings of the International Joint Conference on Neural Networks, IEEE, 2006, pp. 327-332.
24. Tax D.M.J., Duin R.P.W. Growing a multi-class classifier with a reject option. Pattern Recognit. Lett. 2008, 29:1565-1570.
25. Krawczyk B., Woźniak M., Cyganek B. Clustering-based ensembles for one-class classification. Inf. Sci. 2014, 264:182-195.
26. Cyganek B. One-class support vector ensembles for image segmentation and classification. J. Math. Imaging Vis. 2012, 42:103-117.
27. Sharma S., Bellinger C., Japkowicz N. Clustering based one-class classification for compliance verification of the comprehensive nuclear-test-ban treaty. Advances in artificial intelligence, Lecture Notes in Computer Science 2012, vol. 7310:181-193. Springer, Berlin, Heidelberg. 10.1007/978-3-642-30353-1_16.
28. Kuncheva L.I. Switching between selection and fusion in combining classifiers. an experiment. IEEE Trans. Syst. Man Cybern. Part B-Cybern. 2002, 32:146-156.
29. Kuncheva L.I., Whitaker C.J., Shipp C.A., Duin R.P.W. Limits on the majority vote accuracy in classifier fusion. Pattern Anal. Appl. 2003, 6:22-31.
30. Wozniak M., Jackowski K. Some remarks on chosen methods of classifier fusion based on weighted voting. Hybrid Artificial Intelligence Systems, Lecture Notes in Computer Science 2009, vol. 5572:541-548. Springer. 10.1007/978-3-642-02319-4_65.
31. Vilalta R., Drissi Y. A perspective view and survey of meta-learning. Artif. Intell. Rev. 2002, 18:77-95.
32. Džeroski S., Ženko B. Is combining classifiers with stacking better than selecting the best one?. Mach. Learn. 2004, 54:255-273.
33. Ting K.M., Witten I.H. Issues in stacked generalization. J. Artif. Intell. Res. 1999, 10:271-289.
34. Merz C.J. Using correspondence analysis to combine classifiers. Mach. Learn. 1999, 36:33-58.
35. Todorovski L., Džeroski S. Combining classifiers with meta decision trees. Mach. Learn. 2003, 50:223-249.
36. A.K. Seewald, How to make stacking better and faster while also taking care of an unknown weakness, in: Proceedings of the 19th International Conference on Machine Learning, 2002, pp. 554-561.
37. Kim H.-C., Pang S., Je H.-M., Kim D., Bang S.Y. Constructing support vector machine ensemble. Pattern Recognit. 2003, 36:2757-2767.
38. P. Savicky, J. Fürnkranz, Combining pairwise classifiers with stacking, in: Advances in Intelligent Data Analysis, Lecture Notes in Computer Science, vol. 2810, Springer, Berlin, Heidelberg, 2003, pp. 219-229.
39. Lézoray O., Cardot H. Comparing combination rules of pairwise neural networks classifiers. Neural Process. Lett. 2008, 27:43-56.
40. Menahem E., Rokach L., Elovici Y. Troika-an improved stacking schema for classification tasks. Inf. Sci. 2009, 179:4097-4122.
41. Kang S., Cho S. Approximating support vector machine with artificial neural network for fast prediction. Expert Syst. Appl. 2014, 41:4989-4995.
42. Giraud-Carrier C. A note on the utility of incremental learning. AI Commun. 2000, 13:215-223.
43. Bache K., Lichman M. UCI Machine Learning Repository 2014, URL: 〈http://archive.ics.uci.edu/ml.
44. Bishop C.M., Nasrabadi N.M. Pattern Recognition and Machine Learning 2006, Springer, New York.
45. Wu X., Kumar V., Ross Quinlan J., Ghosh J., Yang Q., Motoda H., McLachlan G.J., Ng A., Liu B., Yu P.S., Zhou Z.-H., Steinbach M., Hand D.J., Steinberg D. Top 10 algorithms in data mining. Knowl. Inform. Syst. 2008, 14:1-37.
46. Hastie T., Tibshirani R., Friedman J. The Elements of Statistical Learning: Data Mining, Inference, and Prediction 2009, Springer, New York. second ed.
47. Demšar J. Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 2006, 7:1-30.
48. García S., Herrera F. An extension on "statistical comparisons of classifiers over multiple data sets" for all pairwise comparisons. J. Mach. Learn. Res. 2008, 9:2677-2694.
49. García S., Fernández A., Luengo J., Herrera F. A study of statistical techniques and performance measures for genetics-based machine learning. accuracy and interpretability. Soft Comput. 2009, 13:959-977.
50. García S., Fernández A., Luengo J., Herrera F. Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining. experimental analysis of power. Inf. Sci. 2010, 180:2044-2064.