Enhancing directed binary trees for multi-class classification

Information Sciences

Volumn 223, Issue , 2013, Pages 42-55

  Montañés, Elena ^a   Barranquero, Jose ^a   Díez, Jorge ^a   Del Coz, Juan José ^a  

^a UNIVERSITY OF OVIEDO   (Spain)

Author keywords

Decomposition methods; Directed binary trees; Generalization error bounds; Multi class classification; Support vector machines

Indexed keywords

BASE CLASSIFIERS; BENCHMARK DATA; BINARY CLASSIFICATION; BINARY CLASSIFIERS; BINARY MODELS; DECOMPOSITION METHODS; GENERALIZATION ERROR BOUNDS; MULTI-CLASS CLASSIFICATION; MULTI-CLASS CLASSIFIER; REAL-WORLD APPLICATION; VOTING SCHEMES;

BENCHMARKING; CLASSIFICATION (OF INFORMATION); CLASSIFIERS; DECOMPOSITION; ERROR ANALYSIS; FORECASTING; SUPPORT VECTOR MACHINES; TREES (MATHEMATICS);

BINARY TREES;

EID: 84870240532     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2012.10.011     Document Type: Article

References (47)

1. E. Allwein, R. Schapire, and Y. Singer Reducing multiclass to binary: a unifying approach for margin classifiers Journal of Machine Learning Research 2001 113 141 (Pubitemid 33738778)
2. A. Asuncion, D. Newman, UCI machine learning repository, 2007.
3. C. Chang, C. Lin, LIBSVM: a library for support vector machines, 2001.
4. O. Chapelle, V. Vapnik, O. Bousquet, and S. Mukherjee Choosing multiple parameters for support vector machines Machine Learning 46 2002 131 159 (Pubitemid 34129966)
5. J. Chen, C. Wang, and R. Wang Adaptive binary tree for fast svm multiclass classification Neurocomputing 72 2009 3370 3375
6. P. Chen, S. Liu, An improved dag-svm for multi-class classification, in: International Conference on Natural Computation (ICNC '09), pp. 460-462.
7. K. Crammer, and Y. Singer On the algorithmic implementation of multiclass kernel-based vector machines Journal of Machine Learning Research 2 2001 265 292
8. K. Crammer, and Y. Singer On the learnability and design of output codes for multiclass problems Machine Learning 47 2002 201 233 (Pubitemid 34126110)
9. N. Cristianini, and J. Shawe-Taylor An Introduction to Support Vector Machines and other kernel-based learning methods 2000 Cambridge University Press
10. J. Demšar Statistical comparisons of classifiers over multiple data sets Journal of Machine Learning Research 7 2006 30
11. T. Dietterich, and G. Bakiri Solving multiclass learning problems via error-correcting output codes Journal of Artificial Intelligence Research 2 1995 263 286
12. J. Díez, J. del Coz, A. Bahamonde, and O. Luaces Soft margin trees W. Buntine, M. Grobelnik, D. Mladenic, J. Shawe-Taylor, Machine Learning and Knowledge Discovery in Databases Lecture Notes in Computer Science 5781 2009 Springer Berlin, Heidelberg 302 314
13. J. Fakcharoenphol, and B. Kijsirikul Constructing multiclass learners from binary learners: a simple black-box analysis of the generalization errors S. Jain, H.U. Simon, E. Tomita, Algorithmic Learning Theory Lecture Notes in Computer Science 3734 2005 Springer Berlin, Heidelberg 135 147
14. J. Fakcharoenphol, B. Kijsirikul, Erratum: Constructing multiclass learners from binary learners: a simple black-box analysis of the generalization errors, in: Proceedings of the 19th International Conference on Algorithmic Learning Theory, ALT '08, Springer-Verlag, Berlin, Heidelberg, 2008, pp. 464-466.
15. N. Farajzadeh, G. Pan, Z. Wu, and M. Yao Multiclass classification based on meta probability codes IJPRAI 25 2011 1219 1241
16. B. Fei, and J. Liu Binary tree of svm: a new fast multiclass training and classification algorithm IEEE Transactions on Neural Networks 2006 696 704
17. J. Feng, Y. Yang, J. Fan, Fuzzy multi-class svm classifier based on optimal directed acyclic graph using in similar handwritten chinese characters recognition, in: International Symposium on Neural Networks (ISNN '05), vol. 3496, pp. 875-880.
18. V. Fernández-Ibáñez, T. Fearn, E. Montañés, J. Quevedo, A. Soldado, and B. de la Roza-Delgado Improving the discriminatory power of a near-infrared microscopy spectral library with a support vector machine classifier Applied Spectroscopy 64 2010 46 52
19. E. Frank, S. Kramer, Ensembles of nested dichotomies for multi-class problems, in: International Conference of Machine Learning (ICML '04), pp. 305-312.
20. J. Friedman, Another Approach to Polychotomous Classification, Technical Report, Department of Statistics, Stanford University, 1996.
21. J. Fürnkranz Round robin classification Journal of Machine Learning Research 2 2002 721 747 (Pubitemid 135712579)
22. N. García-Pedrajas, and D. Ortíz-Boyer Improving multiclass pattern recognition by the combination of two strategies IEEE Transactions on Pattern Analysis and Machine Intelligence 28 2006 1001 1006
23. N. García-Pedrajas, and D. Ortíz-Boyer An empirical study of binary classifier fusion methods for multiclass classification Information Fusion 12 2011 111 130
24. T. Hastie, and R. Tibshirani Classification by Pairwise Coupling NIPS '97 1998 MIT Press Cambridge, MA, USA 507 513
25. C. Hsu, and C. Lin A comparison of methods for multiclass support vector machines IEEE Transactions on Neural Networks 13 2002 415 425 (Pubitemid 34475042)
26. T. Joachims, Text categorization with support vector machines: learning with many relevant features, in: C. Nédellec, C. Rouveirol (Eds.), Proceedings of ECML-98, 10th European Conference on Machine Learning, Springer, Heidelberg, 1998, pp. 137-142. (Pubitemid 128067178)
27. B. Kijsirikul, N. Ussivakul, Multiclass support vector machines using adaptive directed acyclic graph, in: International Joint Conference on Neural Networks (IJCNN '02), pp. 980-985.
28. A. Klautau, N. Jevtić, and A. Orlitsky On nearest-neighbor error-correcting output codes with application to all-pairs multiclass support vector machines Journal of Machine Learning Research 4 2003 1 15
29. Y. Lee, Y. Lin, and G. Wahba Multicategory support vector machines: theory and application to the classification of microarray data and satellite radiance data Journal of the American Statistical Association 99 2004 67 82
30. A. Lorena, A. Carvalho, and J. Gama A review on the combination of binary classifiers in multiclass problems Artificial Intelligence Review 30 2008 19 37
31. W. Maass On the computational power of winner-take-all Neural Computation 12 2000 2519 2535
32. G. Madzarov, D. Gjorgjevikj, and I. Chorbev A multi-class svm classifier utilizing binary decision tree Informatica (Slovenia) 33 2009 225 233
33. O. Murphy, and R. McCraw Designing storage efficient decision trees IEEE Transactions on Computers 40 1991 315 320 (Pubitemid 21728095)
34. T.H. Oong, and N.A.M. Isa One-against-all ensemble for multiclass pattern classification Applied Soft Computing 12 2012 1303 1308
35. S.H. Park, J. Fürnkranz, Efficient pairwise classification, in: J.N. Kok, J. Koronacki, R. López de Mántaras, S. Matwin, D. Mladenić, A. Skowron (Eds.), Proceedings of 18th European Conference on Machine Learning (ECML-07), Springer-Verlag, Warsaw, Poland, 2007, pp. 658-665.
36. A. Passerini, M. Pontil, and P. Frasconi New results on error correcting output codes of kernel machines IEEE Transactions on Neural Networks 15 2004 45 54
37. J. Platt, N. Cristianini, J. Shawe-Taylor, Large margin DAGs for multiclass classification, in: NIPS '00, pp. 547-553.
38. J. Quevedo, A. Bahamonde, M. Pérez-Enciso, and O. Luaces Disease liability prediction from large scale genotyping data using classifiers with a reject option IEEE/ACM Transactions on Computational Biology and Bioinformatics 9 2012 88 97
39. R. Rifkin, and A. Klautau In defense of one-vs-all classification Journal of Machine Learning Research 5 2004 101 141
40. B. de la Roza-Delgado, A. Soldado, A. Martínez-Fernandez, F. Vicente, A. Garrido-Varo, D. Pérez-Marín, M. de la Haba, and J. Guerrero-Ginel Application of near-infrared microscopy (nirm) for the detection of meat and bone meals in animal feeds: a tool for food and feed safety Food Chemistry 105 2007 1164 1170 (Pubitemid 47079085)
41. W.R.T. Phetkaew, B. Kijsirikul, Reordering adaptive directed acyclic graphs: an improved algorithm for multiclass support vector machines, in: International Joint Conference on Neural Networks (IJCNN '03), vol. 2, pp. 1605-1610.
42. F. Takahashi, S. Abe, Optimizing directed acyclic graph support vector machines, in: Artificial Neural Networks in Pattern Recognition (ANNPR '03), pp. 166-170.
43. R. Tibshirani, and T. Hastie Margin trees for high-dimensional classification Journal of Machine Learning Research 8 2007 637 652 (Pubitemid 46473522)
44. V. Vapnik The Nature of Statistical Learning Theory 1995 Springer Verlag New York, Inc. New York, NY, USA
45. J. Weston, C. Watkins, Support vector machines for multi-class pattern recognition, in: Proceedings of the 6th European Symposium on Artificial Neural Networks (ESANNs).
46. T. Windeatt, and R. Ghaderi Coding and decoding strategies for multi-class learning problems Information Fusion 4 2003 11 21 (Pubitemid 36210678)
47. J. Zhou, H. Peng, and C.Y. Suen Data-driven decomposition for multi-class classification Pattern Recognition 41 2008 67 76 (Pubitemid 47299107)