Multiclass learning approaches: A theoretical comparison with implications

Advances in Neural Information Processing Systems

Volumn 1, Issue , 2012, Pages 485-493

  Daniely, Amit ^a   Sabato, Sivan ^b   Shalev Shwartz, Shai ^a  

^a HEBREW UNIVERSITY OF JERUSALEM   (Israel)

^b MICROSOFT RESEARCH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION ERRORS; BINARY CLASSIFICATION; BINARY CLASSIFIERS; ERROR CORRECTING OUTPUT CODE; ESTIMATION ERRORS; MULTI-CLASS LEARNING; MULTICLASS CLASSIFICATION METHODS; MULTICLASS SVM;

EID: 84877772139     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. E. L. Allwein, R.E. Schapire, and Y. Singer. Reducing multiclass to binary: A unifying approach for margin classifiers. Journal of Machine Learning Research, 1:113-141, 2000.
2. S. Ben-David, N. Cesa-Bianchi, D. Haussler, and P. Long. Characterizations of learnability for classes of {0, ⋯, n}-valued functions. Journal of Computer and System Sciences, 50:74-86, 1995.
3. S. Bengio, J. Weston, and D. Grangier. Label embedding trees for large multi-class tasks. In NIPS, 2011.
4. A. Beygelzimer, J. Langford, and P. Ravikumar. Multiclass classification with filter trees. Preprint, June, 2007.
5. K. Crammer and Y. Singer. On the algorithmic implementation of multiclass kernel-based vector machines. Journal of Machine Learning Research, 2:265-292, 2001.
6. A. Daniely, S. Sabato, S. Ben-David, and S. Shalev-Shwartz. Multiclass learnability and the erm principle. In COLT, 2011.
7. T. G. Dietterich and G. Bakiri. Solving multiclass learning problems via error-correcting output codes. Journal of Artificial Intelligence Research, 2:263-286, January 1995.
8. Trevor Hastie and Robert Tibshirani. Classification by pairwise coupling. The Annals of Statistics, 26(1):451-471, 1998.
9. Ryan Rifkin and Aldebaro Klautau. In defense of one-vs-all classification. Journal of Machine Learning Research, 5:101-141, 2004.
10. David E. Rumelhart, Geoffrey E. Hinton, and Ronald J. Williams. Learning internal representations by error propagation. In David E. Rumelhart and James L. McClelland, editors, Parallel Distributed Processing - Explorations in the Microstructure of Cognition, chapter 8, pages 318-362. MIT Press, 1986.
11. G. Takacs. Convex polyhedron learning and its applications. PhD thesis, Budapest University of Technology and Economics, 2009.
12. V. N. Vapnik. Statistical Learning Theory. Wiley, 1998.
13. J. Weston and C. Watkins. Support vector machines for multi-class pattern recognition. In Proceedings of the Seventh European Symposium on Artificial Neural Networks, April 1999.