The consistency of multicategory support vector machines

Advances in Computational Mathematics

Volumn 24, Issue 1-4, 2006, Pages 155-169

  Chen, Di Rong ^a   Xiang, Dao Hong ^a  

^a BEIHANG UNIVERSITY   (China)

Author keywords

Bayes rule; Classification; Consistency; Misclassification error; Reproducing kernel Hilbert space; Support vector machine; Universal consistency

Indexed keywords

EID: 33645782058     PISSN: 10197168     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10444-004-7207-1     Document Type: Article

References (25)

1. E.L. Allwein, R.E. Schapire and Y. Singer, Reducing multiclass to binary: A unifying approach for margin classifiers, in: Proc. of 17th Internat. Conf. on Machine Learning (Morgan Kaufmann, San Francisco, CA, 2000) pp. 9-16.
2. N. Aronszajn, Theory of reproducing kernels, Trans. Amer. Math. Soc. 68 (1950) 337-404.
3. P.L. Bartlett, The sample complexity of pattern classification with neural network: The size of the weights is more important than the size of the networks, IEEE Trans. Inform. Theory 44 (1998) 525-536.
4. B.E. Boser, I. Guyon and V. Vapnik, A training algorithm for optimal margin classifiers, in: Proc. of the 5th Annual Workshop of Computational Learning Theory, Vol. 5 (ACM, Pittsburgh, 1992) pp. 144-152.
5. L. Botton, C. Cortes, J. Denker, H. Drucker, I. Jackel, Y. LeCun, U. Muller, E. Sackinger, P. Simard and V. Vapnik, Comparion of classifer methods: A case study in handwriting digit recognition, in: Internat. Conf. on Pattern Recognition (IEEE Computer Soc. Press, Los Alamitos, CA, 1994) pp. 77-87.
6. O. Bousquet and A. Elisseeff, Stability and generalization, J. Machine Learning Res. 2 (2002) 499-526.
7. E.J. Bredensteiner and K.P. Bennett, Multicategory classification by support vector machines, Comput. Optim. Appl. 12 (1999) 35-46.
8. C. Burges, A tutorial on support vector machines for pattern recognition, Data Mining Knowledge Discovery 2 (1998) 121-167.
9. D.R. Chen, Q. Wu, Y. Ying and D.X. Zhou, Support vector machine soft margin classifier: Error analysis, J. Machine Learning Res. 5 (2004) 1143-1175.
10. C. Cortes and V. Vapnik, Support-vector networks, Maching Learning 20 (1995) 273-297.
11. K. Crammer and Y. Singer, On the learnability and design of output codes for multiclass problems, Comput. Learning Theory (2000) 35-46.
12. F. Cucker and S. Smale, On the mathematical foundations of learning, Bull. Amer. Math. Soc. 39 (2001) 1-49.
13. L. Devroye, L. Gyöfi and G. Lugosi, A Probabilistic Theory of Pattern Recognition (Springer, New York, 1997).
14. T.G. Dietterich and G. Bakiri, Solving multiclass learning problems via error-correcting output codes, J. Artificial Intelligence Res. 2 (1995) 263-286.
15. T. Evgeniou, M. Pontil and T. Poggio, Regularization networks and support vector machines, Adv. Comput. Math. 13 (2000) 1-50.
16. J. Friedman, Another approach to polychotomous classification, Technical Report, Department of Statistics, Stanford University (1996).
17. Y. Lee, Y. Lin and G. Wahba, Multicategory support vector machines, theory, and application to the classification of microarray data and satellite radiance data, J. Amer. Statist. Assoc., to appear.
18. Y. Lee, G. Wahba and S.A. Ackerman, Cloud classification of satellite radiance data by multicategory support vector machines, Technical Report No. 1075, Department of Statistics, University of Wisconsin-Madison (2003).
19. I. Steinwart, Support vector machines are universally consistent, J. Complexity 18 (2002) 768-791.
20. V. Vapnik, Statistical Learning Theory (Wiley, New York, 1998).
21. J. Weston and C. Watkins, Support vector machines for multiclass pattern recognition, in: Proc. of the 7th European Symposium on Artificial Neural Neworks (1999).
22. R.C. Williamson, A.J. Smola and B. Schökopf, Generalization performance of regularization networks and support vector machines via entropy numbers of compact operators, IEEE Trans. Inform. Theory 47 (2001) 2516-2532.
23. Q. Wu and D.X. Zhou, Analysis of support vector machine classification (2003) submitted.
24. D.X. Zhou, The covering number in learning theory, J. Complexity 18 (2002) 739-767.
25. D.X. Zhou, Capacity of reproducing kernel spaces in learning theory, IEEE Trans. Inform. Theory 49 (2003) 1743-1752.