Reinforced multicategory support vector machines

Journal of Computational and Graphical Statistics

Volumn 20, Issue 4, 2011, Pages 901-919

  Liu, Yufeng ^a   Yuan, Ming ^b  

^a University of North Carolina at Chapel Hill   (United States)

^b Georgia Institute of Technology   (United States)

Author keywords

Fisher consistency; Multicategory classification; Regularization; SVM

Indexed keywords

EID: 83455181597     PISSN: 10618600     EISSN: None     Source Type: Journal    
DOI: 10.1198/jcgs.2010.09206     Document Type: Article

References (38)

1. Allwein, E. L., Schapire, R. E., Singer, Y., and Kaelbling, P. (2000), "Reducing Multiclass to Binary: A Unifying Approach for Margin Classifiers, " Journal of Machine Learning Research, 1, 113-141. [902]
2. Bartlett, P., Jordan, M., and McAuliffe, J. (2006), "Convexity, Classification, and Risk Bounds, " Journal of the American Statistical Association, 101, 138-156. [902,904]
3. Bhattacharjee, A., Richards, W. G., Staunton, J., Li, C., Monti, S., Vasa, P., Ladd, C., Beheshti, J., Bueno, R., Gillette, M., Loda, M., Weber, G., Mark, E. J., Lander, E. S., Wong, W., Johnson, B. E., Golub, T. R., Sugarbaker, D. J., and Meyerson, M. (2001), "Classification of Human Lung Carcinomas by mRNA Expression Profiling Reveals Distinct Adenocarcinoma Subclasses, " Proceedings of the National Academy Science USA, 13790-13795. [913]
4. Boser, B., Guyon, I., and Vapnik, V. N. (1992), "A Training Algorithm for Optimal Margin Classifiers, " in COLT'92 Proceedings of the Fifth Annual Workshop on Computational Learning Theory, eds. D. Haussler, New York: ACM, pp. 144-152. [901]
5. Bredensteiner, E., and Bennett, K. (1999), "Multicategory Classification by Support Vector Machines, " Computational Optimizations and Applications, 12, 53-79. [903]
6. Brown, M. P. S., Grundy, W. N., Lin, D., Cristianini, N., Sugnet, C. W., Furey, T. S., Ares, M., and Haussler, D. (2000), "Knowledge-Based Analysis of Microarray Gene Expression Data by Using Support Vector Machines, " The Proceeding of National Academy of Sciences, 97, 262-267. [911]
7. Cortes, C., and Vapnik, V. N. (1995), "Support-Vector Networks, " Machine Learning, 20, 273-279. [901]
8. Crammer, K., and Singer, Y. (2001), "On the Algorithmic Implementation of Multiclass Kernel-Based Vector Machines, " Journal of Machine Learning Research, 2, 265-292. [902,903]
9. Cristianini, N., and Shawe-Taylor, J. (2000), An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods, Cambridge, U.K.: Cambridge University Press. [901]
10. Dietterich, T. G., and Bakiri, G. (1995), "Solving Multiclass Learning Problems via Error-Correcting Output Codes, " Journal of Artificial Intelligence Research, 2, 263-286. [902]
11. Hastie, T., Rosset, S., Tibshirani, R., and Zhu, J. (2004), "The Entire Regularization Path for the Support Vector Machine, " Journal of Machine Learning Research, 5, 1391-1415. [914]
12. Hastie, T., Tibshirani, R., and Friedman, J. (2001), The Elements of Statistical Learning: Data Mining, Inference, and Prediction, New York: Springer-Verlag. [901]
13. Hill, S. I., and Doucet, A. (2007), "A Framework for Kernel-Based Multi-Category Classication, " Journal of Articial Intelligence Research, 30, 525-564. [904,914]
14. Kimeldorf, G., and Wahba, G. (1971), "Some Results on Tchebycheffian Spline Functions, " Journal of Mathematical Analysis and Applications, 33, 82-95. [906]
15. Lee, Y., Lin, Y., and Wahba, G. (2004), "Multicategory Support Vector Machines, Theory, and Application to the Classification of Microarray Data and Satellite Radiance Data, " Journal of the American Statistical Association, 99, 67-81. [902-904,908,914,915]
16. Lin, Y. (2004), "A Note on Margin-Based Loss Functions in Classification, " Statistics and Probability Letters, 68, 73-82. [901,903]
17. Liu, Y. (2007), "Fisher Consistency of Multicategory Support Vector Machines, " in Proceedings of the Eleventh InternationalWorkshop on Artificial Intelligence and Statistics, Madison, WI: Omnipress, pp. 289-296. [902, 905]
18. Liu, Y., and Shen, X. (2006), "Multicategory ψ-Learning, " Journal of the American Statistical Association, 101, 500-509. [902-904]
19. Liu, Y., Hayes, D. N., Nobel, A., and Marron, J. S. (2008), "Statistical Significance of Clustering for High Dimension Low Sample Size Data, " Journal of the American Statistical Association, 103, 1281-1293. [912]
20. Platt, J. C. (1999), "Fast Training of Support Vector Machines Using Sequential Minimal Optimization, " in Advances in Kernel Methods-Support Vector Learning, eds. B. Schölkopf, C. J. C. Burges, and A. J. Smola, Cambridge, MA: MIT Press, pp. 185-208. [914]
21. Qiao, X., and Liu, Y. (2009), "Adaptive Weighted Learning for Unbalanced Multicategory Classification, " Biometrics, 65, 159-168. [913]
22. Rifkin, R. M., and Klautau, A. (2004), "In Defense of One-vs-All Classification, " Journal of Machine Learning Research, 5, 101-141. [902,914]
23. Schölkopf, B., and Smola, A. J. (2002), Learning With Kernels, Cambridge, MA: MIT Press. [901]
24. Shen, X., and Wang, L. (2007), "Generalization Error for Multi-Class Margin Classification, " Electronic Journal of Statistics, 1, 307-330. [914]
25. Shen, X., Tseng, G. C., Zhang, X., andWong, W. H. (2003), "On ψ-Learning, " Journal of the American Statistical Association, 98, 724-734. [914]
26. Steinwart, I., and Scovel, C. (2006), "Fast Rates for Support Vector Machines Using Gaussian Kernels, " The Annals of Statistics, 35, 575-607. [914]
27. 1 Penalty, " Technical Report MI 2004-14, University of Leiden. [914]
28. Tewari, A., and Bartlett, P. (2007), "On the Consistency of Multiclass Classification Methods, " Journal of Machine Learning Research, 8, 1007-1025. [904]
29. Vapnik, V. (1998), Statistical Learning Theory, New York: Wiley. [902,903]
30. Wahba, G. (1999), "Support Vector Machines, Reproducing Kernel Hilbert Spaces, and Randomized GACV, " in Advances in Kernel Methods: Support Vector Learning, eds. B. Schölkopf, C. J. C. Burges, and A. J. Smola, Cambridge, MA: MIT Press, pp. 125-143. [903,906]
31. Wahba, G., Lin, Y., and Zhang, H. H. (2000), "Generalized Approximate Cross Validation for Support Vector Machines, or, Another Way to Look at Margin-Like Quantities, " in Advances in Large Margin Classifiers, eds. P. Bartlett, B. Scholkopf, D. Schuurmans, and A. Smola, Cambridge, MA: MIT Press, pp. 297-309. [914]
32. Wang, L., and Shen, X. (2006), "Multicategory Support Vector Machines, Feature Selection and Solution Path, " Statistica Sinica, 16, 617-634. [914]
33. 1-Norm Multiclass Support Vector Machines: Methodology and Theory, " Journal of the American Statistical Association, 102, 583-594. [914]
34. Weston, J. (1999), "Extensions to the Support Vector Method, " Ph.D. thesis, Royal Holloway University of London. [904]
35. Weston, J., and Watkins, C. (1999), "Support Vector Machines for Multi-Class Pattern Recognition, " in Proceedings of the 7th European Symposium on Artificial Neural Networks (ESANN-99), ed. M. Verleysen, Bruges, Belgium, pp. 219-224. [902,903,909,910]
36. Wu, Y., and Liu, Y. (2007), "Robust Truncated-Hinge-Loss Support Vector Machines, " Journal of the American Statistical Association, 102, 974-983. [911]
37. Zhang, T. (2004a), "Statistical Analysis of Some Multi-Category Large Margin Classification Methods, " Journal of Machine Learning Research, 5, 1225-1251. [904]
38. Zhang, T. (2004b), "Statistical Behavior and Consistency of Classification Methods Based on Convex Risk Minimization, " The Annals of Statistics, 32, 56-85. [902]