Hard or soft classification? large-margin unified machines

Journal of the American Statistical Association

Volumn 106, Issue 493, 2011, Pages 166-177

  Liu, Yufeng ^a   Zhang, Hao Helen ^b   Wu, Yichao ^b  

^a University of North Carolina at Chapel Hill   (United States)

^b NORTH CAROLINA STATE UNIVERSITY   (United States)

Author keywords

Class probability estimation; DWD; Fisher consistency; Regularization; SVM

Indexed keywords

EID: 79954529373     PISSN: 01621459     EISSN: None     Source Type: Journal    
DOI: 10.1198/jasa.2011.tm10319     Document Type: Article

References (25)

1. Bartlett, P., Jordan, M., and McAuliffe, J. (2006), ''Convexity, Classification, and Risk Bounds,'' Journal of the American Statistical Association, 101, 138-156. [169]
2. Boser, B., Guyon, I., and Vapnik, V. N. (1992), ''A Training Algorithm for Optimal Margin Classifiers,'' The Fifth Annual Conference on Computational Learning Theory, Pittsburgh, PA: ACM Press, pp. 142-152. [166]
3. Cortes, C., and Vapnik, V. N. (1995), ''Support-Vector Networks,'' Machine Learning, 20, 273-279. [166]
4. Cristianini, N., and Shawe-Taylor, J. (2000), An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods, Cambridge, United Kingdom: Cambridge University Press. [166]
5. Freund, Y., and Schapire, R. (1997), ''A Decision Theoretic Generalization of On-Line Learning and an Application to Boosting,'' Journal of Computer and System Sciences, 55, 119-139. [166-168]
6. Friedman, J. H., Hastie, T., and Tibshirani, R. (2000), ''Additive Logistic Regression: A Statistical View of Boosting,'' The Annals of Statistics, 28, 337-407. [166-168]
7. Hastie, T., Tibshirani, R., and Friedman, J. (2001), The Elements of Statistical Learning: Data Mining, Inference, and Prediction, New York: Springer-Verlag. [166]
8. Lin, X., Wahba, G., Xiang, D., Gao, F., Klein, R., and Klein, B. (2000), ''Smoothing Spline ANOVA Models for Large Data Sets With Bernoulli Observations and the Randomized GACV,'' The Annals of Statistics, 28, 1570-1600. [166,167]
9. Lin, Y. (2002), ''Support Vector Machines and the Bayes Rule in Classification,'' Data Mining and Knowledge Discovery, 6, 259-275. [169]
10. Lin, Y. (2004), ''A Note on Margin-Based Loss Functions in Classification,'' Statistics & Probability Letters, 68, 73-82. [169]
11. Liu, Y., and Shen, X. (2006), ''Multicategory ψ-Learning,'' Journal of the American Statistical Association, 101, 500-509. [167]
12. Liu, Y., Hayes, D. N., Nobel, A., and Marron, J. S. (2008), ''Statistical Significance of Clustering for High Dimension Low Sample Size Data,'' Journal of the American Statistical Association, 103, 1281-1293. [175]
13. Marron, J. S., Todd, M., and Ahn, J. (2007), ''Distance Weighted Discrimination,'' Journal of the American Statistical Association, 102, 1267-1271. [166-168]
14. McCullagh, P., and Nelder, J. (1989), Generalized Linear Models, London, United Kingdom: Chapman & Hall/CRC. [170]
15. Qiao, X., Zhang, H. H., Liu, Y., Todd, M. J., and Marron, J. S. (2010), ''Weighted Distance Weighted Discrimination and Its Asymptotic Properties,'' Journal of the American Statistical Association, 105, 401-414. [168]
16. Schölkopf, B., and Smola, A. J. (2002), Learning With Kernels, Cambridge, MA: MIT Press. [166]
17. Shen, X., Tseng, G. C., Zhang, X., andWong, W. H. (2003), ''On ψ-Learning,'' Journal of the American Statistical Association, 98, 724-734. [167]
18. Tewari, A., and Bartlett, P. (2005), ''On the Consistency of Multiclass lassificationMethods,'' in Proceedings of the 18th Annual Conference on Learning Theory, Vol. 3559, Bertinoro, Italy: Springer, pp. 143-157. [168]
19. Vapnik, V. (1998), Statistical Learning Theory, New York: Wiley. [166]
20. Wahba, G. (1998), ''Support Vector Machines, Reproducing Kernel Hilbert Spaces, and Randomized GACV,'' in: Advances in Kernel Methods: Support Vector Learning, eds. B. Schölkopf, C. J. C. Burges, and A. J. Smola, Cambridge, MA: MIT Press, pp. 125-143. [166,167]
21. Wahba, G. (2002), ''Soft and Hard Classification by Reproducing Kernel Hilbert Space Methods,'' Proceedings of the National Academy of Sciences, 99, 16524-16530. [166]
22. Wang, J., Shen, X., and Liu, Y. (2008), ''Probability Estimation for Large-Margin Classifiers,'' Biometrika, 95, 149-167. [167,169,173]
23. Wu, Y., and Liu, Y. (2007), ''Robust Truncated-Hinge-Loss Support Vector Machines,'' Journal of the American Statistical Association, 102, 974-983. [167]
24. Zhang, T. (2004), ''Statistical Analysis of Some Multi-Category Large Margin Classification Methods,'' Journal of Machine Learning Research, 5, 1225-1251. [168]
25. Zhu, J., and Hastie, T. (2005), ''Kernel Logistic Regression and the Import Vector Machine,'' Journal of Computational and Graphical Statistics, 14, 185-205. [167]