Non-crossing large-margin probability estimation and its application to robust SVM via preconditioning

Statistical Methodology

Volumn 8, Issue 1, 2011, Pages 56-67

  Wu, Yichao ^a   Liu, Yufeng ^b  

^a NORTH CAROLINA STATE UNIVERSITY   (United States)

^b University of North Carolina at Chapel Hill   (United States)

Author keywords

Conditional class probability; Large margin classifier; Preconditioning; SVM

Indexed keywords

EID: 78649719165     PISSN: 15723127     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.stamet.2009.05.004     Document Type: Article

References (21)

1. Cortes C., Vapnik V. Support-vector networks. Machine Learning 1995, 20:273-279.
2. Cristianini N., Shawe-Taylor J. An Introduction to Support Vector Machines and other Kernel-Based Learning Methods 2000, Cambridge University Press.
3. Fan J., Li R. Variable selection via nonconcave penalized likelihood and it oracle properties. Journal of American Statistical Association 2001, 96:1348-1360.
4. Freund Y., Schapire R. A decision theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Sciences 1997, 55:119-139.
5. Friedman J.H., Hastie T., Tibshirani R. Additive logistic regression: A statistical view of boosting. Annals of Statistics 2000, 28:337-407.
6. Lin Y. Support vector machines and the Bayes rule in classification. Data Mining and Knowledge Discovery 2002, 6:259-275.
7. Lin Y., Lee Y., Wahba G. Support vector machines for classification in nonstandard situations. Machine Learning 2002, 46:191-202.
8. Lin X., Wahba G., Xiang D., Gao F., Klein R., Klein B. Smoothing spline ANOVA models for large data sets with bernoulli observations and the randomized GACV. The Annals of Statistics 2000, 28:1570-1600.
9. Liu Y., Shen X. Multicategory ψ-learning. Journal of the American Statistical Association 2006, 101:500-509.
10. McCullagh P., Nelder J.A. Generalized Linear Models 1989, Chapman & Hall, London. 2nd ed.
11. Paul D., Bair E., Hastie T., Tibshirani R. Pre-conditioning for feature selection and regression in high-dimensional problems. Annals of Statistics 2008, 36(4):1595-1618.
12. Shen X., Tseng G.C., Zhang X., Wong W.H. On ψ-learning. Journal of the American Statistical Association 2003, 98:724-734.
13. Tibshirani R. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society, Series B 1996, 58:267-288.
14. Vapnik V. Statistical Learning Theory 1998, Wiley.
15. Vapnik V., Lerner A. Pattern recognition using generalized portrait method. Automation and Remote Control 1963, 24.
16. Wahba G. Support vector machines, reproducing kernel Hilbert spaces, and randomized GACV. Advances in Kernel Methods: Support Vector Learning 1998, 125-143. MIT Press. B. Scholkopf, C.J.C. Burges, A.J. Smola (Eds.).
17. Wang J., Shen X., Liu Y. Probability estimation for large margin classifiers. Biometrika 2008, 95:149-167.
18. Wu Y., Liu Y. Robust truncated-hinge-loss support vector machines. Journal of the American Statistical Association 2007, 102:974-983.
19. Zhang H.H., Liu Y., Wu Y., Zhu J. Variable selection for the multicategory SVM via sup-norm regularization. Electronic Journal of Statistics 2008, 2:149-167.
20. Zhu J., Hastie T. Kernel logistic regression and the import vector machine. Journal of Computational and Graphical Statistics 2005, 14:185-205.
21. Zhu J., Rosset S., Hastie T., Tibshirani R. 1-norm support vector machines. Neural Information Processing Systems 2004, 16.