Probability estimation for large-margin classifiers

Biometrika

Volumn 95, Issue 1, 2008, Pages 149-167

  Wang, Junhui ^a   Shen, Xiaotong ^a   Liu, Yufeng ^b  

^a UNIVERSITY OF MINNESOTA   (United States)

^b University of North Carolina at Chapel Hill   (United States)

Author keywords

Function estimation; High dimension and low sample size; Interval estimate; Tuning; Weighting

Indexed keywords

EID: 40249094631     PISSN: 00063444     EISSN: 14643510     Source Type: Journal    
DOI: 10.1093/biomet/asm077     Document Type: Article

References (29)

1. BARTLETT, P. & TEWARI, A. (2007). Sparseness vs estimating conditional probabilities: some asymptotic results. J. Mach. Learn. Res. 8, 775-90.
2. BREIMAN, L. (1992). The little bootstrap and other methods for dimensionality selection in regression: X-fixed prediction error. J. Am. Statist. Assoc. 87, 738-54.
3. BREIMAN, L. & SPECTOR, P. (1992). Submodel selection and evaluation in regression-the X-Random case. Int. Rev. Statist. 3, 291-319.
4. CORTES, C. & VAPNIK, V. (1995). Support vector networks. Mach. Learn. 20, 273-97.
5. EFRON, B. (2004). The estimation of prediction error: covariance penalties and cross-validation (with Discussion). J. Am. Statist. Assoc. 99, 619-42.
6. GOLUB, T., SLONIM, D., TAMAYO, P., HUARD, C., GAASENBEEK, M., MESIROV, J., COLLER, H., LOH, M., DOWNING, J. & CALIGIURI, M. (1999). Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science 286, 531-6.
7. GUYON, I. & ELISSEFF, A. (2003). An introduction to variable and feature selection. J. Mach. Learn. Res. 3, 1157-82.
8. GUYON, I., WESTON, J. & VAPNIK, V. (2002). Gene selection for cancer classification using support vector machine. Mach. Learn. 46, 389-422.
9. HASTIE, T., ROSSET, S., TIBSHIRANI, R. & HZ, J. (2004). The entire regularization path for the support vector machine. J. Mach. Learn. Res. 5, 1391-415.
10. JAAKKOLA, T., DIEKHANS, M. & HAUSSLER, D. (1999). Using the Fisher kernel method to detect remote protein homologies. In Proc. Int. Conf. Intell. Syst. Mol. Biol., Ed. T. Lengauer, R. Schneider, P. Bork., D. Brutlag, J. Glasgow, H. Mewes and R. Zimmer, pp. 149-58. Heidelberg, Germany: AAAI.
11. KIMELDORF, G. & WAHBA, G. (1971). Some results on Tchebycheffian spline functions, J. Math. Anal. Applic. 33, 82-95.
12. LIN, Y. (2002). Support vector machines and the Bayes rule in classification. Data Mining Know. Disc. 6, 259-75.
13. LIN, Y., LEE, Y & WAHBA, G. (2002). Support vector machines for classification in nonstandard situations. Mach. Learn. 46, 191-202.
14. LIU, S., SHEN, X. & WONG, W. (2005). Computational development of ψ-learning. In Proc. 2005 SIAM Int. Conf. Data Mining, Ed. H. Kargupta, J. Srivastava, C. Kamath and A. Goodman, pp. 1-12. Philadelphia: SIAM.
15. LIU, Y. & SHEN, X. (2006). Multicategory ψ-learning. J. Am. Statist. Assoc. 101, 500-9.
16. LIU, Y., SHEN, X. & DOSS, H. (2005). Multicategory ψ-learning and support vector machine: computational tools. J. Comp. Graph. Statist. 14, 219-36.
17. PLATT, J.C. (1999). Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. In Advances in Large Margin Classifiers, Ed. A. Smola, P. Bartlett, B. Scholkopf and D. Schuurmans, pp. 61-74. Cambridge, MA: MIT Press.
18. SHEN, X. & HUANG, H-C. (2006). Optimal model assessment, selection and combination. J. Am. Statist. Assoc. 101, 554-68.
19. SHEN, X., TSENG, G.C., HANG, & X. WONG, W.H. (2003). On ψ-learning. J. Am. Statist. Assoc. 98, 724-34.
20. SHEN, X. & WANG, L. (2006). Discussion of 'Local Rademacher complexities and oracle inequalities in risk minimization' by V. Koltchinskii. Ann. Statist. 34, 2677-80.
21. SHEN, X. & WONG, W.H. (1994). Convergence rate of sieve estimates. Ann. Statist. 22, 580-615.
22. STEINWART, I. (2001). On the influence of the kernel on the consistency of support vector machines. J. Mach. Learn. Res. 2, 67-93.
23. STEINWART, I. (2003). Sparseness of support vector machines. J. Mach. Learn. Res. 4, 1071-105.
24. STEINWART, I. & SCOVEL, C. (2007). Fast rates for support vector machines using Gaussian kernels. Ann. Statist. 35, 575-607.
25. TSYBAKOV, A. (2004). Optimal aggregation of classifiers in statistical learning. Ann. Statist. 32, 135-66.
26. VAPNIK, V. (1998). Statistical Learning Theory. New York: Wiley.
27. WAHBA, G. (1990). Spline Models for Observational Data. Philadelphia: SIAM.
28. WANG, J. & SHEN, X. (2006). Estimation of generalisation error: random and fixed inputs. Statist. Sinica 16, 569-88.
29. ZHOU, D.X. (2002). The covering number in learning theory. J. Complexity 18, 739-67.