Convergence rates of generalization errors for margin-based classification

Journal of Statistical Planning and Inference

Volumn 139, Issue 8, 2009, Pages 2543-2551

  Park, Changyi ^a  

^a University of Seoul   (South Korea)

Author keywords

Classification; Convex and non convex loss; Empirical process; Statistical learning theory

Indexed keywords

EID: 67349234428     PISSN: 03783758     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jspi.2008.11.011     Document Type: Article

References (24)

1. Audibert J.-Y., and Tsybakov A. Fast learning rates for plug-in classifiers. Ann. Statist. 35 (2007) 608-633
2. Bartlett P.L., Bousquet O., and Mendelson S. Local Rademacher complexities. Ann. Statist. 34 (2005) 1497-1537
3. Bartlett P.L., Jordan M.I., and McAuliffe J.D. Convexity, classification, and risk bounds. J. Amer. Statist. Assoc. 101 (2006) 138-156
4. Blanchard G., Bousquet O., and Massart P. Statistical performance of support vector machines. Ann. Statist. 36 (2008) 489-531
5. Corduneanu A., and Jaakola T. On information regularization. Proceedings of the Nineteenth Annual Conference on Uncertainty in Artificial Intelligence (2003), Morgan Kaufmann Publishers, San Francisco, CA 151-158
6. Dudley R.M. Metric entropy of some classes of sets with differentiable boundaries. J. Approx. Theory 10 (1974) 227-236
7. Kolmogorov A.N., and Tikhomirov V.M. ε{lunate}-entropy and ε{lunate}-capacity of sets in a functional space. Uspekhi Mat. Nauk 14 (1959) 3-86 (In Russian. English Translations in Amer. Soc. Trans. 17 (1961) 277-264)
8. Lin, Y., 2000. Some asymptotic properties of the support vector machine. TR 1029r, Department of Statistics, University of Wisconsin-Madison.
9. Lin Y. A note on margin-based loss functions in classification. Statist. Probab. Lett. 68 (2002) 73-82
10. Liu Y., and Shen X. On multicategory ψ-learning and support vector machine. J. Amer. Statist. Assoc. 101 (2006) 500-509
11. Lugosi G., and Vayatis N. On the Bayes-risk consistency of regularized boosting methods. Ann. Statist. 32 (2004) 30-55
12. Mammen E., and Tsybakov A.B. Smooth discriminant analysis. Ann. Statist. 27 (1999) 1808-1829
13. Marron J.S., Todd M., and Ahn J. Distance weighted discrimination. J. Amer. Statist. Assoc. 102 (2007) 1267-1271
14. Mason L., Baxter J., Bartlett P., and Frean M.R. Boosting algorithms as gradient descent in function space. Adv. Neural Inform. Process. Syst. 12 (2000) 512-518
15. Mercer J. Functions of positive and negative type and their connection with the theory of integral equations. Philos. Trans. Roy. Soc. London A 209 (1909) 415-446
16. Shen X., and Wong W.H. Convergence rate of sieve estimates. Ann. Statist. 22 (1994) 580-615
17. Shen X., Zhang X., Tseng G.C., and Wong W.H. On ψ-learning. J. Amer. Statist. Assoc. 98 (2003) 724-734
18. Steinwart I., and Scovel J.C. Fast rates for support vector machines using Gaussian kernels. Ann. Statist. 35 (2007) 575-607
19. van de Geer S. Empirical Processes in M-estimation (2000), Cambridge University Press, Cambridge, UK
20. Wahba, G., 1990. Spline methods for observational data. In: CBMS-NSF Regional Conference Series, Philadelphia.
21. Yang Y. Minimax nonparametric classification-part I: rates of convergence, part II: model selection for adaptation. IEEE Trans. Inform. Theory 45 (1999) 2271-2292
22. Zhang T. Statistical behavior and consistency of classification methods based on convex risk minimization. Ann. Statist. 32 (2004) 56-84
23. Zhou D.X. The covering number in learning theory. J. Complexity 18 (2002) 739-767
24. Zhu J., and Hastie T. Kernel logistic regression and the import vector machines. J. Comput. Graph. Statist. 14 (2005) 185-205