Sparseness of support vector machines

Journal of Machine Learning Research

Volumn 4, Issue 6, 2004, Pages 1071-1105

  Steinwart, Ingo ^a  

^a LOS ALAMOS NATIONAL LABORATORY   (United States)

Author keywords

Computational learning theory; PAC model; Pattern recognition; Sparseness; Support vector machines

Indexed keywords

ASYMPTOTIC STABILITY; COMPUTATION THEORY; OPTIMIZATION; PATTERN RECOGNITION; PROBLEM SOLVING; SET THEORY;

COMPUTATIONAL LEARNING THEORY; PAC MODEL; SPARSENESS; SUPPORT VECTOR MACHINES;

LEARNING SYSTEMS;

EID: 4644354708     PISSN: 15324435     EISSN: None     Source Type: Journal    
DOI: 10.1162/1532443041827925     Document Type: Article

References (27)

1. N. Aronszajn. Theory of reproducing kernels. Trans. Amer. Math. Soc., 68:337-404, 1950.
2. P.L. Bartlett, M.I. Jordan, and J.D. McAuliffe. Convexity, classification, and risk bounds. Technical Report 638, Department of Statistics, University of California, Berkeley. Available online at http://stat-www.berkeley.edu/tech-reports/638.pdf, 2003.
3. C. Berg, J.P.R. Christensen, and P. Ressel. Harmonic Analysis on Semigroups: Theory of Positive Definite and Related Functions. Springer, New York, 1984.
4. D.D. Cox and F. O'Sullivan. Asymptotic analysis of penalized likelihood and related estimators. Ann. Statist., 18:1676-1695, 1990.
5. N. Cristianini and J. Shawe-Taylor. An Introduction to Support Vector Machines. Cambridge University Press, 2000.
6. J. Diestel and J.J. Uhl. Vector Measures. American Mathematical Society, Providence, 1977.
7. T. Downs, K.E. Gates, and A. Masters. Exact simplification of support vector solutions. Journal of Machine Learning Research, 2:293-297, 2001.
8. R.M. Dudley. Real Analysis and Probability. Cambridge University Press, 2002.
9. G.S. Kimeldorf and G. Wahba. Some results on Tchebycheffian spline functions. J. Math. Anal. Appl., 33:82-95, 1971.
10. Y. Lin. Support vector machines and the Bayes rule in classification. Data Mining and Knowledge Discovery, 6:259-275, 2002.
11. R.R. Phelps. Convex Functions, Monotone Operators and Differentiability, volume 1364 of Lecture Notes in Math. Springer, 1986.
12. K. Ritter. Average-Case Analysis of Numerical Problems, volume 1733 of Lecture Notes in Math. Springer, 2000.
13. R.T. Rockafellar. Integral functionals, normal integrands and measurable selections. In Nonlinear Operators and the Calculus of Variations, volume 543 of Lecture Notes in Math., pages 157-207, 1976.
14. G. Romano. New results in subdifferential calculus with applications to convex optimization. Appl. Math. Optim., 32:213-234, 1995.
15. S. Saitoh. Integral transforms, reproducing kernels and their applications. Addison Wesley Longman, 1997.
16. B. Schölkopf, R. Herbrich, and A.J. Smola. A generalized representer theorem. In Proceedings of the 14th Annual Conference on Computational Learning Theory, volume 2111 of Lecture Notes in Artificial Intelligence, pages 416-426, 2001.
17. B. Schölkopf and A.J. Smola. Learning with Kernels. MIT Press, 2002.
18. B. Schölkopf, A.J. Smola, R.C. Williamson, and P.L. Bartlett. New support vector algorithms. Neural Computation, 12:1207-1245, 2000.
19. I. Steinwart. On the influence of the kernel on the consistency of support vector machines. Journal of Machine Learning Research, 2:67-93, 2001.
20. I. Steinwart. Support vector machines are universally consistent. J. Complexity, 18:768-791, 2002.
21. I. Steinwart. Consistency of support vector machines and other regularized kernel machine. IEEE Transactions on Information Theory, accepted with minor revisions, 2003a.
22. I. Steinwart. On the optimal parameter choice for v-support vector machines. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25:1274-1284, 2003b.
23. I. Steinwart. Sparseness of support vector machines-some asymptotically sharp bounds. To appear in S. Thrun, L. Saul, and B. Schölkopf, editors, Advances in Neural Information Processing Systems 16. MIT Press, 2004. Available online at http: //www.c3.lanl.gov/~ingo/ publications/nips-03.ps.
24. J.A.K. Suykens, T. Van Gestel, J. De Brabanter, B. De Moor, and J. Vandewalle. Least Squares Support Vector Machines. World Scientific, 2002.
25. V. Yurinsky. Sums and Gaussian Vectors, volume 1617 of Lecture Notes in Math. Springer, 1995.
26. T. Zhang. Convergence of large margin separable linear classification. In T.K. Leen, T.G. Dietterich, and V. Tresp, editors, Advances in Neural Information Processing Systems 13, pages 357-363. MIT Press, 2001.
27. T. Zhang. Statistical behaviour and consistency of classification methods based on convex risk minimization. Ann. Statist., 32, 2004.