Analysis of support vector machine classification

Journal of Computational Analysis and Applications

Volumn 8, Issue 2, 2006, Pages 99-119

  Wu, Qiang ^a   Zhou, Ding Xuan ^a  

^a CITY UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Bayes risk consistency; Consistency with hypothesis space; Mercer kernel; Misclassification error; Regularization error; Support vector machine classification

Indexed keywords

EID: 33748649672     PISSN: 15211398     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (32)

1. N. Aronszajn, Theory of reproducing kernels, Trans. Amer. Math. Soc. 68 (1950), 337-404.
2. M. Arthony and P. Bartlett, Neural Network Learning: Theoretical Foundations, Cambridge University Press, 1999.
3. P. L. Bartlett, The sample complexity of pattern classification with neural networks: the size of the weights is more important than the size of the network, IEEE Trans. Inform. Theory 44 (1998), 525-536.
4. B. E. Boser, I. Guyon, and V. Vapnik, A training algorithm for optimal margin classifiers, in Proceedings of the Fifth Annual Workshop of Computational Learning Theory 5 (1992), Pittsburgh, ACM, pp. 144-152.
5. O. Bousquet and A. Elisseeff, Stability and generalization, J. Mach. Learning Res. 2 (2002), 499-526.
6. C. Cortes and V. Vapnik, Support-vector networks, Mach. Learning 20 (1995), 273-297.
7. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines, Cambridge University Press, 2000.
8. F. Cucker and S. Smale, On the mathematical foundations of learning, Bull. Amer. Math. Soc. 39 (2992), 1-49.
9. L. Devroye, L. Györfi, and G. Lugosi, A Probabilistic Theory of Pattern Recognition, Springer-Verlag, New York, 1997.
10. T. Evgeniou, M. Pontil, and T. Poggio, Regularization networks and support vector machines, Adv. Comput. Math. 13 (2000), 1-50.
11. R. A. Fisher, The use of multiple measurements in taxonomic problems, Ann. Eugenics 7 (1936), 111-132.
12. W. S. Lee, P. Bartlett, and R. Williamson, The importance of convexity in learning with least square loss, IEEE Trans. Inform. Theory 44 (1998), 1974-1980.
13. Y. Lin, Support vector machines and the Bayes rule in classification, Data Mining and Knowledge Discovery 6 (2002), 259-275.
14. S. Mukherjee, R. Rifkin, and T. Poggio, Regression and classification with regularization, in Nonlinear Estimation and Classification, D. D. Denison et al. (eds.), Springer-Verlag, New York, pp. 107-124, 2002.
15. P. Niyogi and F. Girosi, On the relationship between generalization error, hypothesis complexity, and sample complexity for radial basis functions, Neural Comp. 8 (1996), 819-842.
16. M. Pontil, A note on different covering numbers in learning theory, J. Complexity 19 (2003), 665-671.
17. A. Rakhlin, S. Mukherjee, and T. Poggio, Stability results in learning theory, Anal. Appl. 3 (2005), 397-417.
18. F. Rosenblatt, Principles of Neurodynamics, Spartan Book, New York, 1962.
19. J. Shawe-Taylor, P. L. Bartlett, R. C. Williamson, and M. Anthony, Structural risk minimization over data-dependent hierarchies, IEEE Trans. Inform. Theory 44 (1998), 1926-1940.
20. S. Smale and D. X. Zhou, Estimating the approximation error in learning theory, Anal. Appl. 1 (2003), 17-41.
21. S. Smale and D. X. Zhou, Shannon sampling and function reconstruction from point values, Bull. Amer. Math. Soc. 41 (2004), 279-305.
22. S. Smale and D. X. Zhou, Shannon sampling II. Connections to learning theory, Appl. Comput. Harmonic Anal. 19 (2005), 285-302.
23. I. Steinwart, Support vector machines are universally consistent, J. Complexity 18 (2002), 768-791.
24. V. Vapnik, Estimation of Dependences Based on Empirical Data, Springer-Verlag, New York, 1982.
25. V. Vapnik, Statistical Learning Theory, John Wiley & Sons, 1998.
26. G. Wahba, Spline models for observational data, SIAM, 1990.
27. G. Wahba, Support vector machines, reproducing kernel Hilbert spaces and the Randomized GACV, In 'Advances in Kernel Methods - Support Vector Learning', Schölkopf, Burges and Smola (eds.), MIT Press, pp. 69-88, 1999.
28. R. C. Williamson, A. J. Smola, and B. Schölkopf, Generalization performance of regularization networks and support vector machines via entropy numbers of compact operators, IEEE Trans. Inform. Theory 47 (2001), 2516-2532.
29. T. Zhang, Statistical behavior and consistency of classification methods based on convex risk minimization, Ann. Stat. 32 (2004), 56-85.
30. D. X. Zhou, The covering number in learning theory, J. Complexity 18 (2002), 739-767.
31. D. X. Zhou, Capacity of reproducing kernel spaces in learning theory, IEEE Trans. Inform. Theory 49 (2003), 1743-1752.
32. D. X. Zhou, Density problem and approximation error in learning theory, preprint 2005.