A tutorial on v-support vector machines

Applied Stochastic Models in Business and Industry

Volumn 21, Issue 2, 2005, Pages 111-136

  Chen, Pai Hsuen ^a   Lin, Chih Jen ^a   Schölkopf, Bernhard ^b  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

^b MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

Author keywords

Positive definite kernels; Statistical learning theory; Support vector implementation; Support vector regression; V support vector machines

Indexed keywords

ALGORITHMS; ERROR CORRECTION; LEARNING SYSTEMS; MATHEMATICAL MODELS; STATISTICAL METHODS; VECTORS;

Ν-SUPPORT VECTOR MACHINES; POSITIVE DEFINITE KERNELS; STATISTICAL LEARNING THEORY; SUPPORT VECTOR IMPLEMENTATION; SUPPORT VECTOR REGRESSION;

PATTERN RECOGNITION;

EID: 17444371247     PISSN: 15241904     EISSN: None     Source Type: Journal    
DOI: 10.1002/asmb.537     Document Type: Article

References (41)

1. Schölkopf B, Smola AJ. Learning with Kernels. MIT Press: Cambridge, MA, 2002.
2. Mercer J. Functions of positive and negative type and their connection with the theory of integral equations. Philosophical Transactions of the Royal Society of London, Series A 1909; 209:415-446.
3. Aizerman MA, Braverman EM, Rozonoèr LI. Theoretical foundations of the potential function method in pattern recognition learning. Automation and Remote Control 1964; 25:821-837.
4. Boser BE, Guyon IM, Vapnik V. A training algorithm for optimal margin classifiers. In Proceedings of the 5th Annual ACM Workshop on Computational Learning Theory, Haussler D (ed.), Pittsburgh, PA, July 1992. ACM Press: New York, 1992; 144-152.
5. Vapnik V. Estimation of Dependences Based on Empirical Data (in Russian). Nauka: Moscow, 1979 (English translation: Springer: New York, 1982).
6. Vapnik V. The Nature of Statistical Learning Theory. Springer: New York, 1995.
7. Schölkopf B, Surges CJC, Smola AJ. Advances in Kernel Methods-Support Vector Learning. MIT Press: Cambridge, MA, 1999.
8. Vapnik V, Chervonenkis A. Theory of Pattern Recognition (in Russian). Nauka: Moscow, 1974 (German translation: Theorie der Zeichenerkennung, Wapnik W, Tscherwonenkis A (eds). Akademie-Verlag: Berlin, 1979).
9. Vapnik V. Statistical Learning Theory. Wiley: NY, 1998.
10. Alon N, Ben-David S, Cesa-Bianchi N, Haussler D. Scale-sensitive dimensions, uniform convergence, and learnability. Journal of the ACM 1997; 44(4):615-631.
11. Vapnik V, Lerner A. Pattern recognition using generalized portrait method. Automation and Remote Control 1963; 24:774-780.
12. Schölkopf B. Support Vector Learning. R. Oldenbourg Verlag: München, 1997. Doktorarbeit, Technische Universität Berlin. Available from http://www.kyb.tuebingen.mpg.de/~bs
13. Bazaraa MS, Sherali HD, Shetty CM. Nonlinear Programming: Theory and Algorithms (2nd edn). Wiley: New York, 1993.
14. Wolfe P. A duality theorem for non-linear programming. Quarterly of Applied Mathematics 1961; 19:239-244.
15. Avriel M. Nonlinear Programming. Prentice-Hall Inc.: Englewood Cliffs, NJ, 1976.
16. Surges CJC, Schölkopf B. Improving the accuracy and speed of support vector learning machines. In Advances in Neural Information Processing Systems, vol. 9. Mozer M, Jordan M, Petsche T (eds). MIT Press: Cambridge, MA, 1997; 375-381.
17. Bartlett PL, Shawe-Taylor J. Generalization performance of support vector machines and other pattern classifiers. In Advances in Kernel Methods - Support Vector Learning, Schölkopf B, Burges CJC, Smola AJ (eds). MIT Press: Cambridge, MA, 1999; 43-54.
18. Smola AJ, Bartlett PL, Schölkopf B, Schuurmans D. Advances in Large Margin Classifiers. MIT Press: Cambridge, MA, 2000.
19. Williamson RC, Smola AJ, Schölkopf A. Generalization performance of regularization networks and support vector machines via entropy numbers of compact operators. IEEE Transactions on Information Theory 2001; 47(6): 2516-2532.
20. Wahba G. Spline Models for Observational Data. CBMS-NSF Regional Conference Series in Applied Mathematics, vol. 59. Society for Industrial and Applied Mathematics: Philadelphia, PA, 1990.
21. Lin C-J. Formulations of support vector machines: a note from an optimization point of view. Neural Computation 2001; 13(2):307-317.
22. Cortes C, Vapnik V. Support vector networks. Machine Learning 1995; 20:273-297.
23. Schölkopf B, Smola AJ, Williamson RC, Bartlett PL. New support vector algorithms. Neural Computation 2000; 12:1207-1245.
24. Crisp DJ, Burges CJC. A geometric interpretation of v-SVM classifiers. In Advances in Neural Information Processing Systems, vol. 12. Solla SA, Leen TK, Müller K-R (eds). MIT Press: Cambridge, MA, 2000.
25. Bennett KP, Bredensteiner EJ. Duality and geometry in SVM classifiers. In Proceedings of the 17th International Conference on Machine Learning, Langley P (ed.), San Francisco, CA. Morgan Kaufmann: Los Altos, CA, 2000; 57-64.
26. Chang C-C, Lin C-J. Training v-support vector classifiers: theory and algorithms. Neural Computation 2001; 13(9):2119-2147.
27. Michie D, Spiegelhalter DJ, Taylor CC. Machine Learning, Neural and Statistical Classification. Prentice-Hall: Englewood Cliffs, NJ, 1994. Data available at http://www.ncc.up.pt/liacc/ML/statlog/datasets.html
28. Steinwart I. Support vector machines are universally consistent. Journal of Complexity 2002; 18:768-791.
29. Steinwart I. Sparseness of support vector machines. Technical Report, 2003.
30. Steinwart I. On the optimal parameter choice for v-support vector machines. IEEE Transactions on Pattern Analysis and Machine Intelligence 2003; 25(10): 1274-1284.
31. Gretton A, Herbrich R, Chapelle O, Schölkopf B, Rayner PJW. Estimating the Leave-One-Out Error for Classification Learning with SVMs. Technical Report CUED/F-INFENG/TR.424, Cambridge University Engineering Department, 2001.
32. Lin C-J. On the convergence of the decomposition method for support vector machines. IEEE Transactions on Neural Networks 2001; 12(6):1288-1298.
33. Joachims T. Making large-scale SVM learning practical. In Advances in Kernel Methods - Support Vector Learning, Schölkopf B, Burges CJC, Smola AJ (eds). MIT Press: Cambridge, MA, 1999; 169-184.
34. Platt JC. Fast training of support vector machines using sequential minimal optimization. In Advances in Kernel Methods - Support Vector Learning, Schölkopf B, Burges CJC, Smola AJ (eds). MIT Press: Cambridge, MA, 1998.
35. Hsu C-W, Lin C-J. A comparison of methods for multi-class support vector machines. IEEE Transactions on Neural Networks 2002; 13(2):415-425.
36. Chung K-M, Kao W-C, Sun C-L, Lin C-J. Decomposition methods for linear support vector machines. Technical Report, Department of Computer Science and Information Engineering, National Taiwan University, 2002.
37. Chang C-C, Lin C-J. LIBSVM: a library for support vector machines, 2001. Software available at http://www.csie.ntu.edu.tw/cjlin/libsvm
38. Perez Cruz F, Weston J, Herrmann DJL, Schölkopf B. Extension of the v-SVM range for classification. In Advances in Learning Theory: Methods, Models and Applications, vol. 190. Suykens J, Horvath G, Basu S, Micchelli C, Vandewalle J (eds). IOS Press: Amsterdam, 2003; 179-196.
39. Bergman R, Griss M, Staelin C. A personal email assistant. Technical Report HPL-2002-236. HP Laboratories, Palo Alto, CA, 2002.
40. Martin DR, Fowlkes CC, Malik J. Learning to detect natural image boundaries using brightness and texture. In Advances in Neural Information Processing Systems, vol. 14, 2002.
41. Weston J, Chapelle O, Elisseeff A, Schölkopf B, Vapnik V. Kernel dependency estimation. In Advances in Neural Information Processing Systems, Becker S, Thrun S, Obermayer K (eds). MIT Press: Cambridge, MA, 2003: 873-880.