A quadratic loss multi-class SVM for which a radius-margin bound applies

Informatica

Volumn 22, Issue 1, 2011, Pages 73-96

  Guermeur, Yann ^a   Monfrini, Emmanuel ^b  

^a LORIA   (France)

^b TELECOM SUDPARIS   (France)

Author keywords

leave one out cross validation error; model selection; multi class SVMs; radius margin bounds

Indexed keywords

EID: 79954473028     PISSN: 08684952     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (36)

1. Altschul, S.F., Madden, T.L., Schäffer, A.A., Zhang, J., Zhang, Z., Miller, W., Lipman, D.J. (1997). Gapped BLAST and PSI-BLAST: a new generation of protein database search programs. Nucleic Acids Research, 25(17), 3389-3402. (Pubitemid 27359211)
2. Anthony, M., Bartlett, P.L. (1999). Neural Network Learning: Theoretical Foundations. Cambridge University Press, Cambridge.
3. Baldi, P., Brunak, S., Chauvin, Y., Andersen, C.A.F., Nielsen, H. (2000). Assessing the accuracy of prediction algorithms for classification: an overview. Bioinformatics, 16(5), 412-424. (Pubitemid 30487963)
4. Balys, V., Rudzkis, R. (2010). Statistical classification of scientific publications. Informatica, 21(4), 471-486.
5. Bartkutė-Norkūnienė, V. (2009). Stochastic optimization algorithms for support vector machines classification. Informatica, 20(2), 173-186.
6. Berlinet, A., Thomas-Agnan, C. (2004). Reproducing Kernel Hilbert Spaces in Probability and Statistics. Kluwer Academic, Boston.
7. Boser, B.E., Guyon, I.M., Vapnik, V.N. (1992). A training algorithm for optimal margin classifiers. In: COLT'92, pp. 144-152.
8. Chapelle, O., Vapnik, V.N., Bousquet, O., Mukherjee, S. (2002). Choosing multiple parameters for support vector machines. Mach. Learn., 46(1), 131-159. (Pubitemid 34129966)
9. Chung, K.-M., Kao,W.-C., Sun, C.-L.,Wang, L.-L., Lin, C.-J. (2003). Radius margin bounds for support vector machines with the RBF kernel. Neural Comput., 15(11), 2643-2681. (Pubitemid 37206930)
10. Cortes, C., Vapnik., V.N. (1995). Support-vector networks. Machine Learning, 20(3), 273-297.
11. Crammer, K., Singer, Y. (2001). On the algorithmic implementation of multiclass kernel-based vector machines. Journal of Machine Learning Research, 2, 265-292.
12. Cuff, J.A., Barton, G.J., (1999). Evaluation and improvement of multiple sequence methods for protein secondary structure prediction. Proteins: Structure, Function, and Genetics, 34(4), 508-519. (Pubitemid 29129701)
13. Duan, K., Keerthi, S.S., Poo, A.N. (2003). Evaluation of simple performance measures for tuning SVM hyperparameters. Neurocomputing, 51, 41-59. (Pubitemid 36367224)
14. Frank, M., Wolfe, P. (1956). An algorithm for quadratic programming. Naval Research Logistics Quarterly, 3, 95-110.
15. Fürnkranz, J. (2002). Round robin classification. Journal of Machine Learning Research, 2, 721-747. (Pubitemid 135712579)
16. Guermeur, Y. (2007). SVM multiclasses, théorie et applications. Habilitation à diriger des recherches, Université Nancy 1 (in French).
17. Guermeur, Y. (2010). Sample complexity of classifiers taking values in RQ, application to multi-class SVMs. Communications in Statistics - Theory and Methods, 39(3), 543-557.
18. Hsu, C.-W., Lin, C.-J. (2002). A comparison of methods for multi-class support vector machines. IEEE Transaction on Neural Networks, 13(2), 415-425. (Pubitemid 34475042)
19. Kabsch, W., Sander, C. (1983). Dictionary of protein secondary structure: pattern recognition of hydrogenbonded and geometrical features. Biopolymers, 22(12), 2577-2637.
20. Lee, Y., Cui, Z. (2006). Characterizing the solution path of multicategory support vector machines. Statistica Sinica, 16(2), 391-409. (Pubitemid 44085509)
21. Lee, Y., Lin, Y., Wahba, G. (2004). Multicategory support vector machines: Theory and application to the classification of microarray data and satellite radiance data. Journal of the American Statistical Association, 99(465), 67-81. (Pubitemid 38545195)
22. Luntz, A., Brailovsky, V. (1969). On estimation of characters obtained in statistical procedure of recognition. Technicheskaya Kibernetica, 3 (in Russian).
23. Norkin, V., Keyzer, M. (2009). On stochastic optimization and statistical learning in reproducing kernel Hilbert spaces by support vector machines (SVM). Informatica, 20(2), 273-292.
24. Rifkin, R., Klautau, A. (2004). In defense of one-vs-all classification. Journal of Machine Learning Research, 5, 101-141.
25. Rosen, J.B. (1960). The gradient projection method for nonlinear programming. Part I. Linear constraints. Journal of the Society for Industrial and Applied Mathematics, 8(1), 181-217.
26. Schölkopf, B., Burges, C., Vapnik, V.N. (1995). Extracting support data for a given task. In: KDD'95, pp. 252-257.
27. Shawe-Taylor, J., Cristianini, N. (2004). Kernel Methods for Pattern Analysis. Cambridge University Press, Cambridge.
28. Tewari, A., Bartlett, P.L. (2007). On the consistency of multiclass classification methods. Journal of Machine Learning Research, 8, 1007-1025. (Pubitemid 46798410)
29. Tikhonov, A.N., Arsenin, V.Y. (1977). Solutions of Ill-Posed Problems. V.H. Winston & Sons, Washington.
30. Vapnik, V.N. (1995). The Nature of Statistical Learning Theory. Springer, New York.
31. Vapnik, V.N. (1998). Statistical Learning Theory. Wiley, New York.
32. Vapnik, V.N., Chapelle, O. (2000). Bounds on error expectation for support vector machines. Neural Computation, 12(9), 2013-2036.
33. Wang, L., Xue, P., Chan, K.L. (2008). Two criteria for model selection in multiclass support vector machines. IEEE Transactions on Systems, Man, and Cybernetics - Part B, 38(6), 1432-1448.
34. Weston, J., Watkins, C. (1998). Multi-class support vector machines. Technical Report CSD-TR-98-04, Royal Holloway, University of London, Department of Computer Science.
35. Wolpert, D.H. (1992). Stacked Generalization. Neural Networks, 5, 241-259.
36. Zhang, T. (2004). Statistical analysis of some multi-category large margin classification methods. Journal of Machine Learning Research, 5, 1225-1251.