A general soft method for learning SVM classifiers with L1-norm penalty

Pattern Recognition

Volumn 41, Issue 3, 2008, Pages 939-948

  Tao, Qing ^a,c   Wu, Gao Wei ^b   Wang, Jue ^c  

^a Hefei New Star Institute of Applied Technology   (China)

^b INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

^c INSTITUTE OF AUTOMATION   (China)

Author keywords

SVMs; Classification; Gilbert's algorithms; Mitchell Dem'yanov Malozemov's algorithms; Nearest points; Schlesinger Kozinec's algorithms; Soft convex hulls; Support vector machines

Indexed keywords

ALGORITHMS; CLASSIFICATION (OF INFORMATION); PATTERN RECOGNITION;

GILBERT'S ALGORITHMS; MITCHELL-DEM'YANOV-MALOZEMOV'S ALGORITHMS; NEAREST POINTS; SCHLESINGER-KOZINEC'S ALGORITHMS;

SUPPORT VECTOR MACHINES;

EID: 35448932022     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2007.08.004     Document Type: Article

References (27)

1. Vapnik V. The Nature of Statistical Learning Theory (1995), Springer, New York
2. Vapnik V. Statistical Learning Theory (1998), Addison-Wiley, Reading, MA
3. Cristianini N., and Schawe-Taylor J. An Introduction to Support Vector Machines (2000), Cambridge University Press, Cambridge
4. Müller K.R., Mika S., Rätsch G., Tsuda K., and Schölkopf B. An introduction to kernel-based learning algorithms. IEEE Trans. Neural Networks 12 2 (2001) 181-201
5. Vapnik V. Estimation of Dependences Based on Empirical Data (1982), Springer, Berlin
6. E.E. Osuna, R. Freund, F. Girosi, Support vector machines: training and applications, Technical Report AIM1602, MIT Artificial Intelligence Laboratory, Cambridge, MA, 1997.
7. Platt J. Fast training of support vector machines using sequential minimal optimization. In: Schölkopf B., Burges C.J.C., and Smola A.J. (Eds). Advances in Kernel Methods-Support Vector Learning (1999), MIT Press, Cambridge, MA 185-208
8. K.P. Bennett, E. Bredensteiner, Geometry in learning, Web Manuscript, 〈http://www.rpi.edu/∼bennek〉. September 1996. Also in Geometry at Work, C. Gorini (Ed.), Mathematical Association of America, Washington, DC, 2000, pp. 132-145.
9. K.P. Bennett, E.J. Bredensteiner, Duality and geometry in SVM classifiers, in: P. Langley (Ed.), Proceedings of the 17th International Conference on Machine Learning, Morgan Kaufmann, Los Altos, CA, 2000, pp. 57-64. Also available at: 〈http://www.rpi.edu/∼bennek〉.
10. Keerthi S.S., Shevade S.K., Bhattacharyya C., et al. A fast iterative nearest point algorithm for support vector machine classifier design. IEEE Trans. Neural Networks 11 1 (2000) 124-136
11. Crisp D.J., and Burges C.J.C. A geometric interpretation of ν-SVM classifiers. Neural Inform. Process. Systems 12 (2000) 244-250
12. Gilbert E.G. An iterative procedure for computing the minimum of a quadratic form on a convex set. SIAM J. Control 4 1 (1966) 61-79
13. Mitchell B.F., Dem'yanov V.F., and Malozemov V.N. Finding the point of a polyhedron closet to the origin. SIAM J. Control 12 (1974) 19-26
14. Wang J., Tao Q., and Wang J. Kernel projection algorithm for large-scale SVM problems. J. Comput. Sci. Technol. 17 5 (2002) 556-564
15. n. Comput. Math. Appl. 40 (2000) 971-983
16. Franc V., and Hlaváč V. An iterative algorithm learning the maximal margin classifier. Pattern Recognition 36 (2003) 1985-1996
17. Schlesinger M.I., Kalmykov V.G., and Suchorukov A.A. Sravnitelnyj analiz algoritmov sinteza linejnogo reshajushchego pravila dlja proverki slozhnych gipotez (Comparative analysis of algorithms synthesising linear decision rule for analysis of complex hypotheses). Automatika 1 (1981) 3-9 (in Russian)
18. Schlesinger M.I., and Hlaváč V. Ten Lectures on Statistical and Structural Pattern Recognition (2002), Kluwer Academic Publishers, Dordrecht
19. T.T. Friess, R. Harrison, Support vector neural networks: the kernel adtron with bias and soft margin, Technical Report 725, University of Sheffield, UK, 1998.
20. Cortes C., and Vapnik V. Support vector networks. Machine Learning 20 (1995) 273-297
21. Schölkopf B., Smola A., Williamson R., and Bartlett P. New support vector algorithms. Neural Comput. 12 (2000) 1083-1121
22. Zhu J., Rosset S., Hastie T., and Tibshirani R. 1-norm Support Vector Machines. Neural Inform. Process. Systems 24 (2003)
23. Tao Q., Wu G.-W., and Wang J. A generalized S-K-algorithm for learning ν-SVM classifiers. Pattern Recognition Lett. 25 10 (2004) 1165-1171
24. Mangasarian O.L., and Bennett K.P. Robust linear programming discrimination of two linearly inseparable sets. Optim. Meth. Software 1 (1992) 23-34. http://www.rpi.edu/bennek Also available at 〈http://www.rpi.edu/∼bennek〉
25. Chang C.C., and Lin C.J. Training ν-support vector classifiers: theory and algorithms. Neural Comput. 13 9 (2001) 2119-2147
26. Tao Q., Wu G., Wang F.-Y., and Wang J. Posterior probability support vector machines for unbalanced data. IEEE Trans. Neural Networks 16 6 (2005) 1561-1573
27. Tao Q., and Wang J. A new fuzzy support vector machine based on the weighted margin. Neural Process. Lett. 20 (2004) 139-150