A multi-class SVM approach based on the l1-norm minimization of the distances between the reduced convex hulls

Pattern Recognition

Volumn 48, Issue 5, 2015, Pages 1598-1607

  Carrasco, Miguel ^a   López, Julio ^b   Maldonado, Sebastián ^a  

^a UNIVERSIDAD DE LOS ANDES   (Chile)

^b UNIVERSIDAD DIEGO PORTALES   (Chile)

Author keywords

Linear programming; Multi class classification; Support vector machines

Indexed keywords

BENCHMARKING; CLASSIFIERS; COMPUTATIONAL GEOMETRY; LEARNING SYSTEMS; LINEAR PROGRAMMING; PATTERN RECOGNITION; QUADRATIC PROGRAMMING; SUPPORT VECTOR MACHINES;

BENCHMARK DATASETS; CLASSIFICATION PERFORMANCE; DECISION FUNCTIONS; DUAL FORMULATIONS; L1-NORM MINIMIZATIONS; LINEAR PROGRAMMING FORMULATION; MULTI-CLASS CLASSIFICATION; REDUCED CONVEX HULLS;

CLASSIFICATION (OF INFORMATION);

EID: 84921656902     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2014.12.006     Document Type: Article

References (38)

1. R. Ñanculef, C. Concha, H. Allende, D. Candel, and C. Moraga Ad-svms a light extension of svms for multicategory classification Int. J. Hybrid Intell. Syst. 6 2009 69 79
2. S. Armstrong, J. Staunton, L. Silverman, R. Pieters, M. den Boer, M. Minden, S. Sallan, E. Lander, T. Golub, and S. Korsmeyer MLL translocations specify a distinct gene expression profile that distinguishes a unique leukemia Nat. Genet. 30 2002 41 47
3. A. Asuncion, D. Newman, UCI Machine Learning Repository, 2007.
4. K. Bennett, E. Bredensteiner, Duality and geometry in svm classifiers, in: Proceedings of 17th International Conference on Machine Learning, Morgan Kaufmann, San Francisco, 2000, pp. 57-64.
5. C. Bhattacharyya Second order cone programming formulations for feature selection J. Mach. Learn. Res. 5 2004 1417 1433
6. C.C. Chang, and C.J. Lin LIBSVM a library for support vector machines ACM Trans. Intell. Syst. Technol. 2 2011 27:1-27:27. Software available at: 〈 http://www.csie.ntu.edu.tw/ cjlin/libsvm 〉
7. K. Crammer, and Y. Singer On the algorithmic implementation of multiclass kernel-based vector machines J. Mach. Learn. Res. 2 2001 265 292
8. D.J. Crisp, C. Burges, A geometric interpretation of v-svm classifiers, in: Advances in Neural Information Processing Systems, The MIT Press, 1999, pp. 244-250.
9. N. Cristianini, and J. Shawe-Taylor An Introduction to Support Vector Machines and Other Kernel-based Learning Methods 2000 Cambridge University Press New York
10. N. Djuric, L. Lan, S. Vucetic, and Z. Wang Budgetedsvm a toolbox for scalable svm approximations J. Mach. Learn. Res. 14 2013 3813 3817
11. T.A. Ferguson Bayesian analysis of some nonparametric problems Ann. Stat. 1 1973 209 230
12. R. Fletcher Practical Methods of Optimization 1989 John Wiley and Sons New York
13. J. Friedman, Another Approach to Polychotomous Classification, Technical Report, Department of Statistics, Stanford University, 1996.
14. M. Galar, A. Fernández, E. Barrenechea, H. Bustince, and F. Herrera Dynamic classifier selection for one-vs-one strategy avoiding non-competent classifiers Pattern Recognit. 46 2013 3412 3424
15. R. Jenssen, M. Kloft, A. Zien, S. Sonnenburg, K. Müller, A Multi-Class Support Vector Machine Based on Scatter Criteria, Technical Report 014-2009, Technische Universität Berlin, 2009.
16. R. Jenssen, M. Kloft, A. Zien, S. Sonnenburg, and K. Müller A scatter-based prototype framework and multi-class extension of support vector machines PLoS ONE 7 2012 e42947
17. U.G. Kressel Advances in Kernel Methods 1999 MIT Press Cambridge, MA, USA 255 268
18. Y. Lee, Y. Lin, and W. G Multicategory support vector machines, theory, and application to the classification of microarray data and satellite radiance data J. Am. Stat. Assoc. 99 2004 67 81
19. D.G. Luenberger Linear and Nonlinear Programming 2nd ed. 2003 Kluwer Academic Publishers Boston, MA
20. S. Maldonado, and J. López Alternative second-order cone programming formulations for support vector classification Inf. Sci. 268 2014 328 341
21. S. Maldonado, and J. López Imbalanced data classification using second-order cone programming support vector machines Pattern Recognit. 47 2014 2070 2079
22. S. Maldonado, R. Weber, and J. Basak Kernel-penalized SVM for feature selection Inf. Sci. 181 2011 115 128
23. J. Mercer Functions of positive and negative type, and their connection with the theory of integral equations Philos. Trans. R. Soc. Lond. 209 1909 415 446
24. M. Momma, K. Hatano, H. Nakayama, Ellipsoidal support vector machines, in: Proceedings of the Asian Conference on Machine Learning (ACML-10), 2010.
25. S. Nath, C. Bhattacharyya, Maximum margin classifiers with specified false positive and false negative error rates, in: Proceedings of the SIAM International Conference on Data Mining, 2007.
26. C. Nutt, D. Mani, R. Betensky, P. Tamayo, J. Cairncross, C. Ladd, U. Pohl, C. Hartmann, M. McLaughlin, T. Batchelor, P. Black, A. von Deimling, S. Pomeroy, T. Golub, and D. Louis Gene expression-based classification of malignant gliomas correlates better with survival than histological classification Cancer Res. 63 2003 1602 1607
27. J. Platt Advances in Kernel Methods-Support Vector Learning 1999 MIT Press Cambridge, MA 185 208
28. B. Schölkopf, and A.J. Smola Learning with Kernels 2002 MIT Press Cambridge
29. S. Shalev-Shwartz, Y. Singer, N. Srebro, and A. Cotter Pegasos primal estimated sub-gradient solver for svm Math. Programm. 127 2011 3 30
30. R. Strack, V. Kecman, B. Strack, and Q. Li Sphere support vector machines for large classification tasks Neurocomputing 101 2013 59 67
31. V. Vapnik Statistical Learning Theory 1998 John Wiley and Sons New York
32. Z. Wang, K. Crammer, S. Vucetic, Multi-class pegasos on a budget, in: Proceedings of the 27th International Conference on Machine Learning (ICML-10), Omnipress, 2010, pp. 1143-1150.
33. Z. Wang, K. Crammer, and S. Vucetic Breaking the curse of kernelization budgeted stochastic gradient descent for large-scale SVM training J. Mach. Learn. Res. 13 2012 3103 3131
34. Z. Wang, N. Djuric, K. Crammer, S. Vucetic, Trading representability for scalability: adaptive multi-hyperplane machine for nonlinear classification, in: Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM, 2011, pp. 24-32.
35. J. Weston, A. Elisseeff, G. BakIr, F. Sinz, The Spider Machine Learning Toolbox, 2005.
36. J. Weston, C. Watkins, Multi-class support vector machines, in: Proceedings of the Seventh European Symposium on Artificial Neural Networks, 1999.
37. W. Zhou, L. Zhang, and L. Jiao Linear programming support vector machines Pattern Recognit. 35 2002 2927 2936
38. J. Zhu, N. Chen, E.P. Xing, Infinite svm: a Dirichlet process mixture of large-margin kernel machines, in: Proceedings of the 28th International Conference on Machine Learning (ICML-11), 2011, pp. 617-624.