Support vector machines with the ramp loss and the hard margin loss

Operations Research

Volumn 59, Issue 2, 2011, Pages 467-479

  Brooks, J Paul ^a  

^a VIRGINIA COMMONWEALTH UNIVERSITY   (United States)

Author keywords

Integer applications; Pattern analysis; Programming; Quadratic integer programming; Statistics; Support vector machines

Indexed keywords

COMPUTATIONAL PERFORMANCE; COMPUTATIONAL STUDIES; CONSISTENT ESTIMATORS; INTEGER APPLICATIONS; INTEGER PROGRAMMING FORMULATIONS; KERNEL FUNCTION; LINEAR KERNEL; LOSS FUNCTIONS; MAXIMUM ERROR; MIXED-INTEGER PROGRAMS; NP-HARD; OPTIMALITY; PATTERN ANALYSIS; PROGRAMMING; QUADRATIC INTEGER PROGRAMMING; QUADRATIC PROGRAMS; REAL WORLD DATA; SOLUTION METHODS;

GEARS; INTEGER PROGRAMMING;

SUPPORT VECTOR MACHINES;

EID: 79957523845     PISSN: 0030364X     EISSN: 15265463     Source Type: Journal    
DOI: 10.1287/opre.1100.0854     Document Type: Article

References (42)

1. Asuncion, A., D. J. Newman. 2007. UCI machine learning repository. University of California, Irvine, http://www.ics.uci.edu/-mlearn/MLRepository. html.
2. Bartlett, P., S. Mendelson. 2002. Rademacher and Gaussian complexities: Risk bounds and structural results. J. Machine Learn. Res. 3 463-482.
3. Bennett, K. P., A. Dimiriz. 1998. Semi-supervised support vector machines. Proc. Neural Inform. Processing Systems. Neural Information Processing Systems Foundation, Boston, MA, 368-374.
4. Bertsimas, D., R. Shioda. 2007. Classification and regression via integer optimization. Oper. Res. 55 252-271. (Pubitemid 46663460)
5. Breiman, L. 1998. Arcing classifiers. Ann. Statist. 26 801-824.
6. Breiman, L., A. Cutler. 2009. randomForest: Breiman and Cutler's Random Forests for Classification and Regression. R port, A. Liaw, M. Wiener. http://cran.r-project.org/web/packages/randomForest/index.html
7. Brooks, J. P., E. K. Lee. 2010. Analysis of the consistency of a mixed integer programming-based multi-category constrained discriminant model. Ann. Oper. Res. 174(1) 147-168.
8. Brooks, J. P., R. Shioda, A. Spencer. 2007. Discrete support vector machines. Technical Report CandO Research Report: CORR 2007-12, Department of Combinatorics and Optimization, University of Waterloo, Waterloo, Ontario, Canada.
9. Chapelle, O., V. Sindhwani, S. S. Keerthi. 2008. Optimization techniques for semi-supervised support vector machines. J. Machine Learn. Res. 9 203-233. (Pubitemid 351469022)
10. Chen, C., O. L. Mangasarian. 1996. Hybrid misclassification minimization. Adv. Computational Math. 5 127-136.
11. Christmann, A., I. Steinwart. 2004. On robustness properties of convex risk minimization methods for pattern recognition. J. Machine Learn. Res. 5 1007-1034.
12. Collobert, R., F. Sinz, J. Weston, L. Bottou. 2006. Trading convexity for scalability. Proc. 23rd Internat. Conf. Machine Learning. International Machine Learning Society, Princeton, NJ.
13. Cortes, C., V. Vapnik. 1995. Support-vector networks. Machine Learning 20(3) 273-297.
14. Cover, T. 1968. Rates of convergence for nearest neighbor procedures. Proc. Hawaii Internat. Conf. System Sci., Honolulu, 413-415.
15. Devroye, L., L. Györfi, G. Lugosi. 1996. A Probabilistic Theory of Pattern Recognition. Springer, New York.
16. Duda, R. O., P. E. Hart, D. G. Stork. 2001. Pattern Classification. Wiley, Hoboken, NJ.
17. Gallagher, R. J., E. K. Lee, D. A. Patterson. 1997. Constrained discriminant analysis via 0/1 mixed integer programming. Ann. Oper. Res. 74 65-88.
18. ILOG CPLEX 11.1 Reference Manual. 2008. ILOG, Incline Village, NV.
19. Joachims, T. 1999. Making large-scale SVM learning practical. B. Schölkopf, C. Burges, A. Smola, eds. Advances in Kernel Methods-Support Vector Learning, B. MIT Press, Cambridge, MA.
20. Johnson, D. S., F. P. Preparata. 1978. The densest hemisphere problem. Theoret. Comput. Sci. 6 93-107.
21. Koehler, G. J., S. S. Erenguc. 1990. Minimizing misclassifications in linear discriminant analysis. Decision Sci. 21 63-85.
22. Liu, Y., X. Shen, H. Doss. 2005. Multicategory .-learning and support vector machine: Computational tools. J. Comput. Graphical Statist. 14 219-236. (Pubitemid 40447834)
23. Mangasarian, O. L. 1965. Linear and nonlinear separation of patterns by linear programming. Oper. Res. 13 444-452.
24. Mangasarian, O. L. 1968. Multi-surface method of pattern separation. IEEE Trans. Inform. Theory 14 801-807.
25. Mangasarian, O. L., W. H. Wolberg. 1990. Cancer diagnosis via linear programming. SIAM News 23 1-18.
26. McDiarmid, C. 1989. On the method of bounded differences. Surveys in Combinatorics 1989. Cambridge University Press, Cambridge, UK, 148-188.
27. Nemhauser, G. L., L. A. Wolsey. 1999. Integer and Combinatorial Optimization. Wiley, New York.
28. Orsenigo, C., C. Vercellis. 2003. Multivariate classification trees based on minimum features discrete support vector machines. IMA J. Management Math. 14 221-234.
29. Orsenigo, C., C. Vercellis. 2007a. Evaluating membership functions for fuzzy discrete SVM. Lecture Notes Artificial Intelligence: Appl. Fuzzy Sets Theory 4578 187-194. (Pubitemid 350284255)
30. Orsenigo, C., C. Vercellis. 2007b. Softening the margin in discrete SVM. Lecture Notes Artificial Intelligence: Adv. Data Mining 4597 49-62.
31. Pérez-Cruz, F., A. R. Figueiras-Vidal. 2003. Empirical risk minimization for support vector classifiers. IEEE Trans. Neural Networks 14 296-303.
32. R Development Core Team. 2009. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria.
33. Schliep, K., K. Hechenbichler. 2009. kknn: Weighted k-Nearest Neighbors Classification and Regression. http://cran.r-project.org/web/packages/kknn/ index.html.
34. Shawe-Taylor, J., N. Cristianini. 2004. Kernel Methods for Pattern Analysis. Cambridge University Press, Cambridge, UK.
35. Shen, X., G. C. Tseng, X. Zhang, W. H. Wong. 2003. On .-learning. J. Amer. Statist. Assoc. 98 724-734.
36. Steinwart, I. 2001. On the influence of the kernel on the consistency of support vector machines. J. Machine Learn. Res. 2 67-93.
37. Steinwart, I. 2002. Support vector machines are universally consistent. J. Complexity 18 768-791.
38. Steinwart, I. 2005. Consistency of support vector machines and other regularized kernel classifiers. IEEE Trans. Inform. Theory 51 128-142. (Pubitemid 40145991)
39. Steinwart, I., A. Christmann. 2008. Support Vector Machines. Springer, New York.
40. Therneau, T. M., B. Atkinson. 2009. rpart: Recursive Partitioning. R port, B. Ripley. http://cran.r-project.org/web/packages/rpart/index.html.
41. Vapnik, V. 1998. Statistical Learning Theory. Wiley, New York.
42. Xu, L., K. Crammer, D. Schuurmans. 2006. Robust support vector machine training via convex outlier ablation. Proc. National Conf. Artificial Intelligence (AAAI-06), Association for the Advancement of Artificial Intelligence, Menlo Park, CA.