An efficient implementation of an active set method for SVMs

Journal of Machine Learning Research

Volumn 7, Issue , 2006, Pages 2237-2257

  Scheinberg, Katya ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Active set methods; Quadratic programming; Support vector machines

Indexed keywords

ACTIVE SET METHODS; CONVEX QUADRATIC PROBLEMS; GENERALIZATION PROPERTIES; SUPPORT VECTOR MACHINE (SVM);

LARGE SCALE SYSTEMS; LEARNING SYSTEMS; NUMERICAL METHODS; PROBLEM SOLVING; QUADRATIC PROGRAMMING;

ALGORITHMS;

EID: 33745798002     PISSN: 15337928     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (22)

1. J. Balcazar, Y. Dai, and O Watanabe. Provably fast trainning algorithms for support vector machines. In Proc. 1st IEEE International Conference on Data Mining, pages 43-50. IEEE, 2001.
2. R. E. Bixby, J. W. Gregory, I. J. Lustig, R. E. Marsten, and D. F. Shanno. Very large-scale linear programming: A case study in combining interior point and simplex methods. Operations Research, 40(5):885-897, 1992.
3. C. L. Blake and C. J Merz. UCI repository of machine learning databases, 1998. URL http://www.ics.uci.edu/~mlearn/MLRepository. html.
4. B. Boser, I. Guyon, and V. N. Vapnik. A training algorithm for optimal margin classifiers. In D. Haussler, editor, Proceedings of the 5th Annual ACM Workshop on Computational Learning Theory, pages 144-152. ACM Press, 1992.
5. G. Cauwenberghs and T. Poggio. Incremental and decremental support vector machine learning. In Todd K. Leen, Thomas G. Dietterich, and Volker Tresp, editors, Advances in Neural Information Processing Systems 13, pages 409-415. MIT Press, 2001.
6. N. Cristianini and J. Shawe-Taylor. An Introductin to Support Vector Macines and Other Kernel-Based Learning Methods. Cambridge University Press, 2000.
7. M. C. Ferris and T. S. Munson. Interior point methods for massive support vector machines. Technical Report 00-05, Computer Sciences Department, University of Wisconsin, Madison, WI, 2000.
8. S. Fine and K. Scheinberg. Efficient svm training using low-rank kernel representations. Journal of Machine Learning Research, 2:243-264, 2001.
9. R. Fletcher. A general quadratic programming algorithm. Journal of the Institute of Mathematics and Its Applications, pages 76-91, 1971.
10. J. J. Forrest. Mathematical programming with a library of optimization subroutines. Presented at the ORSA/TIMS Joint National Meeting, 1989.
11. A. Frangioni. Solving semidefinite quadratic problems within nonsmooth optimization algorithms. Computers in Operations Research, 23(11): 1099-1118, 1996.
12. D. Goldfarb. Extension of newton's method and simplex method for solving quadratic problems. In F. A. Lootsma, editor, Numerical Methods for Nonlinear Optimization, pages 239-254. Academic Press, London, 1972.
13. D. Goldfarb and A. Idnani. A numerically stable dual method for solving strictly convex quadratic Programms. Mathematical Programming, 27:1-33, 1983.
14. G. H. Golub and Ch. F. Van Loan. Matrix Computations. The Johns Hopkins University Press, Baltimore and London, 3rd edition, 1996.
15. T. Hastie, S. Rosset, R. Tibshirani, and J. Zhu. The entire regularization path. Journal of Machine Learning Research, 5:1391-1415, 2004.
16. T. Joachims. Making large-scale support vector machine nlearning practicle. In B. Schölkopf, C. C. Burges, and A. J. Smola, editors, Advances in Kernel Methods, chapter 12, pages 169-184. MIT Press, 1999.
17. L. Kaufman. Solving the quadratic programming problem arising in support vector classification. In B. Schölkopf, C. C. Burges, and A. J. Smola, editors, Advances in Kernel Methods Support Vector Learning, pages 147-168. MIT Press, 1998.
18. K. C. Kiwiel. A dual method for certain positive semidefinite quadratic programming problems. SIAM Journal on Scientific and Statistical Computing, 10:175-186, 1989.
19. J Nocedal and S. Wright. Numerical Optimization. Springer-Verlag, 1999.
20. E. Osuna, R. Freund, and F. Girosi. An improved training algorithm for support vector machines. In Proceedings of the IEEE Neural Networks for Signal Processing VII Workshop, pages 276-285. IEEE, 1997.
21. J. C. Platt. Fast trining support vector machines using sequential mininal optimization. In B. Schölkopf, C. C. Burges, and A. J. Smola, editors, Advances in Kernel Methods, chapter 12, pages 185-208. MIT Press, 1999.
22. R. Vanderbei. Linear Programming: Foundations and Extensions. Sringer, New York, NY, 2nd edition, 2001.