Large-scale linear support vector regression

Journal of Machine Learning Research

Volumn 13, Issue , 2012, Pages 3323-3348

  Ho, Chia Hua ^a   Lin, Chih Jen ^a  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

Author keywords

Coordinate descent methods; Newton methods; Support vector regression

Indexed keywords

COORDINATE DESCENT; LEARNING TECHNIQUES; SUPPORT VECTOR CLASSIFICATION; SUPPORT VECTOR REGRESSION (SVR); TRAINING METHODS;

NEWTON-RAPHSON METHOD; REGRESSION ANALYSIS;

VECTORS;

EID: 84870928469     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (25)

1. Thierry Bertin-Mahieux, Daniel P.W. Ellis, Brian Whitman, and Paul Lamere. The million song dataset. In In Proceedings of the Twelfth International Society for Music Information Retrieval Conference (ISMIR 2011), 2011.
2. Bernhard E. Boser, Isabelle Guyon, and Vladimir Vapnik. A training algorithm for optimal margin classifiers. In Proceedings of the Fifth Annual Workshop on Computational Learning Theory, pages 144-152. ACM Press, 1992. (Pubitemid 23615470)
3. Chih-Chung Chang and Chih-Jen Lin. LIBSVM: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology, 2:27:1-27:27, 2011. Software available at http://www.csie.ntu.edu.tw/?cjlin/libsvm.
4. Olivier Chapelle. Training a support vector machine in the primal. Neural Computation, 19(5): 1155-1178, 2007.
5. Corina Cortes and Vladimir Vapnik. Support-vector network. Machine Learning, 20:273-297, 1995.
6. Rong-En Fan, Kai-Wei Chang, Cho-Jui Hsieh, Xiang-Rui Wang, and Chih-Jen Lin. LIBLINEAR: A library for large linear classification. Journal of Machine Learning Research, 9:1871-1874, 2008. URL http://www.csie.ntu.edu.tw/?cjlin/ papers/liblinear.pdf.
7. Andrew Frank and Arthur Asuncion. UCI machine learning repository, 2010. URL http://archive.ics.uci.edu/ml.
8. Arthur E. Hoerl and Robert W. Kennard. Ridge regression: Biased estimation for nonorthogonal problems. Technometrics, 12(1):55-67, 1970.
9. Cho-Jui Hsieh, Kai-Wei Chang, Chih-Jen Lin, S. Sathiya Keerthi, and Sellamanickam Sundararajan. A dual coordinate descent method for large-scale linear SVM. In Proceedings of the Twenty Fifth International Conference on Machine Learning (ICML), 2008. URL http://www.csie.ntu. edu.tw/?cjlin/papers/ cddual.pdf.
10. Thorsten Joachims. Making large-scale SVM learning practical. In Bernhard Sch?olkopf, Christopher J. C. Burges, and Alexander J. Smola, editors, Advances in Kernel Methods -Support Vector Learning, pages 169-184, Cambridge, MA, 1998. MIT Press.
11. Thorsten Joachims. Training linear SVMs in linear time. In Proceedings of the Twelfth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2006.
12. S. Sathiya Keerthi and Dennis DeCoste. A modified finite Newton method for fast solution of large scale linear SVMs. Journal of Machine Learning Research, 6:341-361, 2005.
13. Shimon Kogan, Dimitry Levin, Bryan R. Routledge, Jacob S. Sagi, and Noah A. Smith. Predicting risk from financial reports with regression. In In Proceedings of the North American Association for Computational Linguistics Human Language Technologies Conference, pages 272-280, 2009.
14. Shuo-Peng Liao, Hsuan-Tien Lin, and Chih-Jen Lin. A note on the decomposition methods for support vector regression. Neural Computation, 14:1267-1281, 2002.
15. Chih-Jen Lin and Jorge J. Moŕe. Newton's method for large-scale bound constrained problems. SIAM Journal on Optimization, 9:1100-1127, 1999. (Pubitemid 129489319)
16. Chih-Jen Lin, Ruby C. Weng, and S. Sathiya Keerthi. Trust region Newton method for largescale logistic regression. Journal of Machine Learning Research, 9:627-650, 2008. URL http://www.csie.ntu.edu.tw/?cjlin/papers/logistic.pdf.
17. Olvi L. Mangasarian. A finite Newton method for classification. Optimization Methods and Software, 17(5):913-929, 2002. (Pubitemid 35476480)
18. Yurii E. Nesterov. Efficiency of coordinate descent methods on huge-scale optimization problems. Technical report, CORE Discussion Paper, Universit'e Catholique de Louvain, Louvain-la-Neuve, Louvain, Belgium, 2010. URL http://www.ucl.be/cps/ucl/doc/core/documents/coredp2010-2web.pdf.
19. John C. Platt. Fast training of support vector machines using sequential minimal optimization. In Bernhard Sch?olkopf, Christopher J. C. Burges, and Alexander J. Smola, editors, Advances in Kernel Methods -Support Vector Learning, Cambridge, MA, 1998. MIT Press.
20. Peter Richt'arik and Martin Tak'äc. Iteration complexity of randomized block-coordinate descent methods for minimizing a composite function. Technical report, School of Mathematics, University of Edinburgh, 2011.
21. Shai Shalev-Shwartz and Ambuj Tewari. Stochastic methods for l1-regularized loss minimization. Journal of Machine Learning Research, 12:1865-1892, 2011.
22. Shai Shalev-Shwartz, Yoram Singer, and Nathan Srebro. Pegasos: primal estimated sub-gradient solver for SVM. In Proceedings of the Twenty Fourth International Conference on Machine Learning (ICML), 2007.
23. Paul Tseng and Sangwoon Yun. A coordinate gradient descent method for nonsmooth separable minimization. Mathematical Programming, 117:387-423, 2009.
24. Vladimir Vapnik. The Nature of Statistical Learning Theory. Springer-Verlag, New York, NY, 1995.
25. Guo-Xun Yuan, Kai-Wei Chang, Cho-Jui Hsieh, and Chih-Jen Lin. A comparison of optimization methods and software for large-scale l1-regularized linear classification. Journal of Machine Learning Research, 11:3183-3234, 2010. URL http://www.csie.ntu.edu.tw/?cjlin/papers/l1.pdf.