Warm Start for parameter selection of linear classifiers

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn 2015-August, Issue , 2015, Pages 149-158

  Chu, Bo Yu ^a   Ho, Chia Hua ^a   Tsai, Cheng Hao ^a   Lin, Chieh Yen ^a   Lin, Chih Jen ^a  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

Author keywords

Linear classification; Regularization parameter; Warm start

Indexed keywords

OPTIMIZATION; PARAMETERIZATION;

BACK-GROUND KNOWLEDGE; LINEAR CLASSIFICATION; LOGISTIC REGRESSIONS; OPTIMIZATION PROBLEMS; OVER FITTING PROBLEM; REGULARIZATION PARAMETERS; REGULARIZATION TERMS; WARM START;

DATA MINING;

EID: 84954123004     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2783258.2783332     Document Type: Conference Paper

References (22)

1. J. F. Bonnans and A. Shapiro. Pertubation analysis of optimization problems. Springer-Verlag, 2000.
2. C.-C. Chang and C.-J. Lin. LIBSVM: A library for support vector machines. ACM TIST, 2(3):27:1-27:27, 2011.
3. O. Chapelle, V. Vapnik, O. Bousquet, and S. Mukherjee. Choosing multiple parameters for support vector machines. MLJ, 46:131-159, 2002.
4. K.-M. Chung, W.-C. Kao, C.-L. Sun, L.-L. Wang, and C.-J. Lin. Radius margin bounds for support vector machines with the RBF kernel. Neural Comput., 15:2643-2681, 2003.
5. D. DeCoste and K. Wagstaff. Alpha seeding for support vector machines. In KDD, 2000.
6. R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R. Wang, and C.-J. Lin. LIBLINEAR: a library for large linear classification. JMLR, 9:1871-1874, 2008.
7. J. H. Friedman, T. Hastie, and R. Tibshirani. Regularization paths for generalized linear models via coordinate descent. JSS, 33:1-22, 2010.
8. J. Giesen, M. Jaggi, and S. Laue. Approximating parameterized convex optimization problems. TALG, 9:10:1-10:17, 2012.
9. T. Hastie, S. Rosset, R. Tibshirani, and J. Zhu. The entire regularization path for the support vector machine. JMLR, 5:1391-1415, 2004.
10. C.-J. Hsieh, K.-W. Chang, C.-J. Lin, S. S. Keerthi, and S. Sundararajan. A dual coordinate descent method for large-scale linear SVM. In ICML, 2008.
11. W.-C. Kao, K.-M. Chung, C.-L. Sun, and C.-J. Lin. Decomposition methods for linear support vector machines. Neural Comput., 16(8):1689-1704, 2004.
12. S. S. Keerthi and C.-J. Lin. Asymptotic behaviors of support vector machines with Gaussian kernel. Neural Comput., 15(7):1667-1689, 2003.
13. S.-J. Kim, K. Koh, M. Lustig, S. Boyd, and D. Gorinevsky. An interior point method for large-scale l1-regularized least squares. IEEE J-STSP, 1:606-617, 2007.
14. R. Kohavi and G. H. John. Automatic parameter selection by minimizing estimated error. In ICML, 1995.
15. J.-H. Lee and C.-J. Lin. Automatic model selection for support vector machines. Technical report, 2000.
16. C.-J. Lin, R. C. Weng, and S. S. Keerthi. Trust region Newton method for large-scale logistic regression. JMLR, 9:627-650, 2008.
17. J. Matoušek and B. Gärtner. Understanding and Using Linear Programming. Springer, 2007.
18. J. Snoek, H. Larochelle, and R. P. Adams. Practical Bayesian optimization of machine learning algorithms. In NIPS. 2012.
19. R. Tibshirani, J. Bien, J. Friedman, T. Hastie, N. Simon, J. Taylor, and R. J. Tibshirani. Strong rules for discarding predictors in lasso-type problems. JRSSB, 74:245-266, 2012.
20. C.-H. Tsai, C.-Y. Lin, and C.-J. Lin. Incremental and decremental training for linear classification. In KDD, 2014.
21. Z. Wu, A. Zhang, C. Li, and A. Sudjianto. Trace solution paths for SVMs via parametric quadratic programming. DMMT, 2008.
22. G.-X. Yuan, C.-H. Ho, and C.-J. Lin. Recent advances of large-scale linear classification. PIEEE, 100:2584-2603, 2012.