Model selection for primal SVM

Machine Learning

Volumn 85, Issue 1-2, 2011, Pages 175-208

  Moore, Gregory ^a   Bergeron, Charles ^a   Bennett, Kristin P ^a  

^a RENSSELAER POLYTECHNIC INSTITUTE   (United States)

Author keywords

Bilevel programming; Cross validation; Model selection; Nonconvex optimization; Support vector machines

Indexed keywords

BI-LEVEL PROGRAMMING; CROSS VALIDATION; MODEL SELECTION; NONCONVEX OPTIMIZATION; SUPPORT VECTOR;

ALGORITHMS; OPTIMIZATION; PROBLEM SOLVING; SUPPORT VECTOR MACHINES;

LEAST SQUARES APPROXIMATIONS;

EID: 80053050901     PISSN: 08856125     EISSN: 15730565     Source Type: Journal    
DOI: 10.1007/s10994-011-5246-7     Document Type: Article

References (27)

1. Bazaraa, M. S., Sherali, H. D. & Shetty, C. M. (2006). Nonlinear programming theory and algorithms. New York: Wiley.
2. Bennett, K. P., Hu, J., Ji, X., Kunapuli, G., & Pang, J. S. (2006). Model selection via bilevel optimization. In International joint conference on neural networks (pp. 1922-1929). (Pubitemid 351369560)
3. Bennett, K. P., Kunapuli, G., Hu, J., & Pang, J. S. (2008). Bilevel optimization and machine learning. In J. Zurada et al. (Eds.), Lecture notes in computer science: Vol. 5050. Computational intelligence: research frontiers: IEEE WCCI 2008, Hong Kong, China, 1-6 June, 2008: Plenary/invited Lectures (pp. 25-47). New York: Springer.
4. Bergeron, C., Moore, G., Krein, M., Breneman, C. M., & Bennett, K. P. (2011a). Exploiting domain knowledge for improved quantitative high-throughput screening curve fitting. Journal of Chemical Information and Modeling
5. Bergeron, C., Moore, G., Zaretzki, J., Breneman, C. M. & Bennett, K. P. (2011b). Fast bundle algorithm for multiple instance learning. IEEE Transactions on Pattern Analysis and Machine Intelligence
6. J. Bracken J. McGill 1973 Mathematical programs with optimization problems in the constraints Operations Research 21 37 44 359797 0263.90029 10.1287/opre.21.1.37
7. C. Breneman M. Rhem 1997 A QSPR analysis of hplc column capacity factors for a set of high-energy materials using electronic van der Waals surface property descriptors computed by the transferable atom equivalent method Journal of Computational Chemistry 18 2 182 197 10.1002/(SICI)1096-987X(19970130)18: 2<182::AID-JCC4>3.0.CO;2-R (Pubitemid 127598564)
8. O. Chapelle V. Vapnik O. Bousquet S. Mukherjee 2002 Choosing multiple parameters for support vector machines Machine Learning 46 1-3 131 159 0998.68101 10.1023/A:1012450327387 (Pubitemid 34129966)
9. Clarke, F. H. (1990). Optimization and nonsmooth analysis. New York: Wiley.
10. B. Colson P. Marcotte G. Savard 2007 An overview of bilevel programming Annals of Operation Research 153 235 256 2329985 1159.90483 10.1007/s10479-007- 0176-2
11. S. Dempe 2003 Annotated bibliography on bilevel programming and mathematical programs with equilibrium constraints Optimization 52 333 359 1996321 1140.90493 10.1080/0233193031000149894 (Pubitemid 36995924)
12. Do, C., Foo, C. S., & Ng, A. (2008). Efficient multiple hyperparameter learning for log-linear models. In Advances in neural information processing systems 20 (pp. 377-384).
13. T. Eitrich B. Lang 2006 Efficient optimization of support vector machine learning parameters for unbalanced datasets Journal of Computational and Applied Mathematics 196 2 425 436 2249433 1097.68113 10.1016/j.cam.2005.09.009 (Pubitemid 44093872)
14. G. H. Golub M. Heath G. Wahba 1979 Generalized cross-validation as a method for choosing a good ridge parameter Technometrics 21 2 215 223 533250 0461.62059 10.2307/1268518
15. Joachims, T. (2006). Training linear SVMs in linear time. In Knowledge discovery and data mining (pp. 217-226). (Pubitemid 44535518)
16. Keerthi, S., Sindhwani, V., & Chapelle, O. (2006). An efficient method for gradient-based adaptation of hyperparameters in svm models. In Neural information processing systems 18 (pp. 673-680).
17. Kunapuli, G., Bennett, K. P., & Pang, J. S. (2008). Bilevel model selection for support vector machines. In P. Pardalos & P. Hansen (Eds.), AMS: Vol. 45. Data mining and mathematical programming (pp. 129-158).
18. Mangasarian, O. L. (1994). Nonlinear programming. New York: McGraw-Hill.
19. Momma, M., & Bennett, K. P. (2002). A pattern search method for model selection of support vector regression. In Proceedings of the second SIAM international conference on data mining.
20. Moore, G., Bergeron, C., & Bennett, K. P. (2009). Nonconvex bilevel programming for hyperparameter selection. In Proceedings of the 2009 IEEE international conference on data mining workshops (pp. 374-381).
21. D. Noll O. Prot A. Rondepierre 2008 A proximity control algorithm to minimize nonsmooth and nonconvex functions Pacific Journal of Optimization 4 571 604 2541264 1162.49020
22. Pang, J. S., & Sun, D. (2008). First-order sensitivity of linearly constrained strongly monotone composite variational inequalities. Technical report.
23. Ruszczyński, A. (2006). Nonlinear optimization. Princeton: Princeton University Press.
24. Seeger, M. (1999). Bayesian model selection for support vector machines, Gaussian processes and other kernel classifiers. In Advances in neural information processing systems (pp. 603-609).
25. Skajaa, A. (2010). Limited memory bfgs for nonsmooth optimization. Master's thesis, Courant Institute of Mathematical Science, New York University.
26. Suykens, J., Brabanter, J., & Gestel, T. V. (2002). Least squares support vector machines. Singapore: World Scientific.
27. Teo, C. H., Le, Q. V., Smola, A., & Vishwanathan, S. V. N. (2007). A scalable modular convex solver for regularized risk minimization. In Proceedings of the ACM SIGKDD international conference on knowledge discovery and data mining (pp. 727-736). (Pubitemid 350229258)