Fast optimization of hyperparameters for support vector regression models with highly predictive ability

Chemometrics and Intelligent Laboratory Systems

Volumn 142, Issue , 2015, Pages 64-69

  Kaneko, Hiromasa ^a   Funatsu, Kimito ^a  

^a UNIVERSITY OF TOKYO   (Japan)

Author keywords

Computational time; Hyperparameter; Optimization; Predictive ability; Support vector regression

Indexed keywords

ARTICLE; CALCULATION; CONTROLLED STUDY; MATHEMATICAL COMPUTING; NONLINEAR REGRESSION ANALYSIS; PREDICTION; PROCESS OPTIMIZATION; QUANTITATIVE STRUCTURE ACTIVITY RELATION; STATISTICAL MODEL; STATISTICAL PARAMETERS; SUPPORT VECTOR MACHINE; VALIDATION PROCESS;

EID: 84922595610     PISSN: 01697439     EISSN: 18733239     Source Type: Journal    
DOI: 10.1016/j.chemolab.2015.01.001     Document Type: Article

References (22)

1. Frank I.E., Friedman J.H. A statistical view of some chemometrics regression tools. Technometrics 1993, 35:109-135.
2. Tibshirani R. Regression shrinkage and selection via the lasso. J. R. Stat. Soc. 1996, 58:267-288.
3. Wold S. Principal component analysis. Chemom. Intell. Lab. Syst. 1987, 2:37-52.
4. Wold S., Sjöström M., Eriksson L. PLS-regression: a basic tool of chemometrics. Chemom. Intell. Lab. Syst. 2001, 58:109-130.
5. Rantanen J., Rasanen E., Antikainen O., Mannermaa J.P., Yliruusi J. In-line moisture measurement during granulation with a four-wavelength near-infrared sensor: an evaluation of process-related variables and a development of non-linear calibration model. Chemom. Intell. Lab. Syst. 2001, 56:51-58.
6. Arakawa M., Hasegawa K., Funatsu K. QSAR study of anti-HIV HEPT analogues based on multi-objective genetic programming and counter-propagation neural network. Chemom. Intell. Lab. Syst. 2006, 83:91-98.
7. Kim K., Lee J.M., Lee I.B. A novel multivariate regression approach based on kernel partial least squares with orthogonal signal correction. Chemom. Intell. Lab. Syst. 2005, 79:22-30.
8. Chen T., Morris J., Martin E. Gaussian process regression for multivariate spectroscopic calibration. Chemom. Intell. Lab. Syst. 2007, 87:59-67.
9. Li H.D., Liang Y.Z., Xu Q.S. Support vector machines and its applications in chemistry. Chemom. Intell. Lab. Syst. 2009, 95:188-198.
10. Baumann K. Cross-validation as the objective function for variable-selection techniques. TrAC Trends Anal. Chem. 2003, 22:395-406.
11. Golbraikh A., Tropsha A. Beware of q2!. J. Mol. Graph. Model. 2002, 20:269-276.
12. Kaneko H., Funatsu K. Criterion for evaluating the predictive ability of nonlinear regression models without cross-validation. J. Chem. Inf. Model. 2013, 53:2341-2348.
13. Bergstra J., Bengio Y. Random search for hyper-parameter optimization. J. Mach. Learn. Res. 2012, 13:281-305.
14. Howe D., Costanzo M., Fey P., Gojobori T., Hannick L., Hide W., Hill D.P., Kania R., Schaeffer M., St Pierre S., Twigger S., White O., Rhee S.Y. Big data: the future of biocuration. Nature 2008, 455:47-50.
15. Camacho J. Visualizing big data with compressed score plots: approach and research challenges. Chemom. Intell. Lab. Syst. 2014, 135:110-125.
16. Cherkassky V., Ma Y. Practical selection of SVM parameters and noise estimation for SVM regression. Neural Netw. 2004, 17:113-126.
17. Tang Y., Guo W., Gao J. Efficient model selection for support vector machine with Gaussian kernel function. Proc. Comput. Intell. Data Min. 2009, 40-45.
18. Hou T.J., Xia K., Zhang W., Xu X.J. ADME evaluation in drug discovery. 4. Prediction of aqueous solubility based on atom contribution approach. J. Chem. Inf. Comput. Sci. 2004, 44:266-275.
19. http://www.talete.mi.it/products/dragon_description.htm.
20. http://www.cadaster.eu/node/65.
21. Bishop C.M. Pattern Recognition and Machine Learning 2006, Springer, New York.
22. http://www.csie.ntu.edu.tw/~cjlin/libsvm/.