Efficient computation and model selection for the support vector regression

Neural Computation

Volumn 19, Issue 6, 2007, Pages 1633-1655

  Gunter, Lacey ^a   Zhu, Ji ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOLOGICAL MODEL; COMPUTER SIMULATION; ECONOMICS; HUMAN; REGRESSION ANALYSIS; TIME;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; HUMANS; MODELS, BIOLOGICAL; PATTERN RECOGNITION, AUTOMATED; REGRESSION ANALYSIS; TIME FACTORS;

EFFICIENT COMPUTATION; ENTIRE SOLUTIONS; MODEL SELECTION; REGULARIZATION PARAMETERS; SOLUTION PATH; SUPPORT VECTOR REGRESSION MODELS; SUPPORT VECTOR REGRESSIONS; UNBIASED ESTIMATES;

DEGREES OF FREEDOM (MECHANICS);

EID: 34249726632     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/neco.2007.19.6.1633     Document Type: Article

References (32)

1. Allgower, E., & Georg, K. (1993). Continuation and path following. Acta Numerica, 2, 1-64.
2. Chang, C. C., & Lin, C. J. (2001). LIBSVM: A library for support vector machines. Taipei: Department of Computer Science and Information Engineering, National Taiwan University. Available online at http://www.csie.ntu.edu.tw/cjlin/libsvm/.
3. Chang, C. C., & Lin, C. J. (2002). Training v-support vector regression: Theory and algorithms. Neural Computation, 14(8), 1959-1977.
4. Chang, M. W., & Lin, C. J. (2005). Lea ve-one-outbounds for support vector regression model selection. Neural Computation, 17, 1188-1222.
5. Craven, P., & Wahba, G. (1979). Smoothing noisy data with spline function. Numerical Mathematics, 31, 377-403.
6. DeCoste, D., & Wagstaff, K. (2000). Alpha seeding for support vector machines. In Proceedings of Sixth ACM SIGKDD. New York: ACM Press.
7. Efron, B. (1986). How biased is the apparent error rate of a prediction rule? Journal of the American Statistical Association, 81, 461-470.
8. Efron, B. (2004). The estimation of prediction error: Covariance penalties and cross-validation. Journal of the American Statistical Association, 99, 619-632.
9. Friedman, J. (1991). Multivariate adaptive regression splines. Annals of Statistics, 19, 1-67.
10. Gondzio, J., & Grothey, A. (2001). Reoptimization with the primal-dual interior point method. SIAM, journal on Optimization, 13, 842-864.
11. Hastie, T., Rosset, S., Tibshirani, R., & Zhu, J. (2004). The entire regularization path for the support vector machine. Journal of Machine. Learning Research, 5, 1391-1415.
12. Hoerl, A., & Kennard, R. (1970). Ridge regression: Biased estimation for nonorthogonal problems. Technometrics, 12(3), 55-67.
13. Joachims, T. (1999). Making large-scale SVM learning practical. In B. Schölkopf, C. Burges, & A. Smola (Eds.), Advances in kernel methods - Support vector learning (pp. 169-184). Cambridge, MA: MIT Press.
14. Keerthi, S., Shevade, S., Bhattacharyya, C., & Murthy, K. (1999). Improvements to Plait's SMO algorithm for SVM classifier design. (Tech. Rep. Mechanical and Production Engineering, CD-99-14). Singapore: National University of Singapore.
15. Kimeldorf, G., & Wahba, G. (1971). Some results on Tchebycheffian spline functions. Journal of Mathematical Analysis and Applications, 33, 82-95.
16. Ma, J., Theiler, J., & Perkins, S. (2003). Accurate on-line support vector regression. Neural Computation, 15, 2683-2703.
17. Meyer, M., & Woodroofe, M. (2000). On the degrees of freedom in shape-restricted regression. Annals of Statistics, 28, 1083-1104.
18. Müller, K., Smola, A., Rätsch, G., Schölkopf, B., Kohlmorgen, J., & Vapnik, V. (1997). Predicting time series with support vector machines. In Proceedings of the. Seventh International Conference on Artificial Neural Networks (pp. 999-1004). Berlin: Springer-Verlag.
19. O'Sullivan, F. (1985). Discussion of "Some aspects of the spline smoothing approach to nonparametric curve fitting" by B. W. Silverman. Journal of the. Royal Statistical Society, Series B, 36, 111-147.
20. Osuna, E., Freund, R., & Girosi, F. (1997). An improved training algorithm for support vector machines. In Proceedings of the IEEE Neural Networks for Signal Processing VII Workshop (pp. 276-285). Piscataway, NJ: IEEE Press.
21. Platt, J. (1999). Fast training of support vector machines using sequential minimal optimization. In B. Schölkopf, C. Burges, & A. Smola (Eds.), Advances in kernel methods - Support vector learning (pp. 185-208). Cambridge, MA: MIT Press.
22. Schölkopf, B., Smola, A., Williamson, R., & Bartlett, P. (2000). New support vector algorithms. Neural Computation, 12, 1207-1245.
23. Shpigelman, L., Crammer, K., Paz, R., Vaadia, E., & Singer, Y. (2004). A temporal kernel-based model for tracking hand movements from neural activities. In L. K. Saul, Y. Weiss, & L. Bottou (Eds.). Advances in neural information processing systems, 17. Cambridge, MA: MIT Press.
24. Smola, A., & Schölkopf, B. (2004). A tutorial on support vector regression. Statistics and Computing, 14, 199-222.1
25. Stein, C. (1981). Estimation of the mean of a multivariate normal distribution. Annals of Statistics, 9(6), 1135-1151.
26. Stone, M. (1974). Cross-validation choice and assessment of statistical predictors (with discussion). Journal of the Royal Statistical Society Series B, 36, 111-147.
27. Vanderbei, R. (1994). LOQO: An interior point code, for quadratic programming (Tech. Rep., Statistics and Operations Research SOR-94-15). Princeton, NJ: Princeton University.
28. Vapnik, V. (1995). The nature of statistical learning theory. New York: Springer-Verlag.
29. Vapnik, V., Golowich, S., & Smola, A. (1996). Support vector method for function approximation, regression estimation, and signal processing. In M. Mozer, M. Jordan, T. Petsche (Eds.), Advances in neural information processing systems, 9. Cambridge, MA: MIT Press.
30. Wahba, C. (1990). Spline models for observational data. Philadelphia: SIAM.
31. Ye, J. (1998). On measuring and correcting the effects of data mining and model selection. Journal of the American Statistical Association, 93(441), 120-131.
32. Zou, H., Hastie, T., & Tibshirani, R. (2005). On the degrees of freedom of the lasso (Tech. Rep.). Palo Alto, CA: Department of Statistics, Stanford University.