A new solution path algorithm in support vector regression

IEEE Transactions on Neural Networks

Volumn 19, Issue 10, 2008, Pages 1753-1767

  Wang, Gang ^a,b   Yeung, Dit Yan ^a   Lochovsky, Frederick H ^a  

^a HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

^b MICROSOFT RESEARCH ASIA   (China)

Author keywords

Model selection; Solution path; Support vector regression (SVR)

Indexed keywords

BOOLEAN FUNCTIONS; REGRESSION ANALYSIS; SOLUTIONS; VECTORS;

EFFICIENT; ERROR PARAMETERS; HYPER-PARAMETER; MODEL SELECTION; MODEL SELECTION PROBLEMS; NEW SOLUTIONS; PATH ALGORITHMS; PIECEWISE; PRACTICAL USES; REGULARIZATION PATHS; SOLUTION PATH; SOLUTION PATHS; SOLUTION SPACES; SUPPORT VECTOR REGRESSION (SVR); SUPPORT VECTOR REGRESSIONS;

ALGORITHMS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; COMPUTER SIMULATION; FEEDBACK SYSTEM; MATHEMATICAL COMPUTING; REGRESSION ANALYSIS; STATISTICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; FEEDBACK; MODELS, STATISTICAL; NEURAL NETWORKS (COMPUTER); NUMERICAL ANALYSIS, COMPUTER-ASSISTED; REGRESSION ANALYSIS;

EID: 54349106864     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2008.2002077     Document Type: Article

References (27)

1. V. N. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.
2. B. Schölkopf and A. Smola, Learning with Kernels. Cambridge, MA: MIT Press, 2002.
3. B. Scholkopf, A. Smola, R. Williamson, and P. Bartlett, "New support vector algorithms," Neural Comput., vol. 12, pp. 1207-1245, 2000.
4. S. Rosset and J. Zhu, "Piecewise linear regularized solution paths," Stanford Univ., Stanford, CA, Tech. Rep., 2003.
5. J. Zhu, S. Rosset, T. Hastie, and R. Tibshirani, "1-norm support vector machines," in Advances in Neural Information Processing Systems 16 Cambridge, MA: MIT Press, 2003.
6. B. Efron, T. Hastie, I. Johnstone, and R. Tibshirani, "Least angle regression," Ann. Statist., vol. 32, no. 2, pp. 407-499, 2004.
7. T. Hastie, S. Rosset, R. Tibshirani, and J. Zhu, "The entire regularization path for the support vector machine," J. Mach. Learn. Res., vol. 5, pp. 1391-1415, 2004.
8. F. Bach, R. Thibaux, and M. Jordan, "Regularization paths for learning multiple kernels," in Advances in Neural Information Processing Systems 17. Cambridge, MA: MIT Press, 2005.
9. L. Gunter and J. Zhu, "Efficient computation and model selection for the support vector regression," Neural Comput., vol. 19, no. 6, pp. 1633-1655, 2007.
10. E. Allgower and K. Georg, Numerical Continuation Methods, B. Heidelberg, Ed. New York: Springer-Verlag, 1990.
11. S. Rosset, "Following curved regularized optimization solution paths," in Advances in Neural Information Processing Systems 17. Cambridge, MA: MIT Press, 2004.
12. S. Rosset, J. Zhu, and T. Hastie, "Boosting as a regularized path to a maximum margin classifier," J. Mach. Learn. Res., vol. 5, pp. 941-973, 2004.
13. C. Williams and M. Seeger, "Using the Nyström method to speed up kernel machines," in Advances in Neural Information Processing Systems 13. Cambridge, MA: MIT Press, 2000.
14. A. Smola and B. Schölkopf, "Sparse greedy matrix approximation for machine learning," in Proc. 17st Int. Conf. Mach. Learn., 2000, pp. 911-918.
15. E. Osuna, R. Freund, and F. Girosi, "An improved training algorithm for support vector machines," in Proc. IEEE Workshop Neural Netw. Signal Process., 1997, pp. 276-285.
16. T. Joachims, "Making large-scale support vector machine learning practical," in Advances in Kernel Methods-Support Vector Learning Cambridge, MA: MIT Press, 1999.
17. J. Platt, "Fast training of support vector machines using sequential minimal optimization," in Advances in Kernel Methods-Support Vector Learning. Cambridge, MA: MIT Press, 1999.
18. C. C. Chang and C. J. Lin, L1BSVM: A Library for Support Vector Machines, 2001 [Online]. Available: http://www.csie.ntu.edu.tw/~cjlin/ libsvm/
19. S. Keerthi, S. K. Shevade, C. Bhattacharyya, and K. Murthy, "Improvements to Plait's SMO algorithm for SVM classifier design," Neural Comput., vol. 13, pp. 637-649, 2001.
20. G. Wang, D. Yeung, and F. Lochovsky, "A kernel path algorithm for support vector machines," in Proc. 24th Int. Conf. Mach. Learn., 2007, pp. 951-958.
21. B. Efron, "The estimation of prediction error: Covariance penalties and cross-validation," J. Amer. Statist. Assoc., vol. 99, no. 467, pp. 619-632, 2004.
22. H. Zou, T. Hastie, and R. Tibshirani, "On the degrees of freedom of the LASSO," Ann. Statist., to be published.
23. H. Akaike, "Information theory and an extension of the maximum likelihood principle," in Proc. 2nd Int. Symp. Inf. Theory, 1973, pp. 267-281.
24. G. Schwartz, "Estimating the dimension of a model," Ann. Statist. vol. 6, pp. 461-464, 1978.
25. P. Craven and G. Wahba, "Smoothing noisy data with spline function," Numerische Mathematik, vol. 31, pp. 377-403, 1979.
26. J. Friedman, "Multivariate adaptive regression splines," Ann. Statist., vol. 19, no. 1, pp. 1-82, 1991.
27. G. Wang, D. Yeung, and F. Lochovsky, "The kernel path in kernelized LASSO," in Proc. 11th Int. Conf. Artif. Intell. Statist., 2007.