Recursive reduced least squares support vector regression

Pattern Recognition

Volumn 42, Issue 5, 2009, Pages 837-842

  Zhao, Yongping ^a   Sun, Jianguo ^a  

^a NANJING UNIVERSITY OF AERONAUTICS AND ASTRONAUTICS   (China)

Author keywords

Classification; Iterative strategy; Least squares support vector regression; Parsimoniousness; Reduced technique

Indexed keywords

CURVE FITTING; LEAST SQUARES APPROXIMATIONS; RECURSIVE FUNCTIONS; REGRESSION ANALYSIS;

CLASSIFICATION; ITERATIVE STRATEGY; LEAST SQUARES SUPPORT VECTOR REGRESSION; PARSIMONIOUSNESS; REDUCED TECHNIQUE;

VECTORS;

EID: 58249091399     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2008.09.028     Document Type: Article

References (32)

1. Vapnik V. The Nature of Statistical Learning Theory (1995), Springer, New York
2. Vapnik V. An overview of statistical learning theory. IEEE Trans. Neural Networks 10 5 (1999) 988-999
3. Cortes C., and Vapnik V. Support vector networks. Mach. Learn. 20 (1995) 273-297
4. E. Osuna, R. Freund, F. Girosi, An improved training algorithm for support vector machines, in: Proceedings of Neural Networks for Signal Processing, vol. VII, New York, USA, 1997.
5. J.C. Platt, Fast training of support vector machines using sequential minimal optimization, in: Advances in Kernel Methods-Support Vector Machines, Cambridge, MA, USA, 1998.
6. Shevade S.K., Keerthi S.S., Bhattacharyya C., and Murthy K.R.K. Improvements to the SMO algorithm for SVM regression. IEEE Trans. Neural Networks 11 5 (2000) 1188-1193
7. T. Joachims, Making large-scale SVM learning practical, in: Advances in Kernel Methods-Support Vector Machine, Cambridge, MA, USA, 1999.
8. Collobert R., and Bengio S. SVMTorch: support vector machines for large-scale regression problems. J. Mach. Learn. 1 2 (2001) 143-160
9. C.C. Chang, C.J. Lin, LIBSVM: a library for support vector machines, available from 〈http://www.csie.ntu.edu.tw/~cjlin〉.
10. Downs T., Gates K., and Masters A. Exact simplification of support vector solutions. J. Mach. Learn. 2 2 (2002) 293-297
11. Y.-J. Lee, O.L. Mangasarian, RSVM: reduced support vector machines, in: Proceedings of the First SIAM International Conference on Data Mining, 2001.
12. Lin K.M., and Lin C.J. A study on reduced support vector machines. IEEE Trans. Neural Networks 14 6 (2003) 1449-1459
13. Lee Y.J., and Huang S.Y. Reduced support vector machines: a statistical theory. IEEE Trans. Neural Networks 18 1 (2007) 1-13
14. Suykens J.A.K., and Vandewalle J. Least squares support vector machine classifiers. Neural Process. Lett. 9 3 (1999) 293-300
15. Suykens J.A.K., Van Gestel T., De Brabanter J., De Moor B., and Vandewalle J. Least Squares Support Vector Machines (2002), World Scientific, Singapore
16. Van Gestel T., Suykens J.A.K., Baesens B., Viaene S., Vanthienen J., Dedene G., De Moor B., and Vandewalle J. Benchmarking least squares support vector machine classifiers. Mach. Learn. 16 2 (2004) 5-32
17. J.A.K. Suykens, L. Lukas, P. Van Dooren, B. De Moor, J. Vandewalle, Least squares support vector machine classifiers: a large scale algorithm, in: Proceedings of the European Conference on Circuit Theory and Design, Torino, Italy, 1999.
18. Chu W., Ong C.J., and Keerthy S.S. An improved conjugate gradient method scheme to the solution of least squares SVM. IEEE Trans. Neural Networks 16 2 (2005) 498-501
19. Keerthi S.S., and Shevade S.K. SMO for least squares SVM formulations. Neural Comput. 15 2 (2003) 487-507
20. J.A.K. Suykens, L. Lukas, J. Vandewalle, Sparse approximation using least square vector machines, in: 2000 IEEE International Symposium on Circuits and Systems, Lausanne, Switzerland, 2000.
21. de Kruif B.J., and de Vries T.J.A. Pruning error minimization in least squares support vector machines. IEEE Trans. Neural Networks 14 3 (2004) 696-702
22. Zeng X.Y., and Chen X.W. SMO-based pruning methods for sparse least squares support vector machines. IEEE Trans. Neural Networks 16 6 (2005) 1541-1546
23. Kuh A., and De Wilde P. Comments on "Pruning error minimization in least squares support vector machines". IEEE Trans. Neural Networks 18 2 (2007) 606-609
24. Jiao L., Bo L., and Wang L. Fast sparse approximation for least squares support vector machine. IEEE Trans. Neural Networks 18 3 (2007) 685-697
25. Cawley G.C., and Talbot N.L.C. Reduced rank kernel ridge regression. Neural Process. Lett. 16 3 (2002) 293-302
26. Zhang X. Matrix Analysis and Applications (2005), Tsinghua University Press, Beijing
27. Y. Zhao, K.C. Keong, Fast leave-one-out evaluation and improvement on inference for LS-SVMs, in: Proceedings of the 17th International Conference on Pattern Recognition, Los Alamitos, CA, USA, 2004.
28. An S., Liu W., and Venkatesh S. Fast cross-validation algorithms for least squares support vector machine and kernel ridge regression. Pattern Recognition 40 8 (2007) 2154-2162
29. Valentini G., and Dietterich T.G. Bias-variance analysis of support vector machines for the development of SVM-based ensemble methods. J. Mach. Learn. Res. 5 (2004) 725-775
30. Cherkassky V., and Ma Y.Q. Practical selection of SVM parameters and noise estimation for SVM regression. Neural Networks 17 (2004) 113-126
31. Available from 〈http://www.csie.ntu.edu.tw/~cjlin/libsvmtools/datasets/regression.html〉.
32. Available from 〈http://www.liacc.up.pt/~ltorgo/Regression/DataSets.html〉.