The kernel recursive least-squares algorithm

IEEE Transactions on Signal Processing

Volumn 52, Issue 8, 2004, Pages 2275-2285

  Engel, Yaakov ^a   Mannor, Shie ^b   Meir, Ron ^c  

^a HEBREW UNIVERSITY OF JERUSALEM   (Israel)

^b MCGILL UNIVERSITY   (Canada)

^c TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL COMPLEXITY; LEAST SQUARES APPROXIMATIONS; RECURSIVE FUNCTIONS; REGRESSION ANALYSIS; TIME SERIES ANALYSIS;

KERNEL METHODS; NONLINEAR REGRESSION; RECURSIVE ESTIMATION; RECURSIVE LEAST SQUARES;

LEARNING ALGORITHMS;

EID: 3543096272     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2004.830985     Document Type: Article

References (31)

1. B. Schölkopf and A. Smola, Learning With Kernels. Cambridge, MA: MIT Press, 2002.
2. R. Herbrich, Learning Kernel Classifiers. Cambridge, MA: MIT Press, 2002.
3. V. Vapnik, Statistical Learning Theory. New York: Wiley Interscience, 1998.
4. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines. Cambridge, U.K.: Cambridge Univ. Press, 2000.
5. T. Kailath, A. Sayed, and B. Hassibi, Linear Estimation. Englewood Cliffs, NJ: Prentice-Hall, 2000.
6. S. Haykin, Adaptive Filter Theory, Third ed. Englewood Cliffs, NJ: Prentice-Hall, 1996.
7. L. Scharf, Statistical Signal Processing. Reading, MA: Addison-Wesley, 1991.
8. L. Ljung, System Identification: Theory for the User, Second ed. Englewood Cliffs, NJ: Prentice-Hall, 1999.
9. G. Kimeldorf and G. Wahba, "Some results on Tchebycheffian spline functions," J. Math. Anal. Applic., vol. 33, pp. 82-95, 1971.
10. J. Platt, "Fast training of support vector machines using sequential minimal optimization," in Advances in Kernel Methods - Support Vector Learning. Cambridge, MA: MIT Press, 1999, pp. 42-65.
11. R. Collobert and S. Bengio, "SVMTorch: support vector machines for large-scale regression problems," J. Machine Learning Res., vol. 1, pp. 143-160, 2001.
12. T. Evgeniou, M. Pontil, and T. Poggio, "Regularization networks and support vector machines," Adv. Comput. Math., vol. 13, no. 1, pp. 1-50, 2000.
13. C. Burges, "Simplified support vector decision rules," in Proc. Int. Conf. Machine Learning, 1996, pp. 71-77.
14. C. Burges and B. Schölkopf, "Improving the accuracy and speed of support vector machines," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 1997, vol. 9.
15. C. Williams and M. Seeger, "Using the Nyström method to speed up kernel machines," Adv. Neural Inform. Processing Syst., vol. 13, pp. 682-688, 2001.
16. M. Tipping, "Sparse Bayesian learning and the relevance vector machine," J. Machine Learning Res., vol. 1, pp. 211-244, June 2001.
17. S. Fine and K. Scheinberg, "Efficient SVM training using low-rank kernel representation," J. Machine Learning Res. (Special Issue on Kernel Methods), pp. 243-264, 2001.
18. T. Downs, K. Gates, and A. Masters, "Exact simplification of support vector solutions," J. Machine Learning Res., vol. 2, pp. 293-297, Dec. 2001.
19. A. Smola and B. Schölkopf, "Sparse greedy matrix approximation for machine learning," in Proc. 17th Int. Conf. Machine Learning, San Francisco, CA, 2000, pp. 911-918.
20. A. Smola and P. Bartlett, "Sparse greedy Gaussian process regression," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2001, vol. 13, pp. 619-625.
21. P. Vincent and Y. Bengio "Kernel matching pursuit," Machine Learning, vol. 48, pp. 165-187, 2002.
22. L. Csató and M. Opper, "Sparse on-line Gaussian processes," Neural Comput., vol. 14, pp. 641-668, 2002.
23. B. Natarajan, "Sparse approximate solutions to linear systems," SIAM J. Comput., vol. 24, no. 2, pp. 227-234, 1995.
24. Y. Engel, S. Mannor, and R. Meir, "Sparse online greedy support vector regression," in Proc. 13th Eur. Conf. Machine Learning, 2002.
25. V. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.
26. S. Mallat, A Wavelet Tour of Signal Processing. New York: Academic, 1998.
27. M. Anthony and P. Bartlett, Neural Network Learning; Theoretical Foundations. Cambridge, U.K.: Cambridge Univ. Press, 1999.
28. B. Schölkopf, A. Smola, and K.-R. Müller, "Nonlinear component analysis as a kernel eigenvalue problem," Neural Comput., vol. 10, pp. 1299-1319, 1998.
29. A. S. Weigend and N. A. Gershenfeld, Eds., Time Series Prediction: Forecasting the Future and Understanding the Past. Reading, MA: Addison-Wesley, 1994.
30. K.-R. Müller, A. Smola, G. Rätsch, B. Schölkopf, J. Kohlmorgen, and V. Vapnik, "Using support vector machines for time series prediction," in Proc. Int. Conf. Artificial Neural Networks. Berlin, Germany, 1997, pp. 999-1004.
31. D. Sebald and J. Bucklew, "Support vector machine techniques for nonlinear equalization," IEEE Trans. Signal Processing, vol. 48, pp. 3217-3226, Nov. 2000.