Fixed-budget kernel recursive least-squares

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2010, Pages 1882-1885

  Van Vaerenbergh, Steven ^a   Santamaría, Ignacio ^a   Liu, Weifeng ^b   Príncipe, José C ^c  

^a UNIVERSITY OF CANTABRIA   (Spain)

^b AMAZON   (United States)

^c J Crayton Pruitt Family Department of Biomedical Engineering   (United States)

Author keywords

Fixed budget; Kernel methods; Machine learning; Nonlinear filtering; Recursive least squares

Indexed keywords

ADAPTIVE FILTERING; ADAPTIVE FILTERS; BUDGET CONTROL; LEARNING SYSTEMS; LEAST SQUARES APPROXIMATIONS;

DATAPOINTS; FIXED BUDGET; FIXED MEMORY BUDGET; KERNEL RECURSIVE LEAST SQUARES; KERNEL-METHODS; MACHINE-LEARNING; NONLINEAR MAPPINGS; NONLINEAR TRACKING; RECURSIVE LEAST SQUARE ALGORITHM; RECURSIVE LEAST SQUARES;

NONLINEAR FILTERING;

EID: 78049413965     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2010.5495350     Document Type: Conference Paper

References (15)

1. B. Schölkopf and A. J. Smola, Learning with Kernels, The MIT Press, Cambridge, MA, USA, 2002.
2. J. Platt, "A resource-allocating network for function interpolation," Neural Computation, vol. 3, no. 2, pp. 213-225, 1991.
3. Y. Engel, S. Mannor, and R. Meir, "The kernel recursive least-squares algorithm," IEEE Transactions on Signal Processing, vol. 52, no. 8, pp. 2275-2285, 2004.
4. W. Liu, I. Park, and J. C. Príncipe, "An information theoretic approach of designing sparse kernel adaptive filters," IEEE Transactions on Neural Networks, vol. 20, no. 12, pp. 1950-1961, Dec. 2009.
5. Yann Le Cun, John S. Denker, and Sara A. Solla, "Optimal brain damage," in 2nd Annual Conf. on Neural Information Proc. Syst. (NIPS), Denver, USA, Nov. 1989, pp. 598-605.
6. B. Hassibi, D.G. Stork, and G.J. Wolff, "Optimal brain surgeon and general network pruning," in IEEE International Conference on Neural Networks, 1993, vol. 1, pp. 293-299.
7. B.J. de Kruif and T.J.A. de Vries, "Pruning error minimization in least squares support vector machines," IEEE Transactions on Neural Networks, vol. 14, no. 3, pp. 696-702, May 2003.
8. L. Hoegaerts, J.A.K. Suykens, J. Vandewalle, and B. De Moor, "A comparison of pruning algorithms for sparse least squares support vector machines," Lecture Notes in Computer Science, pp. 1247-1253, 2004.
9. G.-B. Huang, P. Saratchandran, and N. Sundararajan, "A generalized growing and pruning RBF (GGAP-RBF) neural network for function approximation," IEEE Transactions on Neural Networks, vol. 16, no. 1, pp. 57-67, Jan. 2005.
10. O. Dekel, S. Shalev-Shwartz, and Y. Singer, "The forgetron: A kernel-based perceptron on a budget," SIAM Journal on Computing, vol. 37, no. 5, pp. 1342-1372, 2008.
11. J. Kivinen, A.J. Smola, and R.C. Williamson, "Online learning with kernels," IEEE Transactions on Signal Processing, vol. 52, no. 8, pp. 2165-2176, Aug. 2004.
12. S. Van Vaerenbergh, J. Vía, and I. Santamaría, "A sliding-window kernel RLS algorithm and its application to nonlinear channel identification," in IEEE Int. Conf. on Acoustics, Speech, and Sig. Proc. (ICASSP), Toulouse, France, May 2006.
13. S. Van Vaerenbergh, J. Vía, and I. Santamaría, "Nonlinear system identification using a new sliding-window kernel RLS algorithm," Journal of Comm., vol. 2, no. 3, pp. 1-8, May 2007.
14. V. N. Vapnik, The Nature of Statistical Learning Theory, Springer-Verlag New York, Inc., 1995.
15. J. C. Príncipe, W. Liu, and S. Haykin, Kernel Adaptive Filtering: A Comprehensive Introduction, Wiley New York, 2010, in press.