Stochastic behavior analysis of the Gaussian kernel least-mean-square algorithm

IEEE Transactions on Signal Processing

Volumn 60, Issue 5, 2012, Pages 2208-2222

  Parreira, Wemerson D ^a   Bermudez, José Carlos M ^a   Richard, Cédric ^b   Tourneret, Jean Yves ^c  

^a FEDERAL UNIVERSITY OF SANTA CATARINA   (Brazil)

^b UNIVERSITÉ CÔTE D'AZUR   (France)

^c UNIVERSITÉ DE TOULOUSE   (France)

Author keywords

Adaptive filtering; convergence analysis; kernel least mean square (KLMS); nonlinear system; reproducing kernel

Indexed keywords

ALGORITHM PARAMETERS; ANALYTICAL DETERMINATION; CONVERGENCE ANALYSIS; CONVERGENCE SPEED; DESIGN PARAMETERS; FINITE ORDER; GAUSSIAN KERNELS; GAUSSIANS; LEAST MEAN SQUARE ALGORITHMS; LEAST MEAN SQUARES; LINEAR FILTERS; MODEL ORDER; MODEL PREDICTION; MONTE CARLO SIMULATION; NON-LINEARITY; NONLINEAR ADAPTIVE FILTERING; PRACTICAL IMPLEMENTATION; RECURSIVE EXPRESSIONS; REPRODUCING KERNEL; STABILITY LIMIT; STEADY STATE; STEADY-STATE BEHAVIORS; STEP SIZE; STOCHASTIC BEHAVIOR; TRANSIENT BEHAVIOR; TWO PARAMETER;

ADAPTIVE FILTERING; ADAPTIVE FILTERS; ALGORITHMS; GAUSSIAN DISTRIBUTION; MONTE CARLO METHODS; NONLINEAR SYSTEMS;

PARAMETER ESTIMATION;

EID: 84860009963     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2012.2186132     Document Type: Article

References (22)

1. M. Schetzen, The Volterra and Wiener Theory of the Nonlinear Systems. New York: Wiley, 1980.
2. G. Kimeldorf and G. Wahba, "Some results on Tchebycheffian spline functions," J. Math. Anal. Appl., vol. 33, pp. 82-95, 1971.
3. D. L. Duttweiler and T. Kailath, "An RKHS approach to detection and estimation theory: Some parameter estimation problems (Part V)," IEEE Trans. Inf. Theory, vol. 19, no. 1, pp. 29-37, 1973.
4. W. Liu, J. C. Principe, and S. Haykin, Kernel Adaptive Filtering. New York: Wiley, 2010.
5. Y. Engel, S. Mannor, and R. Meir, "Kernel recursive least squares," IEEE Trans. Signal Process., vol. 52, no. 8, pp. 2275-2285, 2004.
6. P. Honeine, C. Richard, and J. C. M. Bermudez, "On-line nonlinear sparse approximation of functions," in Proc. IEEE ISIT'07, Nice, France, Jun. 2007, pp. 956-960.
7. C. Richard, J. C. M. Bermudez, and P. Honeine, "Online prediction of time series data with kernels," IEEE Trans. Signal Process., vol. 57, no. 3, pp. 1058-1067, Mar. 2009.
8. W. Liu, P. P. Pokharel, and J. C. Principe, "The kernel least-meansquares algorithm," IEEE Trans. Signal Process., vol. 56, no. 2, pp. 543-554, Feb. 2008.
9. P. Bouboulis and S. Theodoridis, "Extension ofWirtinger's calculus in reproducing kernel Hilbert spaces and the complex kernel LMS," IEEE Trans. Signal Process., vol. 59, no. 3, pp. 964-978, Mar. 2011.
10. K. Slavakis and S. Theodoridis, "Sliding window generalized kernel affine projection algorithm using projection mappings," EURASIP J. Adv. Signal Process., vol. 2008, 2008.
11. J. Omura and T. Kailath, "Some Useful Probability Distributions," Stanford Electron. Lab., Stanford Univ., Stanford, CA, Tech. Rep. 7050-6, 1965.
12. J. Minkoff, "Comment: On the unnecessary assumption of statistical independence between reference signal and filter weights in feedforward adaptive systems," IEEE Trans. Signal Process., vol. 49, no. 5, p. 1109, May 2001. (Pubitemid 32444209)
13. A. H. Sayed, Fundamentals of Adaptive Filtering. Hoboken, NJ: Wiley, 2003.
14. S. Haykin, Adaptive Filter Theory, 2nd ed. Englewood Cliffs, NJ: Prentice-Hall, 1991.
15. G. Grimmett and D. Stirzaker, Probability and Random Processes. New York: Oxford Univ. Press, 2001.
16. D. G. Luenberger, Introduction Dynamic Systems: Theory, Models & Applications. New York: Wiley, 1979.
17. G. H. Golub and C. F. V. Loan, Matrix Computations. Baltimore, MD: The Johns Hopkins Univ. Press, 1996.
18. K. S. Narendra and K. Parthasarathy, "Identification and control of dynamical systems using neural networks," IEEE Trans. Neural Netw., vol. 1, no. 1, pp. 3-27, Mar. 1990.
19. D. P. Mandic, "A generalized normalized gradient descent algorithm," IEEE Signal Process. Lett., vol. 2, pp. 115-118, Feb. 2004.
20. J. Vörös, "Modeling and identification of wiener systems with twosegment nonlinearities," IEEE Trans. Contr. Syst. Technol., vol. 11, no. 2, pp. 253-257, Mar. 2003.
21. J.-S. Wang and Y.-L. Hsu, "Dynamic nonlinear system identification using aWiener-type recurrent network with okid algorithm," J. Inf. Sci. Eng., vol. 24, pp. 891-905, 2008.
22. H. Al-Duwaish,M. N. Karim, and V. Chandrasekar, "Use ofmultilayer feedforward neural networks in identification and control of wiener model," in Proc. Contr. Theory Appl., May 1996, vol. 143, no. 3.