Extension of wirtinger's calculus to reproducing kernel hilbert spaces and the complex kernel LMS

IEEE Transactions on Signal Processing

Volumn 59, Issue 3, 2011, Pages 964-978

  Bouboulis, Pantelis ^a   Theodoridis, Sergios ^a,b  

^a UNIVERSITY OF ATHENS   (Greece)

^b University of Patras and Computer Technology Institute   (Greece)

Author keywords

Complex valued nonlinear adaptive filters; kernel adaptive filtering; reproducing kernel Hilbert spaces; Wirtinger's calculus

Indexed keywords

ADAPTIVE KERNELS; ADAPTIVE SIGNAL PROCESSING; BATCH TECHNIQUES; COMPLEX GAUSSIAN; COMPLEX SIGNAL; COMPLEX-VALUED SIGNAL; COMPLEXIFICATION; KERNEL ADAPTIVE FILTERING; KERNEL METHODS; LEAST MEAN SQUARES; MACHINE LEARNING COMMUNITIES; MACHINE LEARNING PROBLEM; MATHEMATICAL TOOLS; NON-LINEARITY; NONLINEAR ADAPTIVE FILTER; NONLINEAR ALGORITHMS; NONLINEAR PROCESSING; ONLINE TECHNIQUE; PERFORMANCE IMPROVEMENTS; REAL-VALUED DATA; REPRODUCING KERNEL; REPRODUCING KERNEL HILBERT SPACES; WIRTINGER'S CALCULUS;

ADAPTIVE FILTERING; ADAPTIVE FILTERS; CALCULATIONS; COMPUTATION THEORY; ELECTRIC FILTERS; LEARNING ALGORITHMS; LEARNING SYSTEMS; MATHEMATICAL OPERATORS; SIGNAL PROCESSING;

HILBERT SPACES;

EID: 79951660458     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2010.2096420     Document Type: Article

References (39)

1. W. Liu, P. Pokharel, and J. C. Principe, "The kernel least-mean-square algorithm," IEEE Trans. Signal Process., vol. 56, no. 2, pp. 543-554, 2008. (Pubitemid 351285052)
2. J. Kivinen, A. Smola, and R. C. Williamson, "Online learning with kernels," IEEE Trans. Signal Process., vol. 52, no. 8, pp. 2165-2176, 2004.
3. Y. Engel, S. Mannor, and R. Meir, "The kernel recursive least-squares algorithm," IEEE Trans. Signal Process., vol. 52, no. 8, 2004.
4. K. Slavakis, S. Theodoridis, and I. Yamada, "On line classification using kernels and projection based adaptive algorithm," IEEE Trans. Signal Process., vol. 56, no. 7, pp. 2781-2797, 2008.
5. K. Slavakis, S. Theodoridis, and I. Yamada, "Adaptive constrained learning in reproducing kernel Hilbert spaces: The robust beamforming case," IEEE Trans. Signal Process., vol. 57, no. 12, pp. 4744-4764, 2009.
6. K. Slavakis and S. Theodoridis, "Sliding window generalized kernel affine projection algorithm using projection mappings," EURASIP J. Adv. Signal Process., 2008, vol. art. no. 735351.
7. B. Schölkopf and A. J. Smola, Learning With Kernels. Cambridge: MIT Press, 2002.
8. S. Theodoridis and K. Koutroumbas, Pattern Recognition, 4th ed. New York: Academic, 2009.
9. J. Shawe-Taylor and N. Cristianini, Kernel Methods for Pattern Analysis. Cambridge, U.K.: Cambridge Univ. Press, 2004.
10. K. Kim, M. O. Franz, and B. Scholkopf, "Iterative kernel principal component analysis for image modeling," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 9, pp. 1351-1366, 2005. (Pubitemid 41387769)
11. P. Bouboulis, K. Slavakis, and S. Theodoridis, "Adaptive kernel-based image denoising employing semi-parametric regularization," IEEE Trans. Image Process., vol. 19, no. 6, pp. 1465-1479, 2010.
12. B. Schölkopf, A. J. Smola, and K. R. Muller, "Kernel principal component analysis," Lecture Notes in Comput. Sci., vol. 1327, pp. 583-588, 1997. (Pubitemid 127140297)
13. M. Filippone, F. Camastra, F. Masulli, and S. Rovetta, "A survey of kernel and spectral methods for clustering. pattern recognition," Pattern Recogn., vol. 41, no. 1, pp. 176-190, 2008. (Pubitemid 47284212)
14. W. Liu, J. C. Principe, and S. Haykin, Kernel Adaptive Filtering. New York: Wiley, 2010.
15. W. Wirtinger, "Zur formalen theorie der functionen von mehr complexen veränderlichen," Math. Ann., vol. 97, pp. 357-375, 1927.
16. B. Picinbono and P. Chevalier, "Widely linear estimation with complex data," IEEE Trans. Signal Process., vol. 43, no. 8, pp. 2030-2033, 1995.
17. D. Mandic and V. S. L. Goh, Complex Valued Nonlinear Adaptive Filters. New York: Wiley, 2009.
18. T. Adali and H. Li, Complex-Valued Adaptive Signal Processing, ser. Adaptive Signal Processing: Next Generation Solutions, T. Adali and S. Haykin, Eds. Hoboken, NJ: Wiley, 2010.
19. T. Adali, H. Li, M. Novey, and J. Cardoso, "Complex ICA using nonlinear functions," IEEE Trans. Signal Process., vol. 56, no. 9, pp. 4536-4544, 2008.
20. M. Novey and T. Adali, "On extending the complex fast ICA algorithm to noncircular sources," IEEE Trans. Signal Process., vol. 56, no. 5, pp. 2148-2154, 2008.
21. H. Li and T. Adali, "Complex-valued adaptive signal processing using nonlinear functions," J. Adv. Signal Process. Special Issue on Emerging Mach. Learn. Tech. Signal Process., 2008, 765 615.
22. H. L. T. Adali and R. Aloysius, "On properties of the widely linear mse filter and its lms implementation," in Proc. Conf. Inf. Sci. Syst. (CISS), Baltimore, MD, Mar. 2009.
23. T. Adali and S. Haykin, Adaptive Signal Processing: Next Generation Solutions. Piscataway, NJ: Wiley-IEEE Press, 2010.
24. S. Saitoh, Integral Transforms, Reproducing Kernels and Their applications. Harlow: Longman Scientif. Tech., 1997.
25. V. I. Paulsen, An Introduction to the Theory of Reproducing Kernel Hilbert Spaces [Online]. Available: http://www.math.uh.edu/vern/ rkhs.pdf
26. J. Mercer, "Functions of positive and negative type and their connection with the theory of integral equations," Phil. Trans. Roy. Soc. Ser. A, vol. 209, pp. 415-446, 1909.
27. N. Aronszajn, "Theory of reproducing kernels," Trans. Amer. Math. Soc., vol. 68, no. 3, pp. 337-404, 1950.
28. I. Steinwart, D. Hush, and C. Scovel, "An explicit description of the reproducing kernel Hilbert spaces of Gaussian RBF kernels," IEEE Trans. Inf. Theory, vol. 52, no. 10, pp. 4635-4643, 2006. (Pubitemid 46445299)
29. D. Luenberger, Linear and Nonlinear Programming. Reading, MA: Addison-Wesley, 1984.
30. L. A. Lusternik and V. J. Sobolev, Elements of Functional Analysis. New York: Frederick Ungar, 1961.
31. A. V. Balakrishnan, Applied Functional Analysis. New York: Springer, 1976.
32. D. H. Brandwood, "A complex gradient operator and its application in adaptive array theory," IEE Proc. H (Microw., Opt. Antennas), vol. 130, no. 1, pp. 11-16, 1983. (Pubitemid 13526378)
33. A. V. de Bos, "Complex gradient and hessian," IEE Proc. Visual Image Signal Process., vol. 141, no. 6, pp. 380-382, 1994.
34. K. Kreutz-Delgado, The Complex Gradient Operator and the -Calculus [Online]. Available: http://citeseerx.ist.psu.edu/viewdoc/download? doi=10.1.1.86.6515&rep=rep1&type=pdf
35. P. Bouboulis,Wirtinger's Calculus in General Hilbert Spaces [Online]. Available: http://arxiv.org/abs/1005.5170
36. S. B. Chae, Holomorphy and Calculus in Normed Spaces. New York: Marcel Dekker, 1985.
37. J. Platt, "A resourse allocating network for function interpolation," Neural Computat., vol. 3, no. 2, pp. 213-225, 1991.
38. S. van Vaerenbergh, J. Vía, and I. Santamaría, "A sliding-window kernel RLS algorithm and its application to nonlinear channel identification," in Proc. ICASSP, Toulouse, France, 2006, vol. V, pp. 789-792, IEEE.
39. B. Picinbono, "On circularity," IEEE Trans. Signal Process., vol. 42, no. 12, pp. 3473-3482, 1994