Adaptive multiregression in reproducing kernel hilbert spaces: The multiaccess MIMO channel case

IEEE Transactions on Neural Networks and Learning Systems

Volumn 23, Issue 2, 2012, Pages 260-276

  Slavakis, Konstantinos ^a   Bouboulis, Pantelis ^b   Theodoridis, Sergios ^b  

^a UNIVERSITY OF PELOPONNESE   (Greece)

^b UNIVERSITY OF ATHENS   (Greece)

Author keywords

Adaptive kernel learning; convex analysis; multiple input multiple output channel equalization; projection; regression; subgradient

Indexed keywords

ADAPTIVE KERNELS; CONVEX ANALYSIS; MULTIPLE-INPUT MULTIPLE-OUTPUT CHANNELS; PROJECTION; REGRESSION; SUBGRADIENT;

COMPUTATION THEORY; LEARNING ALGORITHMS; NUMERICAL METHODS; PARALLEL PROCESSING SYSTEMS;

ITERATIVE METHODS;

EID: 84875880314     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2011.2178321     Document Type: Article

References (51)

1. B. Schölkopf and A. J. Smola, Learning with Kernels. Cambridge, MA: MIT Press, 2001.
2. S. Theodoridis and K. Koutroumbas, Pattern Recognition, 4th ed. New York: Academic, 2009.
3. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods. Cambridge, U.K.: Cambridge Univ. Press, 2000.
4. F. Dufrenois, J. Colliez, and D. Hamad, "Bounded influence support vector regression for robust single-model estimation," IEEE Trans. Neural Netw., vol. 20, no. 11, pp. 1689-1706, Nov. 2009.
5. D. Musicant and A. Feinberg, "Active set support vector regression," IEEE Trans. Neural Netw., vol. 15, no. 2, pp. 268-275, Mar. 2004.
6. D. Tzikas, A. Likas, and N. Galatsanos, "Sparse Bayesian modeling with adaptive kernel learning," IEEE Trans. Neural Netw., vol. 20, no. 6, pp. 926-937, Jun. 2009.
7. S. Chen, A. Wolfgang, C. Harris, and L. Hanzo, "Symmetric RBF classifier for nonlinear detection in multiple-antenna-aided systems," IEEE Trans. Neural Netw., vol. 19, no. 5, pp. 737-745, May 2008.
8. F. Pérez-Cruz and O. Bousquet, "Kernel methods and their potential use in signal processing," IEEE Signal Process. Mag., vol. 21, no. 3, pp. 57-65, May 2004.
9. N. Aronszajn, "Theory of reproducing kernels," Trans. Amer. Math. Soc., vol. 68, no. 3, pp. 337-404, 1950.
10. T. Frieß, N. Cristianini, and C. Campbell, "The kernel adatron algorithm: A fast and simple learning procedure for support vector machines," in Proc. Int. Conf. Mach. Learn., 1998, pp. 188-196.
11. J. Kivinen, A. J. Smola, and R. C. Williamson, "Online learning with kernels," IEEE Trans. Signal Process., vol. 52, no. 8, pp. 2165-2176, Aug. 2004.
12. G. Cauwenberghs and T. Poggio, "Incremental and decremental support vector machine learning," in Advances in Neural Information Processing Systems, vol. 13. Cambridge, MA: MIT Press, 2000, pp. 409-415.
13. P. Laskov, C. Gehl, S. Krüger, and K.-R. Müller, "Incremental support vector learning: Analysis, implementation and applications," J. Mach. Learn. Res., vol. 7, pp. 1909-1936, Dec. 2006.
14. A. Bordes, S. Ertekin, J. Weston, and L. Bottou, "Fast kernel classifiers with online and active learning," J. Mach. Learn. Res., vol. 6, no. 9, pp. 1579-1619, Sep. 2005.
15. S. Vishwanathan, N. Schraudolph, and A. Smola, "Step size adaptation in reproducing kernel Hilbert space," J. Mach. Learn. Res., vol. 7, pp. 1107-1133, Jun. 2006.
16. D. J. Sebald and J. A. Bucklew, "Support vector machine techniques for nonlinear equalization," IEEE Trans. Signal Process., vol. 48, no. 11, pp. 3217-3226, Nov. 2000.
17. A. H. Sayed, Fundamentals of Adaptive Filtering. New York: Wiley, 2003.
18. S. Haykin, Adaptive Filter Theory, 3rd ed. Englewood Cliffs, NJ: Prentice-Hall, 1996.
19. W. Liu, J. Príncipe, and S. Haykin, Kernel Adaptive Filtering: A Comprehensive Introduction. Hoboken, NJ: Wiley, 2010.
20. Y. Engel, S. Mannor, and R. Meir, "The kernel recursive least-squares algorithm," IEEE Trans. Signal Process., vol. 52, no. 8, pp. 2275-2285, Aug. 2004.
21. G.-O. Glentiis, K. Berberidis, and S. Theodoridis, "Efficient least squares adaptive algorithms for FIR transversal filtering," IEEE Signal Process. Mag., vol. 16, no. 4, pp. 13-41, Jul. 1999.
22. K. Slavakis, S. Theodoridis, and I. Yamada, "Online kernel-based classification using adaptive projection algorithms," IEEE Trans. Signal Process., vol. 56, no. 7, pp. 2781-2796, Jul. 2008.
23. K. Slavakis and S. Theodoridis, "Sliding window generalized kernel affine projection algorithm using projection mappings," EURASIP J. Adv. Signal Process., vol. 2008, pp. 1-16, 2008.
24. K. Slavakis, S. Theodoridis, and I. Yamada, "Adaptive constrained learning in reproducing kernel Hilbert spaces: The robust beamforming case," IEEE Trans. Signal Process., vol. 57, no. 12, pp. 4744-4764, Dec. 2009.
25. I. Yamada, K. Slavakis, and K. Yamada, "An efficient robust adaptive filtering algorithm based on parallel subgradient projection techniques," IEEE Trans. Signal Process., vol. 50, no. 5, pp. 1091-1101, May 2002.
26. I. Yamada, "Adaptive projected subgradient method: A unified view for projection based adaptive algorithms," J. IEICE, vol. 86, no. 8, pp. 654-658, Aug. 2003.
27. I. Yamada and N. Ogura, "Adaptive projected subgradient method for asymptotic minimization of sequence of nonnegative convex functions," Numer. Funct. Anal. Optim., vol. 25, nos. 7-8, pp. 593-617, 2004.
28. K. Slavakis, I. Yamada, and N. Ogura, "The adaptive projected subgradient method over the fixed point set of strongly attracting nonexpansive mappings," Numer. Funct. Anal. Optim., vol. 27, nos. 7-8, pp. 905-930, 2006.
29. K. Slavakis and I. Yamada. (2011). The Adaptive Projected Subgradient Method Constrained by Families of Quasi-Nonexpansive Mappings and Its Application to Online Learning [Online]. Available: http://arxiv.org/abs/1008. 5231
30. S. Theodoridis, K. Slavakis, and I. Yamada, "Adaptive learning in a world of projections: A unifying framework for linear and nonlinear classification and regression tasks," IEEE Signal Process. Mag., vol. 28, no. 1, pp. 97-123, Jan. 2011.
31. P. J. Huber, Robust Statistics. New York: Wiley, 1981.
32. E. G. Larsson, P. Stoica, and G. Ganesan, Space-Time Block Coding for Wireless Communications. New York: Cambridge Univ. Press, 2003.
33. S. Shahbazpanahi, M. Beheshti, A. Gershman, M. Gharavi-Alkhansari, and K. Wong, "Minimum variance linear receivers for multiaccess MIMO wireless systems with space-time block coding," IEEE Trans. Signal Process., vol. 52, no. 12, pp. 3306-3313, Dec. 2004.
34. R. Cavalcante and I. Yamada, "Multiaccess interference suppression in orthogonal space-time block coded MIMO systems by adaptive projected subgradient method," IEEE Trans. Signal Process., vol. 56, no. 3, pp. 1028-1042, Mar. 2008.
35. M. Chen, S. Ge, and B. How, "Robust adaptive neural network control for a class of uncertain MIMO nonlinear systems with input nonlinearities," IEEE Trans. Neural Netw., vol. 21, no. 5, pp. 796-812, May 2010.
36. M. Sánchez-Fernández, M. de Prado-Cumplido, J. Arenas-García, and F. Pérez-Cruz, "SVM multiregression for nonlinear channel estimation in multiple-input multiple-output systems," IEEE Trans. Signal Process., vol. 52, no. 8, pp. 2298-2307, Aug. 2004.
37. I. Goethals, K. Pelckmans, J. Suykens, and B. D. Moor, "Identification of MIMO Hammerstein models using least squares support vector machines," Automatica, vol. 41, no. 7, pp. 1263-1272, Jul. 2005.
38. S. Alamouti, "A simple transmit diversity technique for wireless communications," IEEE J. Sel. Areas Commun., vol. 16, no. 8, pp. 1451-1458, Oct. 1998.
39. V. Tarokh, H. Jafarkhani, and A. Calderbank, "Space-time block codes from orthogonal designs," IEEE Trans. Inf. Theory, vol. 45, no. 5, pp. 1456-1467, Jul. 1999.
40. P. L. Combettes, "The foundations of set theoretic estimation," Proc. IEEE, vol. 81, no. 2, pp. 182-208, Feb. 1993.
41. G. S. Kimeldorf and G. Wahba, "Some results on Tchebycheffian spline functions," J. Math. Anal. Appl., vol. 33, no. 1, pp. 82-95, 1971.
42. E. Kreyszig, Introductory Functional Analysis with Applications (Classics Library). New York: Wiley, 1989.
43. R. T. Rockafellar, Convex Analysis. Princeton, NJ: Princeton Univ. Press, 1970.
44. I. Ekeland and R. Témam, Convex Analysis and Variational Problems. Amsterdam, The Netherlands: North-Holland, 1976.
45. M. S. Bazaraa, H. D. Sherali, and C. M. Shetty, Nonlinear Programming: Theory and Algorithms, 2nd ed. New York: Wiley, 1993.
46. B. T. Polyak, "Minimization of unsmooth functionals," USSR Comput. Math. Phys., vol. 9, no. 3, pp. 14-29, 1969.
47. L. M. Bregman, "The method of successive projections for finding a common point of convex sets," Soviet Math. Dokl., vol. 162, no. 3, pp. 688-692, 1965.
48. L. G. Gubin, B. T. Polyak, and E. V. Raik, "The method of projections for finding the common point of convex sets," USSR Comput. Math. Phys., vol. 7, no. 6, pp. 1-24, 1967.
49. M. Yukawa, K. Slavakis, and I. Yamada, "Multi-domain adaptive learning based on feasibility splitting and adaptive projected subgradient method," IEICE Trans. Fundam., vol. E93-A, no. 2, pp. 456-466, Feb. 2010.
50. Y. Kopsinis, K. Slavakis, and S. Theodoridis, "Online sparse system identification and signal reconstruction using projections onto weighted-1 balls," IEEE Trans. Signal Process., vol. 59, no. 3, pp. 936-952, Mar. 2011.
51. H. H. Bauschke and P. L. Combettes, "A weak-to-strong convergence principle for Fejér-monotone methods in Hilbert spaces," Math. Oper. Res., vol. 26, no. 2, pp. 248-264, May 2001.