Gaussian processes for nonlinear signal processing: An overview of recent advances

IEEE Signal Processing Magazine

Volumn 30, Issue 4, 2013, Pages 40-50

  Perez Cruz, Fernando ^a   Van Vaerenbergh, Steven ^b   Murillo Fuentes, Juan Jose ^c   Lazaro Gredilla, Miguel ^a   Santamaria, Ignacio ^b  

^a UNIVERSIDAD CARLOS III DE MADRID   (Spain)

^b UNIVERSITY OF CANTABRIA   (Spain)

^c UNIVERSITY OF SEVILLE   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE ALGORITHMS; DIGITAL COMMUNICATION SYSTEMS; GAUSSIAN DISTRIBUTION; GAUSSIAN NOISE (ELECTRONIC); LEARNING SYSTEMS;

BASIC FORMULATION; GAUSSIAN PROCESSES; NON-GAUSSIAN NOISE; NON-LINEAR ESTIMATION; NON-LINEAR SIGNAL PROCESSING; NON-STATIONARITIES; NONLINEAR EXTENSION; WIRELESS DIGITAL COMMUNICATIONS;

SIGNAL PROCESSING;

EID: 85032750849     PISSN: 10535888     EISSN: None     Source Type: Journal    
DOI: 10.1109/MSP.2013.2250352     Document Type: Review

References (39)

1. C. K. I. Williams and C. E. Rasmussen, "Gaussian processes for regression, " in Neural Information Processing Systems 8. Cambridge, MA: MIT Press, 1996, pp. 598-604.
2. M. Kuss and C. Rasmussen, "Assessing approximate inference for binary Gaussian process classification, " Mach. Learn. Res., vol. 6, pp. 1679-1704, Oct. 2005.
3. N. Lawrence, "Probabilistic non-linear principal component analysis with Gaussian process latent variable models, " Mach. Learn. Res., vol. 6, pp. 1783-1816, Nov. 2005.
4. A. O'Hagan and J. F. Kingman, "Curve fitting and optimal design for prediction, " J. Roy. Stat. Soc. Series B, vol. 40, no. 1, pp. 1783-1816, 1978.
5. C. E. Rasmussen and C. K. I. Williams, Gaussian Processes for Machine Learning. Cambridge, MA: MIT Press, 2006.
6. V. N. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.
7. F. Pérez-Cruz and O. Bousquet, "Kernel methods and their potential use in signal processing, " IEEE Signal Processing Mag., vol. 21, no. 3, pp. 57-65, 2004.
8. L. Csató and M. Opper, "Sparse representation for Gaussian process models, " in Neural Information Processing Systems 13. Cambridge, MA: MIT Press, 2001, pp. 444-450.
9. S. Van Vaerenbergh, M. Lázaro-Gredilla, and I. Santamaría, "Kernel recursive least-squares tracker for time-varying regression, " IEEE Trans. Neural Networks Learn. Syst., vol. 23, no. 8, pp. 1313-1326, Aug. 2012.
10. Y. Engel, S. Mannor, and R. Meir, "The kernel recursive least squares algorithm, " IEEE Trans. Signal Processing, vol. 52, no. 8, pp. 2275-2285, Aug. 2004.
11. W. Liu, I. Park, and J. C. Préncipe, "An information theoretic approach of designing sparse kernel adaptive filters, " IEEE Trans. Neural Networks, vol. 20, no. 12, pp. 1950-1961, 2009.
12. S. Van Vaerenbergh, J. Vía, and I. Santamaría, "A sliding-window kernel RLS algorithm and its application to nonlinear channel identification, " in Proc. IEEE Int. Conf. Acoustics, Speech and Signal Processing (ICASSP), Toulouse, France, May 2006, vol. 5, pp. 789-792.
13. G. S. Kimeldorf and G. Wahba, "Some results on Tchebycheffian spline functions, " J. Math. Anal. Appl., vol. 33, no. 1, pp. 82-95, 1971.
14. O. Bousquet and D. J. L. Herrmann, "On the complexity of learning the kernel matrix, " in Advances in Neural Information Processing Systems 15. Cambridge, MA: MIT Press, 2003, pp. 399-406.
15. D. J. C. MacKay, Information Theory, Inference and Learning Algorithms. Cambridge, U. K. : Cambridge Univ. Press, 2003.
16. J. Quiñonero-Candela and C. E. Rasmussen, "A unifying view of sparse approximate Gaussian process regression, " Mach. Learn. Res., vol. 6, pp. 1939-1959, Dec. 2005.
17. M. Seeger, C. K. I. Williams, and N. D. Lawrence, "Fast forward selection to speed up sparse Gaussian process regression, " in Proc. 9th Int. Workshop Artificial Intelligence and Statistics, 2003.
18. E. Snelson and Z. Ghahramani, "Sparse Gaussian processes using pseudo-inputs, " in Advances in Neural Information Processing Systems 18. Cambridge, MA: MIT Press, 2006, pp. 1259-1266.
19. M. Lázaro-Gredilla and A. Figueiras-Vidal, "Inter-domain Gaussian processes for sparse inference using inducing features, " in Advances in Neural Information Processing Systems 22. Cambridge, MA: MIT Press, 2010, pp. 1087-1095.
20. M. K. Titsias, "Variational learning of inducing variables in sparse Gaussian processes, " in Proc. 12th Int. Workshop Artificial Intelligence and Statistics, 2009, pp. 567-574.
21. D. Gu, "Spatial Gaussian process regression with mobile sensor networks, " IEEE Trans. Neural Networks Learn. Syst., vol. 23, pp. 1279-1290, 2012.
22. E. Snelson, Z. Ghahramani, and C. Rasmussen, "Warped Gaussian processes, " in Advances in Neural Information Processing Systems 16. Cambridge, MA: MIT Press, 2003.
23. M. Lázaro-Gredilla, "Bayesian warped Gaussian processes, " in Advances in Neural Information Processing Systems 26. Cambridge, MA: MIT Press, 2013.
24. W. Liu, J. C. Príncipe, and S. Haykin, Kernel Adaptive Filtering: A Comprehensive Introduction. Hoboken, NJ: Wiley, 2010.
25. K. Slavakis, S. Theodoridis, and I. Yamada, "Online kernel-based classification using adaptive projection algorithms, " IEEE Trans. Signal Processing, vol. 56, no. 7, pp. 2781-2796, July 2008.
26. S. Theodoridis, K. Slavakis, and I. Yamada, "Adaptive learning in a world of projections, " IEEE Signal Processing Mag., vol. 28, no. 1, pp. 97-123, Jan. 2011.
27. S. Van Vaerenbergh, I. Santamaría, and M. Lázaro-Gredilla, "Estimation of the forgetting factor in kernel recursive least squares, " in Proc. IEEE Int. Workshop Machine Learning Signal Processing (MLSP), Sept. 2012, pp. 1-6.
28. M. Lázaro-Gredilla, S. Van Vaerenbergh, and I. Santamaría, "A Bayesian approach to tracking with kernel recursive least-squares, " in Proc. IEEE Int. Workshop Machine Learning Signal Processing (MLSP), Sept. 2011, pp. 1-6.
29. A. Sayed, Fundamentals of Adaptive Filtering. New York: Wiley-IEEE Press, 2003.
30. K. Feher, Digital Communications: Satellite/Earth Station Engineering. Englewood Cliffs, NJ: Prentice-Hall, 1983.
31. B. Chen, S. Zhao, P. Zhu, and J. C. Principe, "Quantized kernel least mean square algorithm, " IEEE Trans. Neural Networks Learn. Syst., vol. 23, no. 1, pp. 22-32, Jan. 2012.
32. J. Gutiérrez, Ó. González, J. Pérez, D. Ramírez, L. Vielva, J. Ibáñez, and I. Santamaría, "Frequency-domain methodology for measuring MIMO channels using a generic test bed, " IEEE Trans. Instrum. Meas., vol. 60, no. 3, pp. 827-838, Mar. 2011.
33. T. Minka, "Expectation propagation for approximate Bayesian inference, " in Proc. 17th Conf. Uncertainty Artificial Intelligence, Seattle, WA, 2001, pp. 362-369.
34. P. Olmos, J. Murillo-Fuentes, and F. Pérez-Cruz, "Joint nonlinear channel equalization and soft LDPC decoding with Gaussian processes, " IEEE Trans. Signal Processing, vol. 58, no. 3, pp. 1183-1192, 2010.
35. J. Wang, D. Fleet, and A. Hertzmann, "Gaussian process dynamical models for human motion, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 2, pp. 283-298, Feb. 2008.
36. A. Liutkus, R. Badeau, and G. Richard, "Gaussian processes for underdetermined source separation, " IEEE Trans. Signal Processing, vol. 59, no. 7, pp. 3155-3167, July 2011.
37. L. Pasolli, F. Melgani, and E. Blanzieri, "Gaussian process regression for estimating chlorophyll concentration in subsurface waters from remote sensing data, " IEEE Geosci. Remote Sensing Lett., vol. 7, no. 3, pp. 464-468, Mar. 2010.
38. C. Archambeau, D. Cornford, M. Opper, and J. Shawe-Taylor, "Gaussian process approximations of stochastic differential equations, " J. Mach. Learn. Res., vol. 1, pp. 1-16, Mar. 2007.
39. J. J. Murillo-Fuentes and F. Pérez-Cruz, "Gaussian process regressors for multiuser detection in DS-CDMA systems, " IEEE Trans. Commun., vol. 57, no. 8, pp. 2339-2347, Aug. 2009.