A unified SVM framework for signal estimation

Digital Signal Processing: A Review Journal

Volumn 26, Issue 1, 2014, Pages 1-20

  Rojo Álvarez, José Luis ^a   Martínez Ramón, Manel ^b   Muñoz Marí, Jordi ^c   Camps Valls, Gustavo ^c  

^a UNIVERSIDAD REY JUAN CARLOS   (Spain)

^b University of New Mexico   (United States)

^c UNIVERSITY OF VALENCIA   (Spain)

Author keywords

Deconvolution; Digital processing; Filtering; Kernel method; Signal estimation; Spectral estimation; Support vector; System identification

Indexed keywords

ARRAY PROCESSING; DECONVOLUTION; FILTRATION; IDENTIFICATION (CONTROL SYSTEMS); LINEAR SYSTEMS; RELIGIOUS BUILDINGS; SIGNAL ANALYSIS; SPECTRUM ANALYSIS; SUPPORT VECTOR MACHINES;

DIGITAL SIGNAL PROCESSING (DSP); HETEROGENEOUS INFORMATION SOURCES; KERNEL METHODS; NON-LINEAR SYSTEM IDENTIFICATION; REPRODUCING KERNEL HILBERT SPACES; SIGNAL ESTIMATION; SPECTRAL ESTIMATION; SUPPORT VECTOR;

DIGITAL SIGNAL PROCESSING;

EID: 84893953531     PISSN: 10512004     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.dsp.2013.11.009     Document Type: Article

References (74)

1. L. Scharf Statistical Signal Processing 1990 Addison-Wesley Reading, MA
2. V.N. Vapnik The Nature of Statistical Learning Theory 1995 Springer-Verlag New York
3. A.J. Smola, and B. Schölkopf A tutorial on support vector regression Stat. Comput. 14 2004 199 222
4. J. Shawe-Taylor, and N. Cristianini Kernel Methods for Pattern Analysis 2004 Cambridge University Press
5. J.L. Rojo-Álvarez, G. Camps-Valls, M. Martínez- Ramón, E. Soria-Olivas, A. Navia Vázquez, and A.R. Figueiras-Vidal Support vector machines framework for linear signal processing Signal Process. 85 2005 2316 2326
6. J. Picone, A. Ganapathiraju, and J. Hamaker Kernel Methods in Bioengineering, Signal, and Image Processing 2007 Idea Group Inc. Hershey, PA
7. D. Cremers Shape statistics in kernel space for variational image segmentation Pattern Recognit. 36 2003 1929 1943
8. K.I. Kim, M.O. Franz, and B. Schölkopf Iterative kernel principal component analysis for image modeling IEEE Trans. Pattern Anal. Mach. Intell. 27 2005 1351 1366
9. S. Chen, S. Gunn, and C.J. Harris Decision feedback equaliser design using support vector machines IEE Proc., Vis. Image Signal Process. 147 2000 213 219
10. S. Chen, A.K. Samingan, and L. Hanzo Support vector machine multiuser receiver for DS-CDMA signals in multipath channels IEEE Trans. Neural Netw. 12 2001 604 611
11. S. Chen, A.K. Sanmigan, and L. Hanzo Adaptive multiuser receiver using a support vector machine technique Proc. of the IEEE Semiannual Vehicular Tech. Conf. VTC 2001 Spring, Rhode, Greece 2001 604 608 (CD-ROM)
12. W. Bai, C. He, L.G. Jiang, and X.X. Li Robust channel estimation in MIMO-OFDM systems IEE Electron. Lett. 39 2003 242 244
13. M. Sánchez-Fernández, M. de Prado-Cumplido, J. Arenas-García, and F. Pérez-Cruz SVM multiregression for nonlinear channel estimation in multiple-input multiple-output systems IEEE Trans. Signal Process. 52 2004 2298 2307
14. C.C. Gaudes, J. Via, and I. Santamaría An IRWLS procedure for robust beamforming with sidelobe control Sensor Array and Multichannel Signal Processing Workshop Proceedings 2004 342 346
15. C.C. Gaudes, I. Santamaria, J. Via, E.M.M. Gomez, and T.S. Paules Robust array beamforming with sidelobe control using support vector machines IEEE Trans. Signal Process. 55 2007 574 584
16. R.G. Ayestaran, and F. Las-Heras Support vector regression for the design of array antennas IEEE Antennas Wirel. Propag. Lett. 4 2005 414 416
17. A. Navia-Vázquez, F. Pérez-Cruz, A. Artés- Rodríguez, and A. Figueiras-Vidal Weighted least squares training of support vector classifiers leading to compact and adaptive schemes IEEE Trans. Neural Netw. 12 2001 1047 1059
18. S. Mika, G. Rätsch, B. Schölkopf, A. Smola, J. Weston, and K.-R. Müller Invariant feature extraction and classification in kernel spaces Adv. Neural Inf. Process. Syst. vol. 12 1999 MIT Press Cambridge, MA
19. G. Baudat, and F. Anouar Generalized discriminant analysis using a kernel approach Neural Comput. 12 2000 2385 2404
20. A. Ben-Hur, D. Horn, H. Siegelmann, and V. Vapnik Support vector clustering J. Mach. Learn. Res. 2 2001 125 137
21. A. Hyvärinen, J. Karhunen, and E. Oja Independent Component Analysis 2001 John Wiley & Sons New York
22. F.R. Bach, and M.I. Jordan Kernel independent component analysis J. Mach. Learn. Res. 3 2002 1 48
23. A. Gretton, R. Herbrich, and A. Smola The kernel mutual information Technical report 2003 Max Planck Institute for Biological Cybernetics
24. P. Drezet, and R. Harrison Support vector machines for system identification Proc. UKACC Int. Conf. Control98 Swansea, UK 1998 688 692
25. A. Gretton, A. Doucet, R. Herbrich, P. Rayner, and B. Schölkopf Support vector regression for black-box system identification 11th IEEE Workshop on Statistical Signal Processing 2001 IEEE Signal Processing Society Piscataway, NY 341 344
26. J.A.K. Suykens Support vector machines: a nonlinear modelling and control perspective Eur. J. Control 7 2001 311 327 (Special Issue on Fundamental Issues in Control)
27. J.A.K. Suykens, J. Vandewalle, and B.D. Moor Optimal control by least squares support vector machines Neural Netw. 14 2001 23 35
28. D. Mattera Support Vector Machines for Signal Processing, Studies in Fuzziness and Soft Computing 2013 Springer Berlin/Heidelberg 321 342
29. I. Goethals, K. Pelckmans, J.A.K. Suykens, and B.D. Moor Subspace identification of Hammerstein systems using least squares support vector machines IEEE Trans. Autom. Control 50 2005 1509 1519
30. M.A. Aizerman, E.M. Braverman, and L. Rozoner Theoretical foundations of the potential function method in pattern recognition learning Autom. Remote Control 25 1964 821 837
31. J.L. Rojo-Álvarez, M. Martínez-Ramón, A.R. Figueiras-Vidal, A. García-Armada, and A. Artés-Rodríguez A robust support vector algorithm for non-parametric spectral analysis IEEE Signal Process. Lett. 10 2003 320 323
32. G. Camps-Valls, M. Martínez-Ramón, J. Rojo-Álvarez, and E. Soria-Olivas Robust γ-filter using support vector machines Neurocomputing 62 2004 493 499
33. J.L. Rojo-Álvarez, M. Martínez-Ramón, M. de Prado Cumplido, A. Artés-Rodríguez, and A.R. Figueiras-Vidal Support vector method for robust ARMA system identification IEEE Trans. Signal Process. 52 2004 155 164
34. M. Martínez-Ramón, N. Xu, and C. Christodoulou Beamforming using support vector machines IEEE Antennas Wirel. Propag. Lett. 4 2005 439 442
35. A. El Gonnouni, M. Martinez-Ramon, J. Rojo-Alvarez, G. Camps-Valls, A. Figueiras-Vidal, and C. Christodoulou A support vector machine music algorithm IEEE Trans. Antennas Propag. 60 2012 4901 4910
36. M. Martínez-Ramón, J. Rojo-Álvarez, G. Camps-Valls, A. Navia-Vázquez, J. Muñoz-Marí, E. Soria-Olivas, and A. Figueiras-Vidal Support vector machines for nonlinear kernel ARMA system identification IEEE Trans. Neural Netw. 17 2006 1617 1622
37. M. Martínez-Ramón, J. Rojo-Álvarez, G. Camps-Valls, and C. Christodoulou Kernel antenna array processing IEEE Trans. Antennas Propag. 55 2007 642 650
38. J. Rojo-Ávarez, C. Figuera-Pozuelo, C. Martinez-Cruz, G. Camps-Valls, F. Alonso-Atienza, and M. Martinez-Ramon Nonuniform interpolation of noisy signals using support vector machines IEEE Trans. Signal Process. 55 2007 4116 4126
39. J.L. Rojo-Álvarez, M. Martínez-Ramón, J. Muñoz-Marí, G. Camps-Valls, C.E.M. Cruz, and A.R. Figueiras-Vidal Sparse deconvolution using support vector machines EURASIP J. Adv. Signal Process. 2008 10.1155/2008/816507
40. C. Figuera, J.L. Rojo-Álvarez, M. Wilby, I. Mora-Jiménez, and A.J. Caamaño Advanced support vector machines for 802.11 indoor location Signal Process. 9 2012 2126 2136
41. C. Figuera, Óscar Barquero-Pérez, J.L. Rojo-Álvarez, M. Martínez-Ramón, A. Guerrero-Curieses, and A.J.C. No Spectrally adapted Mercer kernels for support vector nonuniform interpolation Signal Process. 94 2014 421 433
42. J. Arenas-Garcia, K. Petersen, G. Camps-Valls, and L. Hansen Kernel multivariate analysis framework for supervised subspace learning: A tutorial on linear and kernel multivariate methods IEEE Signal Process. Mag. 30 2013 16 29
43. F. Pérez-Cruz, S. Van Vaerenbergh, J. Murillo-Fuentes, M. Lázaro-Gredilla, and I. Santamaría Gaussian processes for nonlinear signal processing: An overview of recent advances IEEE Signal Process. Mag. 30 2013 40 50
44. G. Ding, Q. Wu, Y.-D. Yao, J. Wang, and Y. Chen Kernel-based learning for statistical signal processing in cognitive radio networks: Theoretical foundations, example applications, and future directions IEEE Signal Process. Mag. 30 2013 126 136
45. N. Cristianini, and J. Shawe-Taylor Bayesian voting schemes and large margin classifiers B. Schölkopf, C.J.C. Burges, A.J. Smola, Advances in Kernel Methods - Support Vector Learning 1999 MIT Press Cambridge, MA 55 68
46. V. Vapnik Statistical Learning Theory, Adaptive and Learning Systems for Signal Processing, Communications, and Control 1998 John Wiley & Sons
47. B. Schölkopf, and A. Smola Learning with Kernels 1st edition 2002 MIT Press Cambridge, MA
48. J. Suykens, J. Vandewalle, and B.D. Moor Intelligence and cooperative search by coupled local minimizers Int. J. Bifurc. Chaos 11 2001 2133 2144
49. J.L. Rojo-Álvarez, M. Martínez-Ramón, A.R. Figueiras-Vidal, M. de Prado Cumplido, and A. Artés-Rodríguez Support vector method for ARMA system identification: a robust cost interpretation International Conference on Artificial Neural Networks ICANN2002 Lect. Notes Comput. Sci. vol. 2415 2002 Springer-Verlag Madrid, Spain
50. G. Camps-Valls, J.L. Rojo-Álvarez, and M. Martínez- Ramón Kernel Methods in Bioengineering, Signal, and Image Processing 2007 Idea Group Inc. Hershey, PA
51. N. Cristianini, and J. Shawe-Taylor An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods 2000 Cambridge University Press Cambridge, UK
52. A.N. Tikhonov, and V.Y. Arsenen Solution to Ill-Posed Problems 1977 V.H. Winston & Sons
53. S. Marple Digital Spectral Analysis with Applications 1987 Prentice-Hall Englewood Cliffs, NJ
54. N.R. Lomb Least-squares frequency analysis of unequally spaced data Astrophys. Space Sci. 39 1976 447 462
55. L. Ljung System Identification. Theory for the User 2nd edition 1999 Prentice Hall Upper Saddle River, NJ
56. A. Oppenheim, and R. Schafer Discrete-Time Signal Processing 1989 Prentice Hall Englewood Cliffs, NJ
57. J.L. Yen On nonuniform sampling of bandwidth-limited signals IRE Trans. Circuits Theory 3 1956 251 257
58. H. Choi, and D.C. Munson Jr. Analysis and design of minimax-optimal interpolators IEEE Trans. Signal Process. 46 1998 1571 1579
59. L. Ying, and D.C. Munson Approximation of the minmax interpolator Proc. Int. Conf. on Acoust., Speech, and Signal Processing, ICASSP2000, vol. 3 Turkey 2013 328 331
60. I. Santamaría-Caballero, C. Pantaleón-Prieto, and A. Artés-Rodríguez Sparse deconvolution using adaptive mixed-Gaussian models Signal Process. 54 1996 161 172
61. S.A. Kassam, and H.V. Poor Robust techniques for signal processing: A survey Proc. IEEE 73 1985 433 482
62. H.V. Trees Detection, Estimation, and Modulation Theory 2002 John Wiley & Sons New York
63. L. Zhang, Z. Weida, and L. Jiao Wavelet support vector machine IEEE Trans. Syst. Man Cybern., Part B, Cybern. 34 2004 34 39
64. T. Söderström, and P. Stoica System Identification 1987 Prentice-Hall Englewood Cliffs, NJ
65. A. Gretton, M. Davy, A. Doucet, and P.J.W. Rayner Nonstationary signal classification using support vector machines 11th IEEE Workshop on Statistical Signal Processing 2001 IEEE Signal Processing Society Piscataway, NY 305 308
66. M. Espinoza, J.A.K. Suykens, and B.D. Moor Kernel based partially linear models and nonlinear identification IEEE Trans. Autom. Control 50 2005 1602 1606
67. O. Nelles Nonlinear System Identification. From Classical Approaches to Neural Networks and Fuzzy Models 2001 Springer-Verlag Berlin, Heidelberg, New York
68. G. Camps-Valls, M. Martínez-Ramón, J.L. Rojo-Álvarez, and J. Muñoz-Marí Non-linear system identification with composite relevance vector machines IEEE Signal Process. Lett. 14 2007 279 282
69. G. Camps-Valls, J. Muñoz-Marí, M. Martínez- Ramón, J. Requena-Carrión, and J. Rojo-Álvarez Learning non-linear time-scales with kernel γ-filters Neurocomputing 72 2008 1324 1328
70. A. Papoulis Probability Random Variables and Stochastic Processes 3rd edition 1991 McGraw-Hill New York
71. B. Schölkopf, A. Smola, and K.R. Müller Nonlinear component analysis as a kernel eigenvalue problem Neural Comput. 10 1998 1299 1319
72. T. Olofsson Semi-sparse deconvolution robust to uncertainties in the impulse responses Ultrasonics 42 2004 969 975
73. J.A.K. Suykens, and J. Vandewalle Recurrent least squares support vector machines IEEE Trans. Circuits Syst. I 47 2000 1109 1114
74. C.E. Rasmussen, and C.K.I. Williams Gaussian Processes for Machine Learning 2006 MIT Press Cambridge, MA