A new kernel-based approach for linear system identification

Automatica

Volumn 46, Issue 1, 2010, Pages 81-93

  Pillonetto, Gianluigi ^a   De Nicolao, Giuseppe ^b  

^a UNIVERSITY OF PADOVA   (Italy)

^b UNIVERSITY OF PAVIA   (Italy)

Author keywords

Bayesian estimation; Gaussian processes; Kernel based methods; Linear system identification; Regularization; Robust identification; Stochastic embedding

Indexed keywords

BAYESIAN ESTIMATIONS; GAUSSIAN PROCESSES; KERNEL BASED METHODS; LINEAR SYSTEM IDENTIFICATION; ROBUST IDENTIFICATION;

GAUSSIAN DISTRIBUTION; GAUSSIAN NOISE (ELECTRONIC); IMPULSE RESPONSE; LINEAR SYSTEMS; STOCHASTIC SYSTEMS;

BAYESIAN NETWORKS;

EID: 73049114921     PISSN: 00051098     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.automatica.2009.10.031     Document Type: Article

References (53)

1. Adams R.A., and Fournier J. Sobolev spaces (2003), Academic Press
2. Anderson B.D.O., and Moore J.B. Optimal filtering (1979), Prentice-Hall, Englewood Cliffs, NJ, USA
3. Aronszajn N. Theory of reproducing kernels. Transactions of the American Mathematical Society 68 (1950) 337-404
4. Barry D. Nonparametric Bayesian regression. The Annals of Statistics 14 (1986) 934-953
5. Bell B.M., and Pillonetto G. Estimating parameters and stochastic functions of one variable using nonlinear measurements models. Inverse Problems 20 3 (2004) 627-646
6. Bertero M. Linear inverse and ill-posed problems. Advances in Electronics and Electron Physics 75 (1989) 1-120
7. Burenkov V.I. Sobolev spaces on domains (1998), Teubner-Texte zur Mathematik
8. Chiuso, A., Pillonetto, G., & De Nicolao, G. (2008). Subspace identification using predictor estimation via Gaussian regression. In Proceedings of the IEEE conf. on dec. and control. Cancun, Mexico
9. Cucker F., and Smale S. On the mathematical foundations of learning. Bulletin of the American Mathematical Society 39 (2001) 1-49
10. Ferrari-Trecate G., Williams C.K.I., and Opper M. Finite-dimensional approximation of Gaussian processes. In: Kearns M., Solla S., and Cohn D. (Eds). Advances in neural information processing systems (1999), MIT Press
11. Freedman D. On the Bernstein-Von Mises theorem with infinite-dimensional parameters. The Annals of Statistics 27 (1999) 1119-1140
12. Garulli A., Vicino A., and Zappa G. Conditional central algorithms for worst-case set-membership identification and filtering. IEEE Transaction on Automatic Control 45 1 (2000) 14-23
13. ∞ identification and model quality evaluation. IEEE Transaction on Automatic Control 42 (1997) 188-199
14. Goodwin G.C., Braslavsky J.H., and Seron M.M. Non-stationary stochastic embedding for transfer function estimation. Automatica 38 (2002) 47-62
15. Goodwin G.C., Gevers M., and Ninness B. Quantifying the error in estimated transfer functions with application to model order selection. IEEE Transaction on Automatic Control 37 7 (1992) 913-928
16. Hakvoort R.G., and Van den Hof P.M.J. Identification of probabilistic system uncertainty regions by explicit evaluation of bias and variance errors. IEEE Transaction on Automatic Control 42 (1997) 1516-1528
17. Hjalmarsson H. From experiment design to closed-loop control. Automatica 41 (2005) 393-438
18. Hjalmarsson H., and Gustafsson F. Composite modeling of transfer functions. IEEE Transaction on Automatic Control 40 (1995) 820-832
19. Johansen T.A. On Tikhonov regularization, bias and variance in nonlinear system identification. Automatica 33 (1997) 441-446
20. Kass R.E., and Raftery A.E. Bayes factors. Journal of the American Statistical Association 90 (1995) 773-795
21. Lecchini A., and Gevers M. Explicit expression of the parameter bias in identification of Laguerre models from step responses. Systems and Control Letters 52 (2004) 149-165
22. Ljung, L. (1999a). Model validation and model error modeling. In Proceedings of the Astrom symposium on control. (pp. 15-42) Studentliteratur, Lund, Sweden
23. Ljung L. System identification - Theory for the user (1999), Prentice Hall
24. Ljung L. System identification toolbox for matlab, v7.2 (2008), The MathWorks, Inc, Natick, MA
25. Luenberger D.G. Linear and nonlinear programming (1989), Addison Wesley
26. Lukic M.N., and Beder J.H. Stochastic processes with sample paths in reproducing kernel Hilbert spaces. Transactions of the American Mathematical Society 353 (2001) 3945-3969
27. Makila P.M., Partington J.R., and Gustafsson T. Worst-case control-relevant identification. Automatica 31 (1995) 1799-1820
28. Milanese M., Norton J.P., Piet-Lahanier H., and Walter E. Bounding approaches to system identification (1996), Plenum Press, New York, NY, USA
29. Milanese M., and Vicino A. Optimal estimation theory for dynamic systems with set membership uncertainty: An overview. Automatica 27 6 (1991) 997-1009
30. Neve M., De Nicolao G., and Marchesi L. Nonparametric identification of population models via Gaussian processes. Automatica 97 7 (2007) 1134-1144
31. Pillonetto G., and Bell B.M. Bayes and empirical Bayes semi-blind deconvolution using eigenfunctions of a prior covariance. Automatica 43 10 (2007) 1698-1712
32. Pillonetto, G., Chiuso, A., & De Nicolao, G. (2008). Predictor estimation via Gaussian regression. In Proceedings of the IEEE conf. on dec. and control, Cancun, Mexico
33. Pillonetto G., and Saccomani M.P. Input estimation in nonlinear dynamic systems using differential algebra concepts. Automatica 42 (2006) 2117-2129
34. Poggio T., and Girosi F. Networks and the best approximation property. Biological Cybernetics 63 (1990) 169-176
35. Poggio T., and Girosi F. Networks for approximation and learning. Proceedings of the IEEE 78 (1990) 1481-1497
36. Rasmussen C.E., and Williams C.K.I. Gaussian processes for machine learning (2006), The MIT Press
37. Reinelt W., Garulli A., and Ljung L. Comparing different approaches to model error modeling in robust identification. Automatica 38 5 (2002) 787-803
38. Runge C. Uber empirische funktionen und die interpolation zwischen aquidistanten ordinaten. Zeitschrift für Mathematik und Physik 46 (1901) 224-243
39. Smale S., and Zhou D.X. Learning theory estimates via integral operators and their approximations. Constructive Approximation 26 (2007) 153-172
40. Smola A.J., and Schölkopf B.M. Bayesian kernel methods. In: Mendelson S., and Smola A.J. (Eds). Machine learning, proceedings of the summer school, Australian National University (2003), Springer-Verlag, Berlin, Germany 65-117
41. Söderström T., and Stoica P. System identification (1989), Prentice Hall
42. Stenman, A., & Tjarnstrom, F. (2000) A nonparametric approach to model error modeling. In Proceedings of the 12th IFAC symposium on system identification (pp. 157-162) Santa Barbara, USA
43. Sun H. Mercer theorem for RKHS on noncompact sets. Journal of Complexity 21 (2005) 337-349
44. Suykens J.R., Van Gestel T., De Brabanter J., De Moor B., and Vandewalle J. Least squares support vector machines (2002), World Scientific, Singapore
45. Thompson J.R., and Tapia R.A. Nonparametric function estimation, modelling and simulation (1990), SIAM, Philadelphia, PA
46. Tikhonov A.N., and Arsenin V.Y. Solutions of ill-posed problems (1977), Winston/Wiley, Washington, DC
47. Wahba G. Practical approximate solutions to linear operator equations when the data are noisy. SIAM Journal on Numerical Analysis 14 (1977) 651-667
48. Wahba G. Spline models for observational data (1990), SIAM, Philadelphia
49. Wahba, G. (1998). Support vector machines, reproducing kernel Hilbert spaces and randomized GACV. Technical report. Department of Statistics, University of Wisconsin
50. Wahlberg B., and Ljung L. Design variables for bias distribution in transfer function estimation. IEEE Transaction on Automatic Control 31 2 (1986) 134-144
51. Williams C.K.I., and Rasmussen C.E. Gaussian processes for regression. In: Touretzky D.S., Mozer M.C., and Hasselmo M.E. (Eds). Proc. conf. advances in neural information processing systems, Vol. 8. NIPS (1996), MIT Press 514-520
52. Zhu H., and Rohwer R. Bayesian regression filters and the issue of priors. Neural computing and applications 4 (1995) 130-142
53. Zhu H., Williams C.K.I., Rohwer R., and Morciniec M. Gaussian regression and optimal finite dimensional linear models. In: Bishop C.M. (Ed). Neural networks and machine learning (1998), Springer-Verlag