Errors-in-variables methods in system identification

Automatica

Volumn 43, Issue 6, 2007, Pages 939-958

  Söderström, Torsten ^a  

^a UPPSALA UNIVERSITY   (Sweden)

Author keywords

Consistency; Errors in variables; Identifiability; Parameter estimation; System identification

Indexed keywords

DEGREES OF FREEDOM (MECHANICS); ERROR ANALYSIS; MATHEMATICAL MODELS; PROBLEM SOLVING;

CONSISTENCY; ERRORS-IN-VARIABLES; IDENTIFIABILITY;

IDENTIFICATION (CONTROL SYSTEMS);

EID: 34247516344     PISSN: 00051098     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.automatica.2006.11.025     Document Type: Article

References (111)

1. Adcock R.J. Note on the methods of least squares. The Analyst 4 6 (1877) 183-184
2. Adcock R.J. A problem in least squares. The Analyst 5 2 (1878) 53-54
3. Agüero, J. C. (2005). System identification methodologies incorporating constraints. Ph.D. thesis, The University of Newcastle, Callaghan, NSW, Australia.
4. Agüero, J. C., & Goodwin, G. C. (2006). Identifiability of errors in variables dynamic systems. In IFAC symposium on system identification, Newcastle, Australia, March 29-31, 2006.
5. Agüero, J. C., Goodwin, G. C., & Salgado, M. E. (2005). On the optimal estimation of errors in variables models for robust control. In 16th IFAC world congress, Prague, Czech Republic, July 4-8, 2005.
6. Anderson B.D.O. Identification of scalar errors-in-variables models with dynamics. Automatica 21 (1985) 709-716
7. Anderson B.D.O., and Deistler M. Identifiability of dynamic errors-in-variables models. Journal of Time Series Analysis 5 (1984) 1-13
8. Anderson B.D.O., and Deistler M. Dynamic errors-in-variables systems in three variables. Automatica 23 (1987) 611-616
9. Anderson T.W. Estimating linear statistical relationships. The Annals of Mathematical Statistics 12 1 (1984) 1-45
10. Aoki M., and Yue P.C. On a priori error estimate of some identification methods. IEEE Transactions on Automatic Control AC-15 (1970) 541-548
11. Beghelli, S., Castaldi, P., & Soverini, U. (1997). A frequential approach for errors-in-variables models. In Proceedings of the European control conference, ECC '97, Brussels, Belgium, July 1-4, 1997.
12. Beghelli S., Guidorzi R.P., and Soverini U. The Frisch scheme in dynamic system identification. Automatica 26 (1990) 171-176
13. Beghelli S., and Soverini U. Identification of linear relations from noisy data. Geometrical aspects. Systems and Control Letters 18 5 (1992) 339-346
14. Castaldi, P., Montanari, M., & Tilli, A. (2002). Induction motor model identification via frequency-domain Frisch scheme. In IFAC world congress, Barcelona, Spain.
15. Castaldi P., and Soverini U. Identification of dynamic errors-in-variables models. Automatica 32 4 (1996) 631-636
16. Cheng, C. L., & Van Ness, J. W. (1999). Kendall's library of statistics: Statistical regression with measurement error (Vol. 6). Edward Arnold.
17. Chou C.T., and Verhaegen M. Subspace algorithms for the identification of multivariable dynamic errors-in-variables models. Automatica 33 10 (1997) 1857-1869
18. Deistler M. Linear dynamic errors-in-variables models. Journal of Applied Probability 23A (1986) 23-39
19. Deistler M., and Anderson B.D.O. Linear dynamic errors-in-variables models Some structure theory. Journal of Econometrics 41 (1989) 39-63
20. Diversi, R., Guidorzi, R., & Soverini, U. (2003). A new criterion in EIV identification and filtering applications. In 13th IFAC symposium on system identification, Rotterdam, The Netherlands, August 27-29, 2003.
21. Diversi, R., Guidorzi, R., & Soverini, U. (2007). Maximum likelihood identification of noisy input-output models. Automatica, 43(2), 464-472.
22. Eising R., Linssen N., and Rietbergen H. System identification from noisy measurements of inputs and outputs. Systems and Control Letters 2 (1983) 348-353
23. Ekman, M. (2005). Identification of linear systems with errors in variables using separable nonlinear least squares. In 16th IFAC world congress, Prague, Czech Republic, July 4-8, 2005.
24. Ekman, M., Hong, M., & Söderström, T. (2006). A separable nonlinear least squares approach for identification of linear systems with errors in variables. In 14th IFAC symposium on system identification, Newcastle, Australia, March 29-31, 2006.
25. Feng C.B., and Zheng W.X. Robust identification of stochastic linear systems with correlated noise. IEE Proceedings, Part D 138 5 (1991) 484-492
26. Fernando K.V., and Nicholson H. Identification of linear systems with input and output noise. The Koopmans-Levin method. IEE Proceedings, Part D 132 1 (1985) 30-36
27. Forsell, U., Gustafsson, F., & McKelvey, T. (1999). Time-domain identification of dynamic errors-in-variables systems using periodic excitation signals. In Proceedings of the IFAC 14th world congress, Beijing, P.R. China, 1999.
28. Frisch, R. (1934). Statistical confluence analysis by means of complete regression systems. Technical Report 5, University of Oslo, Economics Institute, Oslo, Norway.
29. Fuller W.A. Measurement error models (1987), Wiley, New York, NY
30. Garnier H., Gilson M., and Zheng W.X. A bias-eliminated least-squares method for continuous-time model identification of closed-loop systems. International Journal of Control 71 (2000) 38-48
31. Gilson M., and Van den Hof P. On the relation between a bias-eliminated least-squares (BELS) and an IV estimator in closed-loop identification. Automatica 37 (2001) 1593-1600
32. Gleser L.J. Estimation in a multivariable "errors in variables" regression model: Large sample results. The Annals of Statistics 9 1 (1981) 24-44
33. Golub G.H., and Van Loan C.F. An analysis of the total least squares problem. SIAM Journal of Numerical Analysis 17 (1980) 883-893
34. Green M., and Anderson B.D.O. Identification of multivariable errors in variable models with dynamics. IEEE Transactions on Automatic Control 31 5 (1986) 467-471
35. Guidorzi R. Invariants and canonical forms for systems structural and parametric identification. Automatica 17 1 (1981) 117-133
36. Guidorzi R. Certain models from uncertain data: The algebraic case. Systems and Control Letters 17 6 (1991) 415-424
37. Guidorzi R. Identification of the maximal number of linear relations from noisy data. Systems and Control Letters 24 3 (1995) 159-165
38. Guidorzi, R. (1996). Identification of multivariable processes in the Frisch scheme context. In MTNS 96, St Louis, USA, 1996.
39. Guidorzi R., Diversi R., and Soverini U. Optimal errors-in-variables filtering. Automatica 39 (2003) 281-289
40. Guillaume P., Pintelon R., and Schoukens J. Robust parametric transfer function estimation using complex logarithmic frequency response data. IEEE Transactions on Automatic Control 40 (1995) 1180-1190
41. Heij C., Scherrer W., and Deistler M. System identification by dynamic factor models. SIAM Journal on Control and Optimization 35 6 (1997) 1924-1951
42. Hong, M., Söderström, T., & Zheng, W. X. (2006a). Accuracy analysis of bias-eliminating least squares estimates for errors-in-variables identification. In 14th IFAC symposium on system identification, Newcastle, Australia, March 29-31, 2006.
43. Hong, M., Söderström, T., & Zheng, W. X. (2006b). A simplified form of the bias-eliminating least squares method for errors-in-variables identification. Technical Report 2006-000, Department of Information Technology, Uppsala University, Uppsala, Sweden, 2006. Available at 〈http://www.it.uu.se/research/publications/reports/2006-000〉.
44. Hsiao C. Identification for a linear dynamic simultaneous error-shock model. International Economic Review 18 1 (1977) 181-194
45. Hsiao C., and Robinson P.M. Efficient estimation of dynamic error-shock model. International Economic Review 19 2 (1978) 467-479
46. Ikenoue, M., Kanae, S., Yand, Z.-J. & Wada, K. (2005). Identification of noisy input-output system using bias-compensated least-squares method. In IFAC 16th world congress, Prague, Czech Republic, July 2005.
47. Jia, L. J., Ikenoue, M., Jin, C. Z., & Wada, K. (2001). On bias compensated least squares method for noisy input-output system identification. In Proceedings of the 40th IEEE conference on decision and control (pp. 3332-3337), Orlando, Florida, USA, 2001.
48. Kalman R.E. Identification from real data. In: Hazewinkel M., and Rinnoy Kan A.H.G. (Eds). Current developments in the interface: Economics, econometrics, mathematics (1982), Reidel, Dordrecht, The Netherlands
49. Kalman R.E. System identification from noisy data. In: Bednarek A.R., and Cesari L. (Eds). Dynamical systems II (1982), Academic Press, New York, NY
50. Karlsson E., Söderström T., and Stoica P. Computing the Cramér-Rao lower bound for noisy input-output systems. Signal Processing 80 11 (2000) 2421-2447
51. Koopmans T.J. Linear regression analysis of economic time series (1937), N. V. Haarlem, The Netherlands
52. Kukush A., Markovsky I., and Van Huffel S. Consistency of the structured total least squares estimator in a multivariate errors-in-variables model. Journal of Statistical Planning and Inference 133 (2005) 315-358
53. Levin M.J. Estimation of a system pulse transfer function in the presence of noise. IEEE Transactions on Automatic Control AC-9 (1964) 229-235
54. Ljung L. System identification-Theory for the user. (2nd ed.) (1999), Prentice-Hall, Upper Saddle River, NJ, USA
55. Ljung L., and Söderström T. Theory and practice of recursive identification (1983), MIT Press, Cambridge, MA, USA
56. Mahata, K. (2007). An improved bias-compensation approach for errors-in-variables model identification. Automatica, 43, in press.
57. Mahata, K., & Garnier, H. (2005). Direct identification of continuous-time errors-in-variables models. In 14th IFAC world congress, Prague, Czech Republic, July 3-8, 2005.
58. Markovsky, I., Kukush, A., & Van Huffel, S. (2006). On errors-in-variables with unknown noise variance ratio. In IFAC symposium on system identification, Newcastle, Australia, March 29-31, 2006.
59. Markovsky, I., Willems, J. C., & De Moor, B. (2002). Continuous-time errors-in-variables filtering. In 41st conference on decision and control (CDC 2002) (pp. 2576-2581), Las Vegas, Nevada, December 2002.
60. Markovsky I., Willems J.C., Van Huffel S., and De Moor B. Exact and approximate modeling of linear systems. A behavioral approach (2006), SIAM, Philadelphia, PA
61. Markovsky I., Willems J.C., Van Huffel S., De Moor B., and Pintelon R. Application of structured total least squares for system identification and model reduction. IEEE Transactions on Automatic Control 50 10 (2005) 1490-1500 (special issue on system identification: Linear vs. nonlinear)
62. Milanese M., and Vicino A. Optimal estimation theory for dynamic systems with set membership uncertainty: An overview. Automatica 27 6 (1991) 997-1009
63. Nowak E. Global identification of the dynamic shock-error model. Journal of Econometrics 27 (1985) 211-219
64. Nowak E. Identifiability in multivariate dynamic linear errors-in-variables models. Journal of the American Statistical Association 87 419 (1992) 713-723
65. Nowak E. The identification of multivariate linear dynamic errors-in-variables models. Journal of Econometrics 59 (1993) 213-227
66. Pintelon R., Guillaume P., Rolain Y., Schoukens J., and Van hamme H. Parametric identification of transfer functions in the frequency domain-A survey. IEEE Transactions on Automatic Control 39 11 (1994) 2245-2260
67. Pintelon R., and Schoukens J. System identification. A frequency domain approach (2001), IEEE Press, New York, NY, USA
68. Pintelon, R., & Schoukens, J. (2005). Personal communication.
69. Pintelon R., and Schoukens J. Frequency domain maximum likelihood estimation of linear dynamic errors-in-variables models. Automatica 43 4 (2007) 621-630
70. Reiersøl O. Confluence analysis by means of lag moments and other methods of confluence analysis. Econometrica 9 (1941) 1-24
71. Reiersøl O. Identifiability of a linear relation between variables which are subject to error. Econometrica 18 4 (1950) 375-389
72. Sagara, S., Yang, Z. J., & Wada, K. (1991). Identification of continuous systems from noisy sampled input-output data. In IFAC symposium on system identification and parameter estimation (pp. 1622-1627), Budapest, Hungary, 1991.
73. Scherrer W., and Deistler M. A structure theory for linear dynamic errors-in-variables models. SIAM Journal on Control and Optimization 36 6 (1998) 2148-2175
74. Schoukens J., Pintelon R., Vandersteen G., and Guillaume P. Frequency domain system identification using non-parametric noise models estimated from a small number of data sets. Automatica 33 (1997) 1073-1086
75. Söderström T. Spectral decomposition with application to identification. In: Archetti F., and Gugiani M. (Eds). Numerical techniques for stochastic systems (1980), North-Holland, Amsterdam
76. Söderström T. Identification of stochastic linear systems in presence of input noise. Automatica 17 (1981) 713-725
77. Söderström T. Discrete-time stochastic systems-Estimation and control. (2nd ed.) (2002), Springer, London, UK
78. Söderström, T. (2003). Why are errors-in-variables problems often tricky? In European control conference, ECC 2003, Cambridge, UK, September 1-4, 2003.
79. Söderström, T. (2005). Accuracy analysis of the Frisch estimates for identifying errors-in-variables systems. In 44th IEEE CDC/ECC 2005, Seville, Spain, December 12-15, 2005.
80. Söderström, T. (2006). On computing the Cramer-Rao bound and covariance matrices for PEM estimates in linear state space models. In 14th IFAC symposium on system identification, Newcastle, Australia, March 29-31, 2006.
81. Söderström, T. (2007). Extending the Frisch scheme for errors-in-variables identification to correlated noise. International Journal of Adaptive Control and Signal Processing, 21, in press.
82. Söderström, T., & Hong, M. (2005). Identification of dynamic errors-in-variables systems with periodic data. In Proceedings of the 16th IFAC world congress, Prague, Czech Republic, July 4-8, 2005.
83. Söderström T., Hong M., and Zheng W.X. Convergence properties of bias-eliminating algorithms for errors-in-variables identification. International Journal of Adaptive Control and Signal Processing 19 9 (2005) 703-722
84. Söderström, T., Larsson, E. K., Mahata, K., & Mossberg, M. (2006). Using continuous-time modeling for errors-in-variables identification. In 14th IFAC symposium on system identification, Newcastle, Australia, March 29-31, 2006.
85. Söderström T., and Mahata K. On instrumental variable and total least squares approaches for identification of error-in-variables models. International Journal of Control 75 (2002) 709-718
86. Söderström T., Mahata K., and Soverini U. Identification of dynamic errors-in-variables model: Approaches based on two-dimensional ARMA modelling of the data. Automatica 39 5 (2003) 929-935
87. Söderström T., Soverini U., and Mahata K. Perspectives on errors-in-variables estimation for dynamic systems. Signal Processing 82 8 (2002) 1139-1154
88. Söderström T., and Stoica P. Instrumental variable methods for system identification (1983), Springer, Berlin
89. Söderström T., and Stoica P. System identification (1989), Prentice Hall International, Hemel Hempstead, UK
90. Söderström T., Zheng W.X., and Stoica P. Comments on 'On a least-squares-based algorithm for identification of stochastic linear systems'. IEEE Transactions on Signal Processing 47 (1999) 1395-1396
91. Solo V. Identifiability of time series models with errors in variables. Journal of Applied Probability 23A (1986) 63-71
92. Soverini, U., & Söderström, T. (2000). Identification methods of dynamic systems in presence of input noise. In Proceedings of the SYSID 2000, IFAC 12th symposium on system identification, Santa Barbara, California, June 21-23, 2000.
93. Stoica P., Cedervall M., and Eriksson A. Combined instrumental variable and subspace fitting approach to parameter estimation of noisy input-output systems. IEEE Transactions on Signal Processing 43 (1995) 2386-2397
94. Stoica P., and Nehorai A. On the uniqueness of prediction error models for systems with noisy input-output data. Automatica 23 4 (1987) 541-543
95. Stoica P., Söderström T., and Šimonytė V. Study of a bias-free least squares parameter estimator. IEE Proceedings Control Theory Applications 142 (1995) 1-6
96. Tugnait J.K. Stochastic system identification with noisy input using cumulant statistics. IEEE Transactions on Automatic Control AC-37 (1992) 476-485
97. van den Bos A. Identification of continuous-time systems using multiharmonic test signals. In: Sinha N.K., and Rao G.P. (Eds). Identification of continuous-time systems (1992), Kluwer Academic, Dordrecht, The Netherlands
98. Van Huffel, S. (Ed.). (1997). Recent advances in total least squares techniques and errors-in-variables modelling. Philadelphia, USA: SIAM.
99. Van Huffel, S., & Lemmerling, Ph. (Eds.). (2002). Total least squares and errors-in-variables modelling. Analysis, algorithms and applications. Dordrecht, The Netherlands: Kluwer.
100. Van Huffel S., and Vandewalle J. Comparison of total least squares and instrumental variable methods for parameter estimation of transfer function models. International Journal of Control 50 (1989) 1039-1056
101. Van Huffel S., and Vandewalle J. The total least squares problem: Computation aspects and analysis (1991), SIAM, Philadelphia, USA
102. Van Schuppen J.H. Stochastic realization problems. In: Nijmeijer N., and Schumacher J.M. (Eds). Three decades of mathematical system theory (1989), Berlin, Springer
103. Wada K., Eguchi M., and Sagara S. Estimation of pulse transfer function via bias-compensated least-squares method in the presence of input and output noise. System Sciences 16 3 (1990) 57-70
104. Wald A. The fitting of straight lines if both variables are subject to error. The Annals of Mathematical Statistics 11B 3 (1940) 284-300
105. Willems J. From time series to linear systems. Automatica 37 (1986) 561-580
106. Zheng W.X. Transfer function estimation form noisy input and output data. International Journal of Adaptive Control and Signal Processing 12 (1998) 365-380
107. Zheng W.X. On least-squares identification of stochastic linear systems with noisy input-output data. International Journal of Adaptive Control and Signal Processing 13 (1999) 131-143
108. Zheng, W. X. (1999b). Parametric identification of noisy closed-loop linear systems. In Proceedings of 14th IFAC world congress, Beijing, P.R. China, July 1999.
109. Zheng W.X. A bias correction method for identification of linear dynamic errors-in-variables models. IEEE Transactions on Automatic Control 47 7 (2002) 1142-1147
110. Zheng W.X., and Feng C.B. Unbiased parameter estimation of linear systems in presence of input and output noise. International Journal of Adaptive Control and Signal Processing 3 (1989) 231-251
111. Zheng W.X., and Feng C.B. Identification of a class of dynamic errors-in-variables models. International Journal of Adaptive Control and Signal Processing 6 (1992) 431-440