Some system identification challenges and approaches

IFAC Proceedings Volumes (IFAC-PapersOnline)

Volumn 15, Issue PART 1, 2009, Pages 1-20

  Ninness, Brett ^a  

^a UNIVERSITY OF NEWCASTLE   (Australia)

Author keywords

Bayesian estimation; Maximum likelihood methods; Prediction error estimation

Indexed keywords

BAYESIAN NETWORKS; ECONOMICS; ERROR ANALYSIS; ESTIMATION; IDENTIFICATION (CONTROL SYSTEMS); MAXIMUM LIKELIHOOD ESTIMATION; MODEL STRUCTURES; RELIGIOUS BUILDINGS; SIGNAL PROCESSING; STATISTICAL MECHANICS;

BAYESIAN ESTIMATIONS; ERROR BOUND; HIGHER DIMENSIONS; MAXIMUM LIKELIHOOD METHODS; NON-LINEAR MODEL STRUCTURE; ORIENTED SYSTEMS; PREDICTION ERROR ESTIMATIONS; SIGNAL-PROCESSING; SYSTEM-IDENTIFICATION;

STATISTICS;

EID: 80051623188     PISSN: 14746670     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.3182/20090706-3-fr-2004.00001     Document Type: Conference Paper

References (88)

1. Frequency Domain System Identification Toolbox for MATLAB. http://elecwww.vub.ac.be/fdident/index.html.
2. A. Abdulle and G. Wanner. 200 years of the least squares method. Elemente der Mathematik, 57:45-60, 2002.
3. B.D.O. Anderson and J.B. Moore. Optimal Filtering. Prentice Hall, 1979.
4. K.J. Åström. Maximum likelihood and prediction error methods. Automatica, 16:551-574, 1980. (Pubitemid 11452707)
5. K.J. Åström and Peter Eykhoff. System identification a survey. Automatica, 7:123-162, 1971.
6. K.L. Åström and T. Bohlin. Numerical identification of linear dynamic systems from normal operating records. In Proceedings of the IFAC Symposium on Self-Adaptive Systems, Teddington, UK, pages 96- 111, 1965.
7. D. Bauer, M. Deistler, and W. Scherrer. Consistency and asymptotic Normality of some subspace algorithms for systems without observed inputs. Automatica, 35:1243-1254, 1999.
8. Dietmar Bauer and Magnus Jansson. Analysis of the asymptotic properties of the moesp type of subspace algorithms. Automatica, 36(4):497-509, April 2000. (Pubitemid 30550604)
9. L.E. Baum, T. Petrie, G. Soules, and N. Weiss. A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains. Annals of Mathematical Statistics, 41:164-171, 1970.
10. Niek H. Bergboer, Vincent Verdult, and Michel H.G. Verhaegen. An efficient implementation of Maximum Likelihood identification of LTI state-space models by local gradient search. In Proceedings of the 41st IEEE CDC, Las Vegas, USA, December 2002.
11. Dennis S. Bernstein. Matrix Mathematics. Princeton University Press, 2005.
12. M.J. Borran and B Aazhang. EM-based multiuser detection in fast fading multipath environments. In Proc. EURASIP, volume 8, pages 787-796, 2002.
13. John W. Brewer. Kronecker products and matrix calculus in system theory. IEEE Transactions on Circuits and Systems, 25(9):772-781, September 1978.
14. P.E. Caines. Linear Stochastic Systems. John Wiley and Sons, New York, 1988.
15. A. Chiuso and G. Picci. Asymptotic variance of subspace estimates. Journal of Econometrics, 118(1- 2):257-291, 2004.
16. K.L. Chung. A Course in Probability Theory. Harcourt, Brace and World Inc., 1968.
17. Rev.Mr.Bayes (communicated by Mr.Price). An essay towards solving a problem in the doctrine of chances. Philosophical Transactions of the Royal Society of London, 53:370-418, 1763.
18. Matthew Crouse, Robert Nowak, and Richard Baraniuk. Wavelet-based statistical signal processing using hidden Markov models. IEEE Transactions on Signal Processing, 46(4):886-902, April 1998. (Pubitemid 128743828)
19. A. Dempster, N. Laird, and D. Rubin. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, Series B, 39(1):1-38, 1977.
20. J. E. Dennis and R. B. Schnabel. Numerical Methods for Unconstrained Optimization and Nonlinear Equa tions. Prentice Hall, 1983.
21. J.L. Doob. Stochastic Processes. John Wiley and Sons, London, 1953.
22. A. Doucet, S. J. Godsill, and C. Andrieu. On sequential Monte Carlo sampling methods for Bayesian filtering. Statistics and Computing, 10(3):197-208, 2000.
23. A. Doucet and A. M. Johansen. Oxford Handbook of Nonlinear Filtering, chapter A tutorial on particle filtering and smoothing: fifteen years later, D. Crisan and B. Rozovsky (eds.). Oxford University Press, 2009.
24. Wouter Favoreel, Bart De Moor, and Peter Van Overschee. Subspace identification of bilinear systems subject to white inputs. IEEE Trans. Automat. Control, 44(6):1157-1165, 1999.
25. R.A. Fisher. On an absolute criterion for fitting frequency curves. Mess. Math., 41:155, 1912.
26. R.A. Fisher. On the mathematical foundations of theoretical statistics. Philosophical Transactions of the Royal Society, London, Series A, (222):309-368, 1922.
27. A.E. Gelfand and A.F.M Smith. Sampling based approaches to calculating marginal densities. Journal of the American Statistical Association, 85:398-409, 1990.
28. Michel Gevers. A personal view of the development of system identification. IEEE Control Systems Magazine, pages 93-105, December 2006.
29. Stuart Gibson and Brett Ninness. Robust maximumlikelihood estimation of multivariable dynamic systems. Automatica, 41(10):1667-1682, 2005. (Pubitemid 41119026)
30. Stuart Gibson, Adrian Wills, and Brett Ninness. Maximum-likelihood parameter estimation of bilinear systems. IEEE Transactions on Automatic Control, 50(10):1581-1596, 2005. (Pubitemid 41555606)
31. S. J. Godsill, A. Doucet, and M. West. Monte Carlo smoothing for nonlinear time series. Journal of the American Statistical Association, 99(465):156-168, March 2004. (Pubitemid 38545203)
32. I. Goethals, K. Pelckmans, J. A. K. Suykens, and B. De Moor. Supspace Identification of Hammerstein Systems Using Least Squares Support Vector Machines. IEEE Transactions on Automatic Control, 50(10):pp1509-1519, 2005. (Pubitemid 41555601)
33. G. C. Goodwin and J. C. Agüero. Approximate EM algorithms for parameter and state estimation in nonlinear stochastic models. In Proceedings of the 44th IEEE conference on decision and control (CDC) and the European Control Conference (ECC), pages 368-373, Seville, Spain, December 2005. (Pubitemid 46296994)
34. G.C. Goodwin and A. Feuer. Estimation with missing data. Mathematical and Computer Modelling of Dynamical Systems, 5(3):220-244, 1999.
35. G.C. Goodwin and R.L. Payne. Dynamic System Identification. Academic Press, 1977.
36. N. J. Gordon, D. J. Salmond, and A. F. M. Smith. A novel approach to nonlinear/non-Gaussian Bayesian state estimation. In IEE Proceedings on Radar and Signal Processing, volume 140, pages 107-113, 1993.
37. E.J. Hannan and Manfred Deistler. The Statistical Theory of Linear Systems. JohnWiley and Sons, New York, 1988.
38. W.K. Hastings. Monte Carlo sampling methods using Markov chains and their applications. Biometrika, 57:97-109, 1970.
39. Alf J. Isaksson. Identification of ARX-models subject to missing data. IEEE Trans. Automat. Control, 38(5):813-819, 1993.
40. J.Dongarra and F.Sullivan (eds). The top ten algorithms-The Metropolis algorithm. Computing in Science and Engineering, 2(1):65-69, 2000.
41. A.N. Kolmogorov. Interpolation und extrapolation von stationären zufälligen folgen. Bulletin de l'académie des Sciences de U.S.S.R., 5:3-14, 1941.
42. Arthur J. Krener. Bilinear and nonlinear realizations of input-output maps. SIAM J. Control, 13:827-834, 1975.
43. L. H. Lee and K. Poolla. Identification of linear parameter-varying systems using nonlinear programming. Journal of Dynamic Systems, Management, and Control, 121:71-78, March 1999.
44. E.L. Lehmann. Theory of Point Estimation. John Wiley & Sons, 1983.
45. L. Ljung and A. Vicino (Ed). Special issue on system identification: Linear vs nonlinear. IEEE Transaction on Automatic Control, 2005.
46. L. Ljung, G. Goodwin, J. Skoukens, D. Westwick, K. Keesman, and Hong Zhao. Experiences and challenges of nonlinear systems. Panel Discussion Session, at 14th IFAC Symposium on System Identification, 2006.
47. Lennart Ljung. Perspectives on system identification. In Plenary Talk at the 17th IFAC World Congress, Seoul, Korea, July 6-11 2008.
48. Lennart Ljung. System Identification: Theory for the User, (2nd edition). Prentice-Hall, Inc., New Jersey, 1999.
49. Lennart Ljung. MATLAB System Identification Tool-box Users Guide, Version 6. The Mathworks, 2004.
50. L.Ljung. Convergence analysis of parametric identification methods. IEEE Transactions on Automatic Control, AC-23(5):770-783, 1978. (Pubitemid 9396009)
51. L.Ljung and P.E.Caines. Asymptotic Normality of prediction error estimators for approximate system models. Stochastics, 3:29-46, 1979. (Pubitemid 10428005)
52. T. McKelvey, A. Helmersson, and T. Ribarits. Data driven local coordinates for multivariable linear systems and their application to system identification. Automatica, 40:1629-1635, 2004.
53. Tomas McKelvey and Anders Helmersson. A dynamical minimal parametrization of multivariable linear systems and its application to optimization and system identification. In Proc. of the 14th World Congress of IFAC, volume H, pages 7-12, Beijing, P. R. China, 1999.
54. G. McLachlan and T. Krishnan. The EM Algorithm and Extensions. Whiley Series in Probability and Statistics. John Wiley & Sons, New York, USA, 2 edition, 2008.
55. N. Metropolis, A. W. Rosenbluth, M. N. Rosenbluth, A. H. Teller, and E. Teller. Equations of state calculations by fast computing machine. Journal of Chemical Physics, 21(6):1087-1092, 1953.
56. N. Metropolis and S. Ulam. The Monte Carlo method. Journal of the American Statistical Association, 44(247):335-341, 1949.
57. S. P. Meyn and R. L. Tweedie. Markov chains and stochastic stability. Springer-Verlag, London, 1993.
58. M. Milanese and A. Vicino. Optimal inner bounds of feasible parameter set in linear estimation with bounded noise. IEEE Transactions on Automatic Control, 36(6):759, 1991.
59. M. Milanese and A. Vicino. Information based complexity and nonparametric worst-case system identification. Journal of Complexity, 9(4):427-446, December 1993.
60. Brett Ninness. Strong laws of large numbers under weak assumptions with applications. IEEE Transactions on Automatic Control, 45(11):2117-2122, November 2000. (Pubitemid 32085232)
61. Brett Ninness and Soren Henriksen. Bayesian system identification via markov chain monte carlo techniques. Provisionally accepted as a full paper, Automatica, 2009.
62. Brett Ninness and Adrian Wills. An identification toolbox for profiling novel techniques. In 14th IFAC Symposium on System Identification, pages 301-307, mar 2006.
63. John P. Norton. An Introduction to Identification. Academic Press, 1985.
64. J.P. Norton. Identification and application of bounded parameter models. automatica, 23:497-507, 1987. (Pubitemid 17637295)
65. J.P. Norton. Identification of parameter bounds of ARMAX models from records with bounded noises. International Journal of Control, 42:375-390, 1987. (Pubitemid 17533105)
66. B.D. Ripley. Stochastic Simulation. Wiley, 1987.
67. Christian P. Robert. The Bayesian Choice. Springer Verlag, 2 edition, 2001.
68. Gareth O. Roberts and Jeffrey S. Rosenthal. Optimal scaling for various Metropolis-Hastings algorithms. Statistical Science, 16(4):351-367, November 2001. (Pubitemid 33636356)
69. Wilson J. Rugh. Nonlinear System Theory: The Volterra/Wiener Approach. The Johns Hopkins University Press, Baltimore, MD, 1981.
70. P. Salamon, P. Sibani, and R. Frost. Facts, conjectures, and Improvements for Simulated Annealing. SIAM, Philadelphia, 2002.
71. Thomas Schön, Adrian Wills, and Brett Ninness. System identification of nonlinear state space models. Submitted to Automatica, 2009.
72. Mordechai Segal and Ehud Weinstein. A new method for evaluating the log-likelihood gradient (score) of linear dynamic systems. IEEE Transactions on Automatic Control, 33(8):763-766, 1988.
73. R. H. Shumway and D. S. Stoffer. An approach to time series smoothing and forecasting using the EM algorithm. Journal of time series analysis, 3(4):253-264, 1982.
74. B. W. Silverman. Density estimation for statistics and data analysis. Monographs on Statistics and Applied Probability. Chapman & Hall, London, 1986.
75. Luke Tierney. Markov chains for exploring posterior distributions. Ann. Statist., 22(4):1701-1762, 1994. With discussion and a rejoinder by the author.
76. T.Söderström and P.Stoica. System Identification. Prentice Hall, New York, 1989.
77. Peter van Overschee and Bart de Moor. N4SID:Subspace algortihms for the identification of combined deterministic-stochastic systems. Automatica, 30(1):75-93, 1994. (Pubitemid 124007975)
78. Sergio Verdu. Multiuser Detection. Cambridge University Press, 1998.
79. V. Verdult and M. Verhaegen. Subspace identification of MIMO bilinear systems. In Proceedings of the European Control Conference, Karlsruhe, Germany, 1999.
80. Vincent Verdult, Niek Bergboer, and Michel Verghaegen. Maximum Likelihood identification of multivariable bilinear state-space systems by projected gradient search. In Proceedings of the 41st IEEE CDC, Las Vegas, USA, December 2002.
81. M. Verhaegen. Identification of the deterministic part of MIMO state space models in innovations form from input-output data. Automatica, 30(1):61-74, January 1994. (Pubitemid 124007974)
82. Michel Verhaegen and Vincent Verdult. Filtering and System Identification. Cambridge University Press, 2007.
83. E. Walter and H.Piet-Lahanier. Exact recursive polyhedral description of the feasible parameter set for bounded-error models. IEEE Transactions on Automatic Control, AC-34:911-914, 1989.
84. Norbert Wiener. Extrapolation, Interpolation and Smoothing of Stationary Time Series. M.I.T. Press, 1949.
85. Adrian Wills, Adam Mills, and Brett Ninness. A MATLAB software environment for system identification. In Proceeding of the 15th IFAC Symposium on System Identification, 2009.
86. Adrian Wills and Brett Ninness. On gradient-based search for multivariable system estimates. IEEE Trans. Automat. Control, 53(1):298-306, 2008.
87. Adrian Wills, Brett Ninness, and Stuart Gibson. Maximum likelihood estimation of state space models from frequency domain data. IEEE Transactions on Automatic Control, 54(1):19-33, 2009.
88. M. H. Wright. Direct search methods: once scorned, now respectable. In Numerical analysis 1995 (Dundee, 1995), pages 191-208. Longman, Harlow, 1996.