Statistical optimality and canonical variate analysis system identification

Signal Processing

Volumn 52, Issue 2, 1996, Pages 131-144

  Larimore, Wallace E ^a  

^a Adaptics Inc ^*  (United States)

Author keywords

Akaike information criterion; Identification accuracy; Kullback information; Multivariable systems; State order estimation; State order reduction; System identification

Indexed keywords

CLOSED LOOP CONTROL SYSTEMS; CONTROL SYSTEM ANALYSIS; MATHEMATICAL MODELS; MULTIVARIABLE CONTROL SYSTEMS; NUMERICAL METHODS; OPTIMAL CONTROL SYSTEMS; STATISTICAL METHODS; STOCHASTIC CONTROL SYSTEMS;

AKAIKE INFORMATION CRITERION (AIC); CANONICAL VARIATE ANALYSIS (CVA) METHOD; KULLBACK INFORMATION; MODEL APPROXIMATION; OPTIMAL MODEL SELECTION;

IDENTIFICATION (CONTROL SYSTEMS);

EID: 0030198071     PISSN: 01651684     EISSN: None     Source Type: Journal    
DOI: 10.1016/0165-1684(96)00049-7     Document Type: Article

References (43)

1. H. Akaike, "Information theory and an extension of the maximum likelihood principle", in: B.N. Petrov and F. Csaki, eds., 2nd Internat. Symp. on Information Theory, Akademiai Kiado, Budapest, 1973, pp. 267-281.
2. H. Akaike, "Stochastic theory of minimal realization", IEEE Trans. Automat. Control, Vol. 19, 1974, pp. 667-674.
3. H. Akaike, "Markovian representation of stochastic processes by canonical variables", SIAM J. Control, Vol. 13, 1975, pp. 162-173.
4. H. Akaike, "Canonical correlation analysis of time series and the use of an information criterion", in: R.K. Mehra and D.G. Lainiotis, eds., System Identification: Advances and Case Studies, Academic Press, New York, 1976, pp. 27-96.
5. W.F. Arnold, III and A.J. Laub, "Generalized eigenproblem algorithms and software for algebraic Riccati equations", Proc. IEEE, Vol. 72, 1984, pp. 1746-1754.
6. R.J. Bhansali and D.Y. Downham, "Some properties of the order of an autoregressive model selected by a generalization of Akaike's FPE criterion", Biometrika, Vol. 64, 1977, pp. 547-571.
7. G.E.P. Box and G.M. Jenkins, Time Series Analysis Forecasting and Control, Holden-Day, San Francisco, 1976.
8. J.V. Candy, T.E. Bullock and M.E. Warren, "Invariant description of the stochastic realization", Automatica, Vol. 15, 1979, pp. 493-495.
9. Y.M. Cho, G. Xu and T. Kailath, "Fast identification of state space models via explotation of displacement structure", Trans. Automat. Control, Vol. 39, No. 10, 1994, pp. 2004-2017.
10. F. Critchley, P. Marriott and M. Salmon, "Preferred point geometry and the local differential geometry of the Kullback-Leibler divergence", Ann. Statist., Vol. 22, 1995, pp. 1587-1602.
11. M. Deistler, K. Peternell and W. Scherrer, "Consistency and relative efficiency of subspace methods", Proc. IFAC SYSID '94, Copenhagen, Denmark, 4-6 July 1994, Vol. 2, pp. 157-163.
12. I.M. Gelfand and A.M. Yaglom, "Calculation of the amount of information about a random function contained in another such function", Amer. Math. Soc. Trans. Ser. 2, Vol. 12, 1959, pp. 199-236 Original Uspekhi Mat. Nauk., Vol. 12, 1956, pp. 3-52).
13. E.J. Hannan and M. Deistler, The Statistical Theory of Linear Systems, Wiley, New York, 1988.
14. E.J. Hannan and J. Rissanen, "Recursive estimation of ARMA order", Biometrika, Vol. 69, 1982, pp. 492-561.
15. B.L. Ho and R.E. Kalman, "Effective construction of linear state-variable models from input/output functions", Regelungstechnik, Vol. 14, 1966, pp. 545-548.
16. H. Hotelling, "Relations between two sets of variates", Biometrika, Vol. 28, 1936, pp. 321-377.
17. N. Hunter, A comparison of state model estimation using canonical variate analysis and eigensystem realization analysis, Unclassified Report LAUR-95-1275, Los Alamos National Laboratory, Los Alamos, NM, 1995.
18. C.M. Hurvich, R. Shumway and C.L. Tsai, "Improved estimators of Kullback-Leibler information for autoregressive model selection in small samples", Biometrika, Vol. 77, 1990, pp. 709-720.
19. C.M. Hurvich and C.L. Tsai, "Regression and time series model selection in small samples", Biometrika, Vol. 76, 1989, pp. 297-307.
20. C.M. Hurvich and C.L. Tsai, "Bias of the corrected AIC criterion for underfilled regression and time series models", Biometrika, Vol. 78, 1991, pp. 499-510.
21. S. Kullback, Information Theory and Statistics, Dover, New York, 1959.
22. W.E. Larimore, "System identification, reduced-order filtering and modeling via canonical variate analysis", in: H.S. Rao and T. Dorato, eds., Proc. 1983 American Control Conf., IEEE, New York, 1983, pp. 445-451.
23. W.E. Larimore, "Predictive inference, sufficiency, entropy, and an asymptotic likelihood principle", Biometrika, Vol. 70, 1983, pp. 175-181.
24. W.E. Larimore, "Canonical variate analysis for system identification, filtering, and adaptive control", Proc. 29th IEEE Conf. on Decision and Control, Honolulu, Hawaii, December 1990, Vol. 1, pp. 635-639.
25. X Automated System Identification Software Users Manual, Adaptics, Inc, 40 Fairchild Drive, Reading, MA 01867, 1996.
26. W.E. Larimore, "Accuracy confidence bands including the bias of model underfitting", Proc. 1993 American Control Conf., San Francisco, CA, 2-A June 1993.
27. W.E. Larimore, "The optimality of canonical variate identification by example", 10th IFAC Symposium on System Identification, Copenhagen, 4-6 July 1994.
28. W.E. Larimore, S. Mahmood and R.K. Mehra, "Multivariable adaptive model algorithmic control", in: A.H. Haddad and M. Polis, eds., Proc. Conf. on Decision and Control, Las Vegas, NV, 12-14 December 1984, IEEE, New York, Vol. 2, pp. 675-680.
29. W.E. Larimore and R.K. Mehra, "The problem of overfilling data", Byte, Vol. 10, 1985, pp. 167-180.
30. W.E. Larimore and F.T. Luk, "System identification and control using SVDs on systolic arrays", SPIE Symp. on Innovative Science and Technology, Proc. Conf. on High Speed Computing, Vol. 880, January 1988.
31. H. Lutkepohl, Introduction to Multiple Time Series Analysis, Springer, Berlin, 1993.
32. S.M. Pandit and S.M. Wu, Time Series and System Analysis with Applications, Wiley, New York, 1983.
33. R.P. Peloubet, R.L. Haller and R.M. Bolding, "On-line adaptive control of unstable aircraft wing flutter", Proc. 29th IEEE Conf. on Decision and Control, Honolulu, Hawaii, December 1990, Vol. 1, pp. 643-651.
34. S. Prasad and K.V.S. Hari, "Improved ARMA spectral estimation using the canonical variate method", IEEE Trans. Acoust. Speech Signal Process. Vol. 35, No. 6, 1987, pp. 900-903.
35. C.D. Schaper, W.E. Larimore, D.E. Seborg and D.A. Mellichamp, "Identification of chemical processes using canonical variate analysis", Comput. & Chem. Engrg., Vol. 18, 1994, pp. 55-69.
36. G. Schwartz, "Estimating the dimension of a model", Ann. Statist., Vol. 62, 1978, pp. 461-464.
37. R. Shibata, "An optimal autoregressive spectral estimate", Ann. Statist., Vol. 9, 1981, pp. 300-306.
38. R. Shibata, "A theoretical view of the use of AIC", in: O.D. Anderson, ed., Proc. Internat. Time Series Meeting, 1983.
39. P. Van Overschee, Subspace identification, PhD Dissertation, Katholieke Universiteit Leuven, Belgium, 1995.
40. P. Van Overschee and B. De Moor, "A unifying theorem for three subspace system identification algorithms", American Control Conf., Baltimore, MD, 29 June-1 July 1994, pp. 1645-1649.
41. M. Viberg, B. Ottersten, B. Wahlberg and L. Ljung, "Performance of subspace based state-space system identification methods", Proc. IFAC Symposium, Sydney, 1993.
42. J.V. White, "Stochastic state space models from empirical data", Proc. Internat. Conf. Acoust. Speech Signal Process., Boston, MA, April 1983, pp. 243-246.
43. A.M. Yaglom, "Outline of some topics in linear extrapolation of stationary random processes", Proc. 5th Berkeley Symp. Math. Stat. and Prob., Berkeley, CA, 1970, pp. 259-278.