On the relation between CCA and predictor-based subspace identification

IEEE Transactions on Automatic Control

Volumn 52, Issue 10, 2007, Pages 1795-1812

  Chiuso, Alessandro ^a  

^a UNIVERSITY OF PADOVA   (Italy)

Author keywords

Multiple input multiple output (MIMO) identification; Relative efficiency; Statistical analysis; Subspace identification

Indexed keywords

ALGORITHMS; FEEDBACK; OPTIMIZATION; TIME SERIES ANALYSIS;

MULTIPLE-INPUT MULTIPLE-OUTPUT IDENTIFICATION; PREDICTOR-BASED SUBSPACE IDENTIFICATION; RELATIVE EFFICIENCY;

IDENTIFICATION (CONTROL SYSTEMS);

EID: 36249013609     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAC.2007.906159     Document Type: Article

References (51)

1. H. Akaike, "Markovian representation of stochastic processes by canonical variables," SIAM J. Contr., vol. 13, pp. 162-173, 1975.
2. H. Akaike, "Canonical correlation analysis of time series and the use of an information criterion," in System Identification: Advances and Case Studies, R. Mehra and D. Lainiotis, Eds. New York: Academic, 1976, pp. 27-96.
3. D. Bauer, "Some asymptotic theory for the estimation of linear systems using maximum likelihood methods or subspace algorithms," Ph.D. dissertation, TU Wien, Wien, Austria, 1998.
4. D. Bauer, "Asymptotic properties of subspace estimators," Automatica, vol. 41, pp. 359-376, 2005.
5. D. Bauer, "Comparing the CCA subspace method to pseudo maximum likelihood methods in the case of no exogenous inputs," J. Time Series Anal., vol. 26, pp. 631-668, 2005.
6. D. Bauer and M. Jansson, "Analysis of the asymptotic properties of the MOESP type of subspace algorithms," Automatica, vol. 36, pp. 497-509, 2000.
7. D. Bauer and L. Ljung, "Some facts about the choice of the weighting matrices in Larimore type of subspace algorithm," Automatica, vol. 38, pp. 763-773, 2002.
8. P. Caines and C. Chan, "Estimation, identification and feedback," in System Identification: Advances and Case Studies, R. Mehra and D. Lainiotis, Eds. New York: Academic, 1976, pp. 349-405.
9. A. Chiuso, "The role of vector autoregressive modeling in predictor-based subspace identification," Automatica, vol. 43, no. 6, pp. 1034-1048, Jun. 2007.
10. A. Chiuso, "Some insights on the choice of the future horizon in CCA-type subspace algortihms," in Proc. Amer. Control Conf., New York, 2007.
11. A. Chiuso, "On the relation between CCA and predictor-based subspace identification," in Proc. 44rd IEEE Conf. Decision Contr., Sevilla, Spain, 2005.
12. A. Chiuso, "Asymptotic equivalence of certain closed-loop subspace identification methods," in Proc. SYSID 2006, Newcastle, Australia, 2006.
13. A. Chiuso, "Asymptotic variance of closed-loop subspace identification algorithms," IEEE Trans. Autom. Control, vol. 51, no. 8, pp. 1299-1314, 2006.
14. A. Chiuso, "The role of vector auto regressive modeling in subspace identification," in Proc. CDC 2006, San Diego, CA, Dec. 2006.
15. A. Chiuso and G. Picci, Geometry of Oblique Splitting, Minimality and Hankel Operators, ser. Lecture Notes in Control and Information Sciences. Berlin, Germany: Springer, 2003, pp. 85-124, no. 286.
16. A. Chiuso and G. Picci, "The asymptotic variance of subspace estimates," J. Econometrics, vol. 118, no. 1-2, pp. 257-291, 2004.
17. A. Chiuso and G. Picci, "Asymptotic variance of subspace methods by data orthogonalization and model decoupling: A comparative analysis," Automatica, vol. 40, no. 10, pp. 1705-1717, 2004.
18. A. Chiuso and G. Picci, "Numerical conditioning and asymptotic variance of subspace estimates," Automatica, vol. 40, no. 4, pp. 677-683, 2004.
19. A. Chiuso and G. Picci, "On the ill-conditioning of subspace identification with inputs," Automatica, vol. 40, no. 4, pp. 575-589, 2004.
20. A. Chiuso and G. Picci, "Consistency analysis of some closed-loop subspace identification methods," Automatica, vol. 41, no. 3, pp. 377-391, 2005.
21. A. Chiuso and G. Picci, "Prediction error vs. subspace methods in closed-loop identification," in Proc. 16th IFAC World Congr., Prague, Czech Republic, Jul. 2005.
22. N. Chui and J. Maciejowski, "Criteria for informative experiments for subspace identification," Int. J. Contr., vol. 78, no. 5, pp. 326-344, 2005.
23. U. Desai and D. Pal, "A realization approach to stochastic model reduction," IEEE Trans. Autom. Control, vol. AC-29, pp. 1097-1100, 1984.
24. T. Ferguson, A Course in Large Sample Theory. New York: Chapman and Hall, 1996.
25. H. Gazzah, P. Regalia, and J. Delmas, "Asymptotic eigenvalue distribution of block Toeplitz matrices and application to blind SIMO channel identification," IEEE Trans. Inf. Theory, vol. 47, pp. 1243-1251, Mar. 2001.
26. M. Gevers and B. Anderson, "On jointly stationary feedback-free stochastic processes," IEEE Trans. Autom. Control, vol. AC-27, pp. 431-436, 1982.
27. G. Golub and C. Van Loan, Matrix Computation, 2nd ed. Baltimore, MD: The Johns Hopkins Univ. Press., 1989.
28. C. Granger, "Economic processes involving feedback," Inf. Contr. vol. 6, pp. 28-48, 1963.
29. U. Grenander and G. Szegö, Toeplitz Forms and Their Applications New York: Chelsea, 1958.
30. E. Hannan and M. Deistler, The Statistical Theory of Linear Systems New York: Wiley, 1988.
31. E. Hannan and D. Poskitt, "Unit canonical correlations between future and past," Ann. Statist., vol. 16, pp. 784-790, 1988.
32. H. Hotelling, "Relations between two set of variables," Biometrika vol. 28, pp. 321-377, 1936.
33. M. Jansson, "Asymptotic variance analysis of subspace identification methods," in Proc. SYSID2000, Santa Barbara, CA, 2000.
34. M. Jansson, "Subspace identification and ARX modeling," in Proc. SYSID 2003, Rotterdam, The Netherlands, 2003.
35. T. Katayama and G. Picci, "Realization of stochastic systems with exogenous inputs and subspace system identification methods," Automatica, vol. 35, no. 10, pp. 1635-1652, 1999.
36. W. Larimore, "System identification, reduced-order filtering and modeling via canonical variate analysis," in Proc. Amer. Contr. Conf., 1983, pp. 445-451.
37. W. Larimore, "Canonical variate analysis in identification, filtering, and adaptive control," in Proc. 29th IEEE Conf. Decision Contr., Honolulu, HI, 1990, pp. 596-604.
38. W. Larimore, "Large sample efficiency for ADAPTX subspace identification with unknown feedback," in Proc. IFAC DYCOPS'04, Boston, MA, 2004.
39. R. Lewis and G. Reinsel, "Prediction of multivariate time series by autoregressive model fitting," J. Multivariate Anal., vol. 16, pp. 393-411, 1985.
40. A. Lindquist and G. Picci, "Canonical correlation analysis, approximate covariance extension and identification of stationary time series," Automatica, vol. 32, pp. 709-733, 1996.
41. L. Ljung, System Identification, Theory for the User. Englewood Cliffs, NJ: Prentice-Hall, 1997.
42. K. Peternell, W. Scherrer, and M. Deistler, "Statistical analysis of novel subspace identification methods," Signal Process., vol. 52, pp. 161-178, 1996.
43. S. Qin and L. Ljung, "Closed-loop subspace identification with innovation estimation," in Proc. SYSID 2003, Rotterdam, The Netherlands, 2003.
44. S. Qin and L. Ljung, "Parallel QR implementation of subspace identification with parsimonious models," in Proc. SYSID 2003, Rotterdam, The Netherlands, 2003.
45. C. Rao, "Representations of the best linear unbiased estimators in the Gauss-Markov model with a singular dispersion matrix," J. Multivariate Anal., vol. 3, pp. 276-292, 1973.
46. T. Söderström and P. Stoica, System Identification. Englewood Cliffs, NJ: Prentice-Hall, 1989.
47. P. Van Overschee and B. De Moor, "Subspace algorithms for the stochastic identification problem," Automatica, vol. 29, pp. 649-660, 1993.
48. P. Van Overschee and B. De Moor, "N4SID: Subspace algorithms for the identification of combined deterministic - Stochastic systems," Automatica, vol. 30, pp. 75-93, 1994.
49. P. Van Overschee and B. De Moor, "A unifying theorem for three subspace system identification algorithms," Automatica, vol. 31, no. 12, pp. 1853-1864, 1995.
50. M. Verhaegen, "Identification of the deterministic part of MIMO state space models given in innovations form from input-output data," Automatica, vol. 30, pp. 61-74, 1994.
51. H. Werner and C. Yapar, "On inequality constrained generalized least squares selections in the general possibly singular Gauss-Markov model: A projector theoretical approach," Linear Algebra Applicat. (Special Issue Honoring Calyampudi Radhakrishna Rao), vol. 237/238, no. 1-3, pp. 359-393, 1996.