Past-future information bottleneck in dynamical systems

Physical Review E - Statistical, Nonlinear, and Soft Matter Physics

Volumn 79, Issue 4, 2009, Pages

  Creutzig, Felix ^a   Globerson, Amir ^b   Tishby, Naftali ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b HEBREW UNIVERSITY OF JERUSALEM   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

CANONICAL CORRELATION ANALYSIS; GENERALIZED EIGENVALUE PROBLEMS; INFORMATION BOTTLENECK; MODEL REDUCTION; NUMERICAL EXAMPLE; PROCESS INFORMATION; REAL TIME; STATE SPACE; STRUCTURAL PHASE TRANSITION; SYSTEM IDENTIFICATIONS; TRADE OFF;

BIOLOGICAL SYSTEMS; DYNAMICAL SYSTEMS; EIGENVALUES AND EIGENFUNCTIONS; INFORMATION THEORY; PHASE TRANSITIONS;

REAL TIME SYSTEMS;

EID: 67650091011     PISSN: 15393755     EISSN: 15502376     Source Type: Journal    
DOI: 10.1103/PhysRevE.79.041925     Document Type: Article

References (18)

1. T. Cover and J. Thomas, The Elements of Information Theory (Plenum Press, New York, 1991).
2. W. Bialek, I. Nemenman, and N. Tishby, Neural Comput. 13, 2409 (2001). 10.1162/089976601753195969
3. N. Tishby, F. C. Pereira, and W. Bialek, Proceedings of 37th Allerton Conference on Communication and Computation (unpublished).
4. F. Creutzig and H. Sprekeler, Neural Comput. 20, 1026 (2008). 10.1162/neco.2008.01-07-455
5. G. Chechik, A. Globerson, N. Tishby, and Y. Weiss, J. Mach. Learn. Res. 6, 165 (2005).
6. T. Katayama, Subspace Methods for System Identification (Springer, New York, 2005).
7. B. Ho and R. Kalman, Regelungstechnik 14, 545 (1966).
8. C. T. Chen, Linear System Theory and Design (Oxford University Press, New York, 1999).
9. R. Lim, M. Phan, and R. Longman, Princeton University Tech. Report No. 3045, 1998 (unpublished).
10. J. R. Magnus and H. Neudecker, Matrix Differential Calculus with Applications in Statistics and Econometrics (Wiley, New York, 1988).
11. S. Gugercin and A. C. Antoulas, Int. J. Control 77, 748 (2004). 10.1080/00207170410001713448
12. H. Akaike, in Canonical Correlation Analysis of Time Series and the Use of an Information Criterion, edited by, R. Mehra, and, D. Lainiotis, (Academic, New York, 1976), pp. 27-96.
13. N. Jewell and P. Bloomfield, Ann. Stat. 11, 837 (1983). 10.1214/aos/1176346250
14. L. Li, J. Time Ser. Anal. 27, 309 (2005). 10.1111/j.1467-9892.2005.00469. x
15. I. Gelfand and A. Yaglom, Am. Math. Soc. Transl. 12, 199 (1959).
16. S. Soatto and A. Chiuso, Department of Computer Science, UCLA Tech. Report No. UCLA-CSD- 010001, 2000 (unpublished).
17. D. Bauer, Econometric Theory 21, 181 (2005). 10.1017/S0266466605050127
18. K. D. Cock and B. D. Moor, citeseer.ist.psu.edu/564422.html