Information theory, model error, and predictive skill of stochastic models for complex nonlinear systems

Physica D: Nonlinear Phenomena

Volumn 241, Issue 20, 2012, Pages 1735-1752

  Giannakis, Dimitrios ^a   Majda, Andrew J ^a   Horenko, Illia ^b  

^a NEW YORK UNIVERSITY   (United States)

^b UNIVERSITY OF LUGANO   (Switzerland)

Author keywords

Autoregressive models; Clustering algorithms; Information theory; Model error; Predictability; Stochastic models

Indexed keywords

CLUSTERING ALGORITHMS; DYNAMICAL SYSTEMS; FINITE ELEMENT METHOD; INFORMATION FILTERING; INFORMATION THEORY; LOW PASS FILTERS; MOLECULAR DYNAMICS; STOCHASTIC SYSTEMS;

AUTO REGRESSIVE MODELS; COARSE-GRAINED DESCRIPTION; COMPLEX DYNAMICAL SYSTEMS; COMPLEX NONLINEAR SYSTEM; EQUILIBRIUM STATISTICS; LONG RANGE PREDICTION; MODEL ERRORS; PREDICTABILITY;

STOCHASTIC MODELS;

EID: 84865980981     PISSN: 01672789     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.physd.2012.07.005     Document Type: Article

References (66)

1. E.N. Lorenz The predictability of a flow which possesses many scales of motion Tellus 21 1969 289 307
2. E.S. Epstein Stochastic dynamic predictions Tellus 21 1969 739 759
3. D. Ruelle, and F. Takens On the nature of turbulence Comm. Math. Phys. 20 1971 167 192
4. J.A. Vastano, and H.L. Swinney Information transport in spatiotemporal systems Phys. Rev. Lett. 60 1988 1773
5. K. Sobczyk Information dynamics: premises, challenges and results Mech. Syst. Signal Process. 15 2001 475 498
6. A.J. Majda, and J. Harlim Information flow between subspaces of complex dynamical systems Proc. Natl. Acad. Sci. 104 2007 9558 9563
7. R. Kleeman, Information theory and dynamical system predictability, in: Isaac Newton Institute Preprint Series, NI10063, 2010, pp. 1-33.
8. M.A. Katsoulakis, A.J. Majda, and D.G. Vlachos Coarse-grained stochastic processes and Monte Carlo simulations in lattice systems J. Comput. Phys. 186 2003 250 278
9. M.A. Katsoulakis, P. Plechác, and A. Sopasakis Error analysis of coarse-graining for stochastic lattice dynamics J. Numer. Anal. 44 2006 2270 2296
10. L.-Y. Leung, and G.R. North Information theory and climate prediction J. Clim. 3 1990 5 14
11. T. Schneider, and S.M. Griffies A conceptual framework for predictability studies J. Clim. 12 1999 3133 3155
12. R. Kleeman Measuring dynamical prediction utility using relative entropy J. Atmos. Sci. 59 2002 2057 2072
13. A.J. Majda, R. Kleeman, and D. Cai A mathematical framework for predictability through relative entropy Methods Appl. Anal. 9 2002 425 444
14. M. Roulston, and L. Smith Evaluating probabilistic forecasts using information theory Mon. Weather Rev. 130 2002 1653 1660
15. T. DelSole Predictability and information theory, part I: measures of predictability J. Atmos. Sci. 61 2004 2425 2440
16. T. DelSole Predictability and information theory, part II: imperfect models J. Atmos. Sci. 62 2005 3368 3381
17. R.M.B. Young, and P.L. Read Breeding and predictability in the baroclinic rotating annulus using a perfect model Nonlinear Processes Geophys. 15 2008 469 487
18. A.J. Majda, and B. Gershgorin Quantifying uncertainty in climate change science through empirical information theory Proc. Natl. Acad. Sci. 107 2010 14958 14963
19. H. Teng, and G. Branstator Initial-value predictability of prominent modes of North Pacific subsurface temperature in a CGCM Climate Dyn. 36 2011 1813 1834
20. A.J. Majda, and B. Gershgorin Improving model fidelity and sensitivity for complex systems through empirical information theory Proc. Natl. Acad. Sci. 108 2011 10044 10049
21. P. Deuflhard, M. Dellnitz, O. Junge, and C. Schütte Computation of essential molecular dynamics by subdivision techniques I: basic concept Lect. Notes Comp. Sci. Eng. 4 1999 98
22. P. Deuflhard, W. Huisinga, A. Fischer, and C. Schütte Identification of almost invariant aggregates in reversible nearly uncoupled Markov chains Linear Algebra Appl. 315 2000 39
23. I. Horenko, and C. Schütte On metastable conformation analysis of nonequilibrium biomolecular time series Multiscale Model. Simul. 8 2010 701 716
24. R.S. Tsay Analysis of Financial Time Series 2010 Wiley Hoboken
25. D.T. Crommelin, and E. Vanden-Eijnden Fitting timeseries by continuous-time Markov chains: a quadratic programming approach J. Comput. Phys. 217 2006 782 805
26. P. Metzner, E. Dittmer, T. Jahnke, and C. Schütte Generator estimation of Markov jump processes based on incomplete observations equidistant in time J. Comput. Phys. 227 2007 353 375
27. I. Horenko On simultaneous data-based dimension reduction and hidden phase identification J. Atmos. Sci. 65 2008 1941 1954
28. J. Bröcker, D. Engster, and U. Parlitz Probabilistic evaluation of time series models: a comparison of several approaches Chaos 19 2009 04130
29. I. Horenko Finite element approach to clustering of multidimensional time series SIAM J. Sci. Comput. 32 2010 62 83
30. J. de Wiljes, A.J. Majda, I. Horenko, An adaptive Markov chain Monte Carlo approach to time series clustering with regime transition behavior, SIAM J. Multiscale Model. Simul. (2010) (submitted for publication).
31. I. Horenko Parameter identification in nonstationary Markov chains with external impact and its application to computational sociology SIAM J. Multiscale Model. Simul. 9 2011 1700 1726
32. J. Berner, and G. Branstator Linear and nonlinear signatures in planetary wave dynamics of an AGCM: probability density functions J. Atmos. Sci. 64 2007 117 136
33. A.J. Majda, C. Franzke, A. Fischer, and D.T. Crommelin Distinct metastable atmospheric regimes despite nearly Gaussian statistics: a paradigm model Proc. Natl. Acad. Sci. 103 2006 8309 8314
34. C. Franzke, A.J. Majda, and G. Branstator The origin of nonlinear signatures of planetary wave dynamics: mean phase space tendencies and contributions from non-Gaussianity J. Atmos. Sci. 64 2007 3988
35. A.J. Majda, and X. Wang Linear response theory for statistical ensembles in complex systems with time-periodic forcing Commun. Math. Sci. 8 2010 145 172
36. I. Horenko On the identification of nonstationary factor models and their application to atmospheric data analysis J. Atmos. Sci. 67 2010 1559 1574
37. C. Franzke, D. Crommelin, A. Fischer, and A.J. Majda A hidden Markov model perspective on regimes and metastability in atmospheric flows J. Clim. 21 2008 1740 1757
38. C. Penland Random forcing and forecasting using principal oscillation pattern analysis Mon. Weather Rev. 117 1989 2165 2185
39. A.J. Majda, I.I. Timofeyev, and E. Vanden Eijnden Systematic strategies for stochastic mode reduction in climate J. Atmos. Sci. 60 2003 1705
40. C. Franzke, I. Horenko, A.J. Majda, and R. Klein Systematic metastable regime identification in an AGCM J. Atmos. Sci. 66 2009 1997 2012
41. I. Horenko On robust estimation of low-frequency variability trends in discrete Markovian sequences of atmospheric circulation patterns J. Atmos. Sci. 66 2009 2059 2072
42. I. Horenko On clustering of non-stationary meteorological time series Dyn. Atmos. Oceans 49 2010 164 187
43. R.V. Abramov, A.J. Majda, and R. Kleeman Information theory and predictability for low-frequency variability J. Atmos. Sci. 62 2005 65 87
44. T. DelSole, and M.K. Tippett Predictability: recent insights from information theory Rev. Geophys. 45 2007 RG4002
45. T. DelSole, and J. Shukla Model fidelity versus skill in seasonal forecasting J. Clim. 23 2010 4794 4806
46. D. Giannakis, and A.J. Majda Quantifying the predictive skill in long-range forecasting, part I: coarse-grained predictions in a simple ocean model J. Clim. 25 2011 1793 1813
47. D. Giannakis, and A.J. Majda Quantifying the predictive skill in long-range forecasting, part II: model error in coarse-grained Markov models with application to ocean-circulation regimes J. Clim. 25 2011 1814 1826
48. A.J. Majda, B. Gershgorin, and Y. Yuan Low-frequency climate response and fluctuation-dissipation theorems: theory and practice J. Atmos. Sci. 67 2010 1186
49. H. Akaike Information theory and an extension of the maximum likelihood principle B.N. Petrov, F. Caski, Proceedings of the Second International Symposium on Information Theory 1973 Akademiai Kiado Budapest 610
50. A.D.R. McQuarrie, and C.-L. Tsai Regression and Time Series Model Selection 1998 World Scientific Singapore
51. T.A. Cover, and J.A. Thomas Elements of Information Theory second ed. 2006 Wiley-Interscience Hoboken
52. I. Horenko Nonstationarity in multifactor models of discrete jump processes, memory and application to cloud modeling J. Atmos. Sci. 2011 Early online release
53. T. Gneiting, and A.E. Raftery Strictly proper scoring rules, prediction and estimation J. Amer. Statist. Assoc. 102 2007 359 378
54. J. Bröcker Reliability, sufficiency and the decomposition of proper scores Q. J. R. Meteorol. Soc. 135 2009 1512 1519
55. D. Madigan, A. Raftery, C. Volinsky, J. Hoeting, Bayesian model averaging, in: Proceedings of the AAAI Workshop on Integrating Multiple Learned Models, Portland, OR, pp. 77-83.
56. J.A. Hoeting, D. Madigan, A.E. Raftery, and C.T. Volinsky Bayesian model averaging: a tutorial Stat. Sci. 14 1999 382 401
57. A.E. Raftery, T. Gneiting, F. Balabdaoui, and M. Polakowski Using Bayesian model averaging to calibrate forecast ensembles Mon. Weather Rev. 133 2005 1155 1173
58. G. Branstator, and J. Berner Linear and nonlinear signatures in the planetary wave dynamics of an AGCM: phase space tendencies J. Atmos. Sci. 62 2005 1792 1811
59. A.J. Majda, C. Franzke, and D. Crommelin Normal forms for reduced stochastic climate models Proc. Natl. Acad. Sci. 106 2009 3649
60. M.H. DeGroot, and S.E. Fienberg Assessing probability assessors: calibration and refinements S.S. Gupta, J.O. Berger, Statistical Decision Theory and Related Topics III, Vol. 1 1982 Academic Press New York 291 314
61. H. Joe Relative entropy measures of multivariate dependence J. Amer. Stat. Assoc. 84 1989 157 164
62. B.W. Silverman Density Estimation for Statistics and Data Analysis Monographs on Statistics and Applied Probability vol. 26 1986 Chapman & Hall/CRC Boca Raton
63. R.O. Duda, P.E. Hart, and D.G. Stork Pattern Classification second ed. 2000 Wiley-Interscience New York
64. S. Khan, S. Bandyopadhyay, A.R. Ganguly, S. Saigal, D.J. Erickson III, V. Protopopescu, and G. Ostrouchov Relative performance of mutual information estimation methods for quantifying the dependence among short and noisy data Phys. Rev. E 76 2007 026209
65. A.J. Majda, R. Abramov, and B. Gershgorin High skill in low-frequency climate response through fluctuation dissipation theorems despite structural instability Proc. Natl. Acad. Sci. 107 2010 581 586
66. P. Metzner, L. Putzig, I. Horenko, Analysis of persistent non-stationary time series and applications, Commun. Appl. Math. Comput. Sci. (2012) (in press).