Data-driven non-Markovian closure models

Physica D: Nonlinear Phenomena

Volumn 297, Issue , 2015, Pages 33-55

  Kondrashov, Dmitri ^a,b   Chekroun, Mickaël D ^a,b   Ghil, Michael ^a,b,c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c ECOLE NORMALE SUPÉRIEURE   (France)

Author keywords

Empirical model reduction; Inverse modeling; Least mean square minimization; Low order models; Memory effects; Nonlinear stochastic closure model

Indexed keywords

CLIMATE MODELS; DIFFERENTIAL EQUATIONS; FLOW OF FLUIDS; INVERSE PROBLEMS; MULTILAYERS; POPULATION STATISTICS; STATISTICAL PHYSICS; STOCHASTIC SYSTEMS;

EMPIRICAL MODEL; INVERSE MODELING; LEAST MEAN SQUARES; LOW ORDER MODELS; MEMORY EFFECTS; STOCHASTIC CLOSURES;

STOCHASTIC MODELS;

EID: 84921455835     PISSN: 01672789     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.physd.2014.12.005     Document Type: Article

References (141)

1. M. Ghil, and A.W. Robertson Solving problems with GCMs: General circulation models and their role in the climate modeling hierarchy D. Randall, General Circulation Model Development: Past, Present and Future 2000 Academic Press San Diego 285 325
2. A.L. Wilmot-Smith, P.C.H. Martens, D. Nandy, E.R. Priest, and S.M. Tobias Low-order stellar dynamo models Mon. Not. R. Astron. Soc. 363 2005 1167 1172
3. M. Bachar, J.J. Batzel, and S. Ditlevsen Stochastic Biomathematical Models: with Applications to Neuronal Modeling 2013 Springer
4. F. Noé, and S. Fischer Transition networks for modeling the kinetics of conformational change in macromolecules Curr. Opin. Struct. Biol. 18 2 2008 154 162
5. J.-H. Prinz, H. Wu, M. Sarich, B. Keller, M. Senne, M. Held, J. Chodera, C. Schütte, and F. Noé Markov models of molecular kinetics: Generation and validation J. Chem. Phys. 134 17 2011 174105
6. S. Donnet, and A. Samson A review on estimation of stochastic differential equations for pharmacokinetic/pharmacodynamic models Adv. Drug Deliv. Rev. 65 7 2013 929 939
7. S.J. Camargo, A.W. Robertson, S.J. Gaffney, and M. Ghil Cluster analysis of typhoon tracks. part II: large-scale circulation and ENSO J. Climate 20 2007 3654 3676
8. R.S. Kovats, M.J. Bouma, S. Hajat, E. Worrall, and A. Haines El Niño and health Lancet 362 2003 1481 1489
9. C. Ropelewski, and M. Halpert Global and regional scale precipitation patterns associated with the El Niño/southern oscillation Mon. Weather Rev. 115 1987 1606 1626
10. S.M. Hsiang, K.C. Meng, and M.A. Cane Civil conflicts are associated with the global climate Nature 476 2011 438 441
11. M. Cane, S. Zebiak, and S. Dolan Experimental forecasts of El Niño Nature 321 1986 827 832
12. C. Penland Random forcing and forecasting using principal oscillation pattern analysis Mon. Weather Rev. 117 1989 2165 2185
13. C. Penland, and P.D. Sardeshmukh The optimal growth of tropical sea surface temperature anomalies J. Climate 8 1995 1999 2024
14. C.R. Winkler, M. Newman, and P.D. Sardeshmukh A linear model of wintertime low-frequency variability. part I: formulation and forecast skill J. Climate 14 2001 4474 4494
15. Y. Xue, M.A. Cane, S.E. Zebiak, and M.B. Blumenthal On the prediction of ENSO: A study with a low-order Markov model Tellus 46A 1994 512 528
16. C. Penland, and T. Magorian Prediction of Niño-3 sea surface temperatures using iinear inverse modeling J. Climate 6 1993 1067 1076
17. A.G. Barnston, M.K. Tippett, M.L. Heureux, S. Li, and D.G. DeWitt Skill of real-time seasonal ENSO model predictions during 2002-2011 - is our capability improving? Bull. Am. Meteorol. Soc. 93 5 2012 631 651
18. S. Kravtsov, D. Kondrashov, and M. Ghil Multilevel regression modeling of nonlinear processes: derivation and applications to climatic variability J. Climate 18 2005 4404 4424
19. D. Kondrashov, S. Kravtsov, A.W. Robertson, and M. Ghil A hierarchy of data-based ENSO models J. Climate 18 2005 4425 4444
20. S. Kravtsov, D. Kondrashov, and M. Ghil An empirical stochastic model of sea-surface temperature and surface wind over the Southern Ocean Ocean Sci. 8 2011 1891 1936
21. D. Kondrashov, S. Kravtsov, and M. Ghil Empirical mode reduction in a model of extratropical low-frequency variability J. Atmos. Sci. 63 2006 1859 1877
22. D. Kondrashov, S. Kravtsov, and M. Ghil Signatures of nonlinear dynamics in an idealized atmospheric model J. Atmospheric Sci. 68 2011 3 12
23. J.M. Peters, S. Kravtsov, and N.T. Schwartz Predictability associated with nonlinear regimes in an atmospheric model J. Atmos. Sci. 69 2012 1137 1154
24. D. Kondrashov, M.D. Chekroun, A.W. Robertson, and M. Ghil Low-order stochastic model and "past-noise forecasting" of the Madden-Julian Oscillation Geophys. Res. Lett. 40 2013 5305 5310 10.1002/grl.50991
25. K. Strounine, S. Kravtsov, D. Kondrashov, and M. Ghil Reduced models of atmospheric low-frequency variability: parameter estimation and comparative performance Physica D 239 2010 145 166
26. S. Kravtsov, D. Kondrashov, and M. Ghil Empirical model reduction and the modeling hierarchy in climate dynamics T.N. Palmer, P. Williams, Stochastic Physics and Climate Modeling 2009 Cambridge Univ. Press 35 72
27. A.J. Majda, and Y. Yuan Fundamental limitations of ad hoc linear and quadratic multi-level regression models for physical systems Discrete Contin. Dyn. Syst. 17 4 2012 1333 1363
28. A.J. Majda, and J. Harlim Physics constrained nonlinear regression models for time series Nonlinearity 26 1 2013 201 217
29. J. Harlim, A. Mahdi, and A. Majda An ensemble kalman filter for statistical estimation of physics constrained nonlinear regression models J. Comput. Phys. 257 2014 782 812
30. S. Smale On the differential equations of species in competition J. Math. Biol. 3 1 1976 5 7
31. M.W. Hirsch Systems of differential equations which are competitive or cooperative: I. limit sets SIAM J. Math. Anal. 13 2 1982 167 179
32. M.W. Hirsch Systems of differential equations that are competitive or cooperative II: convergence almost everywhere SIAM J. Math. Anal. 16 3 1985 423 439
33. M.W. Hirsch Systems of differential equations which are competitive or cooperative: III. competing species Nonlinearity 1 1 1988 51
34. M.W. Hirsch Systems of differential equations that are competitive or cooperative. iv: structural stability in three-dimensional systems SIAM J. Math. Anal. 21 5 1990 1225 1234
35. H.L. Smith Monotone Dynamical Systems: An Introduction to the Theory of Competitive and Cooperative Systems 2008 American Mathematical Society Providence, R.I
36. O.E. Rössler Chaotic behavior in simple reaction systems Z. Nat.forsch. A 31 1976 259 264
37. O.E. Rössler Chaos in abstract kinetics: two prototypes Bull. Math. Biol. 39 2 1977 275 289
38. L.A. Segel, and M. Slemrod The quasi-steady-state assumption: a case study in perturbation SIAM Rev. 31 3 1989 446 477
39. U. Maas, and S.B. Pope Simplifying chemical kinetics: intrinsic low-dimensional manifolds in composition space Combust. Flame 88 3 1992 239 264
40. L.V. Kalachev, and R.J. Field Reduction of a model describing ozone oscillations in the troposphere: example of an algorithmic approach to model reduction in atmospheric chemistry J. Atmos. Chem. 39 1 2001 65 93
41. R. Zwanzig Nonequilibrium Statistical Mechanics 2001 Oxford University Press
42. J. Wouters, and V. Lucarini Multi-level dynamical systems: Connecting the Ruelle response theory and the Mori-Zwanzig approach J. Stat. Phys. 151 5 2013 850 860
43. A.J. Chorin, O.H. Hald, and R. Kupferman Optimal prediction with memory Physica D 166 2002 239 257
44. A.J. Chorin, and O.H. Hald Stochastic Tools in Mathematics and Science Surveys and Tutorials in the Applied Mathematical Sciences No. 147 2006 Springer New York
45. M.D. Chekroun, D. Kondrashov, and M. Ghil Predicting stochastic systems by noise sampling, and application to the El Niño-Southern Oscillation Proc. Natl. Acad. Sci. USA 108 2011 11766 11771
46. A.J. Majda, R. Abramov, and M. Grote Information Theory and Stochastics for Multiscale Nonlinear Systems 2005 American Mathematical Society Philadelphia, PA 140
47. D.M. Fargue Reducibilité des systèmes héréditaires à des systèmes dynamiques (régis des équations differentielles ou aux dérivées partielles) C. R. Acad. Sci.; Paris B. 277 1973 471 473
48. A. Wörz-Busekros Global stability in ecological systems with continuous time delay SIAM J. Appl. Math. 35 1 1978 123 134
49. C.M. Dafermos Asymptotic stability in viscoelasticity Arch. Ration. Mech. Anal. 37 4 1970 297 308
50. M.D. Chekroun, F. Di Plinio, N.E. Glatt-Holtz, and V. Pata Asymptotics of the Coleman-Gurtin model Discrete Contin. Dyn. Syst. Ser. S 4 2 2011 351 369
51. M.D. Chekroun, and N.E. Glatt-Holtz Invariant measures for dissipative dynamical systems: abstract results and applications Comm. Math. Phys. 316 3 2012 723 761
52. K. Bhattacharya, M. Ghil, and I.L. Vulis Internal variability of an energy-balance model with delayed albedo effects J. Atmos. Sci. 39 1982 1747 1773
53. L. Roques, M.D. Chekroun, M. Cristofol, S. Soubeyrand, and M. Ghil Parameter estimation for energy balance models with memory Proc. Roy. Soc. Edinburgh Sect. A 470 2014 20140349
54. V. Volterra Leçons sur la Théorie Mathématique de la Lutte Pour la vie 1931 Gauthier-Villars Paris
55. N. McDonald Time Lags in Biological Models Lecture Notes in Biomathematics vol. 27 1978 Springer-Verlag
56. H. Smith An Introduction to Delay Differential Equations with Applications to the Life Sciences 2011 Springer
57. H. Mori A continued-fraction representation of the time-correlation functions Progr. Theoret. Phys. 34 3 1965 399 416
58. R. Kupferman Fractional kinetics in Kac-Zwanzig heat bath models J. Stat. Phys. 114 1-2 2004 291 326
59. R. Kupferman, and A. Stuart Fitting sde models to nonlinear Kac-Zwanzig heat bath models Physica D 199 3 2004 279 316
60. I. Horenko, C. Hartmann, C. Schütte, and F. Noé Data-based parameter estimation of generalized multidimensional langevin processes Phys. Rev. E 76 1 2007 016706
61. M. Niemann, T. Laubrich, E. Olbrich, and H. Kantz Usage of the mori-zwanzig method in time series analysis Phys. Rev. E 77 1 2008 011117
62. R. Mañé On the dimension of the compact invariant sets of certain non-linear maps Dynamical Systems and Turbulence Lecture Notes in Mathematics vol. 898 1981 Springer Berlin 230 242
63. F. Takens Detecting strange attractors in turbulence Dynamical Systems and Turbulence Lecture Notes in Mathematics vol. 898 1981 Springer Berlin 366 381
64. D.S. Broomhead, and G.P. King Extracting qualitative dynamics from experimental data Physica D 20 2-3 1986 217 236
65. D.S. Broomhead, and G.P. King On the qualitative analysis of experimental dynamical systems S. Sarkar, Nonlinear Phenomena and Chaos 1986 Adam Hilger Bristol, England 113 144
66. M. Ghil, M.R. Allen, M.D. Dettinger, K. Ide, D. Kondrashov, M.E. Mann, A.W. Robertson, A. Saunders, Y. Tian, F. Varadi, and P. Yiou Advanced spectral methods for climatic time series Rev. Geophys. 40 1 2002 1 41
67. C. Nichkawde Sparse model from optimal nonuniform embedding of time series Phys. Rev. E 89 4 2014 042911
68. G.E.P. Box, and G. Jenkins Time Series Analysis, Forecasting and Control 1970 Holden-Day Boca Raton, Fla.
69. S.A. Billings, S. Chen, and M.J. Korenberg Identification of MIMO non-linear systems using a forward-regression orthogonal estimator Internat. J. Control 49 6 1989 2157 2189
70. S. Lu, K.H. Ju, and K.H. Chon A new algorithm for linear and nonlinear arma model parameter estimation using affine geometry [and application to blood flow/pressure data] IEEE Trans. Biomed. Eng. 48 10 2001 1116 1124
71. A. Willsky Multiresolution markov models for signal and image processing Proc. IEEE 90 8 2002 1396 1458
72. A.T. Ihler, S. Kirshner, M. Ghil, A.W. Robertson, and P. Smyth Graphical models for statistical inference and data assimilation Physica D 230 2007 72 87
73. K. Hornik, M. Stinchcombe, and H. White Multilayer feedforward networks are universal approximators Neural Netw. 2 5 1989 359 366
74. D. Mukhin, E. Loskutov, A. Mukhina, A. Feigin, I. Zaliapin, and M. Ghil Predicting critical transitions in enso models, part i: methodology and simple models with memory J. Climate 2014 10.1175/JCLI-D-14-00239.1
75. D. Mukhin, D. Kondrashov, E. Loskutov, A. Gavrilov, A. Feigin, I. Zaliapin, and M. Ghil Predicting critical transitions in enso models, part ii: spatially dependent models J. Climate 2014 10.1175/JCLI-D-14-00240.1
76. A.J. Majda, and P.R. Kramer Simplified models for turbulent diffusion: theory, numerical modelling, and physical phenomena Phys. Rep. 314 4 1999 237 574
77. M.D. Chekroun, J.D. Neelin, D. Kondrashov, J.C. McWilliams, and M. Ghil Rough parameter dependence in climate models: the role of Ruelle-Pollicott resonances Proc. Natl. Acad. Sci. USA 111 5 2014 1684 1690
78. D.T. Crommelin, and A.J. Majda Strategies for model reduction: comparing different optimal bases J. Atmos. Sci. 61 17 2004 2206 2217
79. T. Hastie, R. Tibshirani, and J. Friedman Linear Methods for Regression 2009 Springer
80. P. Billingsley Convergence of Probability Measures 2009 John Wiley & Sons
81. P.E. Kloeden, and E. Platen Numerical Solution of Stochastic Differential Equations Applications of Mathematics vol. 23 1992 Springer-Verlag Berlin
82. D.J. Higham, X. Mao, and A.M. Stuart Strong convergence of Euler-type methods for nonlinear stochastic differential equations SIAM J. Numer. Anal. 40 3 2002 1041 1063
83. X. Mao, and C. Yuan Stochastic Differential Equations with Markovian Switching 2006 World Scientific
84. C. Penland, and B.D. Ewald On modelling physical systems with stochastic models: diffusion versus Lévy processes Phil. Trans. Roy. Soc. A 366 1875 2008 2455 2474
85. J.-P. Eckmann, and D. Ruelle Ergodic theory of chaos and strange attractors Rev. Modern Phys. 57 1985 617 656
86. B. Gess, W. Liu, and M. Röckner Random attractors for a class of stochastic partial differential equations driven by general additive noise J. Differential Equations 251 4 2011 1225 1253
87. K.R. Schenk-Hoppé Random attractors-general properties, existence and applications to stochastic bifurcation theory Discrete Contin. Dyn. Syst. 4 1998 99 130
88. M.D. Chekroun, H. Liu, and S. Wang Approximation of Invariant Manifolds: Stochastic Manifolds for Nonlinear SPDEs I Springer Briefs in Mathematics 2015 Springer
89. L. Arnold Random Dynamical Systems 1998 Springer-Verlag New York
90. M.D. Chekroun, E. Simonnet, and M. Ghil Stochastic climate dynamics: random attractors and time-dependent invariant measures Physica D 240 21 2011 1685 1700
91. H. Crauel, and F. Flandoli Attractors for random dynamical systems Probab. Theory Related Fields 100 1994 365 393
92. V.I. Arnol'd Mathematical Methods of Classical Mechanics, Vol. 60 1989 Springer
93. F. Varadi, B. Runnegar, and M. Ghil Successive refinements in long-term integrations of planetary orbits Astrophys. J. 592 2003 620 630
94. E. Hairer, C. Lubich, and G. Wanner Geometric Numerical Integration: Structure-preserving Algorithms for Ordinary Differential Equations 2006 Springer
95. G. Da Prato, and J. Zabczyk Stochastic Equations in Infinite Dimensions Encyclopedia of Mathematics and its Applications vol. 44 2008 Cambridge University Press Cambridge
96. A.J. Chorin, O.H. Hald, and R. Kupferman Prediction from partial data, renormalization, and averaging J. Sci. Comput. 28 2-3 2006 245 261
97. A.J. Chorin, and P. Stinis Problem reduction, renormalization, and memory Commun. Appl. Math. Comput. Sci. 1 2006 1 27
98. P. Stinis A comparative study of two stochastic mode reduction methods Physica D 213 2 2006 197 213
99. O.H. Hald, and P. Stinis Optimal prediction and the rate of decay for solutions of the euler equations in two and three dimensions Proc. Natl. Acad. Sci. USA 104 16 2007 6527 6532
100. P. Stinis Higher-order Mori-Zwanzig models for the Euler equations Multiscale Model. Simul. 6 3 2007 741 760
101. A.J. Majda, I. Timofeyev, and E. Vanden-Eijnden A mathematical framework for stochastic climate models Comm. Pure Appl. Math. 54 2001 891 974
102. I. Melbourne, and A.M. Stuart A note on diffusion limits of chaotic skew-product flows Nonlinearity 24 4 2011 1361 1367
103. G.A. Gottwald, and I. Melbourne Homogenization for deterministic maps and multiplicative noise Proc. R. Soc. Lond. Ser. A 469 2156 2013 20130201 16 pp.
104. R. Temam Infinite-Dimensional Dynamical Systems in Mechanics and Physics second ed. Applied Mathematical Sciences vol. 68 1997 Springer-Verlag New York
105. M. Budišić, R. Mohr, and I. Mezić Applied Koopmanism Chaos 22 2012 047510 10.1063/1.4772195
106. M.D. Chekroun, and J. Roux Homeomorphisms group of normed vector space: conjugacy problems and the Koopman operator Discrete Contin. Dyn. Syst. Ser. A 33 2013 3957 3980
107. I.P. Cornfeld, S.V. Fomin, and Y.G. Sinai Ergodic Theory 1982 Springer-Verlag Berlin
108. A. Lasota, and M. Mackey Chaos, Fractals, and Noise: Stochastic Aspects of Dynamics, Vol. 97 1994 Springer
109. H. Brézis Functional Analysis, Sobolev Spaces and Partial Differential Equations 2010 Springer
110. K.-J. Engel, and R. Nagel One-Parameter Semigroups for Linear Evolution Equations Graduate Texts in Mathematics vol. 194 2000 Springer-Verlag New York
111. O. Butterley, and C. Liverani Smooth Anosov flows: correlation spectra and stability J. Mod. Dyn. 1 2007 301 322
112. D. Givon, R. Kupferman, and A. Stuart Extracting macroscopic dynamics: model problems and algorithms Nonlinearity 17 6 2004 R55 R127
113. W. Rudin Real and Complex Analysis third ed. 1987 McGraw-Hill New York
114. R.M. Dudley Real Analysis and Probability 2002 Cambridge University Press
115. O. Kallenberg Foundations of Modern Probability 2002 Springer
116. H. Crauel Random Probability Measures on Polish Spaces 2002 Taylor & Francis Inc.
117. H. Mori Transport, collective motion, and brownian motion Progr. Theoret. Phys. 33 3 1965 423 455
118. S. Nakajima On quantum theory of transport phenomena steady diffusion Progr. Theoret. Phys. 20 6 1958 948 959
119. I. Prigogine, and P. Resibois On the kinetics of the approach to equilibrium Physica 27 7 1961 629 646
120. R. Zwanzig Ensemble method in the theory of irreversibility J. Chem. Phys. 33 1960 1338
121. R. Zwanzig On the identity of three generalized master equations Physica 30 6 1964 1109 1123
122. A.J. Chorin, O.H. Hald, and R. Kupferman Optimal prediction and the Mori-Zwanzig representation of irreversible processes Proc. Natl. Acad. Sci. USA 97 7 2000 2968 2973
123. E. Lehmann, and G. Casella Theory of Point Estimation, Vol. 31 1998 Springer
124. C. Franzke, A.J. Majda, and G. Branstator The origin of nonlinear signatures of planetary wave dynamics: mean phase space tendencies and contributions from non-Gaussianity J. Atmospheric Sci. 64 2007 3987 4003
125. A.J. Majda, C. Franzke, and B. Khouider An applied mathematics perspective on stochastic modelling for climate Phil. Trans. R. Soc. Lond. Ser. A 366 2008 2429 2455
126. M. Kimoto, and M. Ghil Multiple flow regimes in the Northern Hemisphere winter. part I: methodology and hemispheric regimes J. Atmospheric Sci. 50 1993 2625 2643
127. M. Kimoto, and M. Ghil Multiple flow regimes in the Northern Hemisphere winter. part II: sectorial regimes and preferred transitions J. Atmospheric Sci. 50 1993 2645 2673
128. M. Ghil, and S. Childress Topics in Geophysical Fluid Dynamics: Atmospheric Dynamics, Dynamo Theory and Climate Dynamics 1987 Springer-Verlag New York/Berlin
129. R.M. May Stability and Complexity in Model Ecosystems 2001 Princeton University Press
130. M. Peschel, and W. Mende The Predator-Prey Model: Do We Live in a Volterra World? 1986 Springer Wien/New York
131. V. Kozlov, and S. Vakulenko On chaos in Lotka-Volterra systems: an analytical approach Nonlinearity 26 8 2013 2299
132. E.N. Lorenz Deterministic nonperiodic flow J. Atmospheric Sci. 20 2 1963 130 141
133. A. Arneodo, P. Coullet, J. Peyraud, and C. Tresser Strange attractors in Volterra equations for species in competition J. Math. Biol. 14 2 1982 153 157
134. J. Vano, J. Wildenberg, M. Anderson, J. Noel, and J. Sprott Chaos in low-dimensional Lotka-Volterra models of competition Nonlinearity 19 10 2006 2391
135. L. Roques, and M.D. Chekroun Probing chaos and biodiversity in a simple competition model Ecological Complexity 8 1 2011 98 104
136. E. Voit, and I.-C. Chou Parameter estimation in canonical biological systems models Intl. J. Systems Synthetic Biol. 1 2010 1 19
137. P. Dupuis Large deviations analysis of reflected diffusions and constrained stochastic approximation algorithms in convex sets Stochastics 21 1 1987 63 96
138. J. Durbin, and G.S. Watson Testing for serial correlation in least squares regression. i Biometrika 37 3-4 1950 409 428
139. F. Kwasniok The reduction of complex dynamical systems using principal interaction patterns Physica D 92 1996 28 60
140. F. Kwasniok Reduced atmospheric models using dynamically motivated basis functions J. Atmospheric Sci. 64 2007 3452 3474
141. P.E. Gill, W. Murray, and M.H. Wright Practical Optimization 1981 Academic Press London