Probabilistic forecasting and bayesian data assimilation

Probabilistic Forecasting and Bayesian Data Assimilation

Volumn , Issue , 2015, Pages 1-297

  Reich, Sebastian ^a,b   Cotter, Colin ^c  

^a UNIVERSITY OF POTSDAM   (Germany)

^b UNIVERSITY OF READING   (United Kingdom)

^c IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

DYNAMICAL SYSTEMS; ENGINEERING EDUCATION; FORECASTING; KALMAN FILTERS; STUDENTS; VARIATIONAL TECHNIQUES;

BAYESIAN DATA ASSIMILATIONS; DATA ASSIMILATION ALGORITHMS; DYNAMICAL SYSTEMS APPROACH; ENSEMBLE KALMAN FILTER; MATHEMATICAL FRAMEWORKS; PROBABILISTIC FORECASTING; SEQUENTIAL MONTE CARLO METHODS; UNCERTAINTY QUANTIFICATIONS;

MONTE CARLO METHODS;

EID: 84953382137     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1017/CBO9781107706804     Document Type: Book

References (115)

1. Amezcua, J., Kalnay, E., Ide, K. & Reich, S. (2014), ‘Ensemble transform Kalman-Bucy filters’, Q.J.R. Meteor. Soc. 140, 995-1004.
2. Anderson, J. (2007), ‘An adaptive covariance inflation error correction algorithm for ensemble filters’, Tellus 59A, 210-224.
3. Anderson, J. (2010), ‘A non-Gaussian ensemble filter update for data assimilation’, Mon. Wea. Rev. 138, 4186-4198.
4. Anderson, J. (2012), ‘Localization and sampling error correction in ensemble Kalman filter data assimilation’, Mon. Wea. Rev. 140, 2359-2371.
5. Andrieu, C. & Roberts, G. (2009), ‘The pseudo-marginal approach for efficient MonteCarlo computations’, Ann. Statist. 37, 697-725.
6. Arnold, V. (1989), Mathematical Methods of Classical Mechanics, 2nd edn, SpringerVerlag, New York.
7. Arulampalam, M., Maskell, S., Gordon, N. & Clapp, T. (2002), ‘A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking’, IEEE Trans. Sign. Process. 50, 174-188.
8. Ascher, U. (2008), Numerical Methods for Evolutionary Differential Equations, SIAM, Philadelphia, PA.
9. Bain, A. & Crisan, D. (2009), Fundamentals of Stochastic Filtering, Vol. 60 of Stochastic Modelling and Applied Probability, Springer-Verlag, New York.
10. Beaumont, M. (2003), ‘Estimation of population growth or decline in genetically monitored populations’, Genetics 164, 1139-1160.
11. Benamou, J. & Brenier, Y. (2000), ‘A computational fluid mechanics solution to the Monge-Kantorovitch mass transfer problem’, Numer. Math. 84, 375-393.
12. Bengtsson, T., Bickel, P. & Li, B. (2008), ‘Curse of dimensionality revisited: Collapse of the particle filter in very large scale systems’. In IMS Collections, Probability and Statistics: Essays in Honor of David F. Freedman,2, 316-334.
13. Bergemann, K. & Reich, S. (2010), ‘A mollified ensemble Kalman filter’, Q.J.R. Mete-orolog. Soc. 136, 1636-1643.
14. Bergemann, K. & Reich, S. (2012), ‘An ensemble Kalman-Bucy filter for continuous data assimilation’, Meteorolog. Zeitschrift 21, 213-219.
15. Bloom, S., Takacs, L., Silva, A.D. & Ledvina, D. (1996), ‘Data assimilation using incremental analysis updates’, Q.J.R. Meteorolog. Soc. 124, 1256-1271.
16. Bocquet, M. & Sakov, P. (2012), ‘Combining inflation-free and iterative ensemble Kalman filters for strongly nonlinear systems’, Nonlin. Processes Geophys. 19, 383-399.
17. Bocquet, M., Pires, C. & Wu, L. (2010), ‘Beyond Gaussian statistical modeling in geophysical data assimilaition’, Mon. Wea. Rev. 138, 2997-3022.
18. Breźniak, Z. & Zastawniak, T. (1999), Basic Stochastic Processes, Springer-Verlag, London.
19. Bröcker, J. (2012), ‘Evaluating raw ensembles with the continuous ranked probability score’, Q.J.R. Meteorolog. Soc. 138, 1611-1617.
20. Bungartz, H.-J. & Griebel, M. (2004), ‘Sparse grids’, Acta Numerica 13, 147-269.
21. Caflisch, R. (1998), ‘Monte Carlo and Quasi-Monte Carlo methods’, Acta Numerica 7, 1-49.
22. Chen, Y. & Oliver, D. (2013), ‘Levenberg-Marquardt forms of the iterative ensemble smoother for efficient history matching and uncertainty quantification’, Computational Geoscience 17, 689-703.
23. Cheng, Y. & Reich, S. (2013), ‘A McKean optimal transportation perspective on Feynman-Kac formulae with application to data assimilation’., arXiv:1311.6300. To appear in Frontiers in Applied Dynamical Systems, Vol. 1, Springer-Verlag, New York.
24. Chorin, A. & Hald, O. (2009), Stochastic Tools in Mathematics and Science, 2nd edn, Springer-Verlag, Berlin.
25. Chorin, A., Morzfeld, M. & Tu, X. (2010), ‘Implicit filters for data assimilation’, Comm. Appl. Math. Comp. Sc. 5, 221-240.
26. Coles, S. (2001), An Introduction to Statistical Modeling of Extreme Values, SpringerVerlag, New York.
27. Collet, P. & Eckmann, J.-P. (2006), Concepts and Results in Chaotic Dynamics, Springer-Verlag, Berlin.
28. Crisan, D. & Xiong, J. (2010), ‘Approximate McKean-Vlasov representation for a class of SPDEs’, Stochastics 82, 53-68.
29. Daley, R. (1993), Atmospheric Data Analysis, Cambridge University Press, Cambridge.
30. Daum, F. & Huang, J. (2011), ‘Particle filter for nonlinear filters’. In Acoustics, Speech and Signal Processing (ICASSP), 2011 IEEE International Conference, IEEE, New York, 5920-5923.
31. del Moral, P. (2004), Feynman-Kac Formulae: Genealogical and Interacting Particle Systems with Applications, Springer-Verlag, New York.
32. Doucet, A., de Freitas, N. & Gordon, N., editors (2001), Sequential Monte Carlo Methods in Practice, Springer-Verlag, Berlin.
33. Emerik, A. & Reynolds, A. (2012), ‘Ensemble smoother with multiple data assimilation’, Computers & Geosciences 55, 3-15.
34. Engl, H., Hanke, M. & Neubauer, A. (2000), Regularization of Inverse Problems, Kluwer Academic Publishers, Dordrecht.
35. Evans, L. (1998), Partial Differential Equations, American Mathematical Society, Providence, RI.
36. Evans, L. (2013), An Introduction to Stochastic Differential Equations, American Mathematical Society, Providence, RI.
37. Evensen, G. (2006), Data Assimilation. The Ensemble Kalman Filter, Springer-Verlag, New York.
38. Frei, M. & Kunsch, H. (2013), ‘Mixture ensemble Kalman filters’, Computational Statistics and, Data Analysis 58, 127-138.
39. Gardiner, C. (2004), Handbook of Stochastic Methods, 3rd edn, Springer-Verlag.
40. Gneiting, T., Balabdaoui, F. & Raftery, A. (2007), ‘Probabilistic forecasts, calibration and sharpness’, J. R. Statist. Soc. B 69, 243-268.
41. Golub, G. & Loan, C.V. (1996), Matrix Computations, 3rd edn, Johns Hopkins University Press, Baltimore, MD.
42. Gonzalez-Tokman, C. & Hunt, B. (2013), ‘Ensemble data assimilation for hyperbolic systems’, Physica D 243, 128-142.
43. Hand, D. (2008), Statistics: A Very Short Introduction, Oxford University Press, Oxford.
44. Hastie, T., Tibshirani, R. & Friedman, J. (2009), The Elements of Statistical Learning, 2nd edn, Springer-Verlag, New York.
45. Higham, D. (2001), ‘An algorithmic introduction to numerical simulation of stochastic differential equations’, SIAM Review 43, 525-546.
46. Hoke, J. & Anthes, R. (1976), ‘The initialization of numerical models by a dynamic relaxation technique’, Mon. Wea. Rev. 104, 1551-1556.
47. Holtz, M. (2011), Sparse Grid Quadrature in High Dimensions with Applications in Finance and Insurance, Springer-Verlag, Berlin.
48. Hunt, B., Kostelich, E. & Szunyogh, I. (2007), ‘Efficient data assimilation for spatial-temporal chaos: A local ensemble transform Kalman filter’, Physica D 230, 112-137.
49. Janjic, T., McLaughlin, D., Cohn, S. & Verlaan, M. (2014), ‘Convervation of mass and preservation of positivity with ensemble-type Kalman filter algorithms’, Mon. Wea. Rev. 142, 755-773.
50. Jazwinski, A. (1970), Stochastic Processes and Filtering Theory, Academic Press, New York.
51. Julier, S.J. & Uhlmann, J.K. (1997), ‘A new extension of the Kalman filter to nonlinear systems’. In Proc. AeroSense: 11th Int. Symp. Aerospace/Defense Sensing, Simulation and Controls, pp. 182-193.
52. Kaipio, J. & Somersalo, E. (2005), Statistical and Computational Inverse Problems, Springer-Verlag, New York.
53. Kalnay, E. (2002), Atmospheric Modeling, Data Assimilation and Predictability, Cambridge University Press, Cambridge.
54. Katok, A. & Hasselblatt, B. (1995), Introduction to the Modern Theory of Dynamical Systems, Cambridge University Press, Cambridge.
55. Kitanidis, P. (1995), ‘Quasi-linear geostatistical theory for inverting’, Water Resources Research 31, 2411-2419.
56. Kloeden, P. & Platen, E. (1992), Numerical Solution of Stochastic Differential Equations, Springer-Verlag, Berlin.
57. Künsch, H. (2005), ‘Recursive Monte Carlo filter: Algorithms and theoretical analysis’, Ann. Statist. 33, 1983-2021.
58. Lasota, A. & Mackey, M. (1994), Chaos, Fractals, and Noise, 2nd edn, Springer-Verlag, New York.
59. Law, K., Shukia, A. & Stuart, A. (2014), ‘Analysis of the 3DVAR filter for the partially observed Lorenz’63 model’, Discrete and Continuous Dynamical Systems A 34, 1061-1078.
60. Lei, J. & Bickel, P. (2011), ‘A moment matching ensemble filter for nonlinear and non-Gaussian data assimilation’, Mon. Wea. Rev. 139, 3964-3973.
61. Lewis, J., Lakshmivarahan, S. & Dhall, S. (2006), Dynamic Data Assimilation: A Least Squares Approach, Cambridge University Press, Cambridge.
62. Liu, J. (2001), Monte Carlo Strategies in Scientific Computing, Springer-Verlag, New York.
63. Livings, D., Dance, S. & Nichols, N. (2008), ‘Unbiased ensemble square root filters’, Physica D 237, 1021-1028.
64. Lorenz, E. (1963), ‘Deterministic non-periodic flows’, J. Atmos. Sci. 20, 130-141.
65. Majda, A. & Harlim, J. (2012), Filtering Complex Turbulent Systems, Cambridge University Press, Cambridge.
66. McCann, R. (1995), ‘Existence and uniqueness of monotone measure-preserving maps’, Duke Math. J. 80, 309-323.
67. McKean, H. (1966), ‘A class of Markov processes associated with nonlinear parabolic equations’, Proc. Natl. Acad. Sci. USA 56, 1907-1911.
68. Meyn, S. & Tweedie, R. (1993), Markov Chains and Stochastic Stability, SpringerVerlag, London.
69. Miyoshi, T. (2011), ‘The Gaussian approach to adaptive covariance inflation and its implementation with the local ensemble transform Kalman filter’, Mon. Wea. Rev. 139, 1519-1535.
70. Morzfeld, M. & Chorin, A. (2012), ‘Implicit particle filtering for models with partial noise and an application to geomagnetic data assimilation’, Nonlinear Processes in Geophysics 19, 365-382.
71. Morzfeld, M., Tu, X., Atkins, E. & Chorin, A. (2012), ‘A random map implementation of implicit filters’, J. Comput. Phys. 231, 2049-2066.
72. Moselhy, T.E. & Marzouk, Y. (2012), ‘Bayesian inference with optimal maps’, J. Comput. Phys. 231, 7815-7850.
73. Moser, J. (1965), ‘On the volume elements on a manifold’, Trans. Amer. Math. Soc. 120, 286-294.
74. Neal, R. (1996), Bayesian Learning for Neural Networks, Springer-Verlag, New York.
75. Nerger, L., Pfander, T.J., Schroter, J. & Hiller, W. (2012), ‘A regulated localization scheme for ensemble-based Kalman filters’, Q.J.R. Meteorolog. Soc. 138, 802-812.
76. Nocedal, J. & Wright, S. (2006), Numerical Optimization, 2nd edn, Springer-Verlag, New York.
77. Øksendal, B. (2000), Stochastic Differential Equations, 5th edn, Springer-Verlag, Berlin.
78. Oliver, D. (1996), ‘On conditional simulation to inaccurate data’, Math. Geology 28, 811-817.
79. Oliver, D., He, N. & Reynolds, A. (1996), ‘Conditioning permeability fields on pressure data. Technical Report: presented at the 5th European Conference on the Mathematics of Oil Recovery, Leoben, Austria.
80. Olkin, I. & Pukelsheim, F. (1982), ‘The distance between two random vectors with given dispersion matrices’, Lin. Alg. and its Applns. 48, 257-263.
81. Ott, E., Hunt, B., Szunyogh, I., Zimin, A., Kostelich, E., Corazza, M., Kalnay, E., Patil, D. & Yorke, J.A. (2004), ‘A local ensemble Kalman filter for atmospheric data assimilation’, Tellus A 56, 415-428.
82. Otto, F. (2001), ‘The geometry of dissipative evolution equations: the porous medium equation’, Comm. Part. Diff. Eqs. 26, 101-174.
83. Pavliotis, G. (2014), Stochastic Processes and Applications, Springer-Verlag, New York.
84. Pele, O. & Werman, M. (2009), ‘Fast and robust earth mover’s distances’. In 12th IEEE International Conference on Computer Vision, IEEE New York, pp. 460-467.
85. Raftery, A. (1995), ‘Bayesian model selection in social research’, Sociological Methodology 25, 111-163.
86. Rebeschini, P. & van Handel, R. (2013), ‘Can local particle filters beat the curse of dimensionality?’, arXiv:1301.6585.
87. Reich, S. (2011), ‘A dynamical systems framework for intermittent data assimilation’, BIT Numer Math 51, 235-249.
88. Reich, S. (2012), ‘A Gaussian mixture ensemble transform filter’, Q.J.R. Meteorolog. Soc. 138, 222-233.
89. Reich, S. (2013a), ‘A guided sequential Monte Carlo method for the assimilation of data into stochastic dynamical systems’. In Recent Trends in Dynamical Systems, Proceedings in Mathematics and Statistics, 35, Springer-Verlag, Basel, pp. 205-220.
90. Reich, S. (2013b), ‘A nonparametric ensemble transform method for Bayesian inference’, SIAM J. Sci. Comput. 35, A2013-A2024.
91. Reich, S. & Cotter, C. (2013), ‘Ensemble filter techniques for intermittent data assimilation’. In Large Scale Inverse Problems. Computational Methods and Applications in the Earth Sciences, M. Cullen, M.A. Freitag, S. Kindermann & R. Scheichl, eds, Radon Ser. Comput. Appl. Math., 13, de Gruyter, Berlin, pp. 91-134.
92. Robert, C. (2001), The Bayesian Choice: From Decision-Theoretic Motivations to Computational Implementations, 2nd edn, Springer-Verlag, New York.
93. Robert, C. & Casella, G. (2004), Monte Carlo Statistical Methods, 2nd edn, SpringerVerlag, New York.
94. Robinson, J. (2001), Infinite-Dimensional Dynamical Systems, Cambridge University Press, Cambridge.
95. Sakov, P., Oliver, D. & Bertino, L. (2012), ‘An iterative EnKF for strongly nonlinear systems’, Mon. Wea. Rev. 140, 1988-2004.
96. Sarkkä, S. (2013), Bayesian Filtering and Smoothing, Cambridge University Press, Cambridge.
97. Simon, D. (2006), Optimal State Estimation, Wiley, New York.
98. Smith, K. (2007a), ‘Cluster ensemble Kalman filter’, Tellus 59A, 749-757.
99. Smith, L. (2007b), Chaos: A Very Short Introduction, Oxford University Press, Oxford.
100. Smith, R. (2014), Uncertainty Quantification, SIAM, Philadelphia, PA.
101. Stordal, A., Karlsen, H., Nrnvdal, G., Skaug, H. & Valles, B. (2011), ‘Bridging the ensemble Kalman filter and particle filters: the adaptive Gaussian mixture filter’, Comput. Geosci. 15, 293-305.
102. Strang, G. (1986), Introduction to Applied Mathematics, 2nd edn, Wellesley-Cambridge Press, Wellesley, MA.
103. Stuart, A. (2010), ‘Inverse problems: a Bayesian perspective’, Acta Numerica 17, 451-559.
104. Säli, E. & Mayers, D. (2006), An Introduction to Numerical Analysis, Cambridge University Press, Cambridge.
105. Takens, F. (1981), ‘Detecting strange attractors in turbulence’. In Dynamical Systems and Turbulence. Lecture Notes in Mathematics, 898, Springer-Verlag, Berlin, pp. 366-381.
106. Tarantola, A. (2005), Inverse Problem Theory and Methods for Model Parameter Estimation, SIAM, Philadelphia, PA.
107. Tijms, H. (2012), Understanding Probability, 3rd edn, Cambridge University Press, Cambridge.
108. Tippett, M., Anderson, J., Bishop, G., Hamill, T. & Whitaker, J. (2003), ‘Ensemble square root filters’, Mon. Wea. Rev. 131, 1485-1490.
109. van Leeuwen, P. (2010), ‘Nonlinear data assimilation in the geosciences: an extremely efficient particle filter’, Q.J.R. Meteorolog. Soc. 136, 1991-1996.
110. van Leeuwen, P. & Ades, M. (2013), ‘Efficient fully nonlinear data assimilation for geophysical fluid dynamics’, Computers & Geosciences 55, 16-27.
111. Verhulst, F. (2000), Nonlinear Differential Equations and Dynamical Systems, 2nd edn, Springer-Verlag, Berlin.
112. Villani, C. (2003), Topics in Optimal Transportation, American Mathematical Society, Providence, RI.
113. Villani, C. (2009), Optimal Transportation: Old and New, Springer-Verlag, Berlin.
114. Wang, X., Bishop, C. & Julier, S. (2004), ‘Which is better, an ensemble of positivenegative pairs or a centered spherical simplex ensemble?’, Mon. Wea. Rev. 132, 1590-1505.
115. Yang, T., Mehta, P. & Meyn, S. (2013), ‘Feedback particle filter’, IEEE Trans. Automatic Control 58, 2465-2480.