Stochastic partial differential equation based modelling of large space-time data sets

Journal of the Royal Statistical Society. Series B: Statistical Methodology

Volumn 77, Issue 1, 2015, Pages 3-33

  Sigrist, Fabio ^a   Künsch, Hans R ^a   Stahel, Werner A ^a  

^a ETH ZURICH   (Switzerland)

Author keywords

Advection diffusion equation; Gaussian process; Numerical weather prediction; Physics based model; Spatiotemporal model; Spectral methods

Indexed keywords

EID: 84917679654     PISSN: 13697412     EISSN: 14679868     Source Type: Journal    
DOI: 10.1111/rssb.12061     Document Type: Article

References (114)

1. Abramowitz, M. and Stegun, I. A. (1964) Handbook of Mathematical Functions. New York: Dover Publications.
2. Anderson, B. D. O. and Moore, J. B. (1979) Optimal Filtering (eds B. D. O. Anderson and J. B. Moore ). Englewood Cliffs: Prentice Hall.
3. Antolik, M. S. (2000) An overview of the national weather service's centralized statistical quantitative precipitation forecasts. J. Hydrol., 239, 306-337.
4. Applequist, S., Gahrs, G. E., Pfeffer, R. L. and Niu, X.-F. (2002) Comparison of methodologies for probabilistic quantitative precipitation forecasting. Weath. Forecast., 17, 783-799.
5. Aune, E. and Simpson, D. (2012) The use of systems of stochastic PDEs as priors for multivariate models with discrete structures. Preprint arXiv:1208.1717.
6. Banerjee, S., Carlin, B. P. and Gelfand, A. E. (2004) Hierarchical Modeling and Analysis for Spatial Data. Boca Raton: Chapman and Hall-CRC.
7. Banerjee, S., Gelfand, A. E., Finley, A. O. and Sang, H. (2008) Gaussian predictive process models for large spatial data sets. J. R. Statist. Soc. B, 70, 825-848.
8. Bardossy, A. and Plate, E. (1992) Space-time model for daily rainfall using atmospheric circulation patterns. Wat. Resour. Res., 28, 1247-1259.
9. Bell, T. (1987) A space-time stochastic model of rainfall for satellite remote-sensing studies. J. Geophys. Res., 92, 9631-9643.
10. Berrocal, V. J., Raftery, A. E. and Gneiting, T. (2008) Probabilistic quantitative precipitation field forecasting using a two-stage spatial model. Ann. Appl. Statist., 2, 1170-1193.
11. Borgman, L., Taheri, M. and Hagan, R. (1984) Three-dimensional frequency-domain simulations of geological variables. In Geostatistics for Natural Resources Characterization (ed. G. Verly ), pp. 517-541. Boston: Reidel.
12. Bremnes, B. J. (2004) Probabilistic forecasts of precipitation in terms of quantiles using NWP model output. Mnthly Weath. Rev., 132, 338-347.
13. Bronson, R. and Costa, G. B. (2007) Linear Algebra: an Introduction. New York: Academic Press.
14. Brooks, S., Gelman, A., Jones, G. and Meng, X. (2011) Handbook of Markov Chain Monte Carlo. Boca Raton: Chapman and Hall-CRC.
15. Brown, P. E., Kå resen, K. F., Roberts, G. O. and Tonellato, S. (2000) Blur-generated non-separable space-time models. J. R. Statist. Soc. B, 62, 847-860.
16. Cameletti, M., Lindgren, F., Simpson, D. and Rue, H. (2013) Spatio-temporal modeling of particulate matter concentration through the SPDE approach. Adv. Statist. Anal., 79, 109-131.
17. Carter, C. K. and Kohn, R. (1994) On Gibbs sampling for state space models. Biometrika, 81, 541-553.
18. Coe, R. and Stern, R. (1982) Fitting models to daily rainfall data. J. Appl. Meteorol., 21, 1024-1031.
19. Cooley, J. W. and Tukey, J. W. (1965) An algorithm for the machine calculation of complex Fourier series. Math. Computn, 19, 297-301.
20. Cramér, H. and Leadbetter, M. R. (1967) Stationary and Related Stochastic Processes: Sample Function Properties and Their Applications. New York: Wiley.
21. Cressie, N. and Huang, H.-C. (1999) Classes of nonseparable, spatio-temporal stationary covariance functions. J. Am. Statist. Ass., 94, 1330-1340.
22. Cressie, N. and Johannesson, G. (2008) Fixed rank kriging for very large spatial data sets. J. R. Statist. Soc. B, 70, 209-226.
23. Cressie, N. and Wikle, C. K. (2011) Statistics for Spatio-temporal Data. Hoboken: Wiley.
24. Duan, J. A., Gelfand, A. E. and Sirmans, C. (2009) Modeling space-time data using stochastic differential equations. Baysn Anal., 4, 733-758.
25. Dudgeon, D. E. and Mersereau, R. M. (1984) Multidimensional Digital Signal Processing. Englewood Cliffs: Prentice Hall.
26. Eidsvik, J., Shaby, B., Reich, B., Wheeler, M. and Niemi, J. (2012) Estimation and prediction in spatial models with block composite likelihoods using parallel computing. Technical Report. Department of Mathematical Sciences, Norwegian University of Science and Technology, Trondheim. (Available from http://www.math.ntnu.no/~joeid/ESRWN.pdf.)
27. Folland, G. B. (1992) Fourier Analysis and Its Applications. Pacific Grove: Wadsworth and Brooks-Cole.
28. Friederichs, P. and Hense, A. (2007) Statistical downscaling of extreme precipitation events using censored quantile regression. Mnthly Weath. Rev., 135, 2365-2378.
29. Frühwirth-Schnatter, S. (1994) Data augmentation and dynamic linear models. J. Time Ser. Anal., 15, 183-202.
30. Fuentes, M. (2007) Approximate likelihood for large irregularly spaced spatial data. J. Am. Statist. Ass., 102, 321-331.
31. Furrer, R., Genton, M. G. and Nychka, D. (2006) Covariance tapering for interpolation of large spatial datasets. J. Computnl Graph. Statist., 15, 502-523.
32. Gelfand, A. E., Banerjee, S. and Gamerman, D. (2005) Spatial process modelling for univariate and multivariate dynamic spatial data. Environmetrics, 16, 465-479.
33. Gelfand, A. E. and Smith, A. F. M. (1990) Sampling-based approaches to calculating marginal densities. J. Am. Statist. Ass., 85, 398-409.
34. Gelman, A. (2006) Prior distributions for variance parameters in hierarchical models. Baysn Anal., 1, 1-19.
35. Gilks, W. R., Richardson, S. and Spiegelhalter, D. J. (eds) (1996) Markov Chain Monte Carlo in Practice. London: Chapman and Hall.
36. Gneiting, T. (2002) Nonseparable, stationary covariance functions for space-time data. J. Am. Statist. Ass., 97, 590-600.
37. Gneiting, T., Balabdaoui, F. and Raftery, A. E. (2007a) Probabilistic forecasts, calibration and sharpness. J. R. Statist. Soc. B, 67, 243-268.
38. Gneiting, T., Genton, M. G. and Guttorp, P. (2007b) Geostatistical space-time models, stationarity, separability and full symmetry. InModelling Longitudinal and Spatially Correlated Data (eds B. Finkenstädt, L. Held and V. Isham ), pp. 151-175. Boca Raton: Chapman and Hall-CRC.
39. Gneiting, T. and Raftery, A. E. (2005) Weather forecasting with ensemble methods. Science, 310, 248-249.
40. Gneiting, T. and Raftery, A. E. (2007) Strictly proper scoring rules, prediction, and estimation. J. Am. Statist. Ass., 102, 359-378.
41. Golightly, A. and Wilkinson, D. (2008) Bayesian inference for nonlinear multivariate diffusion models observed with error. Computnl Statist. Data Anal., 52, 1674-1693.
42. Gottlieb, D. and Orszag, S. A. (1977) Numerical Analysis of Spectral Methods: Theory and Applications. Philadelphia: Society for Industrial and Applied Mathematics.
43. Haberman, R. (2004) Applied Partial Differential Equations: with Fourier Series and Boundary Value Problems. Englewood Cliffs: Pearson Prentice Hall.
44. Hamill, T. M. and Colucci, S. J. (1997) Verification of Eta RSM short-range ensemble forecasts. Mnthly Weath. Rev., 125, 1312-1327.
45. Hamill, T. M., Whitaker, J. S. and Wei, X. (2004) Ensemble reforecasting: improving medium-range forecast skill using retrospective forecasts. Mnthly Weath. Rev., 132, 1434-1447.
46. Handcock, M. S. and Stein, M. L. (1993) A Bayesian analysis of kriging. Technometrics, 35, 403-410.
47. Hastings, W. K. (1970) Monte Carlo sampling methods using Markov chains and their applications. Biometrika, 57, 97-109.
48. Heine, V. (1955) Models for two-dimensional stationary stochastic processes. Biometrika, 42, 170-178.
49. Hu, X., Simpson, D., Lindgren, F. and Rue, H. (2013) Multivariate gaussian random fields using systems of stochastic partial differential equations. Preprint arXiv:1307.1379.
50. Huang, H.-C. and Hsu, N.-J. (2004) Modeling transport effects on ground-level ozone using a non-stationary space-time model. Environmetrics, 15, 251-268.
51. Hutchinson, M. (1995) Stochastic space-time weather models from ground-based data. Agric. Forst Meteorol., 73, 237-264.
52. Johannesson, G., Cressie, N. and Huang, H.-C. (2007) Dynamic multi-resolution spatial models. Environ. Ecol. Statist., 14, 5-25.
53. Jones, R. and Zhang, Y. (1997) Models for continuous stationary space-time processes. In Modelling Longitudinal and Spatially Correlated Data (eds T. Gregoire, D. R. Brillinger, P. J. Diggle, E. Russek-Cohen, W. G. Warren and R. Wolfinger ), pp. 289-298. New York: Springer.
54. Kleiber, W., Raftery, A. E. and Gneiting, T. (2011) Geostatistical model averaging for locally calibrated probabilistic quantitative precipitation forecasting. J. Am. Statist. Ass., 106, 1291-1303.
55. Krzysztofowicz, R. and Maranzano, C. J. (2006) Bayesian processor of output for probabilistic quantitative precipitation forecasting.Technical Report. Department of Systems Engineering and Department of Statistics, University of Virginia, Charlottesville.
56. Künsch, H. R. (2001) State space and hidden Markov models. InComplex Stochastic Systems, pp. 109-173. Boca Raton: Chapman and Hall-CRC.
57. Lindgren, F., Rue, H. and Lindström, J. (2011) An explicit link between Gaussian fields and Gaussian Markov random fields: the stochastic partial differential equation approach (with discussion). J. R. Statist. Soc. B, 73, 423-498.
58. Ma, C. (2003) Families of spatio-temporal stationary covariance models. J. Statist. Planng Inf., 116, 489-501.
59. Malmberg, A., Arellano, A., Edwards, D. P., Flyer, N., Nychka, D. and Wikle, C. (2008) Interpolating fields of carbon monoxide data using a hybrid statistical-physical model. Ann. Appl. Statist., 2, 1231-1248.
60. Matheson, J. E. and Winkler, R. L. (1976) Scoring rules for continuous probability distributions. Mangmnt Sci., 22, 1087-1096.
61. Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H. and Teller, E. (1953) Equation of state calculations by fast computing machines. J. Chem. Phys., 21, 1087-1092.
62. Neal, P. and Roberts, G. (2006) Optimal scaling for partially updating MCMC algorithms. Ann. Appl. Probab., 16, 475-515.
63. Nychka, D., Wikle, C. and Royle, J. A. (2002) Multiresolution models for nonstationary spatial covariance functions. Statist. Modllng, 2, 315-331.
64. Paciorek, C. J. (2007) Bayesian smoothing with Gaussian processes using Fourier basis functions in the spectralGP package. J. Statist. Softwr., 19, 1-38.
65. Paciorek, C. J. and Schervish, M. J. (2006) Spatial modelling using a new class of nonstationary covariance functions. Environmetrics, 17, 483-506.
66. Palmer, T. N. (2002) The economic value of ensemble forecasts as a tool for risk assessment: from days to decades. Q. J. R. Meteorol. Soc., 128, 747-774.
67. Pedlosky, J. (1987) Geophysical Fluid Dynamics. New York: Springer.
68. Ramrez, M. C. V., de Campos Velho, H. F. and Ferreira, N. J. (2005) Artificial neural network technique for rainfall forecasting applied to the Sao Paulo region. J. Hydrol., 301, 146-162.
69. Robert, C. P. and Casella, G. (2004) Monte Carlo Statistical Methods, 2nd edn. New York: Springer.
70. Roberts, G. O. and Rosenthal, J. S. (2001) Optimal scaling for various Metropolis-Hastings algorithms. Statist. Sci., 16, 351-367.
71. Roberts, G. O. and Rosenthal, J. S. (2009) Examples of adaptive MCMC. J. Computnl Graph. Statist., 18, 349-367.
72. Roberts, G. O. and Stramer, O. (2001) On inference for partially observed nonlinear diffusion models using the Metropolis-Hastings algorithm. Biometrika, 88, 603-621.
73. Royle, J. A. and Wikle, C. K. (2005) Efficient statistical mapping of avian count data. Environ. Ecol. Statist., 12, 225-243.
74. Rue, H. and Held, L. (2005) Gaussian Markov Random Fields. Boca Raton: Chapman and Hall-CRC.
75. Rue, H. and Tjelmeland, H. (2002) Fitting Gaussian Markov random fields to Gaussian fields. Scand. J. Statist., 29, 31-49.
76. Sampson, P. D. and Guttorp, P. (1992) Nonparametric estimation of nonstationary spatial covariance structure. J. Am. Statist. Ass., 87, 108-119.
77. Sansó, B. and Guenni, L. (1999) Venezuelan rainfall data analysed by using a Bayesian space-time model. Appl. Statist., 48, 345-362.
78. Sansó, B. and Guenni, L. (2004) A Bayesian approach to compare observed rainfall data to deterministic simulations. Environmetrics, 15, 597-612.
79. Shumway, R. H. and Stoffer, D. S. (2000) Time Series Analysis and Its Applications. New York: Springer.
80. Sigrist, F., Künsch, H. R. and Stahel, W. A. (2012) A dynamic nonstationary spatio-temporal model for short term prediction of precipitation. Ann. Appl. Statist., 6, 1452-1477.
81. Sigrist, F., Künsch, H. R. and Stahel, W. A. (2012) spate: an R package for statistical modeling with SPDE based spatio-temporal Gaussian processes. Technical Report. Seminar für Statistik, Eidgenössiche Technische Hochschule Zürich, Zurich. (Available from http://stat.ethz.ch/people/sigrist/spate.pdf.)
82. Simpson, D., Lindgren, F. and Rue, H. (2012) In order to make spatial statistics computationally feasible, we need to forget about the covariance function. Environmetrics, 23, 65-74.
83. Sloughter, J. M., Raftery, A. E., Gneiting, T. and Fraley, C. (2007) Probabilistic quantitative precipitation forecasting using Bayesian model averaging. Mnthly Weath. Rev., 135, 3209-3220.
84. Smith, A. F. M. and Roberts, G. O. (1993) Bayesian computation via the Gibbs sampler and related Markov chain Monte Carlo methods. J. R. Statist. Soc. B, 55, 3-23.
85. Solna, K. and Switzer, P. (1996) Time trend estimation for a geographic region. J. Am. Statist. Ass., 91, 577-589.
86. Stein, M. L. (1999) Interpolation of Spatial Data, Some Theory for Kriging. New York: Springer.
87. Stein, M. L. (2005) Space-time covariance functions. J. Am. Statist. Ass., 100, 310-321.
88. Stein, M. L. (2008) A modeling approach for large spatial datasets. J. Kor. Statist. Soc., 37, 3-10.
89. Stein, M. L., Chi, Z. and Welty, L. J. (2004) Approximating likelihoods for large spatial data sets. J. R. Statist. Soc. B, 66, 275-296.
90. Stensrud, D. J. and Yussouf, N. (2007) Reliable probabilistic quantitative precipitation forecasts from a short-range ensemble forecasting system. Weath. Forecast., 22, 2-17.
91. Steppeler, J., Doms, G., Schättler, U., Bitzer, H. W., Gassmann, A., Damrath, U. and Gregoric, G. (2003) Meso-gamma scale forecasts using the nonhydrostatic model LM. Meteorol. Atmosph. Phys., 82, 75-96.
92. Stidd, C. K. (1973) Estimating the precipitation climate. Wat. Resour. Res., 9, 1235-1241.
93. Storvik, G., Frigessi, A. and Hirst, D. (2002) Stationary space-time Gaussian fields and their time autoregressive representation. Statist. Modllng, 2, 139-161.
94. Stroud, J. R., Stein, M. L., Lesht, B. M., Schwab, D. J. and Beletsky, D. (2010) An ensemble Kalman filter and smoother for satellite data assimilation. J. Am. Statist. Ass., 105, 978-990.
95. Tobin, J. (1958) Estimation of relationships for limited dependent variables. Econometrica, 26, 24-36.
96. Vecchia, A. V. (1988) Estimation and model identification for continuous spatial processes. J. R. Statist. Soc. B, 50, 297-312.
97. Vivar, J. C. and Ferreira, M. A. R. (2009) Spatiotemporal models for gaussian areal data. J. Computnl Graph. Statist., 18, 658-674.
98. Whittle, P. (1954) On stationary processes in the plane. Biometrika, 41, 434-449.
99. Whittle, P. (1962) Topographic correlation, power-law covariance functions, and diffusion. Biometrika, 49, 305-314.
100. Whittle, P. (1963) Stochastic processes in several dimensions. Bull. Inst. Int. Statist., 40, 974-994.
101. Wikle, C. K. (2002) A kernel-based spectral model for non-gaussian spatio-temporal processes. Statist. Modllng, 2, 299-314.
102. Wikle, C. K. (2003) Hierarchical Bayesian models for predicting the spread of ecological processes. Ecology, 84, 1382-1394.
103. Wikle, C. (2010) Low-rank representations for spatial processes. InHandbook of Spatial Statistics(eds A. E. Gelfand, P. Diggle, P. Guttorp and M. Fuentes ), pp. 107-118. Boca Raton: Chapman and Hall-CRC.
104. Wikle, C. K., Berliner, L. M. and Cressie, N. (1998) Hierarchical Bayesian space-time models. Environ. Ecol. Statist., 5, 117-154.
105. Wikle, C. K. and Cressie, N. (1999) A dimension-reduced approach to space-time Kalman filtering. Biometrika, 86, 815-829.
106. Wikle, C. and Hooten, M. (2010) A general science-based framework for dynamical spatiotemporal models. Test, 19, 417-451.
107. Wikle, C. K., Milliff, R. F., Nychka, D. and Berliner, L. M. (2001) Spatiotemporal hierarchical bayesian modeling: tropical ocean surface winds. J. Am. Statist. Ass., 96, 382-397.
108. Wilks, D. (1990) Maximum likelihood estimation for the gamma distribution using data containing zeros. J. Clim., 3, 1495-1501.
109. Wilks, D. (1999) Multisite downscaling of daily precipitation with a stochastic weather generator. Clim. Res., 11, 125-136.
110. Xu, K. and Wikle, C. K. (2007) Estimation of parameterized spatio-temporal dynamic models. J. Statist. Planng Inf., 137, 567-588.
111. Xu, K., Wikle, C. K. and Fox, N. I. (2005) A kernel-based spatio-temporal dynamical model for nowcasting weather radar reflectivities. J. Am. Statist. Ass., 100, 1133-1144.
112. Yue, Y. R., Simpson, D., Lindgren, F. and Rue, H. (2012) Bayesian adaptive smoothing spline using stochastic differential equations. Preprint arXiv:1209.2013.
113. Yussouf, N. and Stensrud, D. J. (2006) Prediction of near-surface variables at independent locations from a bias-corrected ensemble forecasting system. Mnthly Weath. Rev., 134, 3415-3424.
114. Zheng, Y. and Aukema, B. H. (2010) Hierarchical dynamic modeling of outbreaks of mountain pine beetle using partial differential equations. Environmetrics, 21, 801-816.