Evolving Bayesian emulators for structured chaotic time series, with application to large climate models

SIAM-ASA Journal on Uncertainty Quantification

Volumn 2, Issue 1, 2014, Pages 1-28

  Williamson, Daniel ^a   Blaker, Adam T ^b  

^a UNIVERSITY OF EXETER   (United Kingdom)

^b NATIONAL OCEANOGRAPHY CENTRE   (United Kingdom)

Author keywords

Bayesian analysis; Climate models; Dynamic emulation; Uncertainty quantification

Indexed keywords

GAUSSIAN DISTRIBUTION; GAUSSIAN NOISE (ELECTRONIC); OCEANOGRAPHY; TIME SERIES;

ATLANTIC MERIDIONAL OVERTURNING CIRCULATIONS; ATMOSPHERE OCEAN GENERAL CIRCULATION MODELS; CHAOTIC BEHAVIORS; CHAOTIC TIME SERIES; CORRELATION LENGTHS; DYNAMIC LINEAR MODEL; GAUSSIAN PROCESSES; UNCERTAINTY QUANTIFICATIONS;

CLIMATE MODELS;

EID: 85108902048     PISSN: None     EISSN: 21662525     Source Type: Journal    
DOI: 10.1137/120900915     Document Type: Article

References (52)

1. L. C. Allison, E. Hawkins, T. Woollings, and L. Jackson (2012), The Value of an Event-Based Approach to Understanding Decadal Fluctuations in the Atlantic Meridional Overturning Circulation, manuscript.
2. I. Andrianakis and P. G. Challenor (2012), The effect of the nugget on Gaussian process emulators of computer models, Comput. Statist. Data Anal., 56, pp. 4215–4228.
3. B. Balan Sarojini, J. Gregory, R. Tailleux, G. R. Bigg, A. T. Blaker, D. R. Cameron, N. R. Edwards, A. P. Megann, L. Shaffrey, and B. Sinha (2011), High frequency variability of the Atlantic meridional overturning circulation, Ocean Sci., 7, 471486.
4. M. J. Bayarri, J. O. Berger, J. Cafeo, G. Garcia-Donato, F. Liu, J. Palomo, R. J. Parthasarathy, R. Paulo, J. Sacks, and D. Walsh (2007), Computer model validation with functional output, Ann. Statist., 35, pp. 1874–1906.
5. A. Biastoch, C. W. Böning, J. Getzlaff, J. M. Molines, and G. Madec (2008), Mechanisms of interannual-decadal variability in the meridional overturning circulation of the mid latitude North Atlantic Ocean, J. Climate, 21, pp. 6599–6615.
6. N. L. Bindoff, J. Willebrand, V. Artale, A. Cazenave, J. Gregory, S. Gulev, K. Hanawa, C. Le Quéré, S. Levitus, Y. Nojiri, C. K. Shum, L. D. Talley, and A. Unnikrishnan (2007), Observations: Oceanic climate change and sea level, in Climate Change 2007: The Physical Science Basis, Contribution of Working Group I to the Fourth Assessment Report of the Intergovernmental Panel on Climate Change, S. Solomon, D. Qin, M. Manning, Z. Chen, M. Marquis, K. B. Averyt, M. Tignor, and H. L. Miller, eds., Cambridge University Press, Cambridge, UK, pp. 385–432.
7. A. T. Blaker, J. J. M. Hirschi, B. Sinha, B. A. de Cuevas, S. G. Alderson, A. C. Coward, and G. Madec (2012), Large near-inertial oscillations of the Atlantic meridional overturning circulation, Ocean Model., 42, pp. 50–56.
8. A. T. Blaker and D. Williamson (2014), Characteristics and Variability of the Atlantic Meridional Overturning Circulation in a Large Climate Model Ensemble, manuscript.
9. P. Challenor, D. McNeall, and J. Gattiker (2009), Assessing the probability of rare climate events, in The Oxford Handbook of Applied Bayesian Analysis, A. O’Hagan and M. West, eds., Oxford University Press, Oxford, UK, pp. 403–430.
10. S. Conti, J. P. Gosling, J. E. Oakley, and A. O’Hagan (2009), Gaussian process emulation of dynamic computer codes, Biometrika, 96, pp. 663–676.
11. S. Conti and A. O’Hagan (2010), Bayesian emulation of complex multi-output and dynamic computer models, J. Stat. Plan. Inference, 140, pp. 640–651.
12. P. S. Craig, M. Goldstein, J. C. Rougier, and A. H. Seheult (2001), Bayesian forecasting for complex systems using computer simulators, J. Amer. Statist. Assoc., 96, pp. 717–729.
13. P. S. Craig, M. Goldstein, A. H. Seheult, and J. A. Smith (1996), Bayes linear strategies for matching hydrocarbon reservoir history, in Bayesian Statistics 5, J. M. Bernado, J. O. Berger, A. P. Dawid, and A. F. M. Smith, eds., Oxford University Press, New York, pp. 69–95.
14. P. S. Craig, M. Goldstein, A. H. Seheult, and J. A. Smith (1997), Pressure matching for hydrocarbon reservoirs: A case study in the use of Bayes linear strategies for large computer experiments, in Case Studies in Bayesian Statistics, Vol. III, C. Gatsonis, J. S. Hodges, R. E. Kass, R. McCulloch, P. Rossi, and N. D. Singpurwalla, eds., Springer-Verlag, New York, pp. 36–93.
15. N. Cressie (1993), Statistics for Spatial Data, John Wiley & Sons.
16. J. A. Cumming and M. Goldstein (2009), Small sample designs for complex high-dimensional models based on fast approximations, Technometrics, 51, pp. 377–388.
17. J. A. Cumming and M. Goldstein (2010), Bayes linear uncertainty analysis for oil reservoirs based on multiscale computer experiments, in The Oxford Handbook of Applied Bayesian Analysis, A. O’Hagan and M. West, eds., Oxford University Press, Oxford, UK, pp. 241–270.
18. C. Currin, T. Mitchell, M. Morris, and D. Ylvisaker (1991), Bayesian prediction of deterministic functions, with applications to the design and analysis of computer experiments, J. Amer. Statist. Assoc., 86, pp. 953–963.
19. P. J. Diggle and P. J. Ribeiro, Jr. (2007), Model-Based Geostatistics, Springer Ser. Statist., Springer, New York.
20. M. Goldstein and D. Wooff (2007), Bayes Linear Statistics Theory and Methods, John Wiley and Sons, Chichester.
21. C. Gordon, C. Cooper, C. A. Senior, H. Banks, J. M. Gregory, T. C. Johns, J. F. B. Mitchell, and R. A. Wood (2000), The simulation of SST, sea ice extents and ocean heat transports in a version of the Hadley Centre coupled model without flux adjustments, Clim. Dyn., 16, pp. 147–168.
22. R. Grammacy and H. Lee (2012), Cases for the nugget in modeling computer experiments, Stat. Comput., 22, pp. 713–722.
23. E. Hawkins and R. Sutton (2009), The potential to narrow uncertainty in regional climate predictions, BAMS, 90, pp. 1095–1107.
24. R. Haylock and A. O’Hagan (1996), On inference for outputs of computationally expensive algorithms with uncertainty on the inputs, in Bayesian Statistics 5, J. M. Bernado, J. O. Berger, A. P. Dawid, and A. F. M. Smith, eds., Oxford University Press, New York, pp. 629–637.
25. D. Higdon, C. Nakhleh, J. Gattiker, and B. Williams (2008a), A Bayesian calibration approach to the thermal problem, Comput. Methods Appl. Mech. Engrg., 197, pp. 2431–2441.
26. H. Higdon, J. Gattiker, B. Williams, and M. Rightley (2008b), Computer model calibration using high-dimensional output, J. Amer. Statist. Assoc., 103, pp. 570–583.
27. W. E. Johns, M. O. Baringer, L. M. Beal, S. A. Cunningham, T. Kanzow, H. L. Brydon, J. J. M. Hirschi, J. Marotzke, C. S. Meinen, B. Shaw, and R. Curry (2011), Continuous, array-based estimates of Atlantic Ocean heat transport at 26.5◦N, J. Clim., 24, pp. 2429–2449.
28. C. G. Kaufman, D. Bingham, S. Habib, K. Heitmann, and J. A. Frieman (2011), Efficient emulators of computer experiments using compactly supported correlation functions, with an application to cosmology, Ann. Appl. Stat., 5, pp. 2470–2492.
29. M. C. Kennedy and A. O’Hagan (2001), Bayesian calibration of computer models, J. R. Stat. Soc. Ser. B Stat. Methodol., 63, pp. 425–464.
30. J. P. C. Kleijnen (2009), Kriging metamodelling in simulation: A review, European J. Oper. Res., 192, pp. 707–716.
31. F. Liu and M. West (2008), A dynamic modelling strategy for Bayesian computer model emulation, Bayesian Anal., 4, pp. 393–412.
32. G. McCarthy, E. Frajka-Williams, W. E. Johns, M. O. Baringer, C. S. Meinen, H. L. Bryden, D. Rayner, A. Duchez, and S. A. Cunningham (2012), Observed interannual variability of the Atlantic meridional overturning circulation at 26.5◦N, GRL, 39, L19609.
33. G. A. Meehl, C. Covey, T. Delworth, M. Latif, B. McAvaney, J. F. B. Mitchell, R. J. Stouffer, and K. E. Taylor (2007), The WCRP CMIP3 multi-model dataset: A new era in climate change research, Bull. Am. Meteorol. Soc., 88, pp. 1383–1394.
34. V. D. Pope, M. L. Gallani, P. R. Rowntree, and R. A. Stratton (2000), The impact of new physical parameterizations in the Hadley Centre climate model: HadAM3, Clim. Dyn., 16, pp. 123–146.
35. R. Prado and M. West (2010), Time Series Analysis: Modeling, Computation and Inference, CRC Press, Boca Raton, FL.
36. D. Rayner, J. J. M. Hirschi, T. Kanzow, W. E. Johns, P. G. Wright, E. Frajka-Williams, H. L. Brydon, C. S. Meinen, M. O. Baringer, J. Marotzke, L. M. Beal, and S. A. Cunningham (2011), Monitoring the Atlantic meridional overturning circulation, Deep Sea Res. Part II, 58, pp. 1744–1753.
37. P. Reichert, G. White, M. J. Bayarri, and E. B. Pitman (2011), Mechanism-based emulation of dynamic simulation models: Concept and application in hydrology, Comput. Statist. Data Anal., 55, pp. 1638–1655.
38. J. C. Rougier (2008), Efficient emulators for multivariate deterministic functions, J. Comput. Graph. Stat., 17, pp. 827–843.
39. J. C. Rougier, D. M. H. Sexton, J. M. Murphy, and D. Stainforth (2009), Emulating the sensitivity of the HadSM3 climate model using ensembles from different but related experiments, J. Clim., 22, pp. 3540–3557.
40. J. Sacks, W. J. Welch, T. J. Mitchell, and H. P. Wynn (1989), Design and analysis of computer experiments, Statist. Sci., 4, pp. 409–435.
41. T. J. Santner, B. J. Williams, and W. I. Notz (2003), The Design and Analysis of Computer Experiments, Springer-Verlag, New York.
42. D. M. H. Sexton, J. M. Murphy, and M. Collins (2011), Multivariate probabilistic projections using imperfect climate models part 1: Outline of methodology, Clim. Dyn., 38, pp. 2513–2542.
43. S. Solomon, D. Qin, M. Manning, Z. Chen, M. Marquis, K. B. Averyt, M. Tignor, and H. L. Miller, eds. (2007), Contribution of Working Group I to the Fourth Assessment Report of the Intergovernmental Panel on Climate Change, 2007, Cambridge University Press, Cambridge, UK.
44. I. Vernon, M. Goldstein, and R. G. Bower (2010), Galaxy formation: A Bayesian uncertainty analysis, Bayesian Anal., 5, pp. 619–846.
45. M. West and J. Harrison (1997), Bayesian Forecasting and Dynamic Models, 2nd ed., Springer, New York.
46. D. Williamson (2010), Policy Making Using Computer Simulators for Complex Physical Systems; Bayesian Decision Support for the Development of Adaptive Strategies, Ph.D. thesis, University of Durham, Durham, UK; available online from http://etheses.dur.ac.uk/348/.
47. D. Williamson and L. Allison (2012), A Study of Rapid Events in the CPDN Ensemble, Durham University Tech. Rep., University of Durham, Durham, UK; available online from http://www.maths.dur.ac.uk/users/daniel.williamson/index.html#publications.
48. D. Williamson and M. Goldstein (2012), Bayesian policy support for adaptive strategies using computer models for complex physical systems, J. Oper. Res. Soc., 63, pp. 1021–1033.
49. D. Williamson, M. Goldstein, L. Allison, A. T. Blaker, P. Challenor, L. Jackson, and K. Yamazaki (2013), History matching for exploring and reducing climate model parameter space using observations and a large perturbed physics ensemble, Clim. Dyn., 41, pp. 1703–1729.
50. D. Williamson, M. Goldstein, and A. T. Blaker (2012), Fast linked analyses for scenario based hierarchies, J. R. Stat. Soc. Ser. C Appl. Stat., 61, pp. 665–692.
51. D. Williamson and I. R. Vernon (2014), Efficient uniform designs for multi-wave computer experiments, preprint, arXiv:1309.3520; J. Roy. Statist. Soc. Ser. B, submitted.
52. K. Yamazaki, D. J. Rowlands, T. Aina, A. T. Blaker, A. Bowery, N. Massey, J. Miller, C. Rye, S. F. B. Tett, D. Williamson, Y. H. Yamazaki, and M. R. Allen (2013), Obtaining diverse behaviours in a climate model without the use of flux adjustments, J. Geophys. Res. Atmos., 118, pp. 2781–2793.