Bayesian History Matching of Complex Infectious Disease Models Using Emulation: A Tutorial and a Case Study on HIV in Uganda

PLoS Computational Biology

Volumn 11, Issue 1, 2015, Pages

  Andrianakis, Ioannis ^a   Vernon, Ian R ^b   McCreesh, Nicky ^b   McKinley, Trevelyan J ^c   Oakley, Jeremy E ^d   Nsubuga, Rebecca N ^e   Goldstein, Michael ^b   White, Richard G ^a  

^a LONDON SCHOOL OF HYGIENE AND TROPICAL MEDICINE   (United Kingdom)

^b DURHAM UNIVERSITY   (United Kingdom)

^c UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^d UNIVERSITY OF SHEFFIELD   (United Kingdom)

^e UGANDA VIRUS RESEARCH INSTITUTE   (Uganda)

Author keywords

[No Author keywords available]

Indexed keywords

CALIBRATION; COMPUTATIONAL EFFICIENCY; DECISION MAKING; DISEASES; ITERATIVE METHODS; SIMULATORS;

BAYESIAN; CASE-STUDIES; COMPLEX MODEL; DECISIONS MAKINGS; EMPIRICAL DATA; HISTORY MATCHING; INFECTIOUS DISEASE MODELS; INPUT PARAMETER; INPUT SPACE; REAL-WORLD;

STOCHASTIC SYSTEMS;

ANALYTIC METHOD; ARTICLE; BAYES THEOREM; BEHAVIOR; CALIBRATION; CASE STUDY; DATA PROCESSING; DEMOGRAPHY; EMULATOR; EPIDEMIOLOGY; HISTORY MATCHING; HUMAN; HUMAN IMMUNODEFICIENCY VIRUS INFECTION; MODEL; SIMULATION; UGANDA; ALGORITHM; BIOLOGICAL MODEL; BIOLOGY; COMPUTER SIMULATION; FEMALE; HIV INFECTIONS; MALE; TRANSMISSION;

ALGORITHMS; BAYES THEOREM; COMPUTATIONAL BIOLOGY; COMPUTER SIMULATION; FEMALE; HIV INFECTIONS; HUMANS; MALE; MODELS, BIOLOGICAL; UGANDA;

EID: 84922219924     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1003968     Document Type: Article

References (60)

1. Law A (2007) Simulation modeling and analysis. McGraw Hill.
2. Spear RC, Hubbard A, Liang S, Seto E, (2002) Disease transmission models for public health decision making: toward an approach for designing intervention strategies for Schistosomiasis Japonica. Environ Health Perspect 110: 907–915.
3. Bauer AL, Beauchemin CAA, Perelson AS, (2009) Agent-based modeling of host-pathogen systems: The successes and challenges. Information Sciences 179: 1379–1389.
4. Grimm V, Railsback SF (2005) Individual-based Modeling and Ecology. Princeton University Press.
5. White RG, Glynn JR, Orroth KK, Freeman E, Bakker R, (2008) Male circumcision for HIV prevention in sub-saharan Africa: who, what and when? AIDS 22: 1841–1850.
6. Dewilde S, Anderson R, (2004) The cost-effectiveness of screening programs using single and multiple birth cohort simulations: a comparison using a model of cervical cancer. Medical Decision Making 24: 486.
7. Grimm V, Berger U, Bastiansen F, Eliassen S, Ginot V, (2006) A standard protocol for describing individual-based and agent-based models. Ecological Modelling 198: 115–126.
8. May RM, (2004) Uses and abuses of mathematics in biology. Science 303: 790–793.
9. Ionides EL, Bretó C, King AA, (2006) Inference for nonlinear dynamical systems. Proceedings of the National Academy of Sciences USA 103: 18438–18443.
10. Gibson GJ, Renshaw E, (1998) Estimating parameters in stochastic compartmental models using Markov chain methods. IMA Journal of Mathematics Applied in Medicine and Biology 15: 19–40.
11. O'Neill PD, Roberts GO, (1999) Bayesian inference for partially observed stochastic epidemics. Journal of the Royal Statistical Society Series A (General) 162: 121–129.
12. Cook AR, Otten W, Marion G, Gibson GJ, Gilligan CA, (2007) Estimation of multiple transmission rates for epidemics in heterogeneous populations. Proceedings of the National Academy of Sciences USA 104: 20392–20397.
13. Jewell CP, Kypraios T, Neal P, Roberts GO, (2009) Bayesian analysis for emerging infectious diseases. Bayesian Analysis 4: 465–496.
14. Keeling MJ, Ross JV, (2008) On methods for studying stochastic disease dynamics. Journal of the Royal Society Interface 5: 171–181.
15. Cauchemez S, Ferguson NM, (2008) Likelihood-based estimation of continuous-time epidemic models from time-series data: Application to measles transmission in London. Journal of the Royal Society Interface 5: 885–897.
16. O'Neill PD, Balding DJ, Becker NG, Eerola M, Mollison D, (2000) Analyses of infectious disease data from household outbreaks by Markov chain Monte Carlo methods. Applied Statistics 49: 517–542.
17. Cauchemez S, Valleron AJ, Boëlle PY, Flahault A, Ferguson NM, (2008) Estimating the impact of school closure on influenza transmission from Sentinel data. Nature 452: 750–755.
18. Toni T, Welch D, Strelkowa N, Ipsen A, Strumpf MPH, (2009) Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems. Journal of the Royal Society Interface 6: 187–202.
19. McKinley TJ, Cook AR, Deardon R (2009) Inference in epidemic models without likelihoods. The International Journal of Biostatistics 5.
20. Conlan AJK, McKinley TJ, Karolemeas K, Brooks Pollock E, Goodchild AV, et al. (2012) Estimating the hidden burden of bovine tuberculosis in Great Britain. PLoS Computational Biology 8: e1002730.
21. McKinley TJ, Ross JV, Deardon R, Cook AR (2013) Simulation-based Bayesian inference for epidemic models. Computational Statistics and Data Analysis: in press.
22. Andrieu C, Doucet A, Holenstein R, (2010) Particle Markov chain Monte Carlo methods. Journal of the Royal Statistical Society, Series B (Methodological) 72: 269–342.
23. Stout NK, Knudsen AB, Kong CY, McMahon PM, Gazelle GS, (2009) Calibration methods used in cancer simulation models and suggested reporting guidelines. Pharmacoeconomics 27: 533–545.
24. Punyacharoensin N, Edmunds WJ, De Angelis D, White RG, (2011) Mathematical models for the study of HIV spread and control amongst men who have sex with men. European Journal of Epidemiology 26: 695–709.
25. Kennedy MC, O'Hagan A, (2001) Bayesian calibration of computer models. Journal of the Royal Statistical Society Series B 63: 425–464.
26. Saltelli A, Chan K, Scott EM (2000) Sensitivity analysis. Wiley Chichester.
27. Oakley JE, O'Hagan A, (2004) Probabilistic sensitivity analysis of complex models: a Bayesian approach. J R Statist Soc B 66: 751–769.
28. Craig PS, Goldstein M, Seheult AH, Smith JA, (1997) Pressure matching for hydrocarbon reservoirs: a case study in the use of Bayes linear strategies for large computer experiments. (with discussion). in Case Studies in Bayesian Statistics, eds C Gastonis, et al Springer-Verlag III: 37–93.
29. Goldstein M, Rougier J, (2009) Reified Bayesian modelling and inference for physical systems. Journal of Statistical Planning and Inference 139: 1221–1239.
30. Goldstein M, Seheult A, Vernon I (2013) Assessing model adequacy. In: Wainwright J, Mulligan M, editors, Environmental Modelling: Finding Simplicity in Complexity, Second Edition, John Wiley & Sons, Ltd, Chichester, UK: Wiley-Blackwell.
31. Sacks J, Welch WJ, Mitchell TJ, Wynn HP, (1989) Design and analysis of computer experiments. Statistical Science 4: 409–435.
32. Bayarri MJ, Berger JO, Paulo R, Sacks J, Cafeo JA, et al. (2007) A framework for the validation of computer models. Technometrics 49: 138–154.
33. Henderson DA, Boys RJ, Krishnan KJ, Lawless C, et al. (2009) Bayesian emulation and calibration of a stochastic computer model of mitochondrial DNA deletions in substantia nigra neurons. Journal of the American Statistical Association 104: 76–87.
34. Higdon D, Gattiker J, Williams B, Rightley M, (2008) Computer model calibration using high-dimensional output. Journal of the American Statistical Association 103: 570–583.
35. Vernon IR, Goldstein M, Bower RG, (2010) Galaxy formation: a Bayesian uncertainty analysis. Bayesian Analysis 5: 619–670.
36. Bower RG, Vernon I, Goldstein M, Benson AJ, Lacey CG, et al. (2010) The parameter space of galaxy formation. MonAst 407: 2017–2045.
37. Vernon I, Goldstein M, Bower RG (2014) Galaxy formation: Bayesian history matching for the observable universe. Statistical Science (to appear).
38. Cumming JA, Goldstein M (2009) Bayes linear uncertainty analysis for oil reservoirs based on multiscale computer experiments. In: O'Hagan A, West M, editors, Handbook of Bayesian Analysis, Oxford, UK: Oxford University Press.
39. Vernon IR, Goldstein M (2010) A Bayes linear approach to systems biology. Technical report, MUCM Technical Report.
40. Vernon I, Goldstein M (2014) Bayes linear emulation and history matching of stochastic systems biology models, in preparation.
41. Williamson D, Goldstein M, Allison L, Blaker A, Challenor P, et al. (2013) History matching for exploring and reducing climate model parameter space using observations and a large perturbed physics ensemble. Climate Dynamics 41: 1703–1729.
42. Brynjarsdottir J, O'Hagan A (2010) Learning about physical parameters: The importance of model discrepancy. Technical report, http://www.tonyogahan.co.uk/academic/pub.html.
43. Goldstein M, Rougier JC, (2006) Bayes linear calibrated prediction for complex systems. JASA 101: 1132–1143.
44. McKay MD, Beckman RJ, Conover WJ, (1979) A comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics 21: 239–245.
45. Loeppky JL, Sacks J, Welch WJ, (2009) Choosing the sample size of a computer experiment: a practical guide. Technometrics 51: 366–376.
46. Williamson D, Vernon IR (2013) Efficient uniform designs for multi-wave computer experiments.
47. Vernon I, Goldstein M (2009) Bayes linear analysis of imprecision in computer models, with application to understanding galaxy formation. In: Augustin T, Coolen FPA, editors, ISIPTA'09: Proceedings of the Sixth International Symposium on Imprecise Probability: Theories and Applications. Durham, UK: SIPTA, pp.441–450.
48. Rasmussen CE, Williams CKI (2006) Gaussian Processes for Machine Learning. The MIT press.
49. Andrianakis I, Challenor P, (2012) The effect of the nugget on Gaussian process emulators of computer models. Computational Statistics & Data Analysis 56: 4215–4228.
50. Bastos LS, O'Hagan A, (2009) Diagnostics for Gaussian process emulators. Technometrics 51: 425–438.
51. Conti S, O'Hagan A, (2010) Bayesian emulation of complex multi-output and dynamic computer models. Journal of Statistical Planning and Inference 140: 640–651.
52. Rougier J, (2008) Efficient emulators for multivariate deterministic functions. Journal of Computational and Graphical Statistics 17: 827–843.
53. Fricker TE, Oakley JE, Urban NM, (2013) Multivariate Gaussian process emulators with nonseparable covariance structures. Technometrics 55: 47–56.
54. Strong M, Oakley JE, Chilcott J, (2012) Managing structural uncertainty in health economic decision models: a discrepancy approach. Journal of the Royal Statistical Society, Series C 61: 25–45.
55. Pukelsheim F, (1994) The three sigma rule. The American Statistician 48: 88–91.
56. McCreesh N, O'Brien K, Nsubuga RN, Shafer LA, Bakker R, et al. (2012) Exploring the potential impact of a reduction in partnership concurrency on HIV incidence in rural Uganda: a modeling study. Sexually Transmitted diseases 39: 407–413.
57. Mulder DW, Nunn AJ, Kamali A, Nakiyingi J, Wagner HU, et al. (1994) Two-year HIV-1-associated mortality in a Ugandan rural population. Lancet 343: 1021–1023.
58. Mulder DW, Nunn AJ, Kamali A, Wagner HU, Kengeya-Kayondo JF, (1994) HIV-1 incidence and HIV-1-associated mortality in a rural Ugandan population cohort. AIDS 8: 87–92.
59. Seeley J, Wagner U, Mulemwa J, Kengeya-Kayondo J, Mulder D, (1991) The development of a community-based HIV/AIDS counselling service in a rural area in Uganda. AIDS Care 3: 207–217.
60. Santner TJ, Williams BJ, Notz WI (2003) The Design and Analysis of Computer Experiments. New York: SV.