Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems

Journal of the Royal Society Interface

Volumn 6, Issue 31, 2009, Pages 187-202

  Toni, Tina ^a   Welch, David ^a,b   Strelkowa, Natalja ^a   Ipsen, Andreas ^a   Stumpf, Michael P H ^a  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

Bayesian model selection; Dynamical systems; Parameter estimation; Sequential importance sampling; Sequential Monte Carlo; Sloppy parameters

Indexed keywords

BAYESIAN NETWORKS; BIOINFORMATICS; DYNAMICAL SYSTEMS; ESTIMATION; IMPORTANCE SAMPLING; MONTE CARLO METHODS;

APPROXIMATE BAYESIAN; BAYESIAN MODEL SELECTION; MATHEMATICAL DESCRIPTIONS; PARAMETER INFERENCE; POSTERIOR DISTRIBUTIONS; SEQUENTIAL IMPORTANCE SAMPLING; SEQUENTIAL MONTE CARLO; SLOPPY PARAMETERS;

PARAMETER ESTIMATION;

ALGORITHM; ARTICLE; BAYES THEOREM; BIOLOGY; INFORMATION; MATHEMATICAL ANALYSIS; MONTE CARLO METHOD; SCIENTIFIC LITERATURE;

EID: 58149142997     PISSN: 17425689     EISSN: 17425662     Source Type: Journal    
DOI: 10.1098/rsif.2008.0172     Document Type: Article

References (52)

1. Anderson, R. M. & May, R. M. 1991 Infectious diseases of humans: dynamics and control. New York, NY: Oxford University Press.
2. Baker, C., Bocharov, G., Ford, J., Lumb, P. S. J., Norton, C. A. H., Paul, T., Junt, P. & Krebs, B. 2005 Ludewig computational approaches to parameter estimation and model selection in immunology. J. Comput. Appl. Math. 184, 50-76.
3. Banks, H., Grove, S., Hu, S. & Ma, Y. 2005 A hierarchical Bayesian approach for parameter estimation in HIV models. Inverse Problems 21, 1803-1822.
4. Battogtokh, D., Asch, D. K., Case, M. E., Arnold, J. & Schuttler, H.-B. 2002 An ensemble method for identifying regulatory circuits with special reference to the qa gene cluster of Neurospora crassa. Proc. Natl Acad. Sci. USA 99, 16 904-16 909.
5. Beaumont, M. 2008a Simulations, genetics and human prehistory (eds S. Matsumura, P. Forester & C. Renfrew). McDonald Institute Monographs, University of Cambridge.
6. Beaumont, M. A. 2008b A note on the ABC-PRC algorithm of Sissons et al. (2007). (http://arxiv.org/abs/0805.3079v1).
7. Beaumont, M. A., Zhang, W. & Balding, D. J. 2002 Approximate Bayesian computation in population genetics. Genetics 162, 2025-2035.
8. Bortz, D. M. & Nelson, P. W. 2006 Model selection and mixed-effects modeling of HIV infection dynamics. Bull. Math. Biol. 68, 2005-2025.
9. Brown, K. S. & Sethna, J. P. 2003 Statistical mechanical approaches to models with many poorly known parameters. Phys. Rev. E 68, 021 904.
10. Cox, R. D. & Hinkley, D. V. 1974 Theoretical statistics. New York, NY: Chapman & Hall/CRC.
11. Del Moral, P., Doucet, A. & Jasra, A. 2006 Sequential Monte Carlo samplers. J. R. Stat. Soc. B 68, 411-432.
12. Elowitz, M. B. & Leibler, S. 2000 A synthetic oscillatory network of transcriptional regulators. Nature 403, 335-338.
13. Enright, W. & Hu, M. 1995 Interpolating Runge-Kutta methods for vanishing delay differential equations. Computing 55, 223-236.
14. Fagundes, N., Ray, N., Beaumont, M., Neuenschwander, S., Salzano, F. M., Bonatto, S. L. & Excoffier, L. 2007 Statistical evaluation of alternative models of human evolution. Proc. Natl Acad. Sci. USA 104, 17 614-17 619.
15. Fields, B. N., Knipe, D. M.& Howley, P. M. 1996 Fundamental virology. Philadelphia, PA: LippincottWilliams & Wilkins.
16. Galassi, M. 2003 GNU scientific library reference manual, 2nd edn. Cambridge, UK: Cambridge University Press.
17. Gillespie, D. 1977 Exact stochastic simulation of coupled chemical reactions. J. Phys. Chem. 81, 2340-2361.
18. Golightly, A. & Wilkinson, D. 2005 Bayesian inference for stochastic kinetic models using a diffusion approximation. Biometrics 61, 781-788.
19. Golightly, A. & Wilkinson, D. 2006 Bayesian sequential inference for stochastic kinetic biochemical network models. J. Comput. Biol. 13, 838-851.
20. Gutenkunst, R., Waterfall, J., Casey, F., Brown, K., Myers, C. & Sethna, J. 2007 Universally sloppy parameter sensitivities in systems biology models. PLoS Comput. Biol. 3, e189.
21. Hammond, B. J. & Tyrrell, D. A. 1971 A mathematical model of common-cold epidemics on Tristan da Cunha. J. Hyg. 69, 423-433.
22. Hoeting, J., Madigan, D., Raftery, A. & Volinsky, C. 1999 Bayesian model averaging: a tutorial. Statist. Sci. 14, 382-401.
23. Horbelt, W., Timmer, J. & Voss, H. 2002 Parameter estimation in nonlinear delayed feedback systems from noisy data. Phys. Lett. A 299, 513-521.
24. Huang, Y., Liu, D. & Wu, H. 2006 Hierarchical Bayesian methods for estimation of parameters in a longitudinal HIV dynamic system. Biometrics 62, 413-423.
25. Johannes, M. & Polson, N. 2005 MCMC methods for continuous-time financial econometrics. In Handbook of financial econometrics (eds Y. Ait-Sahalia & L. Hansen). Amsterdam, The Netherlands: Elsevier Science Ltd.
26. Kass, R. & Raftery, A. 1995 Bayes factors. J. Am. Stat. Assoc. 90, 773-795.
27. Kirkpatrick, S., Gelatt, C. & Vecchi, M. 1983 Optimization by simulated annealing. Science 220, 671-680.
28. Liu, J. S. 2001 Monte Carlo strategies in scientific computing. Berlin, Germany: Springer.
29. Liu, J. S. & Chen, R. 1998 Sequential Monte Carlo methods for dynamic systems. J. Am. Stat. Assoc. 93, 1032-1044.
30. Lotka, A. J. 1925 Elements of physical biology. Baltimore, MD: Williams & Wilkins Co.
31. Marjoram, P., Molitor, J., Plagnol, V. & Tavare, S. 2003 Markov chain Monte Carlo without likelihoods. Proc. Natl Acad. Sci. USA 100, 15 324-15 328.
32. Mendes, P. & Kell, D. 1998 Non-linear optimization of biochemical pathways: applications to metabolic engineering and parameter estimation. Bioinformatics 14, 869-883.
33. Moles, C., Mendes, P. & Banga, J. 2003 Parameter estimation in biochemical pathways: a comparison of global optimization methods. Genome Res. 13, 2467-2474.
34. Muller, T. G., Faller, D., Timmer, J., Swameye, I., Sandra, O. & Klingmüller, U. 2004 Tests for cycling in a signalling pathway. J. R. Stat. Soc. Ser. C 53, 557.
35. Paul, C. 1992 Developing a delay differential equation solver. Appl. Numer. Math. 9, 403-414.
36. Press, W. H., Teukolsky, S. A., Vetterling, W. T. & Flannery, B. P. 1992 Numerical recipes in C: the art of scientific computing, 2nd edn. Cambridge, UK: Cambridge University Press.
37. Pritchard, J., Seielstad, M. T., Perez-Lezaun, A. & Feldman, M. W. 1999 Population growth of human Y chromosomes: a study of Y chromosome microsatellites. Mol. Biol. Evol. 16, 1791-1798.
38. Putter, H., Heisterkamp, S. H., Lange, J. M. A. & de Wolf, F. 2002 A Bayesian approach to parameter estimation in HIV dynamical models. Stat. Med. 21, 2199-2214.
39. Reinker, S., Altman, R. & Timmer, J. 2006 Parameter estimation in stochastic biochemical reactions. IEE Proc. Syst. Biol. 153, 168-178.
40. Robert, C. P. & Casella, G. 2004 Monte Carlo statistical methods, 2nd edn. New York, NY: Springer.
41. Saltelli, A., Ratto, M., Andres, T., Campolongo, F., Cariboni, J., Gatelli, D., Saisana, M. & Tarantola, S. 2008 Global sensitivity analysis: the primer. New York, NY: Wiley.
42. Sanchez, M. & Blower, S. 1997 Uncertainty and sensitivity analysis of the basic reproductive rate: tuberculosis as an example. Am. J. Epidemiol. 145, 1127-1137.
43. Shibli, M., Gooch, S., Lewis, H. E. & Tyrrell, D. A. 1971 Common colds on Tristan da Cunha. J. Hyg. 69, 255.
44. Sisson, S. A., Fan, Y. & Tanaka, M. M. 2007 Sequential Monte Carlo without likelihoods. Proc. Natl Acad. Sci. USA 104, 1760-1765.
45. Stumpf, M. & Thorne, T. 2006 Multi-model inference of network properties from incomplete data. J. Integr. Bioinform. 3, 32.
46. Timmer, J. & Muller, T. 2004 Modeling the nonlinear dynamics of cellular signal transduction. Int. J. Bifurcat. Chaos 14, 2069-2079.
47. van Kampen, N. G. 2007 Stochastic processes in physics and chemistry, 3rd edn. Amsterdam, The Netherlands: North-Holland.
48. Volterra, V. 1926 Variazioni e fluttuazioni del numero d'individui in specie animali conviventi. Mem. R. Acad. Naz. dei Lincei 2, 31-113.
49. Vyshemirsky, V. & Girolami, M. A. 2008 Bayesian ranking of biochemical system models. Bioinformatics 24, 833-839.
50. Wilkinson, D. J. 2006 Stochastic modelling for systems biology. London, UK: Chapman & Hall/CRC.
51. Wilkinson, R. D. 2007 Bayesian inference of primate divergence times. PhD thesis, University of Cambridge.
52. Zucknick, M. 2004 Approximate Bayesian computation in population genetics and genomics. MSc thesis, Imperial College London.