A framework for parameter estimation and model selection from experimental data in systems biology using approximate Bayesian computation

Nature Protocols

Volumn 9, Issue 2, 2014, Pages 439-456

  Liepe, Juliane ^a   Kirk, Paul ^a   Filippi, Sarah ^a   Toni, Tina ^a   Barnes, Chris P ^b   Stumpf, Michael P H ^a  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

BAYES THEOREM; MODELS, BIOLOGICAL; SOFTWARE; SYSTEMS BIOLOGY;

EID: 84893308174     PISSN: 17542189     EISSN: 17502799     Source Type: Journal    
DOI: 10.1038/nprot.2014.025     Document Type: Article

References (69)

1. Kirk, P., Thorne, T. & Stumpf, M.P. Model selection in systems and synthetic biology. Curr. Opin. Biotechnol. 24, 767-774 (2013).
2. Xu, T.-R. et al. Inferring signaling pathway topologies from multiple perturbation measurements of specifc biochemical species. Sci. Signal 3, ra20 (2010).
3. Stumpf, M.P.H., Balding, D.J. & Girolami, M. Handbook of Statistical Systems Biology (Wiley, 2011).
4. Balsa-Canto, E., Peifer, M., Banga, J.R., Timmer, J. & Fleck, C. Hybrid optimization method with general switching strategy for parameter estimation. BMC Syst. Biol. 2, 26 (2008).
5. Kirk, P.D.W. & Stumpf, M.P.H. Gaussian process regression bootstrapping: exploring the effects of uncertainty in time course data. Bioinformatics 25, 1300-1306 (2009).
6. Efron, B. Bayes' theorem in the 21st century. Science 340, 1177-1178 (2013).
7. Vyshemirsky, V. & Girolami, M.A. Bayesian ranking of biochemical system models. Bioinformatics 24, 833-839 (2008).
8. Robert, C. The Bayesian Choice (Springer, 2007).
9. Jeffreys, H. An invariant form for the prior probability in estimation problems. Proc. R. Soc. Lond. A Math. Phys. Sci. 186, 453-461 (1946)
10. Jaynes, E. Prior Probabilities. IEEE Trans. Syst. Sci. Cyber. 4, 227-241 (1968).
11. Bernardo, J.M. & Smith, A.F.M. Bayesian Theory (John Wiley & Sons, 2009).
12. Kass, R.E. & Wasserman, L. The selection of prior distributions by formal rules. J. Am. Statist. Assoc. 91, 1343-1370 (1996).
13. Cox, D. Principles of Statistical Inference (Cambridge University Press, 2006).
14. Toni, T., Ozaki, Y.-I., Kirk, P., Kuroda, S. & Stumpf, M.P.H. Elucidating the in vivo phosphorylation dynamics of the ERK MAP kinase using quantitative proteomics data and Bayesian model selection. Mol. Biosyst. 8, 1921-1929 (2012).
15. Gilks, W.R., Richardson, S. & Spiegelhalter, D.J. Markov Chain Monte Carlo in Practice (CRC Press, 1996).
16. Gutenkunst, R.N. et al. Universally sloppy parameter sensitivities in systems biology models. PLoS Comput. Biol. 3, 1871-1878 (2007).
17. Apgar, J.F., Witmer, D.K., White, F.M. & Tidor, B. Sloppy models, parameter uncertainty, and the role of experimental design. Mol. Biosyst. 6, 1890-1900 (2010).
18. Erguler, K. & Stumpf, M.P.H. Practical limits for reverse engineering of dynamical systems: a statistical analysis of sensitivity and parameter inferability in systems biology models. Mol. Biosyst. 7, 1593-1602 (2011).
19. Sunnåker, M. et al. Approximate Bayesian computation. PLoS Comput. Biol. 9, e1002803 (2013).
20. Tavaré, S., Balding, D.J., Griffths, R.C. & Donnelly, P. Inferring coalescence times from DNA sequence data. Genetics 145, 505-518 (1997).
21. Beaumont, M.A., Zhang, W. & Balding, D.J. Approximate Bayesian computation in population genetics. Genetics 162, 2025-2035 (2002).
22. Kirk, P.D.W., Toni, T. & Stumpf, M.P. Parameter inference for biochemical systems that undergo a Hopf bifurcation. Biophys. J. 95, 540-549 (2008).
23. Golightly, A. & Wilkinson, D.J. Bayesian inference for stochastic kinetic models using a diffusion approximation. Biometrics 61, 781-788 (2005).
24. Bowsher, C.G. & Swain, P.S. Identifying sources of variation and the fow of information in biochemical networks. Proc. Natl. Acad. Sci. USA 109, E1320-E1328 (2012).
25. Hilfnger, A. & Paulsson, J. Separating intrinsic from extrinsic fuctuations in dynamic biological systems. Proc. Natl. Acad. Sci. USA 108, 12167-12172 (2011).
26. Sisson, S.A., Fan, Y. & Tanaka, M.M. Sequential Monte Carlo without likelihoods. Proc. Natl. Acad. Sci. USA 104, 1760-1765 (2007).
27. Toni, T., Welch, D., Strelkowa, N., Ipsen, A. & Stumpf, M.P.H. Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems. J. R. Soc. Interface 6, 187-202 (2009).
28. Beaumont, M.A., Cornuet, J.-M., Marin, J.-M. & Robert, C.P. Adaptive approximate Bayesian computation. Biometrika 96, 983-990 (2009).
29. Joyce, P. & Marjoram, P. Approximately suffcient statistics and Bayesian computation. Stat. Appl. Genet. Mol. Biol. 7, 26 (2008).
30. Nunes, M.A. & Balding, D.J. On optimal selection of summary statistics for approximate Bayesian computation. Stat. Appl. Genet. Mol. Biol. 9, 34 (2010).
31. Robert, C.P., Cornuet, J.-M., Marin, J.-M. & Pillai, N.S. Lack of confdence in approximate Bayesian computation model choice. Proc. Natl. Acad. Sci. USA 108, 15112-15117 (2011).
32. Fearnhead, P. & Prangle, D. Constructing summary statistics for approximate Bayesian computation: semi-automatic approximate Bayesian computation. J. R. Stat. Soc. Ser. B Stat. Methodol. 74, 419-474 (2012).
33. Barnes, C.P., Filippi, S., Stumpf, M.P. & Thorne, T. Considerate approaches to constructing summary statistics for ABC model selection. Stat. Comput. 22, 1181-1197 (2012).
34. Toni, T. & Stumpf, M.P.H. Simulation-based model selection for dynamical systems in systems and population biology. Bioinformatics 26, 104-110 (2010).
35. Wilkinson, R.D. Approximate Bayesian computation (ABC) gives exact results under the assumption of model error. Stat. Appl. Genet. Mol. Biol. 12, 129-141 (2013).
36. Drovandi, C.C., Pettitt, A.N. & Faddy, M.J. Approximate Bayesian computation using indirect inference. J. R. Statist. Soc. Ser. C 60, 317-337 (2011).
37. Grelaud, A., Robert, C.P. & Marin, J.-M. ABC methods for model choice in Gibbs random felds. Comptes Rendus Mathematique 347, 205-210 (2009).
38. Thorne, T. & Stumpf, M.P.H. Graph spectral analysis of protein interaction network evolution. J. R. Soc. Interface 9, 2653-2666 (2012).
39. Pritchard, J.K., Seielstad, M.T., Perez-Lezaun, A. & Feldman, M.W. Population growth of human Y chromosomes: a study of Y chromosome microsatellites. Mol. Biol. Evol. 16, 1791-1798 (1999).
40. Marjoram, P., Molitor, J., Plagnol, V. & Tavaré, S. Markov chain Monte Carlo without likelihoods. Proc. Natl. Acad. Sci. USA 100, 15324-15328 (2003).
41. Lopes, J.S. & Beaumont, M.A. ABC: a useful Bayesian tool for the analysis of population data. Infect. Genet. Evol. 10, 826-833 (2010).
42. Toni, T., Jovanovic, G., Huvet, M., Buck, M. & Stumpf, M.P.H. From qualitative data to quantitative models: analysis of the phage shock protein stress response in Escherichia coli. BMC Syst. Biol. 5, 69 (2011).
43. Silk, D. et al. Designing attractive models via automated identifcation of chaotic and oscillatory dynamical regimes. Nat. Commun. 2, 489 (2011).
44. Liepe, J. et al. Calibrating spatio-temporal models of leukocyte dynamics against in vivo live-imaging data using approximate Bayesian computation. Integr. Biol. 4, 335-345 (2012).
45. Barnes, C.P., Silk, D., Sheng, X. & Stumpf, M.P.H. Bayesian design of synthetic biological systems. Proc. Natl. Acad. Sci. USA 108, 15190-15195 (2011).
46. Maclean, A.L., Lo Celso, C. & Stumpf, M.P.H. Population dynamics of normal and leukaemia stem cells in the haematopoietic stem cell niche show distinct regimes where leukaemia will be controlled. J. R. Soc. Interface 10, 20120968 (2013).
47. Csilléry, K., Blum, M.G.B., Gaggiotti, O.E. & Francois, O. Approximate Bayesian Computation (ABC) in practice. Trends Ecol. Evol. 25, 410-418 (2010).
48. Komorowski, M., Finkenstädt, B., Harper, C.V. & Rand, D.A. Bayesian inference of biochemical kinetic parameters using the linear noise approximation. BMC Bioinformatics 10, 343 (2009).
49. Komorowski, M., Costa, M.J., Rand, D.A. & Stumpf, M.P.H. Sensitivity, robustness, and identifability in stochastic chemical kinetics models. Proc. Natl. Acad. Sci. USA 108, 8645-8650 (2011).
50. Golightly, A. & Wilkinson, D.J. Bayesian parameter inference for stochastic biochemical network models using particle Markov chain Monte Carlo. Interface Focus 1, 807-820 (2011).
51. Ale, A., Kirk, P. & Stumpf, M.P.H. A general moment expansion method for stochastic kinetic models. J. Chem. Phys. 138, 174101 (2013).
52. Cornuet, J.-M. et al. Inferring population history with DIY ABC: a user-friendly approach to approximate Bayesian computation. Bioinformatics 24, 2713-2719 (2008).
53. Cornuet, J.-M., Ravigné, V. & Estoup, A. Inference on population history and model checking using DNA sequence and microsatellite data with the software DIYABC (v1.0). BMC Bioinformatics 11, 401 (2010).
54. Bertorelle, G., Benazzo, A. & Mona, S. ABC as a fexible framework to estimate demography over space and time: some cons, many pros. Mol. Ecol. 19, 2609-2625 (2010).
55. Dematté, L. & Prandi, D. GPU computing for systems biology. Brief. Bioinformatics 11, 323-333 (2010).
56. Zhou, Y., Liepe, J., Sheng, X., Stumpf, M.P.H. & Barnes, C. GPU accelerated biochemical network simulation. Bioinformatics 27, 874-876 (2011).
57. Vyshemirsky, V. & Girolami, M. BioBayes: a software package for Bayesian inference in systems biology. Bioinformatics 24, 1933-1934 (2008).
58. Golightly, A. & Wilkinson, D. Bayesian sequential inference for stochastic kinetic biochemical network models 13, 838-851 (2006).
59. Filippi, S., Barnes, C.P., Cornebise, J. & Stumpf, M.P.H. On optimality of kernels for approximate Bayesian computation using sequential Monte Carlo. Stat. Appl. Genet. Mol. Biol. 12, 87-107 (2013).
60. Silk, D., Filippi, S. & Stumpf, M.P.H. Optimizing threshold-schedules for approximate Bayesian computation sequential Monte Carlo samplers: applications to molecular systems. Preprint at http://arxiv.org/abs/1210.3296 (2012).
61. Leuenberger, C. & Wegmann, D. Bayesian computation and model selection without likelihoods. Genetics 184, 243-252 (2010).
62. Wilkinson, D.J. Stochastic Modelling for Systems Biology (CRC Press, 2011).
63. Rand, D.A. Mapping global sensitivity of cellular network dynamics: sensitivity heat maps and a global summation law. J. R. Soc. Interface 5 (suppl. 1): S59-S69 (2008).
64. Secrier, M., Toni, T. & Stumpf, M.P.H. The ABC of reverse engineering biological signalling systems. Mol. Biosyst. 5, 1925-1935 (2009).
65. Liepe, J., Filippi, S., Komorowski, M. & Stumpf, M.P.H. Maximizing the information content of experiments in systems biology. PLoS Comput. Biol. 9, e1002888 (2013).
66. Vanlier, J., Tiemann, C.A., Hilbers, P.A.J. & van Riel, N.A.W. A Bayesian approach to targeted experiment design. Bioinformatics 28, 1136-1142 (2012).
67. Hindmarsh, A.C. ODEPACK, a systematized collection of ODE solvers, in Scientifc Computing (eds. Stepleman, R.S. et al.) IMACS Transactions on Scientifc Computation, Vol. 1, 55-64 (Elsevier, 1983).
68. Kloeden, P.E. & Platen, E. Numerical Solution of Stochastic Differential Equations (Springer, 1992).
69. Gillespie, D.T. A general method for numerically simulating the stochastic time evolution of coupled chemical reactions. J. Comput. Phys. 22, 403-434 (1976).