Bayesian model comparison and parameter inference in systems biology using nested sampling

PLoS ONE

Volumn 9, Issue 2, 2014, Pages

  Pullen, Nick ^a   Morris, Richard J ^a  

^a JOHN INNES CENTRE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; BAYES THEOREM; BIOENGINEERING; BIOINFORMATICS; DYNAMICS; MATHEMATICAL MODEL; MONTE CARLO METHOD; NOISE; PARAMETERS; PROBABILITY; SKILLING NESTED SAMPLING;

ALGORITHMS; BAYES THEOREM; HUMANS; MODELS, STATISTICAL; MONTE CARLO METHOD; PROBABILITY; SYSTEMS BIOLOGY;

EID: 84895766683     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0088419     Document Type: Article

References (80)

1. Edelstein-Keshet L (1988) Mathematical models in biology. Random House/Birkhäuser mathematics series. Random House.
2. Murray J (2002) Mathematical Biology: I. An Introduction. Interdisciplinary Applied Mathematics. Springer.
3. Gonzalez O, Kuer C, Jung K, Naval P, Mendoza E (2007) Parameter estimation using simulated annealing for s-system models of biochemical networks. Bioinformatics 23: 480-486. (Pubitemid 46323129)
4. Zhan C, Yeung L (2011) Parameter estimation in systems biology models using spline approximation. BMC Systems Biology 5: 14.
5. Chou I, Martens H, Voit E (2006) Parameter estimation in biochemical systems models with alternating regression. Theor Biol Med Model 19: 3-25.
6. Schwaab M, Biscaia EC Jr, Monteiro JL, Pinto JC (2008) Nonlinear parameter estimation through particle swarm optimization. Chemical Engineering Science 63: 1542-1552.
7. Peifer M, Timmer J (2007) Parameter estimation in ordinary differential equations for biochemical processes using the method of multiple shooting. IET Syst Biol 1: 78-88. (Pubitemid 46488241)
8. Toni T, Welch D, Strelkowa N, Ipsen A, Stumpf M (2009) Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems. Journal of the Royal Society Interface 6: 187-202.
9. Kirk P, Toni T, Stumpf M (2008) Parameter inference for biochemical systems that undergo a Hopf bifurcation. Biophysical Journal 95: 540-549.
10. Granqvist E, Oldroyd G, Morris R (2011) Automated Bayesian model development for frequency detection in biological time series. BMC Systems Biology 5: 97.
11. Lillacci G, Khammash M (2010) Parameter estimation and model selection in computational biology. PLoS Computational Biology 6: e1000696.
12. Quach M, Brunel N, d'Alché Buc F (2007) Estimating parameters and hidden variables in nonlinear state-space models based on ODEs for biological networks inference. Bioinformatics 23: 3209-3216. (Pubitemid 350187524)
13. Floudas CA, Gounaris CE (2009) A review of recent advances in global optimization. J of Global Optimization 45: 3-38.
14. Moles C, Mendes P, Banga J (2003) Parameter estimation in biochemical pathways: a comparisonof global optimization methods. Genome Research 13: 2467-2474. (Pubitemid 37428271)
15. Ashyraliyev M, Fomekong-Nanfack Y, Kaandorp J, Blom J (2009) Systems biology: parameter estimation for biochemical models. FEBS Journal 276: 886-902.
16. Dalchau N (2012) Understanding biological timing using mechanistic and black-box models. New Phytol 193: 852-8.
17. Alon U (2006) An Introduction to Systems Biology: Design Principles of Biological Circuits. Chapman and Hall/CRC mathematical & computational biology series. Taylor & Francis.
18. Mendes P, Kell D (1998) Non-linear optimization of biochemical pathways: applications to metabolic engineering and parameter estimation. Bioinformatics 14: 869-883. (Pubitemid 29041543)
19. Banga J (2008) Optimization in computational systems biology. BMC Systems Biology 2: 47.
20. Mitsos A, Melas IN, Morris MK, Saez-Rodriguez J, Lauffenburger DA, et al. (2012) Non linear programming (nlp) formulation for quantitative modeling of protein signal transduction pathways. PLoS One 7: e50085.
21. Press W, Teukolsky S, Vetterling W, Flannery B (1992) Numerical Recipes in C. Cambridge, UK: Cambridge University Press, 2nd edition.
22. Calderhead B, Girolami M (2009) Estimating Bayes factors via thermodynamic integration and population MCMC. Computational Statistics & Data Analysis 53: 4028-4045.
23. Slezak D, Suárez C, Cecchi G, Marshall G, Stolovitzky G (2010) When the optimal is not the best: Parameter estimation in complex biological models. PloS one 5: e13283.
24. Hawkins D (2004) The problem of overfitting. Journal of chemical information and computer sciences 44: 1-12.
25. Akaike H (1973) Information theory and an extension of the maximum likelihood principle. In: Second International Symposium on Information Theory. pp. 267-281.
26. Akaike H (1974) A new look at the statistical model identification. Automatic Control, IEEE Transactions on 19: 716-723.
27. Kirk P, Thorne T, Stumpf MPH (2013) Model selection in systems and synthetic biology. Current opinion in biotechnology.
28. MacKay D (2003) Information Theory, Inference, and Learning Algorithms. Cambridge University Press.
29. Erguler K, Stumpf MPH (2011) Practical limits for reverse engineering of dynamical systems: a statistical analysis of sensitivity and parameter inferability in systems biology models. Mol BioSyst 7: 1593-1602.
30. Gutenkunst RN, Waterfall JJ, Casey FP, Brown KS, Myers CR, et al. (2007) Universally sloppy parameter sensitivities in systems biology models. PLoS Comput Biol 3: e189.
31. Komorowski M, Costa MJ, Rand DA, Stumpf MPH (2011) Sensitivity, robustness, and identifi- ability in stochastic chemical kinetics models. Proceedings of the National Academy of Sciences 108: 8645-8650.
32. Jeffreys H (1961) Theory of Probability. Oxford University Press, third edition.
33. Jaynes E, Bretthorst G (2003) Probability Theory: The Logic of Science. Cambridge University Press.
34. Blumer A, Ehrenfeucht A, Haussler D, Warmuth M (1987) Occam's razor. Information processing letters 24: 377-380.
35. Rasmussen C, Ghahramani Z (2001) Occam's razor. Advances in neural information processing systems: 294-300.
36. MacKay DJ (1991) Bayesian interpolation. Neural Computation 4: 415-447.
37. Posada D, Buckley T (2004) Model selection and model averaging in phylogenetics: advantages of Akaike information criterion and Bayesian approaches over likelihood ratio tests. Systematic Biology 53: 793-808. (Pubitemid 39568279)
38. Wilkinson D (2007) Bayesian methods in bioinformatics and computational systems biology. Briefings in Bioinformatics 8: 109-116.
39. Baldi P, Long AD (2001) A Bayesian framework for the analysis of microarray expression data: regularized t-test and statistical inferences of gene changes. Bioinformatics 17: 509-519. (Pubitemid 32600497)
40. Lartillot N, Philippe H (2006) Computing Bayes factors using thermodynamic integration. Systematic biology 55: 195-207. (Pubitemid 43355101)
41. Toni T, Stumpf MPH (2010) Parameter inference and model selection in signaling pathway models. Methods Mol Biol 673: 283-95.
42. Pártay LB, Bartók AP, Csányi G (2010) Efficient sampling of atomic configurational spaces. J Phys Chem B 114: 10502-12.
43. Burkoff N, Várnai C, Wells S, Wild D (2012) Exploring the energy landscapes of protein folding simulations with Bayesian computation. Biophysical Journal 102: 878-886.
44. Calderhead B, Girolami M (2011) Statistical analysis of nonlinear dynamical systems using differential geometric sampling methods. Interface Focus 1: 821-35.
45. Eydgahi H, Chen WW, Muhlich JL, Vitkup D, Tsitsiklis JN, et al. (2013) Properties of cell death models calibrated and compared using Bayesian approaches. Molecular systems biology 9.
46. Heuett W, Miller B, Racette S, Holloszy J, Chow C, et al. (2012) Bayesian functional integral method for inferring continuous data from discrete measurements. Biophysical Journal 102: 399-406.
47. Schmidl D, Hug S, Li WB, Greiter MB, Theis FJ (2012) Bayesian model selection validates a biokinetic model for zirconium processing in humans. BMC Systems Biology 6: 95.
48. Skilling J (2006) Nested Sampling for General Bayesian Computation. Bayesian Analysis 1: 833-860.
49. Sivia D, Skilling J (2006) Data Analysis: A Bayesian Tutorial. Oxford Science Publications. Oxford University Press.
50. Mukherjee P, Parkinson D, Liddle AR (2006) A nested sampling algorithm for cosmological model selection. The Astrophysical Journal Letters 638: L51.
51. Feroz F, Hobson M (2008) Multimodal nested sampling: an efficient and robust alternative to Markov Chain Monte Carlo methods for astronomical data analyses. Monthly Notices of the Royal Astronomical Society 384: 449-463.
52. Aitken S, Akman O (2013) Nested sampling for parameter inference in systems biology: application to an exemplar circadian model. BMC Systems Biology 7: 72.
53. Murray I (2007) Advances in Markov chain Monte Carlo methods. PhD thesis, Gatsby computational neuroscience unit, University College London.
54. Kass R, Raftery A (1995) Bayes factors. Journal of the American Statistical Association: 773-795.
55. Brooks S, Gelman A, Jones GL, Meng XL (2011) Handbook of Markov Chain Monte Carlo: Methods and Applications. Chapman & Hall/CRC Handbooks of Modern Statistical Methods. CRC Press.
56. Han C, Carlin BP (2001) Markov Chain Monte Carlo Methods for Computing Bayes Factors. Journal of the American Statistical Association 96: 1122-1132.
57. Andrieu C, Doucet A, Holenstein R (2010) Particle Markov chain Monte Carlo methods. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 72: 269-342.
58. Feroz F, Hobson M, Bridges M (2009) MULTINEST: an efficient and robust Bayesian inference tool for cosmology and particle physics. Monthly Notices of the Royal Astronomical Society 398: 1601-1614.
59. Feroz F, Hobson M, Cameron E, Pettitt A (2013) Importance nested sampling and the MULTINEST algorithm. arXiv preprint arXiv:13062144.
60. Ashyraliyev M, Jaeger J, Blom J (2008) Parameter estimation and determinability analysis applied to Drosophila gap gene circuits. BMC Systems Biology 2: 83.
61. Hindmarsh AC, Brown PN, Grant KE, Lee SL, Serban R, et al. (2005) SUNDIALS: Suite of nonlinear and differential/algebraic equation solvers. ACM Transactions on Mathematical Software 31: 363-396.
62. R Core Team (2013) R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. Available: http://www.R-project.org.
63. Wickham H (2009) ggplot2: elegant graphics for data analysis. Springer New York. Available: http://had.co.nz/ggplot2/book.
64. Scott P (2012) Pippipainless parsing, post-processing and plotting of posterior and likelihood samples. The European Physical Journal Plus 127: 1-4.
65. Patil A, Huard D, Fonnesbeck CJ (2010) PyMC: Bayesian Stochastic Modelling in Python. Journal of Statistical Software 35: 1-81.
66. Friel N, Wyse J (2012) Estimating the evidence a review. Statistica Neerlandica 66: 288-308.
67. Jaeger KE, Pullen N, Lamzin S, Morris RJ, Wigge PA (2013) Interlocking feedback loops govern the dynamic behavior of the oral transition in arabidopsis. The Plant Cell Online 25: 820-833.
68. Elowitz MB, Leibler S (2000) A synthetic oscillatory network of transcriptional regulators. Nature 403: 335-8. (Pubitemid 30062393)
69. Vyshemirsky V, Girolami M (2008) Bayesian ranking of biochemical system models. Bioinformatics 24: 833-839. (Pubitemid 351386922)
70. Pokhilko A, Fernández A, Edwards K, Southern M, Halliday K, et al. (2012) The clock gene circuit in Arabidopsis includes a repressilator with additional feedback loops. Molecular Systems Biology 8.
71. Lotka A (1925) Elements of physical biology. Baltimore: Williams & Wilkins.
72. Volterra V (1926) Variazioni efluttuazioni del numero d'individui in specie animali conviventi. Memorie della R Acc dei Lincei 2: 31-113.
73. Goodwin B (1963) Temporal organization in cells: a dynamic theory of cellular control processes. London: Academic Press.
74. Schnakenberg J (1979) Simple chemical reaction systems with limit cycle behaviour. Journal of Theoretical Biology 81: 389-400.
75. Liepe J, Filippi S, Komorowski M, Stumpf MPH (2013) Maximizing the information content of experiments in systems biology. PLoS Comput Biol 9: e1002888.
76. Brewer BJ, Pártay LB, Csányi G (2011) Diffusive nested sampling. Statistics and Computing 21: 649-656.
77. Burnham K, Anderson D (2002) Model Selection and Multi-Model Inference: A Practical Information-Theoretic Approach. Springer.
78. Link W, Barker R (2006) Model weights and the foundations of multimodel inference. Ecology 87: 2626-2635. (Pubitemid 44885973)
79. Neal RM (1996) Bayesian Learning for Neural Networks (Lecture Notes in Statistics). Springer, 1 edition.
80. Rasmussen CE, Williams C (2006) Gaussian Processes for Machine Learning. MIT Press.