Scalable Parameter Estimation for Genome-Scale Biochemical Reaction Networks

PLoS Computational Biology

Volumn 13, Issue 1, 2017, Pages

  Fröhlich, Fabian ^a,b   Kaltenbacher, Barbara ^c   Theis, Fabian J ^a,b   Hasenauer, Jan ^a,b  

^a INSTITUTE OF EPIDEMIOLOGY   (Germany)

^b TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^c UNIVERSITY OF KLAGENFURT   (Austria)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL EFFICIENCY; GENES; ORDINARY DIFFERENTIAL EQUATIONS; SENSITIVITY ANALYSIS;

ADJOINT SENSITIVITY ANALYSIS; BIOCHEMICAL REACTION NETWORK; BIOCHEMICAL REACTIONS; BIOCHEMICAL SPECIES; BIOLOGICAL PROCESS; MECHANISTICS; MEDIUM-SCALE; ORDINARY DIFFERENTIAL EQUATION MODELS; PARAMETERS ESTIMATION; SMALL SCALE;

PARAMETER ESTIMATION;

BIOLOGY; GENOME; KINETICS; PUBLICATION; BIOLOGICAL MODEL; COMPUTER LANGUAGE; COMPUTER SIMULATION; GENE EXPRESSION REGULATION; METABOLISM; PHYSIOLOGY; SIGNAL TRANSDUCTION; SOFTWARE; STATISTICAL MODEL;

PROTEOME;

COMPUTER SIMULATION; GENE EXPRESSION REGULATION; GENOME; MODELS, BIOLOGICAL; MODELS, STATISTICAL; PROGRAMMING LANGUAGES; PROTEOME; SIGNAL TRANSDUCTION; SOFTWARE;

EID: 85011407731     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1005331     Document Type: Article

References (67)

1. Soon WW, Hariharan M, Snyder MP, High-throughput sequencing for biology and medicine. Mol Syst Biol; 2013;9(640). doi: 10.1038/msb.2012.6123340846
2. Chen R, et al. Personal omics profiling reveals dynamic molecular and medical phenotypes. Cell; 2012;148(6):1293–1307. doi: 10.1016/j.cell.2012.02.00922424236
3. Ciriello G, Miller ML, Aksoy BA, Senbabaoglu Y, Schultz N, Sander C, Emerging landscape of oncogenic signatures across human cancers. Nat Gen; 2013;45(10):1127–1133. doi: 10.1038/ng.2762
4. Kitano H, Computational Systems Biology. Nature; 2002;420(6912):206–210. doi: 10.1038/nature0125412432404
5. Hoops S, Sahle S, Gauges R, Lee C, Pahle J, Simus N, et al. COPASI—a COmplex PAthway SImulator. Bioinf; 2006;22:3067–3074. doi: 10.1093/bioinformatics/btl485
6. Balsa-Canto E, Banga JR, AMIGO, a toolbox for advanced model identification in systems biology using global optimization. Bioinf; 2011;27(16):2311–2313. doi: 10.1093/bioinformatics/btr370
7. Raue A, Steiert B, Schelker M, Kreutz C, Maiwald T, Hass H, et al. Data2Dynamics: a modeling environment tailored to parameter estimation in dynamical systems. Bioinf; 2015;31(21):3558–3560. doi: 10.1093/bioinformatics/btv405
8. Kanehisa M, Goto S, KEGG: Kyoto Encyclopedia of Genes and Genomes. Nucleic Acids Res; 2000;28(1):27–30. doi: 10.1093/nar/28.1.2710592173
9. Croft D, O’Kelly G, Wu G, Haw R, Gillespie M, Matthews L, et al. Reactome: a database of reactions, pathways and biological processes. Nucleic Acids Res; 2011;39(Database issue):D691–7. doi: 10.1093/nar/gkq101821067998
10. Franceschini A, Szklarczyk D, Frankild S, Kuhn M, Simonovic M, Roth A, et al. STRING v9.1: protein-protein interaction networks, with increased coverage and integration. Nucleic Acids Res; 2013;41(Database issue):D808–15. doi: 10.1093/nar/gks109423203871
11. Büchel F, Rodriguez N, Swainston N, Wrzodek C, Czauderna T, Keller R, et al. Path2Models: large-scale generation of computational models from biochemical pathway maps. BMC Syst Biol; 2013;7(116).
12. Thiele I, Swainston N, Fleming RMT, Hoppe A, Sahoo S, Aurich MK, et al. A community-driven global reconstruction of human metabolism. Nat Biotechnol; 2013;31(5):419–25. doi: 10.1038/nbt.248823455439
13. Ganter M, Kaltenbach HM, Stelling J, Predicting network functions with nested patterns. Nat Commun; 2014;5:3006. doi: 10.1038/ncomms400624398547
14. Dräger A, Zielinski DC, Keller R, Rall M, Eichner J, Palsson BO, et al. SBMLsqueezer 2: context-sensitive creation of kinetic equations in biochemical networks. BMC Syst Biol; 2015;9:68. doi: 10.1186/s12918-015-0212-926452770
15. Stanford NJ, Lubitz T, Smallbone K, Klipp E, Mendes P, Liebermeister W, Systematic construction of kinetic models from genome-scale metabolic networks. PLoS ONE; 2013;8(11):e79195. doi: 10.1371/journal.pone.007919524324546
16. Villaverde AF, Bongard S, Mauch K, Müller D, Balsa-Canto E, Schmid J, et al. A consensus approach for estimating the predictive accuracy of dynamic models in biology. Computer Methods and Programs in Biomedicine; 2015;119(1):17–28. doi: 10.1016/j.cmpb.2015.02.00125716416
17. Hadamard J, Sur les problémes aux dérivées partielles et leur signification physique. In: Princeton University Bulletin; 1902. p. 49–52.
18. Raue A, Schilling M, Bachmann J, Matteson A, Schelke M, Kaschek D, et al. Lessons learned from quantitative dynamical modeling in systems biology. PLoS ONE; 2013;8(9):e74335. doi: 10.1371/journal.pone.007433524098642
19. Bäck T, Evolutionary algorithms in theory and practice: evolution strategies, evolutionary programming, genetic algorithms. New York and Oxford: Oxford University Press; 1996.
20. Yang XS, Nature-inspired metaheuristic algorithms. 2nd ed. Bristol, UK: Luniver Press; 2010.
21. Kirkpatrick S, Gelatt CD, JrM P Vecchi MP, Optimization by simulated annealing. Science; 1983;220(4598):671–680. doi: 10.1126/science.220.4598.67117813860
22. Balsa-Canto E, Peifer M, Banga JR, Timmer J, Fleck C, Hybrid optimization method with general switching strategy for parameter estimation. BMC Syst Biol; 2008;2(26). doi: 10.1186/1752-0509-2-2618366722
23. Vaz A, Vicente L, A particle swarm pattern search method for bound constrained global optimization. J Global Optim; 2007;39(2):197–219. doi: 10.1007/s10898-007-9133-5
24. Moles CG, Mendes P, Banga JR, Parameter estimation in biochemical pathways: A comparison of global optimization methods. Genome Res; 2003;13:2467–2474. doi: 10.1101/gr.126250314559783
25. Banga JR, Optimization in computational systems biology. BMC Syst Biol; 2008;2(47).
26. Weise T, Global Optimization Algorithms: Theory and Application. Nature Inspired Computation and Applications Laboratory (NICAL), University of Science and Technology, China; 2009.
27. Villaverde AF, Henriques D, Smallbone K, Bongard S, Schmid J, Cicin-Sain D, et al. BioPreDyn-bench: a suite of benchmark problems for dynamic modelling in systems biology. BMC Syst Biol; 2015;9(8). doi: 10.1186/s12918-015-0144-425880925
28. Griewank A, Walther A, Evaluating Derivatives. 2nd ed. Society for Industrial and Applied Mathematics; 2008.
29. Nocedal J, Wright S, Numerical optimization. Springer Science & Business Media; 2006.
30. Hindmarsh AC, Brown PN, Grant KE, Lee SL, Serban R, Shumaker DE, et al. SUNDIALS: Suite of Nonlinear and Differential/Algebraic Equation Solvers. ACM T Math Software; 2005;31(3):363–396. doi: 10.1145/1089014.1089020
31. Lu J, Muller S, Machné R, Flamm C. SBML ODE Solver library: Extensions for inverse analysis. In: Proceedings of the Fifth International Workshop on Computational Systems Biology, WCSB; 2008.
32. Fujarewicz K, Kimmel M, Swierniak A, On fitting of mathematical models of cell signaling pathways using adjoint systems. MBE; 2005;2(3):527–534. doi: 10.3934/mbe.2005.2.52720369938
33. Lu J, August E, Koeppl H, Inverse problems from biomedicine: Inference of putative disease mechanisms and robust therapeutic strategies. J Math Biol; 2012;67(1):143–168. doi: 10.1007/s00285-012-0523-z22526835
34. Hanke M, Scherzer O, Inverse problems light: Numerical differentiation. The American Mathematical Monthly; 2001;108(6):512–521. doi: 10.2307/2695705
35. Plessix RE, A review of the adjoint-state method for computing the gradient of a functional with geophysical applications. Geophys J Int; 2006;167(2):495–503. doi: 10.1111/j.1365-246X.2006.02978.x
36. Leonhardt C, Schwake G, Stögbauer TR, Rappl S, Kuhr JT, Ligon TS, et al. Single-cell mRNA transfection studies: Delivery, kinetics and statistics by numbers. Nanomedicine: Nanotechnology, Biology, and Medicine; 2014;10(4):679–688.
37. Li C, Donizelli M, Rodriguez N, Dharuri H, Endler L, Chelliah V, et al. BioModels Database: An enhanced, curated and annotated resource for published quantitative kinetic models. BMC Syst Biol; 2010;4:92. doi: 10.1186/1752-0509-4-9220587024
38. Smith GR, Shanley DP, Computational modelling of the regulation of Insulin signalling by oxidative stress. BMC Syst Biol; 2013;7(1):1. doi: 10.1186/1752-0509-7-41
39. Kühn C, Wierling C, Kühn A, Klipp E, Panopoulou G, Lehrach H, et al. Monte carlo analysis of an ode model of the sea urchin endomesoderm network. BMC Syst Biol; 2009;3(1):1.
40. Chen WW, Schoeberl B, Jasper PJ, Niepel M, Nielsen UB, Lauffenburger DA, et al. Input–output behavior of ErbB signaling pathways as revealed by a mass action model trained against dynamic data. Mol Syst Biol; 2009;5(239).
41. Chassagnole C, Noisommit-Rizzi N, Schmid JW, Mauch K, Reuss M, Dynamic modeling of the central carbon metabolism of Escherichia coli. Biotechnol Bioeng; 2002;79(1):53–73. doi: 10.1002/bit.1028817590932
42. Kotte O, Zaugg JB, Heinemann M, Bacterial adaptation through distributed sensing of metabolic fluxes. Mol Syst Biol; 2010;6(1). doi: 10.1038/msb.2010.1020212527
43. Villaverde AF, Bongard S, Mauch K, Müller D, Balsa-Canto E, Schmid J, et al. High-Confidence Predictions in Systems Biology Dynamic Models. In: 8th International Conference on Practical Applications of Computational Biology & Bioinformatics (PACBB 2014). Cham: Springer International Publishing; 2014. p. 161–171.
44. MacNamara A, Terfve C, Henriques D, Bernabé BP, Saez-Rodriguez J, State–time spectrum of signal transduction logic models. Phys Biol; 2012;9(4):045003. doi: 10.1088/1478-3975/9/4/04500322871648
45. Smallbone K, Mendes P, Large-scale metabolic models: From reconstruction to differential equations. Ind Biotechnol; 2013;9(4):179–184. doi: 10.1089/ind.2013.0003
46. Longford NT, A fast scoring algorithm for maximum likelihood estimation in unbalanced mixed models with nested random effects. Biometrika; 1987;74(4):817–827. doi: 10.1093/biomet/74.4.817
47. Fletcher R, Powell MJ, A rapidly convergent descent method for minimization. Comp J; 1963;6(2):163–168. doi: 10.1093/comjnl/6.2.163
48. Goldfarb D, A Family of Variable-Metric Methods Derived by Variational Means. Math Comp; 1970;24(109):23–26. doi: 10.1090/S0025-5718-1970-0258249-6
49. Guay M, McLean DD, Optimization and sensitivity analysis for multiresponse parameter estimation in systems of ordinary differential equations. Comp and Chem Eng; 1995;19(12):1271–1285. An International Journal of Computer Application in Chemical Engineering. doi: 10.1016/0098-1354(94)00120-0
50. Özyurt DB, Barton PI, Cheap Second Order Directional Derivatives of Stiff ODE Embedded Functionals. SIAM Journal on Scientific Computing; 2005;26(5):1725–1743. doi: 10.1137/030601582
51. Martins JRRA, Sturdza P, Alonso JJ, The complex-step derivative approximation. ACM Trans Math Softw; 2003;29:245–262. doi: 10.1145/838250.838251
52. Chang YF, Corliss GF, ATOMFT: Solving ODEs and DAEs using Taylor series. Comp Math App; 1994;28(10–12):209–233. doi: 10.1016/0898-1221(94)00193-6
53. Linnainmaa S, Taylor expansion of the accumulated rounding error. BIT; 1976;16(2):146–160. doi: 10.1007/BF01931367
54. Egea JA, Henriques D, Cokelaer T, Villaverde AF, MacNamara A, Danciu DP, et al. MEIGO: an open-source software suite based on metaheuristics for global optimization in systems biology and bioinformatics. BMC Bioinf; 2014;15(136).
55. Schmidt H, Jirstrand M, Systems biology toolbox for MATLAB: a computational platform for research in systems biology. Bioinf; 2006;22(4):514–515. doi: 10.1093/bioinformatics/bti799
56. Gonnet P, Dimopoulos S, Widmer L, Stelling J, A specialized ODE integrator for the efficient computation of parameter sensitivities. BMC Syst Biol; 2012;6(46). doi: 10.1186/1752-0509-6-4622607742
57. Gábor A, Banga JR, Robust and efficient parameter estimation in dynamic models of biological systems. BMC Syst Biol; 2015;9:74. doi: 10.1186/s12918-015-0219-226515482
58. Wittig U, Kania R, Golebiewski M, Rey M, Shi L, Jong L, et al. SABIO-RK—database for biochemical reaction kinetics. Nucl Acids Res; 2012;40(D1):D790–D796. doi: 10.1093/nar/gkr104622102587
59. Chang A, Scheer M, Grote A, Schomburg I, Schomburg D, BRENDA, AMENDA and FRENDA the enzyme information system: new content and tools in 2009. Nucleic Acids Res; 2009;37(Database issue):D588–92. doi: 10.1093/nar/gkn82018984617
60. Neal RM, Brooks S, Gelman A, Jones G, Meng XL, MCMC using Hamiltonian dynamics. In: Handbook of Markov Chain Monte Carlo. London, United Kingdom: Chapman & Hall / CRC Press; 2011.
61. Girolami M, Calderhead B, Riemann manifold Langevin and Hamiltonian Monte Carlo methods. J R Statist Soc B; 2011;73(2):123–214. doi: 10.1111/j.1467-9868.2010.00765.x
62. Lan S, Bui-Thanh T, Christie M, Girolami M. Emulation of higher-order tensors in manifold Monte Carlo methods for Bayesian inverse problems. arXiv; 2015. arXiv:1507.06244v2 [stat.CO].
63. Fröhlich F, Hross S, Theis FJ, Hasenauer J. Radial basis function approximation of Bayesian parameter posterior densities for uncertainty analysis. In: Mendes P, Dada JO, Smallbone KO, editors. Proceedings of the 12th International Conference on Computational Methods in Systems Biology (CMSB 2014), Manchester, UK. Lecture Notes in Bioinformatics. Springer International Publishing Switzerland; 2014. p. 73–85.
64. Xu TR, Vyshemirsky V, Gormand A, von Kriegsheim A, Girolami M, Baillie GS, et al. Inferring signaling pathway topologies from multiple perturbation measurements of specific biochemical species. Sci Signal; 2010;3(113):ra20. doi: 10.1126/scisignal.2000517
65. Hug S, Raue A, Hasenauer J, Bachmann J, Klingmüller U, Timmer J, et al. High-dimensional Bayesian parameter estimation: Case study for a model of JAK2/STAT5 signaling. Math Biosci; 2013;246(2):293–304. doi: 10.1016/j.mbs.2013.04.00223602931
66. Hasenauer J, Jagiella N, Hross S, Theis FJ, Data-driven modelling of biological multi-scale processes. Journal of Coupled Systems and Multiscale Dynamics; 2015;3(2):101–121. doi: 10.1166/jcsmd.2015.1069
67. Berger B, Peng J, Singh M, Computational solutions for omics data. Nat Rev Genet; 2013;14(5):333–346. doi: 10.1038/nrg343323594911