Reverse engineering and identification in systems biology: Strategies, perspectives and challenges

Journal of the Royal Society Interface

Volumn 11, Issue 91, 2014, Pages

  Villaverde, Alejandro F ^a   Banga, Julio R ^a  

^a INSTITUTO DE INVESTIGACIONES MARINAS   (Spain)

Author keywords

Dynamic modelling; Identification; Inference; Reverse engineering; Systems biology

Indexed keywords

DYNAMIC MODELS; IDENTIFICATION (CONTROL SYSTEMS); INVERSE PROBLEMS; REVERSE ENGINEERING;

ENGINEERING PROBLEMS; INFERENCE; NONLINEAR PHYSICS; REGULATORY MECHANISM; SYSTEMS BIOLOGY;

BIOLOGY;

ARTICLE; ENGINEERING; MACHINE LEARNING; MATHEMATICAL MODEL; PHYSICS; REGULATORY MECHANISM; REVERSE ENGINEERING; SYSTEMS BIOLOGY; THEORY; ARTIFICIAL INTELLIGENCE; AUTOMATION; BAYES THEOREM; BIOENGINEERING; BIOLOGICAL MODEL; BIOPHYSICS; MARKOV CHAIN; MONTE CARLO METHOD; PROCEDURES; STATISTICAL MODEL;

DYNAMIC MODELLING; IDENTIFICATION; INFERENCE; REVERSE ENGINEERING; SYSTEMS BIOLOGY;

ARTIFICIAL INTELLIGENCE; AUTOMATION; BAYES THEOREM; BIOENGINEERING; BIOPHYSICS; MARKOV CHAINS; MODELS, BIOLOGICAL; MODELS, STATISTICAL; MONTE CARLO METHOD; SYSTEMS BIOLOGY;

EID: 84891892050     PISSN: 17425689     EISSN: 17425662     Source Type: Journal    
DOI: 10.1098/rsif.2013.0505     Document Type: Article

References (240)

1. Mesarović MD. 1968 Systems theory and biology - view of a theoretician. In Systems Theory and Biology: Proc., III Systems Symp. at Case Institute of Technology, pp. 59-87. New York, NY: Springer. (doi:10.1007/978-3- 642-88343-9-3)
2. Csete ME, Doyle JC. 2002 Reverse engineering of biological complexity. Science 295, 1664-1669. (doi:10.1126/science.1069981)
3. Alon U. 2003 Biological networks: the tinkerer as an engineer. Science 301, 1866-1867. (doi:10.1126/science.1089072)
4. Stelling J, Klamt S, Bettenbrock K, Schuster S, Gilles ED. 2002 Metabolic network structure determines key aspects of functionality and regulation. Nature 420, 190-193. (doi:10.1038/nature01166)
5. Wolkenhauer O, Mesarović M. 2005 Feedback dynamics and cell function: why systems biology is called systems biology. Mol. Biosyst. 1, 14-16. (doi:10.1039/b502088n)
6. Doyle FJ, Stelling J. 2006 Systems interface biology. J. R. Soc. Interface 3, 603-616. (doi:10.1098/rsif.2006.0143)
7. Kremling A, Saez-Rodriguez J. 2007 Systems biology - an engineering perspective. J. Biotechnol. 129, 329-351. (doi:10.1016/j.jbiotec.2007.02.009)
8. Sontag ED. 2004 Some new directions in control theory inspired by systems biology. Syst. Biol. 1, 9-18. (doi:10.1049/sb:20045006)
9. Khammash M, El-Samad H. 2004 Systems biology: from physiology to gene regulation. IEEE Contr. Syst. 24, 62-76. (doi:10.1109/MCS.2004.1316654)
10. Karr JR, Sanghvi JC, Macklin DN, Gutschow MV, Jacobs JM, Bolival B, Assad-Garcia N, Glass JI, Covert MW. 2012 A whole-cell computational model predicts phenotype from genotype. Cell 150, 389-401. (doi:10.1016/j.cell.2012. 05.044)
11. Coveney PV, Fowler PW. 2005 Modelling biological complexity: a physical scientist's perspective. J. R. Soc. Interface 2, 267-280. (doi:10.1098/rsif. 2005.0045)
12. Noble D. 2002 Modeling the heart - from genes to cells to the whole organ. Science 295, 1678-1682. (doi:10.1126/science.1069881)
13. Dada JO, Mendes P. 2011 Multi-scale modelling and simulation in systems biology. Integr. Biol. 3, 86-96. (doi:10.1039/c0ib00075b)
14. Di Ventura B, Lemerle C, Michalodimitrakis K, Serrano L. 2006 From in vivo to in silico biology and back. Nature 443, 527-533. (doi:10.1038/ nature05127)
15. Jaeger J, Crombach A. 2012 Life's attractors. In (ed. OS Soyer) Evolutionary systems biology, pp. 93-119. Berlin, Germany: Springer.
16. Crombach A, Wotton KR, Cicin-Sain D, Ashyraliyev M, Jaeger J. 2012 Efficient reverse-engineering of a developmental gene regulatory network. PLoS Comput. Biol. 8, e1002589. (doi:10.1371/journal.pcbi.1002589)
17. Marchisio MA, Stelling J. 2011 Automatic design of digital synthetic gene circuits. PLoS Comput. Biol. 7, e1001083. (doi:10.1371/journal.pcbi.1001083)
18. Stelling J. 2004 Mathematical models in microbial systems biology. Curr. Opin. Microbiol. 7, 513-518. (doi:10.1016/j.mib.2004.08.004)
19. Bader JS, Chaudhuri A, Rothberg JM, Chant J. 2003 Gaining confidence in high-throughput protein interaction networks. Nat. Biotechnol. 22, 78-85. (doi:10.1038/nbt924)
20. Sharan R, Ideker T. 2006 Modeling cellular machinery through biological network comparison. Nat. Biotechnol. 24, 427-433. (doi:10.1038/nbt1196)
21. Förster J, Famili I, Fu P, Palsson BØ, Nielsen J. 2003 Genome-scale reconstruction of the Saccharomyces cerevisiae metabolic network. Genome Res. 13, 244-253. (doi:10.1101/gr.234503)
22. Llaneras F, Picó J. 2008 Stoichiometric modelling of cell metabolism. J. Biosci. Bioeng. 105, 1-11. (doi:10.1263/jbb.105.1)
23. Machado D, Costa RS, Rocha M, Ferreira EC, Tidor B, Rocha I. 2011 Modeling formalisms in systems biology. AMB Expr. 1, 1-14. (doi:10.1186/2191- 0855-1-45)
24. Tenazinha N, Vinga S. 2011 A survey on methods for modeling and analyzing integrated biological networks. IEEE-ACM Trans. Comput. Biol. Inform. 8, 943-958. (doi:10.1109/TCBB.2010.117)
25. Kholodenko BN. 2006 Cell-signalling dynamics in time and space. Nat. Rev. Mol. Cell Biol. 7, 165-176. (doi:10.1038/nrm1838)
26. Novák B, Tyson JJ. 2008 Design principles of biochemical oscillators. Nat. Rev. Mol. Cell Biol. 9, 981-991. (doi:10.1038/nrm2530)
27. Tyson JJ, Chen KC, Novak B. 2003 Sniffers, buzzers, toggles and blinkers: dynamics of regulatory and signaling pathways in the cell. Curr. Opin. Cell Biol. 15, 221-231. (doi:10.1016/S0955-0674(03) 00017-6)
28. Aldridge BB, Burke JM, Lauffenburger DA, Sorger PK. 2006 Physicochemical modelling of cell signalling pathways. Nat. Cell Biol. 8, 1195-1203. (doi:10.1038/ncb1497)
29. Marbach D, Prill R, Schaffter T, Mattiussi C, Floreano D, Stolovitzky G. 2010 Revealing strengths and weaknesses of methods for gene network inference. Proc. Natl Acad. Sci. USA 107, 6286-6291. (doi:10.1073/pnas.0913357107)
30. Price ND, Papin JA, Schilling CH, Palsson BO. 2003 Genome-scale microbial in silico models: the constraints-based approach. Trends Biotechnol. 21, 162-169. (doi:10.1016/S0167-7799(03)00030-1)
31. Orth JD, Thiele I, Palsson BØ. 2010 What is flux balance analysis? Nat. Biotechnol. 28, 245-248. (doi:10.1038/nbt.1614)
32. Hyduke DR, Lewis NE, Palsson BØ. 2013 Analysis of omics data with genome-scale models of metabolism. Mol. BioSyst. 9, 167-174. (doi:10.1039/c2mb25453k)
33. Bayarri MJ, Berger JO. 2004 The interplay of Bayesian and frequentist analysis. Stat. Sci. 19, 58-80. (doi:10.1214/088342304000000116)
34. Cox DR. 2006 Principles of statistical inference. Cambridge, UK: Cambridge University Press.
35. McGrayne SB. 2011 The theory that would not die: how Bayes rule cracked the enigma code, hunted down Russian submarines, and emerged triumphant from two centuries of controversy. New Haven, CT: Yale University Press.
36. Carlin BP, Louis TA. 1997 Bayes and empirical Bayes methods for data analysis. Stat. Comput. 7, 153-154. (doi:10.1023/A:1018577817064)
37. Geman S, Geman D. 1984 Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Trans. Pattern Anal. Mach. Intell. 6, 721-741. (doi:10.1109/TPAMI.1984.4767596)
38. Gelfand AE, Smith AF. 1990 Sampling-based approaches to calculating marginal densities. J. Amer. Stat. Assoc. 85, 398-409. (doi:10.1080/01621459. 1990.10476213)
39. Gilks WR, Richardson S, Spiegelhalter DJ. 1996 Markov chain Monte Carlo in practice, vol. 2. Boca Raton, FL: CRC press.
40. Smith AF, Roberts GO. 1993 Bayesian computation via the Gibbs sampler and related Markov chain Monte Carlo methods. J. R. Stat. Soc. B 55, 3-23.
41. Silver N. 2012 The signal and the noise: why so many predictions fail - but some don't. Baltimore, MD: Penguin Press.
42. Wilkinson DJ. 2007 Bayesian methods in bioinformatics and computational systems biology. Brief. Bioinform. 8, 109-116. (doi:10.1093/bib/bbm007)
43. Needham CJ, Bradford JR, Bulpitt AJ, Westhead DR. 2007 A primer on learning in Bayesian networks for computational biology. PLoS Comp. Biol. 3, e129. (doi:10.1371/journal.pcbi.0030129)
44. Lawrence ND, Girolami M, Rattray M, Sanguinetti G. 2010 Learning and inference in computational systems biology. Cambridge, UK: MIT Press.
45. D'Haeseleer P, Liang S, Somogyi R. 2000 Genetic network inference: from co-expression clustering to reverse engineering. Bioinformatics 16, 707-726. (doi:10.1093/bioinformatics/16.8.707)
46. Bansal M, Belcastro V, Ambesi-Impiombato A, Di Bernardo D. 2007 How to infer gene networks from expression profiles. Mol. Syst. Biol. 3, 122.
47. De Smet R, Marchal K. 2010 Advantages and limitations of current network inference methods. Nat. Rev. Microbiol. 8, 717-729.
48. Penfold CA, Wild DL. 2011 How to infer gene networks from expression profiles, revisited. Interface Focus 1, 857-870. (doi:10.1098/rsfs.2011.0053)
49. López-Kleine L, Leal L, López C. 2013 Biostatistical approaches for the reconstruction of gene coexpression networks based on transcriptomic data. Brief. Funct. Genomics 12, 457-467. (doi:10.1093/bfgp/ elt003)
50. Friedman N. 2004 Inferring cellular networks using probabilistic graphical models. Science 303, 799-805. (doi:10.1126/science.1094068)
51. Markowetz F, Spang R. 2007 Inferring cellular networks-a review. BMC Bioinform. 8(Suppl. 6), S5. (doi:10.1186/1471-2105-8-S6-S5)
52. Villaverde AF, Ross J, Banga JR. 2013 Reverse engineering cellular networks with information theoretic methods. Cells 2, 306-329. (doi:10.3390/cells2020306)
53. Butte A, Tamayo P, Slonim D, Golub T, Kohane I. 2000 Discovering functional relationships between RNA expression and chemotherapeutic susceptibility using relevance networks. Proc. Natl Acad. Sci. USA 97, 12 182-12 186. (doi:10.1073/pnas.220392197)
54. Stuart J, Segal E, Koller D, Kim S. 2003 A gene-coexpression network for global discovery of conserved genetic modules. Science 302, 249-255. (doi:10.1126/science.1087447)
55. Arkin A, Ross J. 1995 Statistical construction of chemical reaction mechanisms from measured time-series. J. Phys. Chem. 99, 970-979. (doi:10.1021/j100003a020)
56. Arkin A, Shen P, Ross J. 1997 A test case of correlation metric construction of a reaction pathway from measurements. Science 277, 1275-1279. (doi:10.1126/science.277.5330.1275)
57. Székely G, Rizzo M, Bakirov N. 2007 Measuring and testing dependence by correlation of distances. Ann. Stat. 35, 2769-2794. (doi:10.1214/009053607000000505)
58. Szekely G, Rizzo M. 2009 Brownian distance correlation. Ann. Appl. Stat. 3, 1236-1265. (doi:10.1214/09-AOAS312)
59. Roy A, Post C. 2012 Detection of long-range concerted motions in protein by a distance covariance. J. Chem. Theory Comput. 8, 3009-3014. (doi:10.1021/ct300565f)
60. Kong J, Klein B, Klein R, Lee K, Wahba G. 2012 Using distance correlation and SS-ANOVA to assess associations of familial relationships, lifestyle factors, diseases, and mortality. Proc. Natl Acad. Sci. USA 109, 20 352-20 357. (doi:10.1073/pnas.1217269109)
61. Shannon C. 1948 A mathematical theory of communication. Bell Syst. Tech. J. 27, 379-423. (doi:10.1002/j.1538-7305.1948.tb01338.x)
62. Cover T, Thomas J. 1991 Elements of information theory. New York, NY: Wiley.
63. Farber R, Lapedes A, Sirotkin K. 1992 Determination of eukaryotic protein coding regions using neural networks and information theory. J. Mol. Biol. 226, 471-479. (doi:10.1016/0022-2836(92)90961-I)
64. Korber B, Farber R, Wolpert D, Lapedes A. 1993 Covariation of mutations in the v3 loop of human immunodeficiency virus type 1 envelope protein: an information theoretic analysis. Proc. Natl Acad. Sci. USA 90, 7176-7180. (doi:10.1073/pnas. 90.15.7176)
65. Liang S, Fuhrman S, Somogyi R. 1998 Reveal, a general reverse engineering algorithm for inference of genetic network architectures. Pac. Symp. Biocomput. 3, 18-29.
66. Michaels G, Carr D, Askenazi M, Fuhrman S, Wen X, Somogyi R. 1998 Cluster analysis and data visualization of large scale gene expression data. Pac. Symp. Biocomput. 3, 42-53.
67. Butte A, Kohane I. 2000 Mutual information relevance networks: functional genomic clustering using pairwise entropy measurements. Pac. Symp. Biocomput. 5, 418-429.
68. Margolin A, Wang K, Lim W, Kustagi M, Nemenman I, Califano A. 2006 Reverse engineering cellular networks. Nat. Protoc. 1, 662-671. (doi:10.1038/nprot.2006.106)
69. Zoppoli P, Morganella S, Ceccarelli M. 2010 TimeDelay-ARACNE: reverse engineering of gene networks from time-course data by an information theoretic approach. BMC Bioinform. 11, 154. (doi:10.1186/1471-2105-11-154)
70. Steuer R, Kurths J, Daub C, Weise J, Selbig J. 2002 The mutual information: detecting and evaluating dependencies between variables. Bioinformatics 18(Suppl. 2), S231-S240. (doi:10.1093/bioinformatics/18.suppl-2. S231)
71. Cellucci C, Albano A, Rapp P. 2005 Statistical validation of mutual information calculations: comparison of alternative numerical algorithms. Phys. Rev. E 71, 066208. (doi:10.1103/PhysRevE.71.066208)
72. Moon Y, Rajagopalan B, Lall U. 1995 Estimation of mutual information using kernel density estimators. Phys. Rev. E 52, 2318-2321. (doi:10.1103/PhysRevE.52.2318)
73. de Matos Simoes R, Emmert-Streib F. 2011 Influence of statistical estimators of mutual information and data heterogeneity on the inference of gene regulatory networks. PLoS ONE 6, e29279. (doi:10.1371/journal.pone.0029279)
74. Meyer PE, Kontos K, Lafitte F, Bontempi G. 2007 Information-theoretic inference of large transcriptional regulatory networks. EURASIP J. Bioinform. Syst. Biol. 2007, 79879. (doi:10.1155/2007/79879)
75. Luo W, Hankenson K, Woolf P. 2008 Learning transcriptional regulatory networks from high throughput gene expression data using continuous three-way mutual information. BMC Bioinform. 9, 467. (doi:10.1186/1471-2105-9-467)
76. Samoilov M. 1997 Reconstruction and functional analysis of general chemical reactions and reaction networks. PhD thesis, Stanford University, CA, USA.
77. Faith J, Hayete B, Thaden J, Mogno I, Wierzbowski J, Cottarel G, Kasif S, Collins J, Gardner T. 2007 Large-scale mapping and validation of Escherichia coli transcriptional regulation from a compendium of expression profiles. PLoS Biol. 5, e8. (doi:10.1371/journal.pbio.0050008)
78. Bonneau R, Reiss D, Shannon P, Facciotti M, Hood L, Baliga N, Thorsson V. 2006 The inferelator: an algorithm for learning parsimonious regulatory networks from systems-biology data sets de novo. Genome Biol. 7, R36. (doi:10.1186/gb-2006-7-5-r36)
79. Greenfield A, Madar A, Ostrer H, Bonneau R. 2010 DREAM4: combining genetic and dynamic information to identify biological networks and dynamical models. PLoS ONE 5, e13397. (doi:10.1371/journal.pone.0013397)
80. Reshef D, Reshef Y, Finucane H, Grossman S, McVean G, Turnbaugh P, Lander E, Mitzenmacher M, Sabeti P. 2011 Detecting novel associations in large data sets. Science 334, 1518-1524. (doi:10. 1126/science.1205438)
81. Cantone I et al. 2009 A yeast synthetic network for in vivo assessment of reverse-engineering and modeling approaches. Cell 137, 172-181. (doi:10.1016/j.cell.2009.01.055)
82. Villaverde AF, Ross J, Morán F, Banga JR. 2013 Mider: network inference with mutual information distance and entropy reduction. See http://www.iim.csic.es/gingproc/mider.html.
83. Larranaga P, Inza I, Flores JL. 2005 A guide to the literature on inferring genetic networks by probabilistic graphical models. In Data analysis and visualization in genomics and proteomics (eds F Azuaje, J Dopazo), pp. 215. New York, NY: Wiley.
84. Chickering D. 1996 Learning Bayesian networks is NP-complete. In Learning from data: artificial intelligence and statistics (eds D Fisher, H-J Lenz), pp. 121-130. New York, NY: Springer.
85. Beaumont MA, Zhang W, Balding DJ. 2002 Approximate Bayesian computation in population genetics. Genetics 162, 2025-2035.
86. Toni T, Stumpf MP. 2010 Simulation-based model selection for dynamical systems in systems and population biology. Bioinformatics 26, 104-110. (doi:10.1093/bioinformatics/btp619)
87. Cooper G, Herskovits E. 1992 A Bayesian method for the induction of probabilistic networks from data. Mach. Learn. 9, 309-347. (doi:10.1007/ BF00994110)
88. Friedman N, Linial M, Nachman I, Pe'er D. 2000 Using Bayesian networks to analyze expression data. J. Comput. Biol. 7, 601-620. (doi:10.1089/ 106652700750050961)
89. Yu J, Smith V, Wang P, Hartemink A, Jarvis E. 2004 Advances to Bayesian network inference for generating causal networks from observational biological data. Bioinformatics 20, 3594-3603. (doi:10.1093/bioinformatics/bth448)
90. Kim S, Imoto S, Miyano S. 2003 Inferring gene networks from time series microarray data using dynamic Bayesian networks. Brief. Bioinform. 4, 228-235. (doi:10.1093/bib/4.3.228)
91. Kim S, Imoto S, Miyano S. 2004 Dynamic Bayesian network and nonparametric regression for nonlinear modeling of gene networks from time series gene expression data. Biosystems 75, 57-65. (doi:10.1016/j.biosystems.2004.03.004)
92. Dondelinger F, Husmeier D, Lébre S. 2012 Dynamic Bayesian networks in molecular plant science: inferring gene regulatory networks from multiple gene expression time series. Euphytica 183, 361-377. (doi:10.1007/s10681-011- 0538-3)
93. Camacho D, Vera Licona P, Mendes P, Laubenbacher R. 2007 Comparison of reverse-engineering methods using an in silico network. Ann. NY Acad. Sci. 1115, 73-89. (doi:10.1196/annals.1407.006)
94. Prill RJ, Marbach D, Saez-Rodriguez J, Sorger PK, Alexopoulos LG, Xue X, Clarke ND, Altan-Bonnet G, Stolovitzky G. 2010 Towards a rigorous assessment of systems biology models: the DREAM3 challenges. PLoS ONE 5, e9202. (doi:10.1371/journal.pone.0009202)
95. Kirsch A. 2011 An introduction to the mathematical theory of inverse problems, vol. 120. New York, NY: Springer Science + Business Media.
96. Tarantola A. 2005 Inverse problem theory and methods for model parameter estimation. Philadelphia, PA: Society for Industrial and Applied Mathematics.
97. Hadamard J. 1902 Sur les problèmes aux dérivées partielles et leur signification physique. Princet. Univ. Bull. 13, 28.
98. Kohavi R et al. 1995 A study of cross-validation and bootstrap for accuracy estimation and model selection. In Int. Joint Conf. on Artificial Intelligence, vol. 14, pp. 1137-1145. London, UK: Lawrence Erlbaum Associates Ltd.
99. Picard RR, Cook RD. 1984 Cross-validation of regression models. J. Am. Stat. Assoc. 79, 575-583. (doi:10.1080/01621459.1984.10478083)
100. Tikhonov AN, Goncharsky A, Stepanov V, Yagola A. 1995 Numerical methods for the solution of ill-posed problems. Dordrecht, The Netherlands: Kluwer Academic Publishers.
101. Engl HW, Flamm C, Kügler P, Lu J, Müller S, Schuster P. 2009 Inverse problems in systems biology. Inverse Probl. 25, 123014. (doi:10.1088/0266-5611/25/12/123014)
102. Boyd S, Vandenberghe L. 2004 Convex optimization. Cambridge, UK: Cambridge University Press.
103. Schittkowski K. 2002 Numerical data fitting in dynamical systems: a practical introduction with applications and software, vol. 77. Dordrecht, The Netherlands: Kluwer Academic Publishers.
104. Kan A, Timmer G. 1985 A stochastic approach to global optimization. Numer. Optim. 84, 245-262.
105. Horst R, Romeijn HE. 2002 Handbook of global optimization, vol. 2. Dordrecht, The Netherlands: Kluwer Academic Publishers.
106. Floudas C, Gounaris C. 2009 A review of recent advances in global optimization. J. Glob. Optim. 45, 3-38. (doi:10.1007/s10898-008-9332-8)
107. Esposito WR, Floudas CA. 2000 Global optimization for the parameter estimation of differential-algebraic systems. Ind. Eng. Chem. Res. 39, 1291-1310. (doi:10.1021/ie990486w)
108. Miró A, Pozo C, Guillén-Gosálbez G, Egea JA, Jiménez L. 2012 Deterministic global optimization algorithm based on outer approximation for the parameter estimation of nonlinear dynamic biological systems. BMC Bioinform. 13, 90. (doi:10.1186/1471-2105-13-90)
109. Zhu W. 2006 Unsolvability of some optimization problems. Appl. Math. Comput. 174, 921-926. (doi:10.1016/j.amc.2005.05.025)
110. Murty KG, Kabadi SN. 1987 Some NP-complete problems in quadratic and nonlinear programming. Math. Program 39, 117-129. (doi:10.1007/BF02592948)
111. Fortnow L. 2009 The status of the P versus NP problem. Commun. ACM 52, 78-86. (doi:10.1145/1562164.1562186)
112. Moles CG, Mendes P, Banga JR. 2003 Parameter estimation in biochemical pathways: a comparison of global optimization methods. Genome Res. 13, 2467-2474. (doi:10.1101/gr.1262503)
113. Egea JA, Rodrguez-Fernández M, Banga JR, Mart R. 2007 Scatter search for chemical and bio-process optimization. J. Glob. Optim. 37, 481-503. (doi:10.1007/s10898-006-9075-3)
114. Rodriguez-Fernandez M, Egea JA, Banga JR. 2006 Novel metaheuristic for parameter estimation in nonlinear dynamic biological systems. BMC Bioinform. 7, 483. (doi:10.1186/1471-2105-7-483)
115. Banga JR. 2008 Optimization in computational systems biology. BMC Syst. Biol. 2, 47. (doi:10.1186/1752-0509-2-47)
116. Villaverde A, Egea J, Banga J. 2012 A cooperative strategy for parameter estimation in large scale systems biology models. BMC Syst. Biol. 6, 75. (doi:10.1186/1752-0509-6-75)
117. Kotte O, Heinemann M. 2009 A divide-and-conquer approach to analyze underdetermined biochemical models. Bioinformatics 25, 519-525. (doi:10.1093/bioinformatics/btp004)
118. Wolpert DH, Macready WG. 1997 No free lunch theorems for optimization. IEEE Trans. Evol. Comput. 1, 67-82. (doi:10.1109/4235.585893)
119. Ho Y-C. 1999 The no free lunch theorem and the human-machine interface. IEEE Contr. Syst. 19, 8-10. (doi:10.1109/37.768535)
120. Ljung L. 1999 System identification. New York, NY: Wiley Online Library.
121. Walter E, Pronzato L. 1997 Identification of parametric models from experimental data. Communications and Control Engineering Series. London, UK: Springer.
122. Ljung L. 2010 Perspectives on system identification. Annu. Rev. Control 34, 1-12. (doi:10.1016/j.arcontrol.2009.12.001)
123. Bekey GA, Beneken JE. 1978 Identification of biological systems: a survey. Automatica 14, 41-47. (doi:10.1016/0005-1098(78)90075-4)
124. Wiener N. 1948 Cybernetics: or, control and communication in the animal and the machine. New York, NY: Wiley.
125. Von Bertalanffy L. 1968 General system theory: foundations, development, applications. New York, NY: George Braziller.
126. Cury JE, Baldissera FL. 2013 Systems biology, synthetic biology and control theory: a promising golden braid. Ann. Rev. Control 37, 57-67. (doi:10.1016/j.arcontrol.2013.03.006)
127. Bellman R, Åström K. 1970 On structural identifiability. Math. Biosci. 7, 329-339. (doi:10.1016/0025-5564(70)90132-X)
128. Cobelli C, Distefano 3rd JJ. 1980 Parameter and structural identifiability concepts and ambiguities: a critical review and analysis. Am. J. Physiol. 239, R7-R24.
129. Kremling A, Fischer S, Gadkar K, Doyle F, Sauter T, Bullinger E, Allgower F, Gilles E. 2004 A benchmark for methods in reverse engineering and model discrimination: problem formulation and solutions. Genome Res. 14, 1773-1785. (doi:10.1101/gr.1226004)
130. Jaqaman K, Danuser G. 2006 Linking data to models: data regression. Nat. Rev. Mol. Cell Biol. 7, 813-819. (doi:10.1038/nrm2030)
131. Nikerel IE, van Winden WA, Verheijen PJ, Heijnen JJ. 2009 Model reduction and a priori kinetic parameter identifiability analysis using metabolome time series for metabolic reaction networks with linlog kinetics. Metab. Eng. 11, 20-30. (doi:10.1016/j.ymben.2008.07.004)
132. Quaiser T, Mönnigmann M. 2009 Systematic identifiability testing for unambiguous mechanistic modeling - application to JAK-STAT, map kinase, and NF-κb signaling pathway models. BMC Syst. Biol. 3, 50. (doi:10.1186/1752-0509-3-50)
133. Raue A, Kreutz C, Maiwald T, Bachmann J, Schilling M, Klingmüller U, Timmer J. 2009 Structural and practical identifiability analysis of partially observed dynamical models by exploiting the profile likelihood. Bioinformatics 25, 1923-1929. (doi:10.1093/bioinformatics/btp358)
134. Ashyraliyev M, Fomekong-Nanfack Y, Kaandorp JA, Blom JG. 2009 Systems biology: parameter estimation for biochemical models. FEBS J. 276, 886-902. (doi:10.1111/j.1742-4658.2008.06844.x)
135. Balsa-Canto E, Alonso AA, Banga JR. 2010 An iterative identification procedure for dynamic modeling of biochemical networks. BMC Syst. Biol. 4, 11. (doi:10.1186/1752-0509-4-11)
136. Srinath S, Gunawan R. 2010 Parameter identifiability of power-law biochemical system models. J. Biotechnol. 149, 132-140. (doi:10.1016/j.jbiotec. 2010.02.019)
137. Nemcová J. 2010 Structural identifiability of polynomial and rational systems. Math. Biosci. 223, 83-96. (doi:10.1016/j.mbs.2009.11.002)
138. Chis O-T, Banga JR, Balsa-Canto E. 2011 Structural identifiability of systems biology models: a critical comparison of methods. PLoS ONE 6, e27755. (doi:10.1371/journal.pone.0027755)
139. Berthoumieux S, Brilli M, Kahn D, De Jong H, Cinquemani E. 2012 On the identifiability of metabolic network models. J. Math. Biol. 67, 1795-1832. (doi:10.1007/s00285-012-0614-x)
140. Vanlier J, Tiemann C, Hilbers P, van Riel N. In press. Parameter uncertainty in biochemical models described by ordinary differential equations. Math. Biosci. (doi:10.1016/j.mbs.2013.03.006)
141. Cedersund G. 2012 Conclusions via unique predictions obtained despite unidentifiability - new definitions and a general method. FEBS J. 279, 3513-3527. (doi:10.1111/j.1742-4658.2012.08725.x)
142. Schaber J, Klipp E. 2011 Model-based inference of biochemical parameters and dynamic properties of microbial signal transduction networks. Curr. Opin. Biotechnol. 22, 109-116. (doi:10.1016/j.copbio.2010.09.014)
143. Lillacci G, Khammash M. 2010 Parameter estimation and model selection in computational biology. PLoS Comput. Biol. 6, e1000696. (doi:10.1371/journal. pcbi.1000696)
144. Bandara S, Schlöder JP, Eils R, Bock HG, Meyer T. 2009 Optimal experimental design for parameter estimation of a cell signaling model. PLoS Comput. Biol. 5, e1000558. (doi:10.1371/journal.pcbi.1000558)
145. Balsa-Canto E, Alonso AA, Banga JR. 2008 Computational procedures for optimal experimental design in biological systems. IET Syst. Biol. 2, 163-172. (doi:10.1049/iet-syb:20070069)
146. Banga J, Balsa-Canto E. 2008 Parameter estimation and optimal experimental design. Essays Biochem. 45, 195-210. (doi:10.1042/BSE0450195)
147. Apgar JF, Toettcher JE, Endy D, White FM, Tidor B. 2008 Stimulus design for model selection and validation in cell signaling. PLoS Comput. Biol. 4, e30. (doi:10.1371/journal.pcbi.0040030)
148. He F, Brown M, Yue H. 2010 Maximin and Bayesian robust experimental design for measurement set selection in modelling biochemical regulatory systems. Int. J. Robust Nonlinear Control 20, 1059-1078. (doi:10.1002/rnc.1558)
149. Mélykúti B, August E, Papachristodoulou A, El-Samad H. 2010 Discriminating between rival biochemical network models: three approaches to optimal experiment design. BMC Syst. Biol. 4, 38. (doi:10.1186/1752-0509-4-38)
150. Skanda D, Lebiedz D. 2010 An optimal experimental design approach to model discrimination in dynamic biochemical systems. Bioinformatics 26, 939-945. (doi:10.1093/bioinformatics/btq074)
151. Flassig R, Sundmacher K. 2012 Optimal design of stimulus experiments for robust discrimination of biochemical reaction networks. Bioinformatics 28, 3089-3096. (doi:10.1093/bioinformatics/bts585)
152. Stegmaier J, Skanda D, Lebiedz D. 2013 Robust optimal design of experiments for model discrimination using an interactive software tool. PLoS ONE 8, e55723. (doi:10.1371/journal.pone.0055723)
153. Tegner J, Yeung MS, Hasty J, Collins JJ. 2003 Reverse engineering gene networks: integrating genetic perturbations with dynamical modeling. Proc. Natl Acad. Sci. USA 100, 5944-5949. (doi:10.1073/pnas.0933416100)
154. Ingolia NT, Weissman JS. 2008 Systems biology: reverse engineering the cell. Nature 454, 1059-1062. (doi:10.1038/4541059a)
155. Mettetal JT, Muzzey D, Gómez-Uribe C, van Oudenaarden A. 2008 The frequency dependence of osmo-adaptation in Saccharomyces cerevisiae. Sci. Signal 319, 482.
156. Bennett MR, Pang WL, Ostroff NA, Baumgartner BL, Nayak S, Tsimring LS, Hasty J. 2008 Metabolic gene regulation in a dynamically changing environment. Nature 454, 1119-1122. (doi:10.1038/nature07211)
157. Kaltenbach H-M, Dimopoulos S, Stelling J. 2009 Systems analysis of cellular networks under uncertainty. FEBS Lett. 583, 3923-3930. (doi:10.1016/j.febslet.2009.10.074)
158. Kuepfer L, Peter M, Sauer U, Stelling J. 2007 Ensemble modeling for analysis of cell signaling dynamics. Nat. Biotechnol. 25, 1001-1006. (doi:10.1038/nbt1330)
159. Tan Y, Lafontaine Rivera JG, Contador CA, Asenjo JA, Liao JC. 2011 Reducing the allowable kinetic space by constructing ensemble of dynamic models with the same steady-state flux. Metab. Eng. 13, 60-75. (doi:10.1016/j.ymben. 2010.11.001)
160. Marbach D et al. 2012 Wisdom of crowds for robust gene network inference. Nat. Methods 9, 796-804. (doi:10.1038/nmeth.2016)
161. Tigges M, Marquez-Lago TT, Stelling J, Fussenegger M. 2009 A tunable synthetic mammalian oscillator. Nature 457, 309-312. (doi:10.1038/nature07616)
162. Holtz WJ, Keasling JD. 2010 Engineering static and dynamic control of synthetic pathways. Cell 140, 19-23. (doi:10.1016/j.cell.2009.12.029)
163. Menolascina F, Di Bernardo M, Di Bernardo D. 2011 Analysis, design and implementation of a novel scheme for in-vivo control of synthetic gene regulatory networks. Automatica 47, 1265-1270. (doi:10.1016/j.automatica.2011. 01.073)
164. Menolascina F, Siciliano V, di Bernardo D. 2012 Engineering and control of biological systems: a new way to tackle complex diseases. FEBS Lett. 586, 2122-2128. (doi:10.1016/j.febslet.2012.04.050)
165. Milias-Argeitis A, Summers S, Stewart-Ornstein J, Zuleta I, Pincus D, El-Samad H, Khammash M, Lygeros J. 2011 In silico feedback for in vivo regulation of a gene expression circuit. Nat. Biotechnol. 29, 1114-1116. (doi:10.1038/nbt.2018)
166. Sootla A, Strelkowa N, Ernst D, Barahona M, Stan G-B. 2013 Toggling a genetic switch using reinforcement learning. (http://arxiv.org/abs/1303.3183).
167. Uhlendorf J, Miermont A, Delaveau T, Charvin G, Fages F, Bottani S, Batt G, Hersen P. 2012 Long-term model predictive control of gene expression at the population and single-cell levels. Proc. Natl Acad. Sci. USA 109, 14 271-14 276. (doi:10.1073/pnas.1206810109)
168. Horn F, Jackson R. 1972 General mass action kinetics. Arch. Rat. Mech. Anal. 47, 81-116. (doi:10.1007/BF00251225)
169. Feinberg M. 1972 Complex balancing in general kinetic systems. Arch. Rat. Mech. Anal. 49, 187-194. (doi:10.1007/BF00255665)
170. Feinberg M, Horn FJ. 1974 Dynamics of open chemical systems and the algebraic structure of the underlying reaction network. Chem. Eng. Sci. 29, 775-787. (doi:10.1016/0009-2509(74)80195-8)
171. Bailey JE. 2001 Complex biology with no parameters. Nat. Biotechnol. 19, 503-504. (doi:10.1038/89204)
172. Craciun G, Tang Y, Feinberg M. 2006 Understanding bistability in complex enzyme-driven reaction networks. Proc. Natl Acad. Sci. USA 103, 8697-8702. (doi:10.1073/pnas.0602767103)
173. Wang L, Sontag ED. 2008 On the number of steady states in a multiple futile cycle. J. Math. Biol. 57, 29-52. (doi:10.1007/s00285-007-0145-z)
174. Otero-Muras I, Banga JR, Alonso AA. 2009 Exploring multiplicity conditions in enzymatic reaction networks. Biotechnol. Prog. 25, 619-631. (doi:10.1002/btpr.112)
175. Craciun G, Feinberg M. 2010 Multiple equilibria in complex chemical reaction networks: semiopen mass action systems. SIAM J. Appl. Math. 70, 1859-1877. (doi:10.1137/090756387)
176. Szederkényi G. 2010 Computing sparse and dense realizations of reaction kinetic systems. J. Math. Chem. 47, 551-568. (doi:10.1007/s10910-009- 9525-5)
177. Szederkényi G, Hangos KM. 2011 Finding complex balanced and detailed balanced realizations of chemical reaction networks. J. Math. Chem. 49, 1163-1179. (doi:10.1007/s10910-011-9804-9)
178. Shinar G, Feinberg M. 2011 Design principles for robust biochemical reaction networks: what works, what cannot work, and what might almost work. Math. Biosci. 231, 39-48. (doi:10.1016/j.mbs.2011.02.012)
179. Shinar G, Feinberg M. 2010 Structural sources of robustness in biochemical reaction networks. Science 327, 1389-1391. (doi:10.1126/science. 1183372)
180. Craciun G, Pantea C. 2008 Identifiability of chemical reaction networks. J. Math. Chem. 44, 244-259. (doi:10.1007/s10910-007-9307-x)
181. Szederkényi G, Banga J, Alonso A. 2011 Inference of complex biological networks: distinguishability issues and optimization-based solutions. BMC Syst. Biol. 5, 177. (doi:10.1186/1752-0509-5-177)
182. Yeung M, Tegnér J, Collins J. 2002 Reverse engineering gene networks using singular value decomposition and robust regression. Proc. Natl Acad. Sci. USA 99, 6163-6168. (doi:10.1073/pnas.092576199)
183. Hayete B, Gardner TS, Collins JJ. 2007 Size matters: network inference tackles the genome scale. Mol. Syst. Biol. 3, 77. (doi:10.1038/msb4100118)
184. Efron B. 2013 A 250-year argument: belief, behavior, and the bootstrap. Bull. Am. Math. Soc. 50, 129-146. (doi:10.1090/S0273-0979-2012-01374-5)
185. Stumpf M, Balding DJ, Girolami M. 2011 Handbook of statistical systems biology. New York, NY: Wiley.
186. Golightly A, Wilkinson DJ. 2008 Bayesian inference for nonlinear multivariate diffusion models observed with error. Comput. Stat. Data Anal. 52, 1674-1693. (doi:10.1016/j.csda.2007.05.019)
187. Wilkinson DJ. 2012 Stochastic modelling for systems biology, vol. 44. Boca Raton, FL: CRC press.
188. Battogtokh D, Asch D, Case M, Arnold J, Schüttler H-B. 2002 An ensemble method for identifying regulatory circuits with special reference to the qa gene cluster of Neurospora crassa. Proc. Natl Acad. Sci. USA 99, 16 904-16 909. (doi:10.1073/pnas.262658899)
189. Brown KS, Sethna JP. 2003 Statistical mechanical approaches to models with many poorly known parameters. Phys. Rev. E 68, 021904. (doi:10.1103/ PhysRevE.68.021904)
190. Sanguinetti G, Lawrence ND, Rattray M. 2006 Probabilistic inference of transcription factor concentrations and gene-specific regulatory activities. Bioinformatics 22, 2775-2781. (doi:10.1093/bioinformatics/btl473)
191. Girolami M. 2008 Bayesian inference for differential equations. Theor. Comput. Sci. 408, 4-16. (doi:10.1016/j.tcs.2008.07.005)
192. Vyshemirsky V, Girolami MA. 2008 Bayesian ranking of biochemical system models. Bioinformatics 24, 833-839. (doi:10.1093/bioinformatics/btm607)
193. Marjoram P, Molitor J, Plagnol V, Tavaré S. 2003 Markov chain Monte Carlo without likelihoods. Proc. Natl Acad. Sci. USA 100, 15 324-15 328. (doi:10.1073/pnas.0306899100)
194. Sisson S, Fan Y, Tanaka MM. 2007 Sequential Monte Carlo without likelihoods. Proc. Natl Acad. Sci. USA 104, 1760-1765. (doi:10.1073/pnas. 0607208104)
195. Secrier M, Toni T, Stumpf MP. 2009 The ABC of reverse engineering biological signalling systems. Mol. Biosyst. 5, 1925-1935. (doi:10.1039/ b908951a)
196. Toni T, Welch D, Strelkowa N, Ipsen A, Stumpf MP. 2009 Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems. J. R. Soc. Interface 6, 187-202. (doi:10.1098/rsif.2008.0172)
197. Xu T-R et al. 2010 Inferring signaling pathway topologies from multiple perturbation measurements of specific biochemical species. Sci. Signal. 3, ra20. (doi:10.1126/scisignal.2000517)
198. Eydgahi H, Chen WW, Muhlich JL, Vitkup D, Tsitsiklis JN, Sorger PK. 2013 Properties of cell death models calibrated and compared using Bayesian approaches. Mol. Syst. Biol. 9, 644. (doi:10.1038/msb.2012.69)
199. Liepe J, Filippi S, Komorowski M, Stumpf MP. 2013 Maximizing the information content of experiments in systems biology. PLoS Comput. Biol. 9, e1002888. (doi:10.1371/journal.pcbi.1002888)
200. Raue A, Kreutz C, Theis FJ, Timmer J. 2013 Joining forces of Bayesian and frequentist methodology: a study for inference in the presence of non-identifiability. Phil. Trans. R. Soc. A 371, 20110544. (doi:10.1098/rsta. 2011.0544)
201. Hug S, Raue A, Hasenauer J, Bachmann J, Klingmüller U, Timmer J, Theis F. In press. High-dimensional Bayesian parameter estimation: case study for a model of JAK2/STAT5 signaling. Math. Biosci. (doi:10.1016/j.mbs.2013.04. 002)()
202. Rasmussen C, Williams C. 2006 Gaussian processes for machine learning. Cambridge, MA: MIT Press.
203. Calderhead B, Girolami M, Lawrence ND. 2008 Accelerating Bayesian inference over nonlinear differential equations with Gaussian processes. In Advances in Neural Information Processing Systems (eds D Koller, D Schuurmans, Y Bengio, L Bottou), pp. 217-224. Neural Information Processing Systems Foundation, http://books.nips.cc/nips21.html.
204. Girolami M, Calderhead B. 2011 Riemann manifold Langevin and Hamiltonian Monte Carlo methods. J. R. Stat. Soc. B 73, 123-214. (doi:10.1111/j.1467-9868. 2010.00765.x)
205. Calderhead B, Girolami M. 2011 Statistical analysis of nonlinear dynamical systems using differential geometric sampling methods. Interface Focus 1, 821-835. (doi:10.1098/rsfs.2011.0051)
206. Schmidl D, Czado C, Hug S, Theis FJ. 2013 A vinecopula based adaptive MCMC sampler for efficient inference of dynamical systems. Bayesian Anal. 8, 1-22. (doi:10.1214/13-BA801)
207. Gutenkunst RN, Waterfall JJ, Casey FP, Brown KS, Myers CR, Sethna JP. 2007 Universally sloppy parameter sensitivities in systems biology models. PLoS Comput. Biol. 3, e189. (doi:10.1371/journal.pcbi.0030189)
208. Apgar JF, Witmer DK, White FM, Tidor B. 2010 Sloppy models, parameter uncertainty, and the role of experimental design. Mol. Biosyst. 6, 1890-1900. (doi:10.1039/b918098b)
209. Chachra R, Transtrum MK, Sethna JP. 2011 Comment on 'sloppy models, parameter uncertainty, and the role of experimental design'. Mol. Biosyst. 7, 2522-2522. (doi:10.1039/c1mb05046j)
210. Hagen DR, Apgar JF, Witmer DK, White FM, Tidor B. 2011 Reply to comment on 'sloppy models, parameter uncertainty, and the role of experimental design'. Mol. Biosyst. 7, 2523-2524. (doi:10.1039/c1mb05200d)
211. Hagen DR, White JK, Tidor B. 2013 Convergence in parameters and predictions using computational experimental design. Interface Focus 3, 20130008. (doi:10.1098/rsfs.2013.0008)
212. Shannon CE. 1949 Communication in the presence of noise. Proc. IRE 37, 10-21. (doi:10.1109/JRPROC. 1949.232969)
213. Candes EJ, Romberg JK, Tao T. 2006 Stable signal recovery from incomplete and inaccurate measurements. Commun. Pure Appl. Math. 59, 1207-1223. (doi:10.1002/cpa.20124)
214. Donoho DL. 2006 Compressed sensing. IEEE Trans. Inform. Theory 52, 1289-1306. (doi:10.1109/TIT.2006.871582)
215. Candès EJ, Romberg J, Tao T. 2006 Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information. IEEE Trans. Inform. Theory 52, 489-509. (doi:10.1109/TIT.2005.862083)
216. Sheikh MA, Milenkovic O, Baraniuk RG. 2007 Designing compressive sensing DNA microarrays. In Computational Advances in Multi-Sensor Adaptive Processing, 2007. CAMPSAP 2007. 2nd IEEE International Workshop on, pp. 141-144. Piscataway Township, NJ: IEEE.
217. Pan W, Yuan Y, Stan G. 2012 Reconstruction of arbitrary biochemical reaction networks: a compressive sensing approach. In Proc. 51st IEEE Conf. Dec. Contr. 10-13 December 2012, Maui, HI, pp. 2334-2339, Piscataway Township, NJ: Institute of Electrical and Electronics Engineers (IEEE). (doi:10.1109/CDC.2012. 6426216)
218. Baldi P, Brunak S. 2001 Bioinformatics: the machine learning approach. Bradford Book. Cambridge, MA: MIT Press.
219. Larrañaga P et al. 2006 Machine learning in bioinformatics. Brief. Bioinform. 7, 86-112. (doi:10.1093/bib/bbk007)
220. Kell DB. 2006 Metabolomics, modelling and machine learning in systems biology - towards an understanding of the languages of cells. FEBS J. 273, 873-894. (doi:10.1111/j.1742-4658.2006.05136.x)
221. Tarca AL, Carey VJ, Chen X-w, Romero R, Drǎghici S. 2007 Machine learning and its applications to biology. PLoS Comput. Biol. 3 , e116. (doi:10.1371/journal.pcbi.0030116)
222. Kell DB, Oliver SG. 2004 Here is the evidence, now what is the hypothesis? The complementary roles of inductive and hypothesis-driven science in the post-genomic era. Bioessays 26, 99-105. (doi:10.1002/bies.10385)
223. Evans J, Rzhetsky A. 2010 Machine science. Science 329, 399-400. (doi:10.1126/science.1189416)
224. King RD, Whelan KE, Jones FM, Reiser PG, Bryant CH, Muggleton SH, Kell DB, Oliver SG. 2004 Functional genomic hypothesis generation and experimentation by a robot scientist. Nature 427, 247-252. (doi:10.1038/nature02236)
225. Soldatova LN, Clare A, Sparkes A, King RD. 2006 An ontology for a robot scientist. Bioinformatics 22, e464-e471. (doi:10.1093/bioinformatics/btl207)
226. King RD et al. 2009 The automation of science. Science 324, 85-89. (doi:10.1126/science.1165620)
227. Bongard J, Lipson H. 2007 Automated reverse engineering of nonlinear dynamical systems. Proc. Natl Acad. Sci. USA 104, 9943-9948. (doi:10.1073/pnas.0609476104)
228. Schmidt M, Lipson H. 2009 Distilling free-form natural laws from experimental data. Science 324, 81-85. (doi:10.1126/science.1165893)
229. Goldenfeld N, Kadanoff LP. 1999 Simple lessons from complexity. Science 284, 87-89. (doi:10.1126/science.284.5411.87)
230. Tukey JW. 1962 The future of data analysis. Ann. Math. Stat. 33, 1-67. (doi:10.1214/aoms/1177704711)
231. Brenner S. 2010 Sequences and consequences. Phil. Trans. R. Soc. B 365, 207-212. (doi:10.1098/rstb.2009.0221)
232. Noble D. 2011 Systems: what's in a name? Physiology 26, 126-128. (doi:10.1152/physiol.00014.2011)
233. Tarantola A. 2006 Popper, Bayes and the inverse problem. Nat. Phys. 2, 492-494. (doi:10.1038/nphys375)
234. Efron B. 2013 Bayes' theorem in the 21st century. Science 340, 1177-1178. (doi:10.1126/science.1236536)
235. Lindley D. 1975 The future of statistics: a Bayesian 21st century. Adv. Appl. Probab. 7, 106-115. (doi:10.2307/1426315)
236. Erguler K, Stumpf M. 2011 Practical limits for reverse engineering of dynamical systems: a statistical analysis of sensitivity and parameter inferability in systems biology models. Mol. Biosyst. 7, 1593-1602. (doi:10.1039/c0mb00107d)
237. Sontag ED. 2007 Monotone and near-monotone biochemical networks. Syst. Synth. Biol. 1, 59-87. (doi:10.1007/s11693-007-9005-9)
238. Hucka M et al. 2003 The systems biology markup language (SBML): a medium for representation and exchange of biochemical network models. Bioinformatics 19, 524-531. (doi:10.1093/bioinformatics/btg015)
239. Le Novere N et al. 2006 Biomodels database: a free, centralized database of curated, published, quantitative kinetic models of biochemical and cellular systems. Nucleic Acids Res. 34(Suppl. 1), D689-D691. (doi:10.1093/nar/gkj092)
240. Kitano H. 2005 International alliances for quantitative modeling in systems biology. Mol. Syst. Biol. 1:2005.0007. (doi:10.1038/msb4100011)