Summary of the DREAM8 Parameter Estimation Challenge: Toward Parameter Identification for Whole-Cell Models

PLoS Computational Biology

Volumn 11, Issue 5, 2015, Pages

  Karr, Jonathan R ^a,ad   Williams, Alex H ^b   Zucker, Jeremy D ^c   Raue, Andreas ^d,ae   Steiert, Bernhard ^d   Timmer, Jens ^d   Kreutz, Clemens ^d   Hu, Yucheng ^e   Baron, Michael ^f   Bryson, Kevin ^f   Barker, Brandon ^g,i   Bogart, Elijah ^h   Wang, Yiping ^g,i   Chandramohan, Dhruva ^g   Huang, Lei ^g   Zawack, Kelson ^g,i   Shestov, Alexander A ^j   Makadia, Hiren ^k   DeCicco, Danielle ^k   Yin, Alex ^l   Wang, Mengqing ^l   Li, Shuai Cheng ^l   Swistak, Marcin ^m,n   Cygan, Mateusz ^m,q   Kazakiewicz, Denis ^o,p   Kursa, Miron B ^m   Korytkowski, Przemyslaw ^r   Plewczynski, Dariusz ^m,p,s,t   Yang, Jichen ^u   Li, Yajuan ^v,w   Tang, Hao ^u   Wang, Tao ^u   Liu, Yueming ^x   Xie, Yang ^u   Xiao, Guanghua ^u   Bello, Julian ^y   Botero Rozo, David Octavio ^y   Cañas Duarte, Silvia Johana ^y   Castro, Juan Camilo ^y   Gomez, Fabio ^y   Valdes, Ivan ^y   Vivas, Laura González ^y   Bernal, Adriana ^y   Pedraza Leal, Juan Manual ^y   Restrepo, Silvia ^y   Muñoz, Alejandro Reyes ^y   Wilkinson, Simon ^z   Allgood, Brandon A ^z   Bot, Brian M ^aa   Hoff, Bruce R ^aa   Kellen, Michael R ^aa   Covert, Markus W ^ab   Stolovitzky, Gustavo A ^ac   Meyer, Pablo ^ac   more..

^a STANFORD UNIVERSITY   (United States)

^b BRANDEIS UNIVERSITY   (United States)

^c BROAD INSTITUTE OF MIT AND HARVARD   (United States)

^d UNIVERSITY OF FREIBURG   (Germany)

^e TSINGHUA UNIVERSITY   (China)

^f UNIVERSITY COLLEGE LONDON   (United Kingdom)

^g Plant Breeding and Genetics Section in the School of Integrative Plant Science   (United States)

^h Cornell University   (United States)

ⁱ Weill Cornell Graduate School of Biomedical Sciences   (United States)

^j Department of Obstetrics Gynecology   (United States)

^k THOMAS JEFFERSON UNIVERSITY   (United States)

^l Hong Kong College of Technology   (Hong Kong)

^m UNIVERSITY OF WARSAW   (Poland)

ⁿ UNIVERSITY OF WARSAW   (Poland)

^o WROCLAW UNIVERSITY OF TECHNOLOGY   (Poland)

^p MEDICAL UNIVERSITY OF BIALYSTOK   (Poland)

^q SILESIAN UNIVERSITY OF TECHNOLOGY   (Poland)

^r WEST POMERANIAN UNIVERSITY OF TECHNOLOGY   (Poland)

^s UNIVERSITY OF CONNECTICUT HEALTH CENTER   (United States)

^t YALE UNIVERSITY   (United States)

^u UNIVERSITY OF TEXAS SOUTHWESTERN MEDICAL CENTER   (United States)

^v Chinese Academy of Sciences and China National Center for Bioinformation   (China)

^w UNIVERSITY OF TEXAS SOUTHWESTERN MEDICAL CENTER   (United States)

^x UNIVERSITY OF TEXAS AT ARLINGTON   (United States)

^y UNIVERSIDAD DE LOS ANDES   (Colombia)

^z Numerate Inc   (United States)

^aa SAGE BIONETWORKS   (United States)

^ab Stanford University   (United States)

^ac IBM T J WATSON RESEARCH CENTER   (United States)

^ad MOUNT SINAI SCHOOL OF MEDICINE   (United States)

^ae MERRIMACK PHARMACEUTICALS   (United States)

more..

Author keywords

[No Author keywords available]

Indexed keywords

CELL ENGINEERING; CELLS; CYTOLOGY; REVERSE ENGINEERING;

CELL MODEL; CELLULAR COMPONENTS; COMPREHENSIVE MODELING; ENGINEERING ASSESSMENTS; ENGINEERING METHODS; MOLECULAR LEVELS; PARAMETERS ESTIMATION; PARAMETERS IDENTIFICATION; SIMPLE++; WHOLE CELL;

PARAMETER ESTIMATION;

ALGORITHM; ARTICLE; BIOENGINEERING; CELL COMPONENT; COMPUTER MODEL; CONTROLLED STUDY; GENOTYPE; MATHEMATICAL MODEL; MATHEMATICAL PARAMETERS; MECHANISTIC MODEL; PHENOTYPE; PREDICTION; REVERSE ENGINEERING; SYSTEMS BIOLOGY; WHOLE CELL MODEL; BACTERIUM; BIOLOGICAL MODEL; BIOLOGY; CELLS; CLOUD COMPUTING; COMPUTER SIMULATION; GENETIC ASSOCIATION STUDY; GENETICS; METABOLISM; MUTATION; MYCOPLASMA GENITALIUM; STATISTICS AND NUMERICAL DATA;

ALGORITHMS; BACTERIA; BIOENGINEERING; CELLS; CLOUD COMPUTING; COMPUTATIONAL BIOLOGY; COMPUTER SIMULATION; GENETIC ASSOCIATION STUDIES; MODELS, BIOLOGICAL; MUTATION; MYCOPLASMA GENITALIUM;

EID: 84930603902     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1004096     Document Type: Article

References (55)

1. Davidson EH, Rast JP, Oliveri P, Ransick A, Calestani C, et al. (2002) A genomic regulatory network for development. Science 295: 1669–1678. 11872831
2. Orth JD, Conrad TM, Na J, Lerman JA, Nam H, et al. (2011) A comprehensive genome-scale reconstruction of Escherichia coli metabolism–2011. Mol Syst Biol 7: 535. doi: 10.1038/msb.2011.65 21988831
3. Barkai N, Leibler S, (1997) Robustness in simple biochemical networks. Nature 387: 913–917. 9202124
4. Arkin A, Ross J, McAdams HH, (1998) Stochastic kinetic analysis of developmental pathway bifurcation in phage lambda-infected Escherichia coli cells. Genetics 149: 1633–1648. 9691025
5. Karr JR, Sanghvi JC, Macklin DN, Gutschow MV, Jacobs JM, et al. (2012) A whole-cell computational model predicts phenotype from genotype. Cell 150: 389–401. doi: 10.1016/j.cell.2012.05.044 22817898
6. Orth JD, Thiele I, Palsson BO, (2010) What is flux balance analysis? Nat Biotechnol 28: 245–248. doi: 10.1038/nbt.1614 20212490
7. Sanghvi JC, Regot S, Carrasco S, Karr JR, Gutschow MV, et al. (2013) Accelerated discovery via a whole-cell model. Nat Methods 10: 1192–1195. doi: 10.1038/nmeth.2724 24185838
8. Rangamani P, Iyengar R, (2008) Modelling cellular signalling systems. Essays Biochem 45: 83–94. doi: 10.1042/BSE0450083 18793125
9. Friedman N, Linial M, Nachman I, Pe’er D, (2000) Using Bayesian networks to analyze expression data. J Comput Biol 7: 601–620. 11108481
10. Iancu OD, Kawane S, Bottomly D, Searles R, Hitzemann R, et al. (2012) Utilizing RNA-Seq data for de novo coexpression network inference. Bioinformatics 28: 1592–1597. doi: 10.1093/bioinformatics/bts245 22556371
11. Sachs K, Itani S, Carlisle J, Nolan GP, Pe’er D, et al. (2009) Learning signaling network structures with sparsely distributed data. J Comput Biol 16: 201–212. doi: 10.1089/cmb.2008.07TT 19193145
12. Chang R, Shoemaker R, Wang W, (2011) Systematic search for recipes to generate induced pluripotent stem cells. PLoS Comput Biol 7: e1002300. doi: 10.1371/journal.pcbi.1002300 22215993
13. Ashyraliyev M, Jaeger J, Blom JG, (2008) Parameter estimation and determinability analysis applied to Drosophila gap gene circuits. BMC Syst Biol 2: 83. doi: 10.1186/1752-0509-2-83 18817540
14. Banga JR, Balsa-Canto E, (2008) Parameter estimation and optimal experimental design. Essays Biochem 45: 195–209. doi: 10.1042/BSE0450195 18793133
15. Wang C, Duan Q, Gong W, Ye A, Di Z, et al. (2014) An evaluation of adaptive surrogate modeling based optimization with two benchmark problems. Environ Model Softw 60: 167–179.
16. Forrester AIJ, Keane AJ, (2009) Recent advances in surrogate-based optimization. Progr Aerosp Sci 45: 50–79.
17. Halloran JP, Erdemir A, (2011) Adaptive surrogate modeling for expedited estimation of nonlinear tissue properties through inverse finite element analysis. Ann Biomed Eng 39: 2388–2397. doi: 10.1007/s10439-011-0317-2 21544674
18. Jones DR, (2001) A taxonomy of global optimization methods based on response surfaces. J Global Optim 21: 345–383.
19. Ong YS, Nair PB, Keane AJ, (2003) Evolutionary optimization of computationally expensive problems via surrogate modeling. AIAA J 41: 687–696.
20. Razavi S, Tolson BA, Burn DH, (2012) Numerical assessment of metamodelling strategies in computationally intensive optimization. Environ Model Softw 34: 67–86.
21. Queipo NV, Pintos S, Rincón N, Contreras N, Colmenares J, (2002) Surrogate modeling-based optimization for the integration of static and dynamic data into a reservoir description. J Petrol Sci Eng 35: 167–181.
22. Panait L, Luke S, (2005) Cooperative multi-agent learning: The state of the art. Auton Agent Multi Agent Syst 11: 387–434.
23. Nedic A, Ozdaglar A, (2010) Convex optimization in signal processing and communications, Cambridge: Cambridge University Press, chapter Cooperative distributed multi-agent optimization. pp. 340–386.
24. Raffard RL, Tomlin CJ, Boyd SP, (2004) Distributed optimization for cooperative agents: application to formation flight. Decis Contr 3: 2453–2459.
25. Rabbat M, Nowak R (2004) Distributed optimization in sensor networks. In: Proceedings of the 3rd International Symposium on Information Processing in Sensor Networks. New York, NY, USA: ACM, IPSN ‘04, pp. 20–27. doi: 10.1145/984622.984626. URL http://doi.acm.org/10.1145/984622.984626.
26. Chen BY, Fofanov VY, Bryant DH, Dodson BD, Kristensen DM, Apostolico A, Guerra C, Istrail S, Pevzner P, Waterman M, et al. (2006) Geometric sieving: Automated distributed optimization of 3d motifs for protein function prediction. In: Research in Computational Molecular Biology, Springer Berlin Heidelberg, volume 3909 of Lecture Notes in Computer Science. pp. 500–515. http://dx.doi.org/10.1007/11732990_42.
27. Rall LB, (1981) Automatic Differentiation: Techniques and Applications, volume 120 of Lecture Notes in Computer Science. Berlin: Springer. 154 p.
28. Ramachandran R, Barton PI, (2010) Nonlinear system identification employing automatic differentiation. Chem Eng Sci 65: 4884–4893.
29. Phipps E, Casey R, Guckenheimer J, (2006) Automatic Differentiation: Applications, Theory, and Implementations, Berlin: Springer-Verlag, volume 50, chapter Periodic Orbits of Hybrid Systems and Parameter Estimation via AD. pp. 211–223.
30. Schumann-Bischoff J, Luther S, Parlitz U, (2013) Nonlinear system identification employing automatic differentiation. Commun Nonlin Sci Numer Sim 18: 2733–2742.
31. Stolovitzky G, Monroe D, Califano A, (2007) Dialogue on reverse-engineering assessment and methods: the DREAM of high-throughput pathway inference. Ann N Y Acad Sci 1115: 1–22. 17925349
32. Prill RJ, Saez-Rodriguez J, Alexopoulos LG, Sorger PK, Stolovitzky G, (2011) Crowdsourcing network inference: the DREAM predictive signaling network challenge. Sci Signal 4: mr7. doi: 10.1126/scisignal.2002212 21900204
33. Marbach D, Costello JC, Küffner R, Vega NM, Prill RJ, et al. (2012) Wisdom of crowds for robust gene network inference. Nat Methods 9: 796–804. doi: 10.1038/nmeth.2016 22796662
34. Prill RJ, Marbach D, Saez-Rodriguez J, Sorger PK, Alexopoulos LG, et al. (2010) Towards a rigorous assessment of systems biology models: the DREAM3 challenges. PLoS One 5: e9202. doi: 10.1371/journal.pone.0009202 20186320
35. Meyer P, Cokelaer T, Chandran D, Kim KH, Loh PR, et al. (2014) Network topology and parameter estimation: from experimental design methods to gene regulatory network kinetics using a community based approach. BMC Syst Biol 8: 13. doi: 10.1186/1752-0509-8-13 24507381
36. Storn R, Price K, (1997) Differential evolution—a simple and efficient heuristic for global optimization over continuous spaces. J Global Optim 11: 341–359.
37. Yang XS, (2011) Metaheuristic optimization: algorithm analysis and open problems. Lect Notes Comput Sc 6630: 21–32.
38. Chakraborty UK, (2008) Advances in differential evolution. Berlin: Springer-Verlag. 340 p.
39. Oguz C, Laomettachit T, Chen KC, Watson LT, Baumann WT, et al. (2013) Optimization and model reduction in the high dimensional parameter space of a budding yeast cell cycle model. BMC Syst Biol 7: 53. doi: 10.1186/1752-0509-7-53 23809412
40. Breiman L, (2001) Random forests. Machine Learning 45: 5–32.
41. Cooper S, Khatib F, Treuille A, Barbero J, Lee J, et al. (2010) Predicting protein structures with a multiplayer online game. Nature 466: 756–760. doi: 10.1038/nature09304 20686574
42. Lee J, Kladwang W, Lee M, Cantu D, Azizyan M, et al. (2014) RNA design rules from a massive open laboratory. Proc Natl Acad Sci U S A 111: 2122–2127. doi: 10.1073/pnas.1313039111 24469816
43. Du L, Robles AJ, King JB, Powell DR, Miller AN, et al. (2014) Crowdsourcing natural products discovery to access uncharted dimensions of fungal metabolite diversity. Angew Chem Int Ed Engl 53: 804–809. doi: 10.1002/anie.201306549 24285637
44. Cobelli C D, Jr (1980) Parameter and structural identifiability concepts and ambiguities: a critical review and analysis. Am J Physiol 239: R7–24. 7396041
45. Chis OT BCE, Banga JR, (2011) Structural identifiability of systems biology models: a critical comparison of methods. PLoS One 6: e27755. doi: 10.1371/journal.pone.0027755 22132135
46. Hengl S, Kreutz C, Timmer J, Maiwald T, (2007) Data-based identifiability analysis of non-linear dynamical models. Bioinformatics 23: 2612–2618. 17660526
47. Hobbs KH, Hooper SL, (2008) Using complicated, wide dynamic range driving to develop models of single neurons in single recording sessions. J Neurophysiol 99: 1871–1883. doi: 10.1152/jn.00032.2008 18256169
48. Edelman GM, Gally JA, (2001) Degeneracy and complexity in biological systems. Proc Natl Acad Sci U S A 98: 13763–13768. 11698650
49. Gutenkunst RN, Waterfall JJ, Casey FP, Brown KS, Myers CR, et al. (2007) Universally sloppy parameter sensitivities in systems biology models. PLoS Comput Biol 3: 1871–1878. 17922568
50. Daniels BC, Chen YJ, Sethna JP, Gutenkunst RN, Myers CR, (2008) Sloppiness, robustness, and evolvability in systems biology. Curr Opin Biotechnol 19: 389–395. doi: 10.1016/j.copbio.2008.06.008 18620054
51. Prinz AA, Bucher D, Marder E, (2004) Similar network activity from disparate circuit parameters. Nat Neurosci 7: 1345–1352. 15558066
52. Huys QJ, Ahrens MB, Paninski L, (2006) Efficient estimation of detailed single-neuron models. J Neurophysiol 96: 872–890. 16624998
53. Ma W, Trusina A, El-Samad H, Lim WA, Tang C, (2009) Defining network topologies that can achieve biochemical adaptation. Cell 138: 760–773. doi: 10.1016/j.cell.2009.06.013 19703401
54. Taylor AL, Goaillard JM, Marder E, (2009) How multiple conductances determine electrophysiological properties in a multicompartment model. J Neurosci 29: 5573–5586. doi: 10.1523/JNEUROSCI.4438-08.2009 19403824
55. Marder E, Taylor AL, (2011) Multiple models to capture the variability in biological neurons and networks. Nat Neurosci 14: 133–138. doi: 10.1038/nn.2735 21270780