Wisdom of crowds for robust gene network inference

Nature Methods

Volumn 9, Issue 8, 2012, Pages 796-804

  Marbach, Daniel ^a,b   Costello, James C ^c,d,e   Küffner, Robert ^a,b,f   Vega, Nicole M ^c,d,e   Prill, Robert J ^g   Camacho, Diogo M ^c,d,e,i   Allison, Kyle R ^c,d,e   Kellis, Manolis ^a,b   Collins, James J ^c,d,e,h   Aderhold, Andrej ^j,k   Stolovitzky, Gustavo ^g   Bonneau, Richard ^j,m,n   Chen, Yukun ^p   Cordero, Francesca ^p,q   Crane, Martin ^q   Dondelinger, Frank ^j,r   Drton, Mathias ^s   Esposito, Roberto ^p   Foygel, Rina ^s   De La Fuente, Alberto ^t   Gertheiss, Jan ^f   Geurts, Pierre ^u   Greenfield, Alex ^o   Grzegorczyk, Marco ^v   Haury, Anne Claire ^w,x,y   Holmes, Benjamin ^a,b   Hothorn, Torsten ^f   Husmeier, Dirk ^j   Huynh Thu, Vân Anh ^u   Irrthum, Alexandre ^u   Karlebach, Guy ^z   Lèbre, Sophie ^aa   De Leo, Vincenzo ^t,ab   Madar, Aviv ^l   Mani, Subramani ^o   Mordelet, Fantine ^w,y,ac   Ostrer, Harry ^ad   Ouyang, Zhengyu ^ae   Pandya, Ravi ^af   Petri, Tobias ^f   Pinna, Andrea ^t   Poultney, Christopher S ^l   Rezny, Serena ^s   Ruskin, Heather J ^q   Saeys, Yvan ^l,ag   Shamir, Ron ^z   Sîrbu, Alina ^q   Song, Mingzhou ^ae   Soranzo, Nicola ^t   Statnikov, Alexander ^l,ah   Vega, Nicci ^c,d,e   Vera Licona, Paola ^w,y   Vert, Jean Philippe ^w,y   Visconti, Alessia ^p   Wang, Haizhou ^ae   Wehenkel, Louis ^u   Windhager, Lukas ^f   Zhang, Yang ^ae   Zimmer, Ralf ^f   more..

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b BROAD INSTITUTE OF MIT AND HARVARD   (United States)

^c HOWARD HUGHES MEDICAL INSTITUTE   (United States)

^d Boston University   (United States)

^e BOSTON UNIVERSITY   (United States)

^f UNIVERSITY OF MUNICH   (Germany)

^g IBM T J WATSON RESEARCH CENTER   (United States)

^h HARVARD UNIVERSITY   (United States)

ⁱ PFIZER INC   (United States)

^j BIOMATHEMATICS AND STATISTICS SCOTLAND   (United Kingdom)

^k UNIVERSITY OF ST ANDREWS   (United Kingdom)

^l NEW YORK UNIVERSITY   (United States)

^m NEW YORK UNIVERSITY SCHOOL OF MEDICINE   (United States)

ⁿ POLYTECHNIC UNIVERSITY   (United States)

^o VANDERBILT UNIVERSITY MEDICAL CENTER   (United States)

^p UNIVERSITY OF TURIN   (Italy)

^q DUBLIN CITY UNIVERSITY   (Ireland)

^r UNIVERSITY OF EDINBURGH   (United Kingdom)

^s UNIVERSITY OF CHICAGO   (United States)

^t Parco Tecnologico della Sardegna   (Italy)

^u UNIVERSITY OF LIÈGE   (Belgium)

^v TU DORTMUND UNIVERSITY   (Germany)

^w PSL RESEARCH UNIVERSITY   (France)

^x INSTITUT CURIE   (France)

^y INSERM   (France)

^z TEL AVIV UNIVERSITY   (Israel)

^aa UNIVERSITÉ DE STRASBOURG   (France)

^ab Linkalab   (Italy)

^ac Institut National de la Statistique et des etudes economiques   (France)

^ad NEW YORK UNIVERSITY MEDICAL CENTER   (United States)

^ae New Mexico State University   (United States)

^af MICROSOFT RESEARCH   (United States)

^ag DEPARTMENT OF PLANT SYSTEMS BIOLOGY   (Belgium)

^ah GHENT UNIVERSITY   (Belgium)

more..

Author keywords

[No Author keywords available]

Indexed keywords

CELL SURFACE PROTEIN; HYDROCHLORIC ACID;

ALGORITHM; ARTICLE; BACTERIAL METABOLISM; BAYES THEOREM; BIOFILM; BOOTSTRAPPING; COMPUTER MODEL; CONTROLLED STUDY; ESCHERICHIA COLI; GENE CONTROL; GENE EXPRESSION; GENE INTERACTION; GENE REGULATORY NETWORK; GENETIC ASSOCIATION; GENETIC TRANSCRIPTION; GENETIC VARIABILITY; MICROARRAY ANALYSIS; MICROBIAL COMMUNITY; MONTE CARLO METHOD; NONHUMAN; PRINCIPAL COMPONENT ANALYSIS; PRIORITY JOURNAL; SACCHAROMYCES CEREVISIAE; STAPHYLOCOCCUS AUREUS;

ALGORITHMS; COMPUTATIONAL BIOLOGY; ESCHERICHIA COLI; GENE EXPRESSION REGULATION, BACTERIAL; GENE REGULATORY NETWORKS; OLIGONUCLEOTIDE ARRAY SEQUENCE ANALYSIS; SACCHAROMYCES CEREVISIAE; SOFTWARE; STAPHYLOCOCCUS AUREUS; TRANSCRIPTION, GENETIC;

ESCHERICHIA COLI; SACCHAROMYCES CEREVISIAE; STAPHYLOCOCCUS AUREUS;

EID: 84870305264     PISSN: 15487091     EISSN: 15487105     Source Type: Journal    
DOI: 10.1038/nmeth.2016     Document Type: Article

References (55)

1. Surowiecki, J. The Wisdom of Crowds: Why the Many are Smarter than the Few and How Collective Wisdom Shapes Business, Economies, Societies and Nations (Doubleday, 2004).
2. De Smet, R. & Marchal, K. Advantages and limitations of current network inference methods. Nat. Rev. Microbiol. 8, 717-729 (2010).
3. Marbach, D. et al. Revealing strengths and weaknesses of methods for gene network inference. Proc. Natl. Acad. Sci. USA 107, 6286-6291 (2010).
4. Bar-Joseph, Z. et al. Computational discovery of gene modules and regulatory networks. Nat. Biotechnol. 21, 1337-1342 (2003). (Pubitemid 37356619)
5. Reiss, D.J., Baliga, N.S. & Bonneau, R. Integrated biclustering of heterogeneous genome-wide datasets for the inference of global regulatory networks. BMC Bioinformatics 7, 280 (2006).
6. Lemmens, K. et al. DISTILLER: a data integration framework to reveal condition dependency of complex regulons in Escherichia coli. Genome Biol. 10, R27 (2009).
7. Marbach, D. et al. Predictive regulatory models in Drosophila melanogaster by integrative inference of transcriptional networks. Genome Res. published online (28 March 2012).
8. Friedman, N., Linial, M., Nachman, I. & Pe'er, D. Using Bayesian networks to analyze expression data. J. Comput. Biol. 7, 601-620 (2000).
9. Margolin, A.A. et al. ARACNE: an algorithm for the reconstruction of gene regulatory networks in a mammalian cellular context. BMC Bioinformatics 7 (suppl. 1), S7 (2006).
10. di Bernardo, D. et al. Chemogenomic profiling on a genome-wide scale using reverse-engineered gene networks. Nat. Biotechnol. 23, 377-383 (2005).
11. Faith, J.J. et al. Large-scale mapping and validation of Escherichia coli transcriptional regulation from a compendium of expression profiles. PLoS Biol. 5, e8 (2007).
12. Stolovitzky, G., Monroe, D. & Califano, A. Dialogue on reverse-engineering assessment and methods: the DREAM of high-throughput pathway inference. Ann. NY Acad. Sci. 1115, 1-22 (2007). (Pubitemid 350134809)
13. Stolovitzky, G., Prill, R.J. & Califano, A. Lessons from the DREAM2 Challenges. Ann. NY Acad. Sci. 1158, 159-195 (2009).
14. Prill, R.J. et al. Towards a rigorous assessment of systems biology models: the DREAM3 challenges. PLoS ONE 5, e9202 (2010).
15. Reich, M. et al. GenePattern 2.0. Nat. Genet. 38, 500-501 (2006).
16. Gama-Castro, S. et al. RegulonDB version 7.0: transcriptional regulation of Escherichia coli K-12 integrated within genetic sensory response units (Gensor Units). Nucleic Acids Res. 39, D98-D105 (2011).
17. Harbison, C.T. et al. Transcriptional regulatory code of a eukaryotic genome. Nature 431, 99-104 (2004). (Pubitemid 39215116)
18. MacIsaac, K.D. et al. An improved map of conserved regulatory sites for Saccharomyces cerevisiae. BMC Bioinformatics 7, 113 (2006).
19. Huynh-Thu, V.A., Irrthum, A., Wehenkel, L. & Geurts, P. Inferring regulatory networks from expression data using tree-based methods. PLoS ONE 5, e12776 (2010).
20. Küffner, R., Petri, T., Tavakkolkhah, P., Windhager, L. & Zimmer, R. Inferring Gene Regulatory Networks by ANOVA. Bioinformatics 28, 1376-1382 (2012).
21. Tibshirani, R. Regression shrinkage and selection via the lasso. J. R. Stat. Soc. Series B Stat. Methodol. 58, 267-288 (1996).
22. Mordelet, F. & Vert, J.-P. SIRENE: supervised inference of regulatory networks. Bioinformatics 24, i76-i82 (2008).
23. Ravcheev, D.A. et al. Inference of the transcriptional regulatory network in Staphylococcus aureus by integration of experimental and genomics-based evidence. J. Bacteriol. 193, 3228-3240 (2011).
24. Newman, M.E.J. Modularity and community structure in networks. Proc. Natl. Acad. Sci. USA 103, 8577-8582 (2006). (Pubitemid 43878062)
25. Dietterich, T.G. Ensemble methods in machine learning. Multiple Classifier Systems, First International Workshop (eds. Kittler, J. & Roli, F.) 1857, 1-15 (Springer, 2000).
26. Prinz, A.A., Bucher, D. & Marder, E. Similar network activity from disparate circuit parameters. Nat. Neurosci. 7, 1345-1352 (2004). (Pubitemid 41057757)
27. Kuepfer, L., Peter, M., Sauer, U. & Stelling, J. Ensemble modeling for analysis of cell signaling dynamics. Nat. Biotechnol. 25, 1001-1006 (2007). (Pubitemid 47517639)
28. Kaltenbach, H.-M., Dimopoulos, S. & Stelling, J. Systems analysis of cellular networks under uncertainty. FEBS Lett. 583, 3923-3930 (2009).
29. Marbach, D., Mattiussi, C. & Floreano, D. Combining multiple results of a reverse-engineering algorithm: application to the DREAM five-gene network challenge. Ann. NY Acad. Sci. 1158, 102-113 (2009).
30. Marder, E. & Taylor, A.L. Multiple models to capture the variability in biological neurons and networks. Nat. Neurosci. 14, 133-138 (2011).
31. Moult, J. A decade of CASP: progress, bottlenecks and prognosis in protein structure prediction. Curr. Opin. Struct. Biol. 15, 285-289 (2005). (Pubitemid 40826447)
32. Bell, R.M. & Koren, Y. Lessons from the Netflix Prize Challenge. SIGKDD Explor. 9, 75-79 (2007).
33. Haury, A.-C., Mordelet, F., Vera-Licona, P. & Vert, J.-P. TIGRESS: trustful inference of gene regulation using stability selection. Preprint at (2012).
34. Yuan, M. & Lin, Y. Model selection and estimation in regression with grouped variables. J. R. Stat. Soc. Series B Stat. Methodol. 68, 49-67 (2006). (Pubitemid 43415335)
35. Lèbre, S., Becq, J., Devaux, F., Stumpf, M.P.H. & Lelandais, G. Statistical inference of the time-varying structure of gene-regulation networks. BMC Syst. Biol. 4, 130 (2010).
36. Meinshausen, N. & Bühlmann, P. Stability selection. J. R. Stat. Soc. Series B Stat. Methodol. 72, 417-473 (2010).
37. van Someren, E.P. et al. Least absolute regression network analysis of the murine osteoblast differentiation network. Bioinformatics 22, 477-484 (2006).
38. Butte, A.J. & Kohane, I.S. Mutual information relevance networks: functional genomic clustering using pairwise entropy measurements. Pac. Symp. Biocomput. 2000, 418-429 (2000).
39. Mani, S. & Cooper, G.F. A Bayesian local causal discovery algorithm. in Proceedings of the World Congress on Medical Informatics, MedInfo 2004 (eds. Fieschi, M. et al.) 731-735 (IOS, 2004).
40. Tsamardinos, I., Aliferis, C.F. & Statnikov, A. Time and sample efficient discovery of Markov blankets and direct causal relations. in Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 673-678 (ACM, 2003).
41. Aliferis, C.F., Statnikov, A., Tsamardinos, I., Mani, S. & Koutsoukos, X.D. Local causal and Markov blanket induction for causal discovery and feature selection for classification part I: algorithm and empirical evaluation. J. Mach. Learn. Res. 11, 171-234 (2010).
42. Statnikov, A. & Aliferis, C.F. Analysis and computational dissection of molecular signature multiplicity. PLoS Comput. Biol. 6, e1000790 (2010).
43. Karlebach, G. & Shamir, R. Constructing logical models of gene regulatory networks by integrating transcription factor-DNA interactions with expression data: an entropy-based approach. J. Comput. Biol. 19, 30-41 (2012).
44. Yeung, K.Y., Bumgarner, R.E. & Raftery, A.E. Bayesian model averaging: development of an improved multi-class, gene selection and classification tool for microarray data. Bioinformatics 21, 2394-2402 (2005). (Pubitemid 40731595)
45. Yip, K.Y., Alexander, R.P., Yan, K.-K. & Gerstein, M. Improved reconstruction of in silico gene regulatory networks by integrating knockout and perturbation data. PLoS ONE 5, e8121 (2010).
46. Sîrbu, A., Ruskin, H.J. & Crane, M. Stages of gene regulatory network inference: the evolutionary algorithm role. in Evolutionary Algorithms (ed. Kita, E.) Ch. 27, 521-546 (Intech, 2011).
47. Song, M.J. et al. Reconstructing generalized logical networks of transcriptional regulation in mouse brain from temporal gene expression data. EURASIP J. Bioinform. Syst. Biol. 2009, 545176 (2009).
48. Greenfield, A., Madar, A., Ostrer, H. & Bonneau, R. DREAM4: Combining genetic and dynamic information to identify biological networks and dynamical models. PLoS ONE 5, e13397 (2010).
49. Watkinson, J., Liang, K.-C., Wang, X., Zheng, T. & Anastassiou, D. Inference of regulatory gene interactions from expression data using three-way mutual information. Ann. NY Acad. Sci. 1158, 302-313 (2009).
50. Barrett, T. et al. NCBI GEO: archive for functional genomics data sets-10 years on. Nucleic Acids Res. 39, D1005-D1010 (2011).
51. Bolstad, B.M., Irizarry, R.A., Astrand, M. & Speed, T.P. A comparison of normalization methods for high density oligonucleotide array data based on variance and bias. Bioinformatics 19, 185-193 (2003). (Pubitemid 36181903)
52. Marbach, D., Schaffter, T., Mattiussi, C. & Floreano, D. Generating realistic in silico gene networks for performance assessment of reverse engineering methods. J. Comput. Biol. 16, 229-239 (2009).
53. Schaffter, T., Marbach, D. & Floreano, D. GeneNetWeaver: in silico benchmark generation and performance profiling of network inference methods. Bioinformatics 27, 2263-2270 (2011).
54. Hu, Z., Killion, P.J. & Iyer, V.R. Genetic reconstruction of a functional transcriptional regulatory network. Nat. Genet. 39, 683-687 (2007). (Pubitemid 46680240)
55. Faith, J.J. et al. Many Microbe Microarrays Database: uniformly normalized Affymetrix compendia with structured experimental metadata. Nucleic Acids Res. 36, D866-D870 (2008). (Pubitemid 351149837)