Standardized benchmarking in the quest for orthologs

Nature Methods

Volumn 13, Issue 5, 2016, Pages 425-430

  Altenhoff, Adrian M ^a,b   Boeckmann, Brigitte ^b   Capella Gutierrez, Salvador ^c,d,e   Dalquen, Daniel A ^f   DeLuca, Todd ^g   Forslund, Kristoffer ^h   Huerta Cepas, Jaime ^h   Linard, Benjamin ⁱ   Pereira, Cécile ^j   Pryszcz, Leszek P ^c   Schreiber, Fabian ^k   Da Silva, Alan Sousa ^k   Szklarczyk, Damian ^b,l   Train, Clément Marie ^a   Bork, Peer ^h,m,n   Lecompte, Odile ^o   Von Mering, Christian ^b,l   Xenarios, Ioannis ^b,p   Sjölander, Kimmen ^q   Jensen, Lars Juhl ^r   Martin, Maria J ^k   Muffato, Matthieu ^k   Gabaldón, Toni ^c,d,s   Lewis, Suzanna E ^t   Thomas, Paul D ^u   Sonnhammer, Erik ^v   Dessimoz, Christophe ^b,f,p   more..

^a ETH ZURICH   (Switzerland)

^b SWISS INSTITUTE OF BIOINFORMATICS   (Switzerland)

^c BARCELONA INSTITUTE OF SCIENCE AND TECHNOLOGY   (Spain)

^d UNIVERSITAT POMPEU FABRA   (Spain)

^e CBS KNAW FUNGAL BIODIVERSITY CENTRE   (Netherlands)

^f UNIVERSITY COLLEGE LONDON   (United Kingdom)

^g Harvard Medical School Center for Biomedical Informatics   (United States)

^h EUROPEAN MOLECULAR BIOLOGY LABORATORY   (Germany)

ⁱ DEPARTMENT OF LIFE SCIENCES   (United Kingdom)

^j UNIVERSITÉ PARIS SACLAY   (France)

^k WELLCOME TRUST SANGER INSTITUTE   (United Kingdom)

^l UNIVERSITY OF ZURICH   (Switzerland)

^m UNIVERSITY HOSPITAL HEIDELBERG   (Germany)

ⁿ MAX DELBRÜCK CENTER FOR MOLECULAR MEDICINE   (Germany)

^o UNIVERSITÉ DE STRASBOURG   (France)

^p UNIVERSITY OF LAUSANNE   (Switzerland)

^q University of California at Berkeley   (United States)

^r University of Copenhagen   (Denmark)

^s INSTITUCIÓ CATALANA DE RECERCA I ESTUDIS AVANÇATS ICREA   (Spain)

^t LAWRENCE BERKELEY NATIONAL LABORATORY   (United States)

^u UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^v STOCKHOLM UNIVERSITY   (Sweden)

more..

Author keywords

[No Author keywords available]

Indexed keywords

PROTEOME;

ACCURACY; AMINO ACID SEQUENCE; ARTICLE; MULTIGENE FAMILY; NONHUMAN; ORTHOLOGY; PHYLOGENY; PREDICTION; PRIORITY JOURNAL; PROKARYOTE; QUALITY CONTROL; ARCHAEON; BACTERIUM; BIOLOGICAL MODEL; BIOLOGY; CLASSIFICATION; EUKARYOTE; GENE ONTOLOGY; GENETIC DATABASE; GENETICS; GENOMICS; PROCEDURES; PROTEOMICS; SEQUENCE ANALYSIS; SEQUENCE HOMOLOGY; SPECIES DIFFERENCE; STANDARDS;

ARCHAEA; BACTERIA; COMPUTATIONAL BIOLOGY; DATABASES, GENETIC; EUKARYOTA; GENE ONTOLOGY; GENOMICS; MODELS, GENETIC; PHYLOGENY; PROTEOMICS; SEQUENCE ANALYSIS, PROTEIN; SEQUENCE HOMOLOGY; SPECIES SPECIFICITY;

EID: 84962044966     PISSN: 15487091     EISSN: 15487105     Source Type: Journal    
DOI: 10.1038/nmeth.3830     Document Type: Article

References (63)

1. Fitch, W.M. Distinguishing homologous from analogous proteins. Syst. Zool. 19, 99-113 (1970).
2. Koonin, E.V. Orthologs, paralogs, and evolutionary genomics. Annu. Rev. Genet. 39, 309-338 (2005).
3. Gabaldón, T. & Koonin, E.V. Functional and evolutionary implications of gene orthology. Nat. Rev. Genet. 14, 360-366 (2013).
4. Dessimoz, C. Editorial: orthology and applications. Brief. Bioinform. 12, 375-376 (2011).
5. Altenhoff, A.M. & Dessimoz, C. in Evolutionary Genomics (ed. Anisimova, M.) Ch. 9 (Humana Press, 2012).
6. Gabaldón, T. et al. Joining forces in the quest for orthologs. Genome Biol. 10, 403 (2009).
7. Dessimoz, C. et al. Toward community standards in the quest for orthologs. Bioinformatics 28, 900-904 (2012).
8. Sonnhammer, E.L.L. et al. Big data and other challenges in the quest for orthologs. Bioinformatics 30, 2993-2998 (2014).
9. Nehrt, N.L., Clark, W.T., Radivojac, P. & Hahn, M.W. Testing the ortholog conjecture with comparative functional genomic data from mammals. PLoS Comput. Biol. 7, e1002073 (2011).
10. Thomas, P.D., Wood, V., Mungall, C.J., Lewis, S.E. & Blake, J.A. On the use of gene ontology annotations to assess functional similarity among orthologs and paralogs: a short report. PLoS Comput. Biol. 8, e1002386 (2012).
11. Altenhoff, A.M., Studer, R.A., Robinson-Rechavi, M. & Dessimoz, C. Resolving the ortholog conjecture: orthologs tend to be weakly, but signifcantly, more similar in function than paralogs. PLoS Comput. Biol. 8, e1002514 (2012).
12. Chen, X. & Zhang, J. The ortholog conjecture is untestable by the current gene ontology but is supported by RNA sequencing data. PLoS Comput. Biol. 8, e1002784 (2012).
13. Hulsen, T., Huynen, M.A., de Vlieg, J. & Groenen, P.M. Benchmarking ortholog identifcation methods using functional genomics data. Genome Biol. 7, R31 (2006).
14. Chen, F., Mackey, A.J., Vermunt, J.K. & Roos, D.S. Assessing performance of orthology detection strategies applied to eukaryotic genomes. PLoS ONE 2, e383 (2007).
15. Altenhoff, A.M. & Dessimoz, C. Phylogenetic and functional assessment of orthologs inference projects and methods. PLoS Comput. Biol. 5, e1000262 (2009).
16. Boeckmann, B., Robinson-Rechavi, M., Xenarios, I. & Dessimoz, C. Conceptual framework and pilot study to benchmark phylogenomic databases based on reference gene trees. Brief. Bioinform. 12, 423-435 (2011).
17. Trachana, K. et al. Orthology prediction methods: a quality assessment using curated protein families. Bioessays 33, 769-780 (2011).
18. Salichos, L. & Rokas, A. Evaluating ortholog prediction algorithms in a yeast model clade. PLoS ONE 6, e18755 (2011).
19. Dalquen, D.A., Altenhoff, A.M., Gonnet, G.H. & Dessimoz, C. The impact of gene duplication, insertion, deletion, lateral gene transfer and sequencing error on orthology inference: a simulation study. PLoS ONE 8, e56925 (2013).
20. Schmitt, T., Messina, D.N., Schreiber, F. & Sonnhammer, E.L.L. SeqXML and OrthoXML: standards for sequence and orthology information. Brief. Bioinform. 12, 485-488 (2011).
21. Vilella, A.J. et al. EnsemblCompara GeneTrees: complete, duplication-aware phylogenetic trees in vertebrates. Genome Res. 19, 327-335 (2009).
22. Mi, H., Muruganujan, A. & Thomas, P.D. PANTHER in 2013: modeling the evolution of gene function, and other gene attributes, in the context of phylogenetic trees. Nucleic Acids Res. 41, D377-D386 (2013).
23. Huerta-Cepas, J., Capella-Gutiérrez, S., Pryszcz, L.P., Marcet-Houben, M. & Gabaldón, T. PhylomeDB v4: zooming into the plurality of evolutionary histories of a genome. Nucleic Acids Res. 42, D897-D902 (2014).
24. Overbeek, R., Fonstein, M., D'Souza, M., Pusch, G.D. & Maltsev, N. The use of gene clusters to infer functional coupling. Proc. Natl. Acad. Sci. USA 96, 2896-2901 (1999).
25. Wall, D.P., Fraser, H.B. & Hirsh, A.E. Detecting putative orthologs. Bioinformatics 19, 1710-1711 (2003).
26. Powell, S. et al. eggNOG v4.0: nested orthology inference across 3686 organisms. Nucleic Acids Res. 42, D231-D239 (2014).
27. Schreiber, F. & Sonnhammer, E.L.L. Hieranoid: hierarchical orthology inference. J. Mol. Biol. 425, 2072-2081 (2013).
28. Sonnhammer, E.L.L. & Östlund, G. InParanoid 8: orthology analysis between 273 proteomes, mostly eukaryotic. Nucleic Acids Res. 43, D234-D239 (2015).
29. Altenhoff, A.M. et al. The OMA orthology database in 2015: function predictions, better plant support, synteny view and other improvements. Nucleic Acids Res. 43, D240-D249 (2015).
30. Linard, B. et al. OrthoInspector 2.0: software and database updates. Bioinformatics 31, 447-448 (2015).
31. Pryszcz, L.P., Huerta-Cepas, J. & Gabaldón, T. MetaPhOrs: orthology and paralogy predictions from multiple phylogenetic evidence using a consistency-based confdence score. Nucleic Acids Res. 39, e32 (2011).
32. Robinson, D.F. & Foulds, L.R. Comparison of phylogenetic trees. Math. Biosci. 53, 131-147 (1981).
33. Zhang, X., Krause, K.-H., Xenarios, I., Soldati, T. & Boeckmann, B. Evolution of the ferric reductase domain (FRD) superfamily: modularity, functional diversifcation, and signature motifs. PLoS ONE 8, e58126 (2013).
34. Schreiber, F., Patricio, M., Muffato, M., Pignatelli, M. & Bateman, A. TreeFam v9: a new website, more species and orthology-on-the-fy. Nucleic Acids Res. 42, D922-D925 (2014).
35. Dimmer, E.C. et al. The UniProt-GO Annotation database in 2011. Nucleic Acids Res. 40, D565-D570 (2012).
36. Bairoch, A. The ENZYME database in 2000. Nucleic Acids Res. 28, 304-305 (2000).
37. Schlicker, A., Domingues, F.S., Rahnenführer, J. & Lengauer, T. A new measure for functional similarity of gene products based on Gene Ontology. BMC Bioinformatics 7, 302 (2006).
38. Wolf, Y.I. & Koonin, E.V. A tight link between orthologs and bidirectional best hits in bacterial and archaeal genomes. Genome Biol. Evol. 4, 1286-1294 (2012).
39. Dalquen, D.A. & Dessimoz, C. Bidirectional best hits miss many orthologs in duplication-rich clades such as plants and animals. Genome Biol. Evol. 5, 1800-1806 (2013).
40. Sennblad, B. & Lagergren, J. Probabilistic orthology analysis. Syst. Biol. 58, 411-424 (2009).
41. Akerborg, O., Sennblad, B., Arvestad, L. & Lagergren, J. Simultaneous Bayesian gene tree reconstruction and reconciliation analysis. Proc. Natl. Acad. Sci. USA 106, 5714-5719 (2009).
42. UniProt Consortium. Reorganizing the protein space at the Universal Protein Resource (UniProt). Nucleic Acids Res. 40, D71-D75 (2012).
43. Boeckmann, B. et al. Quest for Orthologs (QfO) entails Quest for Tree of Life (QfToL): in search of the gene stream. Genome Biol. Evol. 7, 1988-1999 (2015).
44. Hedges, S.B., Marin, J., Suleski, M., Paymer, M. & Kumar, S. Tree of life reveals clock-like speciation and diversifcation. Mol. Biol. Evol. 32, 835-845 (2015).
45. Jensen, L.J. et al. eggNOG: automated construction and annotation of orthologous groups of genes. Nucleic Acids Res. 36, D250-D254 (2008).
46. Huerta-Cepas, J., Dopazo, J. & Gabaldón, T. ETE: a python environment for tree exploration. BMC Bioinformatics 11, 24 (2010).
47. Katoh, K. & Toh, H. Recent developments in the MAFFT multiple sequence alignment program. Brief. Bioinform. 9, 286-298 (2008).
48. Edgar, R.C. MUSCLE: multiple sequence alignment with high accuracy and high throughput. Nucleic Acids Res. 32, 1792-1797 (2004).
49. Sievers, F. et al. Fast, scalable generation of high-quality protein multiple sequence alignments using Clustal Omega. Mol. Syst. Biol. 7, 539 (2011).
50. Wallace, I.M., O'Sullivan, O., Higgins, D.G. & Notredame, C. M-Coffee: combining multiple sequence alignment methods with T-Coffee. Nucleic Acids Res. 34, 1692-1699 (2006).
51. Capella-Gutiérrez, S., Silla-Martínez, J.M. & Gabaldón, T. trimAl: a tool for automated alignment trimming in large-scale phylogenetic analyses. Bioinformatics 25, 1972-1973 (2009).
52. Guindon, S. et al. New algorithms and methods to estimate maximum-likelihood phylogenies: assessing the performance of PhyML 3.0. Syst. Biol. 59, 307-321 (2010).
53. Huerta-Cepas, J., Dopazo, H., Dopazo, J. & Gabaldón, T. The human phylome. Genome Biol. 8, R109 (2007).
54. Altenhoff, A.M., Gil, M., Gonnet, G.H. & Dessimoz, C. Inferring hierarchical orthologous groups from orthologous gene pairs. PLoS ONE 8, e53786 (2013).
55. Linard, B., Thompson, J.D., Poch, O. & Lecompte, O. OrthoInspector: comprehensive orthology analysis and visual exploration. BMC Bioinformatics 12, 11 (2011).
56. Katoh, K. & Toh, H. Parallelization of the MAFFT multiple sequence alignment program. Bioinformatics 26, 1899-1900 (2010).
57. Thomas, P.D. GIGA: a simple, effcient algorithm for gene tree inference in the genomic age. BMC Bioinformatics 11, 312 (2010).
58. DeLuca, T.F., Cui, J., Jung, J.-Y., St Gabriel, K.C. & Wall, D.P. Roundup 2.0: enabling comparative genomics for over 1800 genomes. Bioinformatics 28, 715-716 (2012).
59. Gonnet, G.H., Hallett, M.T., Korostensky, C. & Bernardin, L. Darwin v. 2.0: an interpreted computer language for the biosciences. Bioinformatics 16, 101-103 (2000).
60. Wikipedia contributors. Least squares inference in phylogeny. Wikipedia, The Free Encyclopedia https://en.wikipedia.org/w/index. php?title=Least-squares-inference-in-phylogeny&oldid=552325441 (2013) (last accessed 7 March 2016).
61. Felsenstein, J. Inferring Phylogenies (Palgrave Macmillan, 2004).
62. Gene Ontology Consortium. Gene Ontology Consortium: going forward. Nucleic Acids Res. 43, D1049-D1056 (2015).
63. Lin, D. An information-theoretic defnition of similarity. in Proceedings of the 15th International Conference on Machine Learning (ed. Shavlik, J.W.) 296-304 (Morgan Kaufmann, San Francisco, California, USA, 1998).