Avoiding the pitfalls of gene set enrichment analysis with SetRank

BMC Bioinformatics

Volumn 18, Issue 1, 2017, Pages

  Simillion, Cedric ^a   Liechti, Robin ^b   Lischer, Heidi E L ^a,c   Ioannidis, Vassilios ^b   Bruggmann, Rémy ^a  

^a UNIVERSITY OF BERN   (Switzerland)

^b SWISS INSTITUTE OF BIOINFORMATICS   (Switzerland)

^c UNIVERSITY OF ZURICH   (Switzerland)

Author keywords

Algorithm; Functional genomics; Gene set enrichment analysis; GSEA; Pathway analysis; R package; Sample source bias; Web interface

Indexed keywords

ALGORITHMS; BENCHMARKING;

FUNCTIONAL GENOMICS; GENE SET ENRICHMENT ANALYSIS; GSEA; PATHWAY ANALYSIS; WEB INTERFACE;

GENES;

BENCHMARKING; FUNCTIONAL GENOMICS; RELIABILITY; ALGORITHM; BIOLOGY; BRAIN; GENE EXPRESSION PROFILING; GENETIC DATABASE; GENETICS; GENOMICS; HUMAN; HUMAN GENOME; METABOLISM; NEOPLASM; PROCEDURES; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; THEORETICAL MODEL;

ALGORITHMS; BRAIN; COMPUTATIONAL BIOLOGY; DATABASES, GENETIC; GENE EXPRESSION PROFILING; GENOME, HUMAN; GENOMICS; HUMANS; MODELS, THEORETICAL; NEOPLASMS; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY;

EID: 85014350524     PISSN: None     EISSN: 14712105     Source Type: Journal    
DOI: 10.1186/s12859-017-1571-6     Document Type: Article

References (39)

1. Ashburner M, Ball CA, Blake JA, Botstein D, Butler H, Cherry JM, Davis AP, Dolinski K, Dwight SS, Eppig JT, Harris MA, Hill DP, Issel-Tarver L, Kasarskis A, Lewis S, Matese JC, Richardson JE, Ringwald M, Rubin GM, Sherlock G. Gene ontology: tool for the unification of biology. the gene ontology consortium. Nat Genet. 2000;25(1):25-9. doi: 10.1038/75556.
2. Kanehisa M, Goto S, Sato Y, Kawashima M, Furumichi M, Tanabe M. Data, information, knowledge and principle: back to metabolism in kegg. Nucleic Acids Res. 2014;42(Database issue):199-205. doi: 10.1093/nar/gkt1076.
3. Croft D, Mundo AF, Haw R, Milacic M, Weiser J, Wu G, Caudy M, Garapati P, Gillespie M, Kamdar MR, Jassal B, Jupe S, Matthews L, May B, Palatnik S, Rothfels K, Shamovsky V, Song H, Williams M, Birney E, Hermjakob H, Stein L, D'Eustachio P. The reactome pathway knowledgebase. Nucleic Acids Res. 2014;42(Database issue):472-7. doi: 10.1093/nar/gkt1102.
4. Kelder T, van Iersel MP, Hanspers K, Kutmon M, Conklin BR, Evelo CT, Pico AR. Wikipathways: building research communities on biological pathways. Nucleic Acids Res. 2012;40(Database issue):1301-7. doi: 10.1093/nar/gkr1074.
5. Karp PD, Ouzounis CA, Moore-Kochlacs C, Goldovsky L, Kaipa P, Ahrén D, Tsoka S, Darzentas N, Kunin V, López-Bigas N. Expansion of the biocyc collection of pathway/genome databases to 160 genomes. Nucleic Acids Res. 2005;33(19):6083-9. doi: 10.1093/nar/gki892.
6. Pan K-H, Lih C-J, Cohen SN. Effects of threshold choice on biological conclusions reached during analysis of gene expression by dna microarrays. Proc Natl Acad Sci U S A. 2005;102(25):8961-5. doi: 10.1073/pnas.0502674102.
7. Tarca AL, Bhatti G, Romero R. A comparison of gene set analysis methods in terms of sensitivity, prioritization and specificity. PLoS One. 2013;8(11):79217. doi: 10.1371/journal.pone.0079217.
8. Eden E, Lipson D, Yogev S, Yakhini Z. Discovering motifs in ranked lists of dna sequences. PLoS Comput Biol. 2007;3(3):39. doi: 10.1371/journal.pcbi.0030039.
9. Eden E, Navon R, Steinfeld I, Lipson D, Yakhini Z. Gorilla: a tool for discovery and visualization of enriched go terms in ranked gene lists. BMC Bioinformatics. 2009;10:48. doi: 10.1186/1471-2105-10-48.
10. Tarca AL, Draghici S, Bhatti G, Romero R. Down-weighting overlapping genes improves gene set analysis. BMC Bioinformatics. 2012;13:136. doi: 10.1186/1471-2105-13-136.
11. Maere S, Heymans K, Kuiper M. Bingo: a cytoscape plugin to assess overrepresentation of gene ontology categories in biological networks. Bioinformatics. 2005;21(16):3448-9. doi: 10.1093/bioinformatics/bti551.
12. Alexa A, Rahnenführer J, Lengauer T. Improved scoring of functional groups from gene expression data by decorrelating go graph structure. Bioinformatics. 2006;22(13):1600-7. doi: 10.1093/bioinformatics/btl140.
13. Nam D, Kim S-B, Kim S-K, Yang S, Kim S-Y, Chu I-S. Adgo: analysis of differentially expressed gene sets using composite go annotation. Bioinformatics. 2006;22(18):2249-53. doi: 10.1093/bioinformatics/btl378.
14. Lu Y, Rosenfeld R, Simon I, Nau GJ, Bar-Joseph Z. A probabilistic generative model for go enrichment analysis. Nucleic Acids Res. 2008;36(17):109. doi: 10.1093/nar/gkn434.
15. Bauer S, Gagneur J, Robinson PN. Going bayesian: model-based gene set analysis of genome-scale data. Nucleic Acids Res. 2010;38(11):3523-32. doi: 10.1093/nar/gkq045.
16. Falcon S, Gentleman R. Using gostats to test gene lists for go term association. Bioinformatics. 2007;23(2):257-8. doi: 10.1093/bioinformatics/btl567.
17. Jiang Z, Gentleman R. Extensions to gene set enrichment. Bioinformatics. 2007;23(3):306-13. doi: 10.1093/bioinformatics/btl599.
18. Brin, S., Page, L.: The anatomy of a large-scale hypertextual web search engine. Computer Networks and ISDN Systems 30(1-7), 107-117 (1998). doi: 10.1016/S0169-7552(98)00110-X. Proceedings of the Seventh International World Wide Web Conference
19. Smoot ME, Ono K, Ruscheinski J, Wang P-L, Ideker T. Cytoscape 2.8: new features for data integration and network visualization. Bioinformatics. 2011;27(3):431-2. doi: 10.1093/bioinformatics/btq675.
20. Szklarczyk D, Franceschini A, Wyder S, Forslund K, Heller D, Huerta-Cepas J, Simonovic M, Roth A, Santos A, Tsafou KP, Kuhn M, Bork P, Jensen LJ, von Mering C. String v10: protein-protein interaction networks, integrated over the tree of life. Nucleic Acids Res. 2015;43(Database issue):447-52. doi: 10.1093/nar/gku1003.
21. Krupp M, Marquardt JU, Sahin U, Galle PR, Castle J, Teufel A. Rna-seq atlas - a reference database for gene expression profiling in normal tissue by next-generation sequencing. Bioinformatics. 2012;28(8):1184. doi: 10.1093/bioinformatics/bts084.
22. Bastian F, Parmentier G, Roux J, Moretti S, Laudet V, Robinson-Rechavi M, Bairoch A, Cohen-Boulakia S, Froidevaux C. Bgee: integrating and comparing heterogeneous transcriptome data among species. Berlin, Heidelberg: Springer; 2008. p. 124-31.
23. Raghavan N, Amaratunga D, Cabrera J, Nie A, Qin J, McMillian M. On methods for gene function scoring as a means of facilitating the interpretation of microarray results. J Comput Biol. 2006;13(3):798-809. doi: 10.1089/cmb.2006.13.798.
24. Holm S. A simple sequentially rejective multiple test procedure. Scand J Stat. 1979;6(2):65-70.
25. Barrett T, Wilhite SE, Ledoux P, Evangelista C, Kim IF, Tomashevsky M, Marshall KA, Phillippy KH, Sherman PM, Holko M, Yefanov A, Lee H, Zhang N, Robertson CL, Serova N, Davis S, Soboleva A. Ncbi geo: archive for functional genomics data sets-update. Nucleic Acids Res. 2013;41(Database issue):991-5. doi: 10.1093/nar/gks1193.
26. Dai M, Wang P, Boyd AD, Kostov G, Athey B, Jones EG, Bunney WE, Myers RM, Speed TP, Akil H, Watson SJ, Meng F. Evolving gene/transcript definitions significantly alter the interpretation of genechip data. Nucleic Acids Res. 2005;33(20):175. doi: 10.1093/nar/gni179.
27. Irizarry RA, Hobbs B, Collin F, Beazer-Barclay YD, Antonellis KJ, Scherf U, Speed TP. Exploration, normalization, and summaries of high density oligonucleotide array probe level data. Biostatistics. 2003;4(2):249-64. doi: 10.1093/biostatistics/4.2.249.
28. Tomfohr J, Lu J, Kepler TB. Pathway level analysis of gene expression using singular value decomposition. BMC Bioinformatics. 2005;6:225. doi: 10.1186/1471-2105-6-225.
29. Goeman JJ, van de Geer SA, de Kort F, van Houwelingen HC. A global test for groups of genes: testing association with a clinical outcome. Bioinformatics. 2004;20(1):93-9.
30. Barry WT, Nobel AB, Wright FA. Significance analysis of functional categories in gene expression studies: a structured permutation approach. Bioinformatics. 2005;21(9):1943-9. doi: 10.1093/bioinformatics/bti260.
31. Tian L, Greenberg SA, Kong SW, Altschuler J, Kohane IS, Park PJ. Discovering statistically significant pathways in expression profiling studies. Proc Natl Acad Sci U S A. 2005;102(38):13544-9. doi: 10.1073/pnas.0506577102.
32. Efron B, Tibshirani R. R.: On testing the significance of sets of genes. The annals of applied statistics. 2007. p. 107-29.
33. Barbie DA, Tamayo P, Boehm JS, Kim SY, Moody SE, Dunn IF, Schinzel AC, Sandy P, Meylan E, Frohling S, Chan EM, Sos ML, Michel K, Mermel C, Silver SJ, Weir BA, Reiling JH, Sheng Q, Gupta PB, Wadlow RC, Le H, Hoersch S, Wittner BS, Ramaswamy S, Livingston DM, Sabatini DM, Meyerson M, Thomas RK, Lander ES, Mesirov JP, Root DE, Gilliland DG, Jacks T, Hahn WC. Systematic rna interference reveals that oncogenic kras-driven cancers require tbk1. Nature. 2009;462(7269):108-12. doi: 10.1038/nature08460.
34. Lee E, Chuang H-Y, Kim J-W, Ideker T, Lee D. Inferring pathway activity toward precise disease classification. PLoS Comput Biol. 2008;4(11):1000217. doi: 10.1371/journal.pcbi.1000217.
35. Subramanian A, Tamayo P, Mootha VK, Mukherjee S, Ebert BL, Gillette MA, Paulovich A, Pomeroy SL, Golub TR, Lander ES, Mesirov JP. Gene set enrichment analysis: a knowledge-based approach for interpreting genome-wide expression profiles. Proc Natl Acad Sci U S A. 2005;102(43):15545-50. doi: 10.1073/pnas.0506580102.
36. Hänzelmann S, Castelo R, Guinney J. Gsva: gene set variation analysis for microarray and rna-seq data. BMC Bioinformatics. 2013;14:7. doi: 10.1186/1471-2105-14-7.
37. Wu D, Smyth GK. Camera: a competitive gene set test accounting for inter-gene correlation. Nucleic Acids Res. 2012;40(17):133. doi: 10.1093/nar/gks461.
38. Michaud J, Simpson KM, Escher R, Buchet-Poyau K, Beissbarth T, Carmichael C, Ritchie ME, Schutz F, Cannon P, Liu M, Shen X, Ito Y, Raskind WH, Horwitz MS, Osato M, Turner DR, Speed TP, Kavallaris M, Smyth GK, Scott HS. Integrative analysis of runx1 downstream pathways and target genes. BMC Genomics. 2008;9:363. doi: 10.1186/1471-2164-9-363.
39. Luo W, Friedman MS, Shedden K, Hankenson KD, Woolf PJ. Gage: generally applicable gene set enrichment for pathway analysis. BMC Bioinformatics. 2009;10:161. doi: 10.1186/1471-2105-10-161.