Gene set analysis approaches for RNA-seq data: Performance evaluation and application guideline

Briefings in Bioinformatics

Volumn 17, Issue 3, 2016, Pages 393-407

  Rahmatallah, Yasir ^a   Emmert Streib, Frank ^b   Glazko, Galina ^a  

^a UNIVERSITY OF ARKANSAS FOR MEDICAL SCIENCES   (United States)

^b TAMPERE UNIVERSITY OF TECHNOLOGY   (Finland)

Author keywords

Competitive; Gene set analysis; RNA seq; Robustnes; Self contained

Indexed keywords

GENE INACTIVATION; PRACTICE GUIDELINE; REPRODUCIBILITY; SAMPLE SIZE; SELECTION BIAS; STATISTICAL MODEL; GENE EXPRESSION PROFILING; GENETICS; HIGH THROUGHPUT SEQUENCING; SEQUENCE ANALYSIS;

RNA;

GENE EXPRESSION PROFILING; HIGH-THROUGHPUT NUCLEOTIDE SEQUENCING; REPRODUCIBILITY OF RESULTS; RNA; SAMPLE SIZE; SEQUENCE ANALYSIS, RNA;

EID: 84971667844     PISSN: 14675463     EISSN: 14774054     Source Type: Journal    
DOI: 10.1093/bib/bbv069     Document Type: Article

References (62)

1. Ledford H. The death of microarrays? Nature 2008;455:847.
2. Fu X, Fu N, Guo S, et al. Estimating accuracy of RNA-Seq and microarrays with proteomics. BMC Genomics 2009;10:161.
3. Wang ET, Sandberg R, Luo S, et al. Alternative isoform regulation in human tissue transcriptomes. Nature 2008;456:470-6.
4. Core LJ, Waterfall JJ, Lis JT. Nascent RNA sequencing reveals widespread pausing and divergent initiation at human promoters. Science 2008;322:1845-8.
5. Wilhelm BT, Marguerat S, Watt S, et al. Dynamic repertoire of a eukaryotic transcriptome surveyed at single-nucleotide resolution. Nature 2008;453:1239-43.
6. Jiang Q, Ma R, Wang J, et al. LncRNA2Function: a comprehensive resource for functional investigation of human lncRNAs based on RNA-seq data. BMC Genomics 2015;16(Suppl 3):S2.
7. Johnston M. Gene chips: array of hope for understanding gene regulation. Curr Biol 1998;8:R171-4.
8. Robinson MD, McCarthy DJ, Smyth GK. edgeR: a Bioconductor package for differential expression analysis of digital gene expression data. Bioinformatics 2010;26:139-40.
9. Anders S, Huber W. Differential expression analysis for sequence count data. Genome Biol 2010;11:R106.
10. Li J, Tibshirani R. Finding consistent patterns: a nonparametric approach for identifying differential expression in RNASeq data. Stat Methods Med Res 2013;22:519-36.
11. Law CW, Chen Y, Shi W, et al. Voom: precision weights unlock linear model analysis tools for RNA-seq read counts. Genome Biol 2014;15:R29.
12. Smyth G. Limma: linear models for microarray data. In: G Smyth, R Gentleman, V Carey, et al. (eds). Bioinformatics and Computational Biology Solutions using R and Bioconductor. New York: Springer, 2005, 397-420.
13. Huang da W, Sherman BT, Lempicki RA. Systematic and integrative analysis of large gene lists using DAVID bioinformatics resources. Nat Protoc 2009;4:44-57.
14. Mootha VK, Lindgren CM, Eriksson KF, et al. PGC-1alpha-responsive genes involved in oxidative phosphorylation are coordinately downregulated in human diabetes. Nat Genet 2003;34:267-73.
15. Glazko GV, Emmert-Streib F. Unite and conquer: univariate and multivariate approaches for finding differentially expressed gene sets. Bioinformatics 2009;25:2348-54.
16. Emmert-Streib F, Glazko GV. Pathway analysis of expression data: deciphering functional building blocks of complex diseases. PLoS Comput Biol 2011;7:e1002053.
17. Young MD, Wakefield MJ, Smyth GK, et al. Gene ontology analysis for RNA-seq: accounting for selection bias. Genome Biol 2010;11:R14.
18. Ritchie ME, Phipson B, Wu D, et al. limma powers differential expression analyses for RNA-sequencing and microarray studies. Nucleic Acids Res 2015;43:e47.
19. Ackermann M, Strimmer K. A general modular framework for gene set enrichment analysis. BMC Bioinformatics 2009;10:47.
20. Huang daW, Sherman BT, Lempicki RA. Bioinformatics enrichment tools: paths toward the comprehensive functional analysis of large gene lists. Nucleic Acids Res 2009;37: 1-13.
21. Dinu I, Potter JD, Mueller T, et al. Gene-set analysis and reduction. Brief Bioinform 2009;10:24-34.
22. Goeman JJ, Buhlmann P. Analyzing gene expression data in terms of gene sets: methodological issues. Bioinformatics 2007;23:980-7.
23. Tian L, Greenberg SA, Kong SW, et al. Discovering statistically significant pathways in expression profiling studies. Proc Natl Acad Sci USA 2005;102:13544-9.
24. Rahmatallah Y, Emmert-Streib F, Glazko G. Gene set analysis for self-contained tests: complex null and specific alternative hypotheses. Bioinformatics 2012;28:3073-80.
25. Rahmatallah Y, Emmert-Streib F, Glazko G. Comparative evaluation of gene set analysis approaches for RNA-Seq data. BMC Bioinformatics 2014;15:397.
26. Montaner D, Minguez P, Al-Shahrour F, et al. Gene set internal coherence in the context of functional profiling. BMC Genomics 2009;10:197.
27. Gatti DM, Barry WT, Nobel AB, et al. Heading down the wrong pathway: on the influence of correlation within gene sets. BMC Genomics 2010;11:574.
28. Tripathi S, Emmert-Streib F. Assessment method for a power analysis to identify differentially expressed pathways. PLoS One 2012;7:e37510.
29. Wang X, Dinu I, Liu W, et al. Linear combination test for hierarchical gene set analysis. Stat Appl Genet Mol Biol 2011;10:Article 13.
30. Hanzelmann S, Castelo R, Guinney J. GSVA: gene set variation analysis for microarray and RNA-seq data. BMC Bioinformatics 2013;14:7.
31. Barry WT, Nobel AB, Wright FA. A statistical framework for testing functional categories in microarray data. Ann Appl Stat 2008;2:286-315.
32. Nam D, Kim SY. Gene-set approach for expression pattern analysis. Brief Bioinform 2008;9:189-97.
33. Maciejewski H. Gene set analysis methods: statistical models andmethodological differences. Brief Bioinform 2014;15:504-18.
34. Tamayo P, Steinhardt G, Liberzon A, et al. The limitations of simple gene set enrichment analysis assuming gene independence. Stat Methods Med Res 2012;0962280212460441.
35. Tarca AL, Bhatti G, Romero R. A comparison of gene set analysis methods in terms of sensitivity, prioritization and specificity. PLoS One 2013;8:e79217.
36. Khatri P, Sirota M, Butte AJ. Ten years of pathway analysis: current approaches and outstanding challenges. PLoS Comput Biol 2012;8:e1002375.
37. Tripathi S, Glazko GV, Emmert-Streib F. Ensuring the statistical soundness of competitive gene set approaches: gene filtering and genome-scale coverage are essential. Nucleic Acids Res 2013;41:e82.
38. Wang X, Cairns MJ. Gene set enrichment analysis of RNA-Seq data: integrating differential expression and splicing. BMC Bioinformatics 2013;14(Suppl 5):S16.
39. Dinu I, Potter JD, Mueller T, et al. Improving gene set analysis of microarray data by SAM-GS. BMC Bioinformatics 2007;8:242.
40. Subramanian A, Tamayo P, Mootha VK, et al. Gene set enrichment analysis: a knowledge-based approach for interpreting genome-wide expression profiles. Proc Natl Acad Sci USA 2005;102:15545-50.
41. Barbie DA, Tamayo P, Boehm JS, et al. Systematic RNA interference reveals that oncogenic KRAS-driven cancers require TBK1. Nature 2009;462:108-12.
42. Mortazavi A, Williams BA, McCue K, et al. Mapping and quantifying mammalian transcriptomes by RNA-Seq. Nat Methods 2008;5:621-8.
43. Robinson MD, Oshlack A. A scaling normalization method for differential expression analysis of RNA-seq data. Genome Biol 2010;11:R25.
44. Bullard JH, Purdom E, Hansen KD, et al. Evaluation of statistical methods for normalization and differential expression in mRNA-Seq experiments. BMC Bioinformatics 2010;11:94.
45. Hansen KD, Irizarry RA, Wu Z. Removing technical variability in RNA-seq data using conditional quantile normalization. Biostatistics 2012;13:204-16.
46. Fridley BL, Jenkins GD, Grill DE, et al. Soft truncation thresholding for gene set analysis of RNA-seq data: application to a vaccine study. Sci Rep 2013;3:2898.
47. Fisher R. Statistical Methods for Research Workers. Oliver & Boyd, Edinburg, 1932.
48. Stouffer S, DeVinney L, Suchmen E. The American Soldier: Adjustment during Army Life. Princeton, NJ: Princeton University Press, 1949.
49. Tusher VG, Tibshirani R, Chu G. Significance analysis of microarrays applied to the ionizing radiation response. Proc Natl Acad Sci USA 2001;98:5116-21.
50. Baldi P, Long AD. A Bayesian framework for the analysis of microarray expression data: regularized t-test and statistical inferences of gene changes. Bioinformatics 2001;17: 509-19.
51. Smyth GK. Linear models and empirical Bayes methods for assessing differential expression in microarray experiments. Stat Appl Genet Mol Biol 2004;3:3.
52. Liu Q, Dinu I, Adewale AJ, et al. Comparative evaluation of gene-set analysis methods. BMC Bioinformatics 2007;8:431.
53. Friedman JH, Rafsky C. Multivariate generalizations of the Wald-Wolfowitz and Smirnov two-sample tests. Ann Stat 1979;7:697-717.
54. Baringhaus L, Franz C. On a new multivariate two-sample test. J Multivar Anal 2004;88:190-206.
55. Klebanov L, Glazko G, Salzman P, et al. A multivariate extension of the gene set enrichment analysis. J Bioinform Comput Biol 2007;5:1139-53.
56. Wu D, Lim E, Vaillant F, et al. ROAST: rotation gene set tests for complex microarray experiments. Bioinformatics 2010;26:2176-82.
57. Damian D, Gorfine M. Statistical concerns about the GSEA procedure. Nat Genet 2004;36:Author reply 663.
58. Wang X, Cairns MJ. SeqGSEA: a Bioconductor package for gene set enrichment analysis of RNA-Seq data integrating differential expression and splicing. Bioinformatics 2014;30:1777-9.
59. Pickrell JK, Marioni JC, Pai AA, et al. Understanding mechanisms underlying human gene expression variation with RNA sequencing. Nature 2010;464:768-772.
60. Liberzon A, Subramanian A, Pinchback R, et al. Molecular signatures database (MSigDB) 3.0. Bioinformatics 2011;27: 1739-40.
61. Robinson MD, Smyth GK. Moderated statistical tests for assessing differences in tag abundance. Bioinformatics 2007;23:2881-7.
62. Su Z, Fang H, Hong H, et al. An investigation of biomarkers derived from legacy microarray data for their utility in the RNA-seq era. Genome Biol 2014;15:523.