Comprehensive evaluation of differential gene expression analysis methods for RNA-seq data

Genome Biology

Volumn 14, Issue 9, 2013, Pages

  Rapaport, Franck ^a   Khanin, Raya ^a   Liang, Yupu ^a   Pirun, Mono ^a   Krek, Azra ^a   Zumbo, Paul ^b   Mason, Christopher E ^b   Socci, Nicholas D ^a   Betel, Doron ^b  

^a MEMORIAL SLOAN KETTERING CANCER CENTER   (United States)

^b WEILL CORNELL MEDICAL COLLEGE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; COMPARATIVE STUDY; CONTROLLED STUDY; DIFFERENTIAL GENE EXPRESSION ANALYSIS; GENE EXPRESSION; GENE IDENTIFICATION; HUMAN; HUMAN CELL; MATHEMATICAL ANALYSIS; NUCLEOTIDE SEQUENCE; RNA ANALYSIS; RNA SEQUENCE; SEQUENCE ANALYSIS; STATISTICAL MODEL; THEORETICAL MODEL; BRAIN LEVEL; CELL LINE; COMPUTER PROGRAM; DNA MICROARRAY; GENE EXPRESSION PROFILING; GENETICS; HIGH THROUGHPUT SEQUENCING; INFORMATION PROCESSING; PROCEDURES; SIGNAL NOISE RATIO; STATISTICS AND NUMERICAL DATA;

NERVE PROTEIN; RNA;

BRAIN CHEMISTRY; CELL LINE; DATASETS AS TOPIC; GENE EXPRESSION; GENE EXPRESSION PROFILING; HIGH-THROUGHPUT NUCLEOTIDE SEQUENCING; HUMANS; NERVE TISSUE PROTEINS; OLIGONUCLEOTIDE ARRAY SEQUENCE ANALYSIS; RNA; SEQUENCE ANALYSIS, RNA; SIGNAL-TO-NOISE RATIO; SOFTWARE;

EID: 84883644707     PISSN: None     EISSN: 1474760X     Source Type: Journal    
DOI: 10.1186/gb-2013-14-9-r95     Document Type: Article

References (37)

1. Mortazavi A, Williams BA, McCue K, Schaeffer L, Wold B. Mapping and quantifying mammalian transcriptomes by RNA-Seq. Nat Methods 2008, 5:621-8. 10.1038/nmeth.1226, 18516045.
2. Berger MF, Levin JZ, Vijayendran K, Sivachenko A, Adiconis X, Maguire J, Johnson LA, Robinson J, Verhaak RG, Sougnez C, Onofrio RC, Ziaugra L, Cibulskis K, Laine E, Barretina J, Winckler W, Fisher DE, Getz G, Meyerson M, Jaffe DB, Gabriel SB, Lander ES, Dummer R, Gnirke A, Nusbaum C, Garraway LA. Integrative analysis of the melanoma transcriptome. Genome Res 2010, 20:413-27. 10.1101/gr.103697.109, 2847744, 20179022.
3. Wang Z, Gerstein M, Snyder M. RNA-Seq: a revolutionary tool for transcriptomics. Nat Rev Genet 2009, 10:57-63. 10.1038/nrg2484, 2949280, 19015660.
4. Young MD, McCarthy DJ, Wakefield MJ, Smyth GK, Oshlack A, Robinson MD. Differential expression for RNA sequencing (RNA-Seq) data: mapping, summarization, statistical analysis, and experimental design. Bioinformatics for High Throughput Sequencing 2012, 169-90. New York: Springer, Rodríguez-Ezpeleta N, Hackenberg M, Aransay AM.
5. Trapnell C, Hendrickson DG, Sauvageau M, Goff L, Rinn JL, Pachter L. Differential analysis of gene regulation at transcript resolution with RNA-seq. Nat Biotechnol 2013, 31:46-53.
6. Robinson MD, McCarthy DJ, Smyth GK. edgeR: a Bioconductor package for differential expression analysis of digital gene expression data. Bioinformatics 2010, 26:139-40. 10.1093/bioinformatics/btp616, 2796818, 19910308.
7. Anders S, Huber W. Differential expression analysis for sequence count data. Genome Biol 2010, 11:R106. 10.1186/gb-2010-11-10-r106, 3218662, 20979621.
8. Li J, Witten DM, Johnstone IM, Tibshirani R. Normalization, testing, and false discovery rate estimation for RNA-sequencing data. Biostatistics 2012, 13:523-38. 10.1093/biostatistics/kxr031, 3372940, 22003245.
9. Hardcastle TJ, Kelly KA. baySeq: empirical Bayesian methods for identifying differential expression in sequence count data. BMC Bioinformatics 2010, 11:422. 10.1186/1471-2105-11-422, 2928208, 20698981.
10. Smyth GK. Linear models and empirical Bayes methods for assessing differential expression in microarray experiments. Stat Appl Genet Mol Biol 2004, 3:Article 3.
11. Shi L, Campbell G, Jones WD, Campagne F, Wen Z, Walker SJ, Su Z, Chu TM, Goodsaid FM, Pusztai L, Shaughnessy JD, Oberthuer A, Thomas RS, Paules RS, Fielden M, Barlogie B, Chen W, Du P, Fischer M, Furlanello C, Gallas BD, Ge X, Megherbi DB, Symmans WF, Wang MD, Zhang J, Bitter H, Brors B, Bushel PR, Bylesjo M, et al. The MicroArray Quality Control (MAQC)-II study of common practices for the development and validation of microarray-based predictive models. Nat Biotechnol 2010, 28:827-38. 10.1038/nbt.1665, 3315840, 20676074.
12. Shi L, Reid LH, Jones WD, Shippy R, Warrington JA, Baker SC, Collins PJ, de Longueville F, Kawasaki ES, Lee KY, Luo Y, Sun YA, Willey JC, Setterquist RA, Fischer GM, Tong W, Dragan YP, Dix DJ, Frueh FW, Goodsaid FM, Herman D, Jensen RV, Johnson CD, Lobenhofer EK, Puri RK, Schrf U, Thierry-Mieg J, Wang C, Wilson M, et al. MAQC Consortium The MicroArray Quality Control (MAQC) project shows inter- and intraplatform reproducibility of gene expression measurements. Nat Biotechnol 2006, 24:1151-61. 10.1038/nbt1239, 3272078, 16964229, MAQC Consortium.
13. Djebali S, Davis CA, Merkel A, Dobin A, Lassmann T, Mortazavi A, Tanzer A, Lagarde J, Lin W, Schlesinger F, Xue C, Marinov GK, Khatun J, Williams BA, Zaleski C, Rozowsky J, Röder M, Kokocinski F, Abdelhamid RF, Alioto T, Antoshechkin I, Baer MT, Bar NS, Batut P, Bell K, Bell I, Chakrabortty S, Chen X, Chrast J, Curado J, et al. Landscape of transcription in human cells. Nature 2012, 489:101-8. 10.1038/nature11233, 3684276, 22955620.
14. ENCODE files. , http://hgdownload.cse.ucsc.edu/goldenPath/hg19/encodeDCC/wgEncodeCaltechRnaSeq/
15. Anders S. HTSeq: Analysis of high-throughput sequencing data with Python. 2011, , http://www-huber.embl.de/users/anders/HTSeq/
16. Wysoker A, Tibbetts K, Fennell T. Picard. 2012, , http://picard.sourceforge.net/
17. Quinlan AR, Hall IM. BEDTools: a flexible suite of utilities for comparing genomic features. Bioinformatics 2010, 26:841-2. 10.1093/bioinformatics/btq033, 2832824, 20110278.
18. Liao Y, Smyth GK, Shi W. featureCounts: an efficient general-purpose read summarization program. 2013, arXiv preprint arXiv:1305.3347.
19. Trapnell C, Williams BA, Pertea G, Mortazavi A, Kwan G, van Baren MJ, Salzberg SL, Wold BJ, Pachter L. Transcript assembly and quantification by RNA-Seq reveals unannotated transcripts and isoform switching during cell differentiation. Nat Biotechnol 2010, 28:511-5. 10.1038/nbt.1621, 3146043, 20436464.
20. Oshlack A, Wakefield MJ. Transcript length bias in RNA-seq data confounds systems biology. Biol Direct 2009, 4:14. 10.1186/1745-6150-4-14, 2678084, 19371405.
21. Gail M. Power Computations for Designing Comparative Poisson Trials. Biometrics 1974, 30:231-7.
22. Aban IB, Cutter GR, Mavinga N. Inferences and power analysis concerning two negative binomial distributions with an application to MRI lesion counts data. Comput Stat Data Anal 2008, 53:820-33. 2631439, 19177180.
23. Dillies MA, Rau A, Aubert J, Hennequet-Antier C, Jeanmougin M, Servant N, Keime C, Marot G, Castel D, Estelle J, Guernec G, Jagla B, Jouneau L, Laloë D, Le Gall C, Schaëffer B, Le Crom S, Guedj M, Jaffrézic F, on behalf of The French StatOmique Consortium A comprehensive evaluation of normalization methods for Illumina high-throughput RNA sequencing data analysis. Brief Bioinform 2012, on behalf of The French StatOmique Consortium.
24. Bullard JH, Purdom E, Hansen KD, Dudoit S. Evaluation of statistical methods for normalization and differential expression in mRNA-Seq experiments. BMC Bioinformatics 2010, 11:94. 10.1186/1471-2105-11-94, 2838869, 20167110.
25. Robinson MD, Oshlack A. A scaling normalization method for differential expression analysis of RNA-seq data. Genome Biol 2010, 11:R25. 10.1186/gb-2010-11-3-r25, 2864565, 20196867.
26. Bolstad BM, Irizarry RA, Astrand M, Speed TP. A comparison of normalization methods for high density oligonucleotide array data based on variance and bias. Bioinformatics 2003, 19:185-93. 10.1093/bioinformatics/19.2.185, 12538238.
27. Law CW, Chen Y, Shi W, Smyth GK. Voom! Precision weights unlock linear model analysis tools for RNA-seq read counts. Technical report 2013, Bioinformatics Division, Walter and Eliza Hall Institute of Medical Research, Melbourne, Australia., http://www. statsci. org/smyth/pubs/13 5 1-voom-techreport. pdf
28. Robinson MD, Smyth GK. Moderated statistical tests for assessing differences in tag abundance. Bioinformatics 2007, 23:2881-7. 10.1093/bioinformatics/btm453, 17881408.
29. Nagalakshmi U, Wang Z, Waern K, Shou C, Raha D, Gerstein M, Snyder M. The transcriptional landscape of the yeast genome defined by RNA sequencing. Science 2008, 320:1344-9. 10.1126/science.1158441, 2951732, 18451266.
30. Marioni JC, Mason CE, Mane SM, Stephens M, Gilad Y. RNA-seq: an assessment of technical reproducibility and comparison with gene expression arrays. Genome Res 2008, 18:1509-17. 10.1101/gr.079558.108, 2527709, 18550803.
31. Canales RD, Luo Y, Willey JC, Austermiller B, Barbacioru CC, Boysen C, Hunkapiller K, Jensen RV, Knight CR, Lee KY, Ma Y, Maqsodi B, Papallo A, Peters EH, Poulter K, Ruppel PL, Samaha RR, Shi L, Yang W, Zhang L, Goodsaid FM. Evaluation of DNA microarray results with quantitative gene expression platforms. Nat Biotechnol 2006, 24:1115-22. 10.1038/nbt1236, 16964225.
32. Anders S, Reyes A, Huber W. Detecting differential usage of exons from RNA-seq data. Genome Res 2012, 22:2008-17. 10.1101/gr.133744.111, 3460195, 22722343.
33. Robles JA, Qureshi SE, Stephen SJ, Wilson SR, Burden CJ, Taylor JM. Efficient experimental design and analysis strategies for the detection of differential expression using RNA-Sequencing. BMC Genomics 2012, 13:484. 10.1186/1471-2164-13-484, 3560154, 22985019.
34. Kvam VM, Liu P, Si Y. A comparison of statistical methods for detecting differentially expressed genes from RNA-seq data. Am J Bot 2012, 99:248-56. 10.3732/ajb.1100340, 22268221.
35. McCarthy DJ, Chen Y, Smyth GK. Differential expression analysis of multifactor RNA-Seq experiments with respect to biological variation. Nucleic Acids Res 2012, 40:4288-97. 10.1093/nar/gks042, 3378882, 22287627.
36. Saletore Y, Meyer K, Korlach J, Vilfan ID, Jaffrey S, Mason CE. The birth of the epitranscriptome: deciphering the function of RNA modifications. Genome Biol 2012, 13:175. 10.1186/gb-2012-13-10-175, 23113984.
37. soccin. , http://bitbucket.org/soccin/seqc