How many biological replicates are needed in an RNA-seq experiment and which differential expression tool should you use?

RNA

Volumn 22, Issue 6, 2016, Pages 839-851

  Schurch, Nicholas J ^a   Schofield, Pietá ^a   Gierliński, Marek ^a   Cole, Christian ^a   Sherstnev, Alexander ^a   Singh, Vijender ^a   Wrobel, Nicola ^b   Gharbi, Karim ^b   Simpson, Gordon G ^a   Owen Hughes, Tom ^a   Blaxter, Mark ^b   Barton, Geoffrey J ^a  

^a UNIVERSITY OF DUNDEE   (United Kingdom)

^b UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

Benchmarking; Differential expression; Experimental design; Replication; RNA seq; Statistical power; Yeast

Indexed keywords

RNA; FUNGAL RNA;

ARTICLE; GENE EXPRESSION; GENE IDENTIFICATION; NONHUMAN; PRIORITY JOURNAL; RNA SEQUENCE; SACCHAROMYCES CEREVISIAE; GENE EXPRESSION PROFILING; GENETICS; PROCEDURES; REPRODUCIBILITY; SEQUENCE ANALYSIS;

GENE EXPRESSION PROFILING; REPRODUCIBILITY OF RESULTS; RNA, FUNGAL; SACCHAROMYCES CEREVISIAE; SEQUENCE ANALYSIS, RNA;

EID: 84970949920     PISSN: 13558382     EISSN: 14699001     Source Type: Journal    
DOI: 10.1261/rna.053959.115     Document Type: Article

References (71)

1. Anders S, Huber W. 2010. Differential expression analysis for sequence count data. Genome Biol 11: R106.
2. Anders S, Pyl PT, HuberW. 2015. HTSeq-a Python framework to work with high-throughput sequencing data. Bioinformatics 31: 166-169.
3. Auer PL, Doerge RW. 2010. Statistical design and analysis of RNA sequencing data. Genetics 185: 405-416.
4. Becker PB, Horz W. 2002. ATP-dependent nucleosome remodeling.Annu Rev Biochem 71: 247-273.
5. Bellera CA, Julien M, Hanley JA. 2010. Normal approximations to the distributions of the Wilcoxon statistics: accurate to what N? Graphical insights. J Stat Educ 18.
6. Benjamini Y, Hochberg Y. 1995. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc B (Methodol) 57: 289-300.
7. Bottomly D, Walter NA, Hunter JE, Darakjian P, Kawane S, Buck KJ, Searles RP, Mooney M, McWeeney SK, Hitzemann R. 2011.Evaluating gene expression in C57BL/6J and DBA/2J mouse striatum using RNA-Seq and microarrays. PLoS One 6: e17820.
8. Bullard JH, Purdom E, Hansen KD, Dudoit S. 2010. Evaluation of statistical methods for normalization and differential expression in mRNA-Seq experiments. BMC Bioinformatics 11: 94.
9. Burden C, Qureshi S, Wilson SR. 2014. Error estimates for the analysis of differential expression from RNA-seq count data. PeerJ 2: e576.
10. Busby MA, Stewart C, Miller CA, Grzeda KR, Marth GT. 2013. Scotty: a web tool for designing RNA-Seq experiments to measure differential gene expression. Bioinformatics 29: 656-657.
11. The Cancer Genome Atlas Research Network. 2008. Comprehensive genomic characterization defines human glioblastoma genes and core pathways. Nature 455: 1061-1068.
12. Cheung VG, Nayak RR, Wang IX, Elwyn S, Cousins SM, Morley M, Spielman RS. 2010. Polymorphic cis- and trans-regulation of human gene expression. PLoS Biol 8.
13. Churchill GA. 2002. Fundamentals of experimental design for cDNA microarrays. Nat Genet 32: 490-495.
14. Colbourn CJ, Dinitz JH. 2007. Handbook of combinatorial designs.Chapman and Hall/Taylor and Francis, Boca Raton, FL.
15. Cui X, Hwang JT, Qiu J, Blades NJ, Churchill GA. 2005. Improved statistical tests for differential gene expression by shrinking variance components estimates. Biostatistics 6: 59-75.
16. De Hertogh B, De Meulder B, Berger F, Pierre M, Bareke E, Gaigneaux A, Depiereux E. 2010. A benchmark for statistical microarray data analysis that preserves actual biological and technical variance. BMC Bioinformatics 11: 17.
17. Dillies MA, Rau A, Aubert J, Hennequet-Antier C, Jeanmougin M, Servant N, Keime C, Marot G, Castel D, Estelle J, et al. 2013. A comprehensive evaluation of normalization methods for Illumina highthroughput RNA sequencing data analysis. Brief Bioinform 14: 671-683.
18. Efron B, Tibshirani R. 1993a. An introduction to the bootstrap, pp. 203- 219. Chapman and Hall, New York.
19. Efron B, Tibshirani R. 1993b. An introduction to the bootstrap, pp. 220- 224. Chapman and Hall, New York.
20. Flicek P, Amode MR, Barrell D, Beal K, Brent S, Chen Y, Clapham P, Coates G, Fairley S, Fitzgerald S, et al. 2011. Ensembl 2011.Nucleic Acids Res 39: D800-D806.
21. Frazee AC, Langmead B, Leek JT. 2011. ReCount: a multi-experiment resource of analysis-ready RNA-seq gene count datasets. BMC Bioinformatics 12: 449.
22. Frazee AC, Sabunciyan S, Hansen KD, Irizarry RA, Leek JT. 2014.Differential expression analysis of RNA-seq data at single-base resolution.Biostatistics 15: 413-426.
23. Gierliń ski M, Blaxter M, Cole C, Gharbi K, Owen-Hughes T, Schofield P, Schurch NJ, Sherstnev A, Singh V, Wrobel N, et al.2015. Statistical models for RNA-seq data derived from a two-condition 48-replicate experiment. Bioinformatics 31: 3625-3630.
24. Gkikopoulos T, Schofield P, Singh V, Pinskaya M, Mellor J, Smolle M, Workman JL, Barton GJ, Owen-Hughes T. 2011. A role for Snf2-related nucleosome-spacing enzymes in genome-wide nucleosome organization.Science 333: 1758-1760.
25. Guo Y, Li CI, Ye F, Shyr Y. 2013. Evaluation of read count based RNAseq analysis methods. BMC Genomics 14: S2.
26. Hansen KD, Wu Z, Irizarry RA, Leek JT. 2011. Sequencing technology does not eliminate biological variability. Nat Biotechnol 29: 572-573.
27. Hardcastle TJ, Kelly KA. 2010. baySeq: empirical Bayesian methods for identifying differential expression in sequence count data. BMC Bioinformatics 11: 422.
28. Hirschhorn JN, Brown SA, Clark CD, Winston F. 1992. Evidence that SNF2/SWI2 and SNF5 activate transcription in yeast by altering chromatin structure. Genes Dev 6: 2288-2298.
29. Holstege FC, Jennings EG, Wyrick JJ, Lee TI, Hengartner CJ, Green MR, Golub TR, Lander ES, Young RA. 1998. Dissecting the regulatory circuitry of a eukaryotic genome. Cell 95: 717-728.
30. The International HapMap Consortium. 2005. A haplotype map of the human genome. Nature 437: 1299-1320.
31. Jiang L, Schlesinger F, Davis CA, Zhang Y, Li R, Salit M, Gingeras TR, Oliver B. 2011. Synthetic spike-in standards for RNA-seq experiments.Genome Res 21: 1543-1551.
32. Kaisers W, Schwender H, Schaal H. 2014. Hierarchical clustering of DNA k-mer counts in RNA-seq fastq files reveals batch effects.arXiv doi: 1405.0114.
33. Kohrer K, Domdey H. 1991. Preparation of high molecular weight RNA.Methods Enzymol 194: 398-405.
34. Kvam VM, Liu P, Si Y. 2012. A comparison of statistical methods for detecting differentially expressed genes from RNA-seq data. Am J Bot 99: 248-256.
35. LawCW, Chen Y, ShiW, Smyth GK. 2014. Voom: precision weights unlock linear model analysis tools for RNA-seq read counts. Genome Biol 15: R29.
36. Leng N, Dawson JA, Thomson JA, Ruotti V, Rissman AI, Smits BM, Haag JD, Gould MN, Stewart RM, Kendziorski C. 2013. EBSeq: an empirical Bayes hierarchical model for inference in RNA-seq experiments.Bioinformatics 29: 1035-1043.
37. Li J, Tibshirani R. 2013. Finding consistent patterns: a nonparametric approach for identifying differential expression in RNA-Seq data.Stat Methods Med Res 22: 519-536.
38. Li J, Witten DM, Johnstone IM, Tibshirani R. 2012. Normalization, testing, and false discovery rate estimation for RNA-sequencing data.Biostatistics 13: 523-538.
39. Liu Y, Zhou J, White KP. 2014. RNA-seq differential expression studies: more sequence or more replication? Bioinformatics 30: 301-304.
40. Love MI, Huber W, Anders S. 2014. Moderated estimation of fold change and dispersion for RNA-seq data with DESeq2. Genome Biol 15: 550.
41. Loven J, Orlando DA, Sigova AA, Lin CY, Rahl PB, Burge CB, Levens DL, Lee TI, Young RA. 2012. Revisiting global gene expression analysis. Cell 151: 476-482.
42. Lund SP, Nettleton D, McCarthy DJ, Smyth GK. 2012. Detecting differential expression in RNA-sequence data using quasi-likelihood with shrunken dispersion estimates. Stat Appl Genet Mol Biol 11 doi: 10.1515/1544-6115.1826.
43. Mann HB, Whitney DR. 1947. On a test of whether one of two random variables is stochastically larger than the other. Ann Math Stat 18: 50-60.
44. Marioni JC, Mason CE, Mane SM, Stephens M, Gilad Y. 2008. RNA-seq: an assessment of technical reproducibility and comparison with gene expression arrays. Genome Res 18: 1509-1517.
45. Montgomery SB, Sammeth M, Gutierrez-Arcelus M, Lach RP, Ingle C, Nisbett J, Guigo R, Dermitzakis ET. 2010. Transcriptome genetics using second generation sequencing in a Caucasian population.Nature 464: 773-777.
46. Moulos P, Hatzis P. 2015. Systematic integration of RNA-Seq statistical algorithms for accurate detection of differential gene expression patterns.Nucleic Acids Res 43: e25.
47. Neigeborn L, Carlson M. 1984. Genes affecting the regulation of SUC2 gene expression by glucose repression in Saccharomyces cerevisiae.Genetics 108: 845-858.
48. Olsson U. 2005. Confidence intervals for the mean of log-normal distribution.J Stat Educ 13.
49. PanW, Lin J, Le CT. 2002. How many replicates of arrays are required to detect gene expression changes in microarray experiments? A mixture model approach. Genome Biol 3: research0022.
50. Peterson CL, Herskowitz I. 1992. Characterization of the yeast SWI1, SWI2, and SWI3 genes, which encode a global activator of transcription.Cell 68: 573-583.
51. Peterson CL, KrugerW, Herskowitz I. 1991. A functional interaction between the C-terminal domain of RNA polymerase II and the negative regulator SIN1. Cell 64: 1135-1143.
52. Pickrell JK, Marioni JC, Pai AA, Degner JF, Engelhardt BE, Nkadori E, Veyrieras JB, Stephens M, Gilad Y, Pritchard JK. 2010.Understanding mechanisms underlying human gene expression variation with RNA sequencing. Nature 464: 768-772.
53. Rapaport F, Khanin R, Liang Y, Pirun M, Krek A, Zumbo P, Mason CE, Socci ND, Betel D. 2013. Comprehensive evaluation of differential gene expression analysis methods for RNA-seq data. Genome Biol 14: R95.
54. Robinson MD, Oshlack A. 2010. A scaling normalization method for differential expression analysis of RNA-seq data. Genome Biol 11: R25.
55. Robinson MD, McCarthy DJ, Smyth GK. 2010. edgeR: a Bioconductor package for differential expression analysis of digital gene expression data. Bioinformatics 26: 139-140.
56. Ryan DP, Owen-Hughes T. 2011. Snf2-family proteins: chromatin remodellers for any occasion. Curr Opin Chem Biol 15: 649-656.
57. Schurch NJ, Cole C, Sherstnev A, Song J, Duc C, Storey KG, McLean WH, Brown SJ, Simpson GG, Barton GJ. 2014. Improved annotation of 3′ untranslated regions and complex loci by combination of strand-specific direct RNA sequencing, RNA-Seq and ESTs.PLoS One 9: e94270.
58. SEQC/MAQC-III Consortium. 2014. A comprehensive assessment of RNA-seq accuracy, reproducibility and information content by the Sequencing Quality Control Consortium. Nat Biotechnol 32: 903-914.
59. Seyednasrollah F, Laiho A, Elo LL. 2013. Comparison of software packages for detecting differential expression in RNA-seq studies. Brief Bioinform 16: 59-70.
60. Sheskin D. 2004. Handbook of parametric and nonparametric statistical procedures, 3rd ed., pp. 428-431. Chapman and Hall/CRC, Boca Raton, FL.
61. Soneson C. 2014. compcodeR-an R package for benchmarking differential expression methods for RNA-seq data. Bioinformatics 30: 2517-2518.
62. Soneson C, Delorenzi M. 2013. A comparison of methods for differential expression analysis of RNA-seq data. BMC Bioinformatics 14: 91.
63. Stern M, Jensen R, Herskowitz I. 1984. Five SWI genes are required for expression of the HO gene in yeast. J Mol Biol 178: 853-868.
64. Sudarsanam P, Iyer VR, Brown PO, Winston F. 2000. Whole-genome expression analysis of snf/swi mutants of Saccharomyces cerevisiae.Proc Natl Acad Sci 97: 3364-3369.
65. Suzuki R, Shimodaira H. 2006. Pvclust: an R package for assessing the uncertainty in hierarchical clustering. Bioinformatics 22: 1540-1542.
66. Tarazona S, Garcia-Alcalde F, Dopazo J, Ferrer A, Conesa A. 2011.Differential expression in RNA-seq: a matter of depth. Genome Res 21: 2213-2223.
67. Trapnell C, Salzberg SL. 2009. How to map billions of short reads onto genomes. Nat Biotechnol 27: 455-457.
68. Trapnell C, Pachter L, Salzberg SL. 2009. TopHat: discovering splice junctions with RNA-Seq. Bioinformatics 25: 1105-1111.
69. Trapnell C, Roberts A, Goff L, Pertea G, Kim D, Kelley DR, Pimentel H, Salzberg SL, Rinn JL, Pachter L. 2012. Differential gene and transcript expression analysis of RNA-seq experiments with TopHat and Cufflinks. Nat Protoc 7: 562-578.
70. Wang ET, Sandberg R, Luo S, Khrebtukova I, Zhang L, Mayr C, Kingsmore SF, Schroth GP, Burge CB. 2008. Alternative isoform regulation in human tissue transcriptomes. Nature 456: 470-476.
71. Wang L, Feng Z, Wang X, Wang X, Zhang X. 2010. DEGseq: an R package for identifying differentially expressed genes from RNA-seq data.Bioinformatics 26: 136-138.