A comprehensive assessment of RNA-seq accuracy, reproducibility and information content by the Sequencing Quality Control Consortium

Nature Biotechnology

Volumn 32, Issue 9, 2014, Pages 903-914

  Su, Zhenqiang ^a   Łabaj, Paweł P ^b   Li, Sheng ^c   Thierry Mieg, Jean ^d   Thierry Mieg, Danielle ^d   Shi, Wei ^e,f   Wang, Charles ^g   Schroth, Gary P ^h   Setterquist, Robert A ⁱ   Thompson, John F ^j   Jones, Wendell D ^k   Xiao, Wenzhong ^l,m   Xu, Weihong ^m   Jensen, Roderick V ⁿ   Kelly, Reagan ^a   Xu, Joshua ^a   Conesa, Ana ^o   Furlanello, Cesare ^p   Gao, Hanlin ^q   Hong, Huixiao ^a   Jafari, Nadereh ^r   Letovsky, Stan ^s   Liao, Yang ^e,f   Lu, Fei ^t   Oakeley, Edward J ^u   Peng, Zhiyu ^v   Praul, Craig A ^w   Santoyo Lopez, Javier ^x,y   Scherer, Andreas ^z,aa   Shi, Tieliu ^ab   Smyth, Gordon K ^e,f   Staedtler, Frank ^u   Sykacek, Peter ^b   Tan, Xin Xing ^t   Thompson, E Aubrey ^ac   Vandesompele, Jo ^ad   Wang, May D ^ae   Wang, Jian ^af   Wolfinger, Russell D ^ag   Zavadil, Jiri ^ah,ai,aj   Auerbach, Scott S ^ak   Bao, Wenjun ^ag   Binder, Hans ^al   Blomquist, Thomas ^am   Brilliant, Murray H ^an   Bushel, Pierre R ^ak   Cai, Weimin ^ao   Catalano, Jennifer G ^ap   Chang, Ching Wei ^a   Chen, Tao ^a   Chen, Geng ^ab   Chen, Rong ^aq   Chierici, Marco ^p   Chu, Tzu Ming ^ag   Clevert, Djork Arné ^ar   Deng, Youping ^as   Derti, Adnan ^at   Devanarayan, Viswanath ^au   Dong, Zirui ^v   Dopazo, Joaquin ^o   Du, Tingting ^ao   Fang, Hong ^a   Fang, Yongxiang ^av   Fasold, Mario ^aw   Fernandez, Anita ^u   Fischer, Matthias ^ax   Furió Tari, Pedro ^o   Fuscoe, James C ^a   Caimet, Florian ^ay   Gaj, Stan ^ay   Gandara, Jorge ^c   Gao, Huan ^v   Ge, Weigong ^a   Gondo, Yoichi ^az   Gong, Binsheng ^a   Gong, Meihua ^v   Gong, Zhuolin ^v   Green, Bridgett ^a   Guo, Chao ^q   Guo, Lei ^a   Guo, Li Wu ^a   Hadfield, James ^ba   Hellemans, Jan ^ad   Hochreiter, Sepp ^ar   Jia, Meiwen ^ao   Jian, Min ^v   Johnson, Charles D ^bb   Kay, Suzanne ^av   Kleinjans, Jos ^ay   Lababidi, Samir ^bc   Levy, Shawn ^bd   Li, Quan Zhen ^be   Li, Li ^ag,aq   Li, Peng ^ab   Li, Yan ^a   Li, Haiqing ^q   Li, Jianying ^ak   Li, Shiyong ^v   Lin, Simon M ^bf   López, Francisco J ^x   Lu, Xin ^au   Luo, Heng ^bg   Ma, Xiwen ^af   Meehan, Joseph ^a   Megherbi, Dalila B ^bh   Mei, Nan ^a   Mu, Bing ^q   Ning, Baitang ^a   Pandey, Akhilesh ^bi,bj   Pérez Florido, Javier ^x   Perkins, Roger G ^a   Peters, Ryan ^bk   Phan, John H ^ae   Pirooznia, Mehdi ^bi   Qian, Feng ^a   Qing, Tao ^ao   Rainbow, Lucille ^av   Rocca Serra, Philippe ^bl   Sambourg, Laure ^bm   Sansone, Susanna Assunta ^bl   Schwartz, Scott ^bb   Shah, Ruchir ^bn   Shen, Jie ^a   Smith, Todd M ^bo   Stegle, Oliver ^bp   Stralis Pavese, Nancy ^b   Stupka, Elia ^bq   Suzuki, Yutaka ^br   Szkotnicki, Lee T ^t   Tinning, Matthew ^z   Tu, Bimeng ^v   Van Delft, Joost ^ay   Vela Boza, Alicia ^x   Venturini, Elisa ^ah   Walker, Stephen J ^bs   Wan, Liqing ^a   Wang, Wei ^bt   Wang, Jinhui ^q   Wang, Jun ^v,bu,bv,bw   Wieben, Eric D ^bx   Willey, James C ^am   Wu, Po Yen ^by   Xuan, Jiekun ^a   Yang, Yong ^af   Ye, Zhan ^an   Yin, Ye ^v   Yu, Ying ^ao   Yuan, Yate Ching ^q   Zhang, John ^bz   Zhang, Ke K ^ca   Zhang, Wenqian ^a,v   Zhang, Wenwei ^v   Zhang, Yanyan ^v   Zhao, Chen ^ab   Zheng, Yuanting ^ao   Zhou, Yiming ^cb   Zumbo, Paul ^c   Tong, Weida ^a   Kreil, David P ^b,cc   Mason, Christopher E ^c   Shi, Leming ^a,cd,ce,cf   more..

^a FDA NCTR   (United States)

^b UNIVERSITY OF NATURAL RESOURCES AND LIFE SCIENCES   (Austria)

^c WEILL CORNELL MEDICAL COLLEGE   (United States)

^d NATIONAL INSTITUTES OF HEALTH   (United States)

^e WALTER AND ELIZA HALL INSTITUTE OF MEDICAL RESEARCH   (Australia)

^f UNIVERSITY OF MELBOURNE   (Australia)

^g LOMA LINDA UNIVERSITY SCHOOL OF MEDICINE   (United States)

^h ILLUMINA INC   (United States)

ⁱ Life Technologies Corporation   (United States)

^j Claritas Genomics   (United States)

^k Expression Analysis Inc   (United States)

^l MASSACHUSETTS GENERAL HOSPITAL   (United States)

^m STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

ⁿ VIRGINIA POLYTECHNIC INSTITUTE AND STATE UNIVERSITY   (United States)

^o CENTRO DE INVESTIGACIÓN PRÍNCIPE FELIPE   (Spain)

^p FONDAZIONE BRUNO KESSLER   (Italy)

^q CITY OF HOPE NATIONAL MEDICAL CENTER   (United States)

^r NORTHWESTERN UNIVERSITY   (United States)

^s SynapDx Corporation   (United States)

^t GE HEALTHCARE   (United States)

^u NOVARTIS PHARMA AG   (Switzerland)

^v BGI SHENZHEN   (China)

^w PENNSYLVANIA STATE UNIVERSITY   (United States)

^x Medical Genome Project   (Spain)

^y UNIVERSITY OF EDINBURGH   (United Kingdom)

^z Australian Genome Research Facility Ltd   (Australia)

^aa Spheromics   (Finland)

^ab EAST CHINA NORMAL UNIVERSITY   (China)

^ac MAYO CLINIC   (United States)

^ad Biogazelle NV   (Belgium)

^ae EMORY UNIVERSITY SCHOOL OF MEDICINE   (United States)

^af ELI LILLY AND COMPANY   (United States)

^ag SAS INSTITUTE INC   (United States)

^ah NEW YORK UNIVERSITY MEDICAL CENTER   (United States)

^ai NEW YORK UNIVERSITY SCHOOL OF MEDICINE   (United States)

^aj INTERNATIONAL AGENCY FOR RESEARCH ON CANCER   (France)

^ak NATIONAL INSTITUTE OF ENVIRONMENTAL HEALTH SCIENCES   (United States)

^al UNIVERSITY OF LEIPZIG   (Germany)

^am MEDICAL COLLEGE OF OHIO   (United States)

^an MARSHFIELD CLINIC   (United States)

^ao FUDAN UNIVERSITY   (China)

^ap CENTER FOR BIOLOGICS EVALUATION AND RESEARCH   (United States)

^aq MOUNT SINAI SCHOOL OF MEDICINE   (United States)

^ar JOHANNES KEPLER UNIVERSITY LINZ   (Austria)

^as RUSH MEDICAL COLLEGE   (United States)

^at NOVARTIS INSTITUTES FOR BIOMEDICAL RESEARCH   (United States)

^au ABBVIE INC   (United States)

^av UNIVERSITY OF LIVERPOOL   (United Kingdom)

^aw ecSeq Bioinformatics   (Germany)

^ax UNIVERSITY OF COLOGNE   (Germany)

^ay MAASTRICHT UNIVERSITY   (Netherlands)

^az RIKEN BIORESOURCE CENTER   (Japan)

^ba UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^bb TEXAS A AND M UNIVERSITY   (United States)

^bc CENTER FOR DRUG EVALUATION AND RESEARCH   (United States)

^bd HUDSONALPHA INSTITUTE FOR BIOTECHNOLOGY   (United States)

^be UNIVERSITY OF TEXAS SOUTHWESTERN MEDICAL CENTER   (United States)

^bf NATIONWIDE CHILDREN S HOSPITAL   (United States)

^bg UNIVERSITY OF ARKANSAS FOR MEDICAL SCIENCES   (United States)

^bh University of Massachusetts   (United States)

^bi JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE   (United States)

^bj Institute of Bioinformatics   (India)

^bk Partek Inc   (United States)

^bl UNIVERSITY OF OXFORD   (United Kingdom)

^bm LABORATOIRE TIMC IMAG   (France)

^bn SRA International Inc   (United States)

^bo Geospiza Inc   (United States)

^bp EUROPEAN BIOINFORMATICS INSTITUTE   (United Kingdom)

^bq SAN RAFFAELE HOSPITAL   (Italy)

^br UNIVERSITY OF TOKYO   (Japan)

^bs WAKE FOREST SCHOOL OF MEDICINE   (United States)

^bt PRINCETON UNIVERSITY   (United States)

^bu UNIVERSITY OF COPENHAGEN   (Denmark)

^bv KING ABDULAZIZ UNIVERSITY   (Saudi Arabia)

^bw Capital Region   (Denmark)

^bx MAYO GRADUATE SCHOOL   (United States)

^by GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

^bz ZHEJIANG UNIVERSITY OF TECHNOLOGY   (China)

^ca UNIVERSITY OF NORTH DAKOTA SCHOOL OF MEDICINE AND HEALTH SCIENCES   (United States)

^cb Digomics LLC   (United States)

^cc UNIVERSITY OF WARWICK   (United Kingdom)

^cd FUDAN UNIVERSITY   (China)

^ce Fudan Zhangjiang Center for Clinical Genomics   (China)

^cf Center for Translational Medicine   (China)

more..

Author keywords

[No Author keywords available]

Indexed keywords

BIOASSAY; MICROARRAYS; POLYMERASE CHAIN REACTION; RNA;

ABSOLUTE MEASUREMENTS; COMPREHENSIVE ASSESSMENT; DIFFERENTIAL EXPRESSIONS; EXON-EXON JUNCTION; INFORMATION CONTENTS; QUANTITATIVE PCR; REPRODUCIBILITIES; US FOOD AND DRUG ADMINISTRATION;

QUALITY CONTROL;

GENOMIC DNA; TRANSCRIPTOME;

ARTICLE; CONTROLLED STUDY; DNA BASE COMPOSITION; DNA CONTAMINATION; DNA LIBRARY; EXON; GENE EXPRESSION; MICROARRAY ANALYSIS; POLYMERASE CHAIN REACTION; PRIORITY JOURNAL; QUALITY CONTROL; REPRODUCIBILITY; RNA ANALYSIS; RNA SEQUENCE; SEQUENCE ANALYSIS; STANDARDS;

POLYMERASE CHAIN REACTION; REPRODUCIBILITY OF RESULTS; SEQUENCE ANALYSIS, RNA;

EID: 84920550975     PISSN: 10870156     EISSN: 15461696     Source Type: Journal    
DOI: 10.1038/nbt.2957     Document Type: Article

References (54)

1. Wang, E.T. et al. Alternative isoform regulation in human tissue transcriptomes. Nature 456, 470-476 (2008).
2. Mortazavi, A., Williams, B.A., McCue, K., Schaeffer, L. & Wold, B. Mapping and quantifying mammalian transcriptomes by RNA-seq. Nat. Methods 5, 621-628 (2008).
3. Labaj, P.P. et al. Characterization and improvement of RNA-Seq precision in quantitative transcript expression profiling. Bioinformatics 27, i383-i391 (2011).
4. Liu, S., Lin, L., Jiang, P., Wang, D. & Xing, Y. A comparison of RNA-Seq and high-density exon array for detecting differential gene expression between closely related species. Nucleic Acids Res. 39, 578-588 (2011).
5. McIntyre, L.M. et al. RNA-seq: technical variability and sampling. BMC Genomics 12, 293 (2011).
6. Toung, J.M., Morley, M., Li, M. & Cheung, V.G. RNA-sequence analysis of human B-cells. Genome Res. 21, 991-998 (2011).
7. Djebali, S. et al. Landscape of transcription in human cells. Nature 489, 101-108 (2012).
8. Cancer Genome Atlas Research Network. Comprehensive genomic characterization defines human glioblastoma genes and core pathways. Nature 455, 1061-1068 (2008).
9. International Cancer Genome Consortium. International network of cancer genome projects. Nature 464, 993-998 (2010).
10. Shi, L. et al. The MicroArray Quality Control (MAQC) project shows inter-and intraplatform reproducibility of gene expression measurements. Nat. Biotechnol. 24, 1151-1161 (2006).
11. Li, S. et al. Detecting and correcting systematic variation in large-scale RNA sequencing data. Nat. Biotechnol. doi:10.1038/nbt.3000 (24 August 2014).
12. Wang, C. et al. The concordance between RNA-seq and microarray data depends on chemical treatment and transcript abundance. Nat. Biotechnol. doi:10.1038/nbt.3001 (24 August 2014).
13. Yu, Y. et al. A rat RNA-seq transcriptomic Bodymap across eleven organs and four developmental stages. Nat. Commun. 5, 3230 (2014)
14. Baker, S.C. et al. The External RNA Controls Consortium: a progress report. Nat. Methods 2, 731-734 (2005).
15. Pruitt, K.D., Tatusova, T., Brown, G.R. & Maglott, D.R. NCBI Reference Sequences (RefSeq): current status, new features and genome annotation policy. Nucleic Acids Res. 40, D130-D135 (2012).
16. Harrow, J. et al. GENCODE: The reference human genome annotation for The ENCODE Project. Genome Res. 22, 1760-1774 (2012).
17. Thierry-Mieg, D. & Thierry-Mieg, J. AceView: a comprehensive cDNA-supported gene and transcripts. Genome Biol. 7, S12 (2006).
18. Dobin, A. et al. STAR: ultrafast universal RNA-seq aligner. Bioinformatics 29, 15-21 (2013).
19. Liao, Y., Smyth, G.K. & Shi, W. The Subread aligner: fast, accurate and scalable read mapping by seed-and-vote. Nucleic Acids Res. 41, e108 (2013).
20. Kim, D. et al. TopHat2: accurate alignment of transcriptomes in the presence of insertions, deletions and gene fusions. Genome Biol. 14, R36 (2013).
21. Li, S. et al. Multi-platform assessment of transcriptome profiling using RNA-seq in the ABRF next-generation sequencing study. Nat. Biotechnol. doi:10.1038/nbt.2972 (24 August 2014).
22. Xu, W. et al. Human transcriptome array for high-throughput clinical studies. Proc. Natl. Acad. Sci. USA 108, 3707-3712 (2011).
23. Marioni, J.C., Mason, C.E., Mane, S.M., Stephens, M. & Gilad, Y. RNA-seq: an assessment of technical reproducibility and comparison with gene expression arrays. Genome Res. 18, 1509-1517 (2008).
24. VanGuilder, H., Vrana, K. & Freeman, W. Twenty-five years of quantitative PCR for gene expression analysis. Biotechniques 44 (suppl.) 619-626 (2008).
25. Aird, D. et al. Analyzing and minimizing PCR amplification bias in Illumina sequencing libraries. Genome Biol. 12, R18 (2011).
26. Shippy, R. et al. Using RNA sample titrations to assess microarray platform performance and normalization techniques. Nat. Biotechnol. 24, 1123-1131 (2006).
27. Trapnell, C. et al. Differential analysis of gene regulation at transcript resolution with RNA-seq. Nat. Biotechnol. 31, 46-53 (2013).
28. Pickrell, J.K., Pai, A.A., Gilad, Y. & Pritchard, J.K. Noisy splicing drives mRNA isoform diversity in human cells. PLoS Genet. 6, e1001236 (2010).
29. Dai, M. et al. Evolving gene/transcript definitions significantly alter the interpretation of GeneChip data. Nucleic Acids Res. 33, e175 (2005).
30. Liu, Y. et al. Evaluating the impact of sequencing depth on transcriptome profiling in human adipose. PLoS ONE 8, e66883 (2013).
31. Levin, J.Z. et al. Targeted next-generation sequencing of a cancer transcriptome enhances detection of sequence variants and novel fusion transcripts. Genome Biol. 10, R115 (2009).
32. Agarwal, A. et al. Comparison and calibration of transcriptome data from RNA-Seq and tiling arrays. BMC Genomics 11, 383 (2010).
33. Raghavachari, N. et al. A systematic comparison and evaluation of high density exon arrays and RNA-seq technology used to unravel the peripheral blood transcriptome of sickle cell disease. BMC Med. Genomics 5, 28 (2012).
34. Qing, T., Yu, Y., Du, T. & Shi, L. mRNA enrichment protocols determine the quantification characteristics of external RNA spike-in controls in RNA-seq studies. Sci. China Life Sci. 56, 134-142 (2013).
35. Benjamini, Y. & Speed, T.P. Summarizing and correcting the GC content bias in high-throughput sequencing. Nucleic Acids Res. 40, e72 (2012).
36. Robinson, M.D. & Oshlack, A. A scaling normalization method for differential expression analysis of RNA-seq data. Genome Biol. 11, R25 (2010).
37. Smyth, G.K. in Bioinformatics and Computational Biology Solutions Using R Bioconductor (eds. Gentleman, R., Carey, V.J., Huber, W., Irizarry, R.A. & Dudoit, S.) 397-420 (Springer, New York, 2005).
38. Huber, W., von Heydebreck, A., Sültmann, H., Poustka, A. & Vingron, M. Variance stabilization applied to microarray data calibration and to the quantification of differential expression. Bioinformatics 18, S96-S104 (2002).
39. Wu, Z., Irizarry, R., Gentleman, R., Murillo, F.M. & Spencer, F. A model based background adjustment for oligonucleotide expression arrays. J. Amer. Stat. Assoc. 99, 909-917 (2004).
40. Hochreiter, S., Clevert, D.-A. & Obermayer, K. A new summarization method for affymetrix probe level data. Bioinformatics 22, 943-949 (2006).
41. Fasold, M., Stadler, P.F. & Binder, H. G-stack modulated probe intensities on expression arrays-sequence corrections and signal calibration. BMC Bioinformatics 11, 207 (2010).
42. Mueckstein, U., Leparc, G.G., Posekany, A., Hofacker, I. & Kreil, D.P. Hybridization thermodynamics of NimbleGen Microarrays. BMC Bioinformatics 11, 35 (2010).
43. Sykacek, P. et al. The impact of quantitative optimization of hybridization conditions on gene expression analysis. BMC Bioinformatics 12, 73 (2011).
44. Rapaport, F. et al. Comprehensive evaluation of differential gene expression analysis methods for RNA-seq data. Genome Biol. 14, R95 (2013).
45. Xu, J. et al. Cross-platform ultradeep transcriptomic profiling of human reference RNA samples by RNA-Seq. Sci. Data (in the press).
46. Liu, S. et al. A comparison of RNA-seq and high-density exon array for detecting differential gene expression between closely related species. Nucleic Acids Res. 39, 578-588 (2011).
47. Munro, S. et al. Nat. Communications. (in the press).
48. David, M., Dzamba, M., Lister, D., Ilie, L. & Brudno, M. SHRiMP2: Sensitive yet practical short read mapping. Bioinformatics 27, 1011-1012 (2011).
49. Glaus, P., Honkela, A. & Rattray, M. Identifying differentially expressed transcripts from RNA-seq data with biological variation. Bioinformatics 28, 1721-1728 (2012).
50. Liao, Y., Smyth, G.K. & Shi, W. featureCounts: an efficient general purpose program for assigning sequence reads to genomic features. Bioinformatics 30, 923-930 (2014).
51. Rasmussen, C.E. Gaussian Processes for Machine Learning (MIT Press, 2006).
52. Law, C.W. et al. Voom: precision weights unlock linear model analysis tools for RNA-seq read counts. Genome Biol. 15, R29 (2014).
53. Dillies, M.-A. et al. A comprehensive evaluation of normalization methods for Illumina high-throughput RNA sequencing data analysis. Brief. Bioinform. 14, 671-683 (2013).
54. Robinson, M.D., McCarthy, D.J. & Smyth, G.K. edgeR: a Bioconductor package for differential expression analysis of digital gene expression data. Bioinformatics 26, 139-140 (2010).