SOAPnuke: A MapReduce acceleration-supported software for integrated quality control and preprocessing of high-throughput sequencing data

GigaScience

Volumn 7, Issue 1, 2018, Pages 1-6

  Chen, Yuxin ^a   Chen, Yongsheng ^b   Shi, Chunmei ^c,d   Huang, Zhibo ^a   Zhang, Yong ^a,e   Li, Shengkang ^a,e   Li, Yan ^a   Ye, Jia ^a   Yu, Chang ^f   Li, Zhuo ^g,h   Zhang, Xiuqing ^a   Wang, Jian ^a,i   Yang, Huanming ^a,i   Fang, Lin ^a,e   Chen, Qiang ^c,d  

^a BGI SHENZHEN   (China)

^b Geneplus Beijing ^*  (China)

^c FUJIAN MEDICAL UNIVERSITY   (China)

^d Fujian Key Laboratory of Translational Cancer Medicine   (China)

^e NATIONAL UNIVERSITY OF DEFENSE TECHNOLOGY   (China)

^f INTEL CORPORATION   (China)

^g GUANGDONG PROVINCIAL HOSPITAL OF CHINESE MEDICINE   (China)

^h Chinese University of Hong Kong   (Hong Kong)

ⁱ James D Watson Institute of Genome Science   (China)

Author keywords

High throughput sequencing; MapReduce; Preprocessing; Quality control

Indexed keywords

MESSENGER RNA; SMALL UNTRANSLATED RNA;

ACCELERATION; ARTICLE; CONCEPTUAL FRAMEWORK; CONTROLLED STUDY; DATA PROCESSING; GENE EXPRESSION; GENOMICS; HIGH THROUGHPUT SEQUENCING; HUMAN; MEASUREMENT ACCURACY; MEASUREMENT PRECISION; METAGENOMICS; POLYADENYLATION; PRIORITY JOURNAL; QUALITY CONTROL; ALGORITHM; BENCHMARKING; BIOLOGY; GENETICS; METABOLISM; METAGENOME; SOFTWARE; STATISTICS AND NUMERICAL DATA; TIME FACTOR; WORKFLOW;

ALGORITHMS; BENCHMARKING; COMPUTATIONAL BIOLOGY; HIGH-THROUGHPUT NUCLEOTIDE SEQUENCING; HUMANS; METAGENOME; QUALITY CONTROL; RNA, SMALL UNTRANSLATED; SOFTWARE; TIME FACTORS; WORKFLOW;

EID: 85044575558     PISSN: None     EISSN: 2047217X     Source Type: Journal    
DOI: 10.1093/gigascience/gix120     Document Type: Article

References (51)

1. Fox S, Filichkin S, Mockler TC. Applications of ultra-highthroughput sequencing. Methods Mol Biol 2009;553:79-108
2. Soon WW, Hariharan M, Snyder MP. High-throughput sequencing for biology and medicine. Mol Syst Biol 2014;9(1):640-
3. Stephens ZD, Lee SY, Faghri F et al. Big data: astronomical or genomical? PLoS Biol 2015;13(7):e1002195
4. Guo Y, Ye F, Sheng Q et al. Three-stage quality control strategies for DNA re-sequencing data. Brief Bioinformatics 2014;15(6):879-89
5. Zhou X, Rokas A. Prevention, diagnosis and treatment of high-throughput sequencing data pathologies. Mol Ecol 2014;23(7):1679-700
6. Schmieder R, Edwards R. Quality control and preprocessing of metagenomic datasets. Bioinformatics 2011;27(6):863-4
7. Moxon S, Schwach F, Dalmay T et al. A toolkit for analysing large-scale plant small RNA datasets. Bioinformatics 2008;24(19):2252-3
8. Gordon A, Hannon GJ. Fastx-toolkit. FASTQ/A short-reads preprocessing tools. http://hannonlab.cshl.edu/fastx toolkit. Accessed 1 November 2017
9. CoxMP, Peterson DA, Biggs PJ. SolexaQA: At-a-glance quality assessment of Illumina second-generation sequencing data. BMC Bioinformatics 2010;11(1):485
10. Zhang T, Luo Y, Liu K et al. BIGpre: a quality assessment package for next-generation sequencing data. Genomics Proteomics Bioinformatics 2011;9(6):238-44
11. Aronesty E. ea-utils: Command-Line Tools for Processing Biological Sequencing Data. Durham, NC: Expression Analysis; 2011
12. Yang X, Liu D, Liu F et al. HTQC: a fast quality control toolkit for Illumina sequencing data. BMC Bioinformatics 2013;14(1):33
13. Li H. seqtk: toolkit for processing sequences in FASTA/Q formats. https://github.com/lh3/seqtk. Accessed 1 March 2017
14. Zhou Q, Su X, Wang A et al. QC-Chain: fast and holistic quality control method for next-generation sequencing data. PLoS One 2013;8(4):e60234
15. Zhou Q, Su X, Jing G et al. Meta-QC-Chain: comprehensive and fast quality control method for metagenomic data. Genomics Proteomics Bioinformatics 2014;12(1):52-56
16. Patel RK, Jain M. NGS QC Toolkit: a toolkit for quality control of next generation sequencing data. PLoS One 2012;7(2):e30619
17. Simon A. FastQC: a quality control tool for high throughput sequence data. http://www.bioinformatics. babraham.ac.uk/projects/fastqc/Accessed 1 November 2017
18. Schmieder R, Lim YW, Rohwer F et al. TagCleaner: identification and removal of tag sequences from genomic and metagenomic datasets. BMC Bioinformatics 2010;11(1):341
19. Falgueras J, Lara AJ, Fernandez-Pozo N et al. SeqTrim: a highthroughput pipeline for preprocessing any type of sequence reads. BMC Bioinformatics 2010;11(1):38
20. St John J. SeqPrep: tool for stripping adaptors and/or merging paired reads with overlap into single reads. https://github.com/jstjohn/SeqPrep Accessed 1 November 2017
21. Kong Y. Btrim: a fast, lightweight adapter and quality trimming programfor next-generation sequencing technologies. Genomics 2011;98(2):152-3
22. Lohse M, Bolger AM, Nagel A et al. RobiNA: a user-friendly, integrated software solution for RNA-seq-based transcriptomics. Nucleic Acids Res 2012;40(W1):W622-7
23. Martin M. Cutadapt removes adapter sequences from high-throughput sequencing reads. EMBnet J 2011;17(1): pp-10
24. Schubert M, Lindgreen S, Orlando L. AdapterRemoval v2: rapid adapter trimming, identification, and read merging. BMC Res Notes 2016;9(1):88
25. Dodt M, Roehr JT, Ahmed R et al. FLEXBAR-flexible barcode and adapter processing for next-generation sequencing platforms. Biology (Basel) 2012;1(3):895-905
26. Li YL, Weng JC, Hsiao CC et al. PEAT: an intelligent and efficient paired-end sequencing adapter trimming algorithm. BMC Bioinformatics 2015;16(Suppl 1):S2
27. Bolger AM, Lohse M, Usadel B. Trimmomatic: a flexible trimmer for Illumina sequence data. Bioinformatics 2014;30(15):2114-20
28. Sturm M, Schroeder C, Bauer P. SeqPurge: highly-sensitive adapter trimming for paired-end NGS data. BMC Bioinformatics 2016;17(1):208
29. Jiang H, Lei R, Ding SW et al. Skewer: a fast and accurate adapter trimmer for next-generation sequencing paired-end reads. BMC Bioinformatics 2014;15(1):182
30. Chen S, Huang T, Zhou Y et al. AfterQC: automatic filtering, trimming, error removing and quality control for fastq data. BMC Bioinformatics 2017;18(S3):80
31. BUSHNELL Brian. BBMap: A Fast, Accurate, Splice-Aware Aligner. Berkeley, CA: Ernest Orlando Lawrence Berkeley National Laboratory; 2014
32. Joshi NA, Fass JN. Sickle: A sliding-window, adaptive, quality-based trimming tool for FastQ files. https://github.com/najoshi/sickle. Accessed 1 November 2017
33. Pertea G. fqtrim: trimming&filtering of next-gen reads. https://ccb.jhu.edu/software/fqtrim/. Access 1 November 2017
34. Vince B. Scythe: a Bayesian adapter trimmer. https://github.com/vsbuffalo/scythe Access 1 March 2017
35. Leggett RM, Clavijo BJ, Clissold L et al. NextClip: an analysis and read preparation tool for Nextera long mate pair libraries. Bioinformatics 2014;30(4):566-8
36. Criscuolo A, Brisse S. AlienTrimmer: a tool to quickly and accurately trim offmultiple short contaminant sequences from high-throughput sequencing reads. Genomics 2013;102(5-6):500-6
37. Goecks J, Nekrutenko A, Taylor J et al. Galaxy: a comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences. Genome Biol 2010;11(8):R86
38. Team RC. R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing; 2013
39. Illumina. NextSeq 500 system overview. https://support. illumina.com/content/dam/illumina-support/courses/nextseq-system-overview/story content/external files/NextSeq500 System Overview narration.pdf Accessed 1 November 2017
40. Huang J, Liang X, Xuan Y et al. A reference human genome dataset of the BGISEQ-500 sequencer. Gigascience 2017;6(5):1-9
41. Zhang X, Hao L, Meng L et al. Digital gene expression tag profiling analysis of the gene expression patterns regulating the early stage of mouse spermatogenesis. PLoS One 2013;8(3):e58680
42. Tam S, Tsao MS, McPherson JD. Optimization of miRNA-seq data preprocessing. Brief Bioinformatics 2015;16(6):950-63
43. Zook JM, Catoe D, McDaniel J et al. Extensive sequencing of seven human genomes to characterize benchmark reference materials. Sci Data 2016;3:160025
44. GATK best practices. http://www.broadinstitute.org/gatk/guide/best-practices. Access 1 November 2017
45. NISTv3.3.2, NA12878 high-confidence variant calls as a gold standard. GIAB. 2017. ftp://ftp-trace.ncbi.nlm.nih.gov/giab/ftp/release/NA12878 HG001/NISTv3.3.2/. Access 1 November 2017
46. Zhang X, Hao L, Meng L et al. Digital gene expression tag profiling analysis of the gene expression patterns regulating the early stage of mouse spermatogenesis. PLoS One 2013;8(3):e58680
47. Zhou L, Chen J, Li Z et al. Integrated profiling of microRNAs and mRNAs: microRNAs located on Xq27.3 associate with clear cell renal cell carcinoma. PLoS One 2010;5(12):e15224
48. Han Y, Zhang X, Wang W et al. The suppression of WRKY44 by GIGANTEA-miR172 pathway is involved in drought response of Arabidopsis thaliana. PLoS One 2013;8(11):e73541
49. Hall AE, Lu WT, Godfrey JD et al. The cytoskeleton adaptor protein ankyrin-1 is upregulated by p53 following DNA damage and alters cell migration. Cell Death Dis 2016;7(4):e2184
50. Surbanovski N, Brilli M, Moser M et al. A highly specific microRNA-mediated mechanism silences LTR retrotransposons of strawberry. Plant J 2016;85(1):70-82
51. Chen Y, Chen Y, Shi C et al. Supporting data for "SOAPnuke: a MapReduce acceleration-supported software for integrated quality control and preprocessing of highthroughput sequencing data." GigaScience Database 2017. http://dx.doi.org/10.5524/100373