Denoising DNA deep sequencing data-high-throughput sequencing errors and their correction

Briefings in Bioinformatics

Volumn 17, Issue 1, 2016, Pages 154-179

  Laehnemann, David ^a   Borkhardt, Arndt ^b   McHardy, Alice Carolyn ^a  

^a HEINRICH HEINE UNIVERSITY   (Germany)

^b UNIVERSITY HOSPITAL DÜSSELDORF   (Germany)

Author keywords

Bias; Error correction; Error model; Error profile; High throughput sequencing; Next generation sequencing

Indexed keywords

ALGORITHM; BIOLOGY; DNA SEQUENCE; GENETIC POLYMORPHISM; GENOMICS; HIGH THROUGHPUT SEQUENCING; HUMAN; HUMAN GENOME; PROCEDURES; SEQUENCE ALIGNMENT; SOFTWARE; STATISTICS AND NUMERICAL DATA;

ALGORITHMS; COMPUTATIONAL BIOLOGY; GENOME, HUMAN; GENOMICS; HIGH-THROUGHPUT NUCLEOTIDE SEQUENCING; HUMANS; POLYMORPHISM, GENETIC; SEQUENCE ALIGNMENT; SEQUENCE ANALYSIS, DNA; SOFTWARE;

EID: 84959087968     PISSN: 14675463     EISSN: 14774054     Source Type: Journal    
DOI: 10.1093/bib/bbv029     Document Type: Article

References (115)

1. Margulies M, EgholmM, Altman WE, et al. Genome sequencing in microfabricated high-density picolitre reactors. Nature 2005;437:376-80.
2. Drmanac R, Sparks AB, Callow MJ, et al. Human genome sequencing using unchained base reads on self-assembling DNA nanoarrays. Science 2009;327:78-81.
3. Bentley DR, Balasubramanian S, Swerdlow HP, et al. Accurate whole human genome sequencing using reversible terminator chemistry. Nature 2008;456:53-9.
4. Rothberg JM, Hinz W, Rearick TM, et al. An integrated semiconductor device enabling non-optical genome sequencing. Nature 2011;475:348-52.
5. Merriman B, R&D Team IT, Rothberg JM. Progress in Ion Torrent semiconductor chip based sequencing. Electrophoresis 2012;33:3397-417.
6. Eid J, Fehr A, Gray J, et al. Real-time DNA sequencing from single polymerase molecules. Science 2009;323:133-8.
7. Clarke J, Wu H-C, Jayasinghe L, et al. Continuous base identification for single-molecule nanopore DNA sequencing. Nat Nanotechnol 2009;4:265-70.
8. Metzker ML. Sequencing technologies-the next generation. Nat Rev Genet 2009;11:31-46.
9. Morey M, Fernández-Marmiesse A, Castiñ eiras D, et al. A glimpse into past, present, and future DNA sequencing. Mol Genet Metab 2013;110:3-24.
10. Loman NJ, Misra RV, Dallman TJ, et al. Performance comparison of benchtop high-throughput sequencing platforms. Nat Biotechnol 2012;30:434-9.
11. Quail MA, Smith M, Coupland P, et al. A tale of three next generation sequencing platforms: comparison of Ion Torrent, Pacific Biosciences and Illumina MiSeq sequencers. BMC Genomics 2012;13:341.
12. Jünemann S, Sedlazeck FJ, Prior K, et al. Updating benchtop sequencing performance comparison. Nat Biotechnol 2013;31: 294-6.
13. Ross MG, Russ C, Costello M, et al. Characterizing and measuring bias in sequence data. Genome Biol 2013;14:R51.
14. Gilles A, Meglécz E, Pech N, et al. Accuracy and quality assessment of 454 GS-FLX Titanium pyrosequencing. BMC Genomics 2011;12:245.
15. Minoche AE, Dohm JC, Himmelbauer H. Evaluation of genomic high-throughput sequencing data generated on Illumina HiSeq and genome analyzer systems. Genome Biol 2011;12:R112.
16. Bragg LM, Stone G, Butler MK, et al. Shining a light on dark sequencing: characterising errors in ion torrent PGM data. PLoS Comput Biol 2013;9:e1003031.
17. Ono Y, Asai K, Hamada M. PBSIM: PacBio reads simulator- toward accurate genome assembly. Bioinformatics 2013;29: 119-121.
18. Balzer S, Malde K, LanzénA, et al. Characteristics of 454 pyrosequencing data-enabling realistic simulation with flowsim. Bioinformatics 2010;26:i420-5.
19. Jaenicke S, Ander C, Bekel T, et al. Comparative and joint analysis of two metagenomic datasets from a biogas fermenter obtained by 454-pyrosequencing. PLoS One 2011;6: e14519.
20. Dohm JC, Lottaz C, Borodina T, et al. Substantial biases in ultra-short read data sets from high-throughput DNA sequencing. Nucleic Acids Res 2008;36:e105.
21. Qu W, Hashimoto S, Morishita S. Efficient frequency-based de novo short-read clustering for error trimming in nextgeneration sequencing. Genome Res 2009;19:1309-15.
22. Nakamura K, Oshima T, Morimoto T, et al. Sequence-specific error profile of Illumina sequencers. Nucleic Acids Res 2011; 39:e90.
23. Schirmer M, Ijaz UZ, D'Amore R, et al. Insight into biases and sequencing errors for amplicon sequencing with the Illumina MiSeq platform. Nucleic Acids Res 2015;43:e37.
24. Koren S, Phillippy AM. One chromosome, one contig: complete microbial genomes fromlong-read sequencing and assembly. Curr Opin Microbiol 2015;23:110-20.
25. Travers KJ, Chin C-S, Rank DR, et al. A flexible and efficient template format for circular consensus sequencing and SNP detection. Nucleic Acids Res 2010;38:e159.
26. Koren S, Harhay GP, Smith TP, et al. Reducing assembly complexity of microbial genomes with single-molecule sequencing. Genome Biol 2013;14:R101.
27. Ferrarini M, Moretto M, Ward JA, et al. An evaluation of the PacBio RS platform for sequencing and de novo assembly of a chloroplast genome. BMC Genomics 2013;14:670.
28. Jiao X. A benchmark study on error assessment and quality control of CCS reads derived from the PacBio RS. J Data Min Genomics Proteomics 2013;4:pii16008.
29. TM Device: A Miniaturised Sensing System - Technology.Oxford Nanopore Technologies, 2014, https://nanoporetech. com/technology/the-minion-device-a-miniaturised-sens ing-system/about-minion-access-programme.
30. Jain M, Fiddes IT, Miga KH, et al. Improved data analysis for the MinION nanopore sequencer. NatMethods 2015;12:351-6.
31. Quick J, Quinlan AR, Loman NJ. A reference bacterial genome dataset generated on the MinIONTM portable singlemolecule nanopore sequencer. GigaScience 2014;3:22.
32. Ammar R, Paton TA, Torti D, et al. Long read nanopore sequencing for detection of HLA and CYP2D6 variants and haplotypes. F1000Res 2015;4:17.
33. Ashton PM, Nair S, Dallman T, et al. MinION nanopore sequencing identifies the position and structure of a bacterial antibiotic resistance island. Nat Biotechnol 2015;33:296-300.
34. Trinklein ND, Aldred SF, Hartman SJ, et al. An abundance of bidirectional promoters in the human genome. Genome Res 2004;14:62-6.
35. Engström PG, Suzuki H, Ninomiya N, et al. Complex loci in human and mouse genomes. PLoS Genet 2006;2:e47.
36. Yang X, Chockalingam SP, Aluru S. A survey of errorcorrection methods for next-generation sequencing. Brief Bioinform 2013;14:56-66.
37. Smith TF, Waterman MS. Identification of common molecular subsequences. J Mol Biol 1981;147:195-7.
38. Anson EL, Myers EW. ReAligner: a program for refining DNA sequence multi-alignments. J Comput Biol 1997;4:369-83.
39. Batzoglou S. Computational Genomics: Mapping, Comparison, and Annotation of Genomes. 2000, Massachusetts Institute of Technology, http://dspace.mit.edu/handle/1721.1/8629.
40. Batzoglou S. ARACHNE: a whole-genome shotgun assembler. Genome Res 2002;12:177-89.
41. Zagordi O, Geyrhofer L, Roth V, et al. Deep sequencing of a genetically heterogeneous sample: local haplotype reconstruction and read error correction. J Comput Biol 2010;17: 417-28.
42. Zagordi O, Bhattacharya A, Eriksson N, et al. ShoRAH: estimating the genetic diversity of a mixed sample from nextgeneration sequencing data. BMC Bioinformatics 2011;12:119.
43. Zhao Z, Yin J, Li Y, et al. An efficient hybrid approach to correcting errors in short reads. Model Decis Artif Intell 2011; 6820:198-210.
44. Simpson JT, Durbin R. Efficient de novo assembly of large genomes using compressed data structures. Genome Res 2012;22:549-56.
45. Pevzner PA, Tang H, Waterman MS. A new approach to fragment assembly in DNA sequencing. In: RECOMB '01 Proceedings of the fifth annual international conference on Computational biology, 2001, pp. 256-67.
46. Schroder J, Schroder H, Puglisi SJ, et al. SHREC: a short-read error correction method. Bioinformatics 2009;25:2157-63.
47. Salmela L. Correction of sequencing errors in a mixed set of reads. Bioinformatics 2010;26:1284-90.
48. Manber U, Myers G. Suffix arrays: a new method for on-line string searches. SIAM J Comput 1993;22:935-48.
49. Ilie L, Fazayeli F, Ilie S. HiTEC: accurate error correction in high-throughput sequencing data. Bioinformatics 2011;27: 295-302.
50. Schulz MH, Bauer S, Robinson PN. The generalised k- Truncated Suffix Tree for time-and space-efficient searches in multiple DNA or protein sequences. Int J Bioinform Res Appl 2008;4:81-95.
51. Zhao Z, Yin J, Zhan Y, et al. PSAEC: an improved algorithm for short read error correction using partial suffix arrays. Front Algorithmics Algorithmic Asp Inf Manag 2011;220-32.
52. Schulz MH, Weese D, Holtgrewe M, et al. Fiona: a parallel and automatic strategy for read error correction. Bioinformatics 2014;30:i356-63.
53. Ferragina P, Manzini G. Opportunistic data structures with applications. In: Proceedings of 41st Annual Symposium on Foundations of Computer Science, IEEE, 2000. pp. 390-8.
54. Burrows M, Wheeler DJ. A Block-sorting Lossless Data Compression Algorithm. 1994, Systems Research Center, Palo Alto.
55. Li H. Exploring single-sample SNP and INDEL calling with whole-genome de novo assembly. Bioinformatics 2012;28: 1838-44.
56. Levenshtein VI. Binary codes capable of correcting deletions, insertions and reversals. Sov Phys Dokl 1966;10:707.
57. Hamming RW. Error detecting and error correcting codes. Bell Syst Tech J 1950;29:147-60.
58. Yang X, Dorman KS, Aluru S. Reptile: representative tiling for short read error correction. Bioinformatics 2010;26: 2526-33.
59. Medvedev P, Scott E, Kakaradov B, et al. Error correction of high-throughput sequencing datasets with non-uniform coverage. Bioinformatics 2011;27:i137-41.
60. Nikolenko SI, Korobeynikov AI, Alekseyev MA. BayesHammer: Bayesian clustering for error correction in single-cell sequencing. BMC Genomics 2013;14:S7.
61. Salmela L, Schroder J. Correcting errors in short reads by multiple alignments. Bioinformatics 2011;27:1455-61.
62. Kao W-C, Chan AH, Song YS. ECHO: a reference-free shortread error correction algorithm. Genome Res 2011;21:1181-92.
63. Aita T, IchihashiN, Yomo T. Probabilisticmodel based error correction in a set of variousmutant sequences analyzed by nextgeneration sequencing. Comput Biol Chem2013;47:221-30.
64. Greenfield P, Duesing K, Papanicolaou A, et al. Blue: correcting sequencing errors using consensus and context. Bioinformatics 2014;30:2723-32.
65. Chaisson M, Pevzner P, Tang H. Fragment assembly with short reads. Bioinformatics 2004;20:2067-74.
66. Li R, Zhu H, Ruan J, et al. De novo assembly of human genomes with massively parallel short read sequencing. Genome Res 2010;20:265-72.
67. Luo R, Liu B, Xie Y, et al. SOAPdenovo2: an empirically improved memory-efficient short-read de novo assembler. GigaScience 2012;1:18.
68. Chaisson MJ, Pevzner PA. Short read fragment assembly of bacterial genomes. Genome Res 2008;18:324-30.
69. Butler J, MacCallum I, Kleber M, et al. ALLPATHS: de novo assembly of whole-genome shotgun microreads. Genome Res 2008;18:810-20.
70. Kelley DR, Schatz MC, Salzberg SL. Quake: quality-aware detection and correction of sequencing errors. Genome Biol 2010;11:R116.
71. Li H. Correcting Illumina sequencing errors for human data. ArXiv 2015;150203744 Q-Bio.
72. Chikhi R, Medvedev P. Informed and automated k-mer size selection for genome assembly. Bioinformatics 2014;30:31-37.
73. Sleep JA, Schreiber AW, Baumann U. Sequencing error correction without a reference genome. BMC Bioinformatics 2013;14:367.
74. Lim E-C, Mü ller J, Hagmann J, et al. Trowel: a fast and accurate error correction module for Illumina sequencing reads. Bioinformatics 2014;30:3264-5.
75. Zhao X, Palmer LE, Bolanos R, et al. EDAR: an efficient error detection and removal algorithm for next generation sequencing data. J Comput Biol 2010;17:1549-60.
76. Marçais G, Yorke JA, Zimin A. QuorUM: an error corrector for Illumina reads. ArXiv 2013;13073515 Q-Bio.
77. Gnerre S, MacCallum I, Przybylski D, et al. High-quality draft assemblies of mammalian genomes from massively parallel sequence data. Proc Natl Acad Sci USA 2011; 108:1513-18.
78. Le H-S, Schulz MH, McCauley BM, et al. Probabilistic error correction for RNA sequencing. Nucleic Acids Res 2013;41:e109.
79. Yin X, Song Z, Dorman K, et al. PREMIER: PRobabilistic errorcorrection using Markov inference in errored reads. In: IEEE International Symposium On Information Theory Proceedings of ISIT, IEEE 2013, pp. 1626-30.
80. Gajer P. Automated correction of genome sequence errors. Nucleic Acids Res 2004;32:562-9.
81. Wijaya E, Frith MC, Suzuki Y, et al. Recount: expectation maximization based error correction tool for next generation sequencing data. Genome Inf 2009;23:189-201.
82. Meacham F, Boffelli D, Dhahbi J, et al. Identification and correction of systematic error in high-throughput sequence data. BMC Bioinformatics 2011;12:451.
83. Chaisson MJ, Brinza D, Pevzner PA. De novo fragment assembly with short mate-paired reads: does the read length matter? Genome Res 2009;19:336-46.
84. Pevzner PA. De novo repeat classification and fragment assembly. Genome Res 2004;14:1786-96.
85. Salmela L, Rivals E. LoRDEC: accurate and efficient long read error correction. Bioinformatics 2014;30:3506-14.
86. Tammi MT. Correcting errors in shotgun sequences. Nucleic Acids Res 2003;31:4663-72.
87. Tammi MT, Arner E, Britton T, et al. Separation of nearly identical repeats in shotgun assemblies using defined nucleotide positions, DNPs. Bioinformatics 2002;18:379-88.
88. Bragg L, Stone G, Imelfort M, et al. Fast, accurate errorcorrection of amplicon pyrosequences using Acacia. Nat Methods 2012;9:425-6.
89. Quince C, Lanzén A, Curtis TP, et al. Accurate determination of microbial diversity from 454 pyrosequencing data. Nat Methods 2009;6:639-41.
90. Reeder J, Knight R. Rapidly denoising pyrosequencing amplicon reads by exploiting rank-abundance distributions. Nat Methods 2010;7:668-9.
91. Quince C, Lanzen A, Davenport RJ, et al. Removing noise from pyrosequenced amplicons. BMC Bioinformatics 2011;12:38.
92. Wirawan A, Harris RS, Liu Y, et al. HECTOR: a parallel multistage homopolymer spectrum based error corrector for 454 sequencing data. BMC Bioinformatics 2014;15:131.
93. Skums P, Dimitrova Z, Campo DS, et al. Efficient error correction for next-generation sequencing of viral amplicons. BMC Bioinformatics 2012;13:S6.
94. Miller JR, Delcher AL, Koren S, et al. Aggressive assembly of pyrosequencing reads with mates. Bioinformatics 2008;24: 2818-24.
95. Koren S, Schatz MC, Walenz BP, et al. Hybrid error correction and de novo assembly of single-molecule sequencing reads. Nat Biotechnol 2012;30:693-700.
96. Bashir A, Klammer AA, Robins WP, et al. A hybrid approach for the automated finishing of bacterial genomes. Nat Biotechnol 2012;30:701-7.
97. Au KF, Underwood JG, Lee L, et al. Improving PacBio long read accuracy by short read alignment. PLoS One 2012;7: e46679.
98. Hackl T, Hedrich R, Schultz J, et al. proovread: large-scale high-accuracy PacBio correction through iterative short read consensus. Bioinformatics 2014;30:3004-11.
99. Lee H, Gurtowski J, Yoo S, et al. Error correction and assembly complexity of single molecule sequencing reads. bioRxiv 2014;006395.
100. Chin C-S, Alexander DH, Marks P, et al. Nonhybrid, finished microbial genome assemblies from long-read SMRT sequencing data. Nat Methods 2013;10:563-9.
101. Goodwin S, Gurtowski J, Ethe-Sayers S, et al. Oxford Nanopore sequencing and de novo assembly of a eukaryotic genome. bioRxiv 2015;013490.
102. Zagordi O, Klein R, Däumer M, et al. Error correction of nextgeneration sequencing data and reliable estimation of HIV quasispecies. Nucleic Acids Res 2010;38:7400-9.
103. Molnar M, Ilie L. Correcting Illumina data. Brief Bioinform 2015;16(4):588-99.
104. Heo Y, Wu X-L, Chen D, et al. BLESS: bloom filter-based error correction solution for high-throughput sequencing reads. Bioinformatics 2014;30:1354-62.
105. Drezen E, Rizk G, Chikhi R, et al. GATB: genome assembly & analysis tool box. Bioinformatics 2014;20:2959-61.
106. Shi H, Schmidt B, Liu W, et al. A parallel algorithm for error correction in high-throughput short-read data on CUDAenabled graphics hardware. J Comput Biol 2010;17:603-15.
107. Shi H, Schmidt B, Liu W, et al. Quality-score guided error correction for short-read sequencing data using CUDA. Procedia Comput Sci 2010;1:1129-38.
108. Liu Y, Schmidt B, Maskell DL. DecGPU: distributed error correction on massively parallel graphics processing units using CUDA and MPI. BMC Bioinformatics 2011;12:85.
109. Song L, Florea L, Langmead B. Lighter: fast and memory-efficient sequencing error correction without counting. Genome Biol 2014;15:509.
110. Liu Y, Schrö der J, Schmidt B. Musket: a multistage k-mer spectrum-based error corrector for Illumina sequence data. Bioinformatics 2013;29:308-15.
111. Shin S, Park J. Correction of sequence-dependent ambiguous bases (Ns) from the 454 pyrosequencing system. Nucleic Acids Res 2014;42:e51.
112. Ilie L, Molnar M. RACER: rapid and accurate correction of errors in reads. Bioinformatics 2013;29:2490-3.
113. Yang X, Aluru S, Dorman KS. Repeat-aware modeling and correction of short read errors. BMC Bioinformatics 2011;12:S52.
114. McKenna A, HannaM, Banks E, et al. The genome analysis toolkit: a MapReduce framework for analyzing next-generation DNA sequencing data. Genome Res 2010;20:1297-303.
115. Dö ring A, Weese D, Rausch T, et al. SeqAn An efficient, generic Cρρ library for sequence analysis. BMC Bioinformatics 2008;9:11.