Adaptive efficient compression of genomes

Algorithms for Molecular Biology

Volumn 7, Issue 1, 2012, Pages

  Wandelt, Sebastian ^a   Leser, Ulf ^a  

^a HUMBOLDT UNIVERSITY   (Germany)

Author keywords

Heuristics; Referential compression; Scalability; Sequence compression

Indexed keywords

EID: 84868670481     PISSN: None     EISSN: 17487188     Source Type: Journal    
DOI: 10.1186/1748-7188-7-30     Document Type: Article

References (37)

1. Consortium IHGS Initial sequencing and analysis of the human genome. Nature 2001, 409(6822):860-921. 10.1038/35057062, 11237011, Consortium IHGS.
2. Schadt EE, Turner S, Kasarskis A. A window into third-generation sequencing. Human Mol Genet 2010, 19(R2):R227-R240. [http://dx.doi.org/10.1093/hmg/ddq416].
3. International Cancer Genome Consortium Data Portal-a one-stop shop for cancer genomics data. Database: the journal of biological databases and curation 2011, 2011(0):bar026. [http://dx.doi.org/10.1093/database/bar026].
4. Kahn SD. On the future of genomic data. Science 2011, 331(6018):728-729. [http://www.sciencemag.org/content/331/6018/728.abstract], 10.1126/science.1197891, 21311016.
5. Fusaro VA, Patil P, Gafni E, Wall DP, Tonellato PJ. Biomedical cloud computing with amazon web services. PLoS Comput Biol 2011, 7(8):1-6. [https://sremote.pitt.edu:11018/login.aspx?direct=true&db=aph&AN=67016557&site=ehost-live].
6. Cloud computing and the DNA data race. Nat Biotechnol 2010, 28(7):691-693. [http://dx.doi.org/10.1038/nbt0710-691], 10.1038/nbt0710-691, 2904649, 20622843.
7. The case for cloud computing in genome informatics. Genome Biol 2010, 11(5):207+. [http://dx.doi.org/10.1186/gb-2010-11-5-207], 10.1186/gb-2010-11-5-207, 2898083, 20441614.
8. Trelles O, Prins P, Snir M, Jansen RC. Big data, but are we ready?. Nat Rev Genet 2011, 12(3):224. [http://dx.doi.org/10.1038/nrg2857-c1].
9. Pennisim E. Will computers crash genomics?. Science 2011, 331(6018):666-668. [http://dx.doi.org/10.1126/science.331.6018.666], 10.1126/science.331.6018.666, 21310981.
10. Giancarlo R, Scaturro D, Utro F. Textual data compression in computational biology: algorithmic techniques. Comput Sci Rev January 2012, 6(1):1-25.
11. Nalbantoglu T, Russell DJ, Sayood K. Data compression concepts and algorithms and their applications to bioinformatics. Entropy 2010, 12:34-52. [http://www.mdpi.com/1099-4300/12/1/34/], 2821113, 20157640.
12. Antoniou D, Theodoridis E, Tsakalidis A. Compressing biological sequences using self adjusting data structures. 10th IEEE International Conference on Information Technology and Applications in Biomedicine 2010, 1-5.
13. Pratas D, Pinho AJ. Compressing the Human Genome Using Exclusively Markov Models. PACBB, Volume 93 of Advances in Intelligent and Soft Computing 2011, 213-220. Springer, Rocha MP, JMC Rodríguez, Fdez-Riverola F, Valencia A, [http://dblp.uni-trier.de/db/conf/pacbb/pacbb2011.html{set minus}#PratasP11].
14. Deorowicz S, Grabowski S. Robust relative compression of genomes with random access. Bioinformatics 2011, 27(21):2979-2986. [http://dx.doi.org/10.1093/bioinformatics/btr505], 10.1093/bioinformatics/btr505, 21896510.
15. Kuruppu S, Puglisi S, Zobel J. Relative Lempel-Ziv compression of genomes for large-scale storage and retrieval. String Processing and Information Retrieval, Volume 6393 of Lecture Notes in Computer Science 2010, 201-206. Berlin / Heidelberg: Springer, Chavez E, Lonardi S.
16. Kuruppu S, Puglisi SJ, Zobel J. Relative Lempel-Ziv compression of genomes for large-scale storage and retrieval. Proceedings of the 17th international conference on String processing and information retrieval, SPIRE'10 2010, 201-206. Berlin, Heidelberg: Springer-Verlag, [http://dl.acm.org/citation.cfm?id=1928328.1928353].
17. Ukkonen E. On-line construction of suffix trees. Algorithmica 1995, 14:249-260. [http://dx.doi.org/10.1007/BF01206331] [doi:10.1007/BF01206331].
18. Ohlebusch E, Fischer J, Gog S. CST++. String Processing and Information Retrieval -17th International Symposium, SPIRE 2010 2010, 322-333.
19. Kuruppu S, Beresford-Smith B, Conway T, Zobel J. Iterative dictionary construction for compression of large DNA data sets. IEEE/ACM Trans Comput Biol Bioinformatics 2012, 9:137-149. [http://dx.doi.org/10.1109/TCBB.2011.82].
20. Duc Cao M, Dix TI, Allison L, Mears C. A simple statistical algorithm for biological sequence compression. Proceedings of the 2007 Data Compression Conference 2007, 43-52. IEEE Computer Society, Washington, DC, USA, [http://dl.acm.org/citation.cfm?id=1251981.1252877].
21. Christley S, Lu Y, Li C, Xie X. Human genomes as email attachments. Bioinformatics 2009, 25(2):274-275. [http://dx.doi.org/10.1093/bioinformatics/btn582], 10.1093/bioinformatics/btn582, 18996942.
22. Grabowski S, Deorowicz S. Engineering relative compression of genomes. ArXiv 2011,, [http://arxiv.org/abs/1103.2351].
23. Kreft S, Navarro G. LZ77-like compression with fast random access. Proceedings of the 2010 Data Compression Conference, DCC '10 2010, 239-248. IEEE Computer Society, Washington, DC, USA, [http://dx.doi.org/10.1109/DCC.2010.29].
24. Grumbach S, Tahi F. Compression of DNA sequences. Data Compression Conference 1993, 340-350.
25. Chen X, Kwong S, Li M. A compression algorithm for DNA sequences and its applications in genome comparison. Proceedings of the fourth annual international conference on Computational molecular biology, RECOMB '00 2000, 107-107. New York, NY, USA: ACM, [http://doi.acm.org/10.1145/332306.332352].
26. Manzini G, Rastero M. A simple and fast DNA compressor. Software - Practice and Experience 2004, 34:1397-1411.
27. Behzadi B, Le Fessant F. DNA compression challenge revisited: a dynamic programming approach. Combinatorial Pattern Matching, Volume 3537 of Lecture Notes in Computer Science 2005, 85-96. Berlin / Heidelberg: Springer, Apostolico A, Crochemore M, Park K.
28. Cherniavsky N, Ladner R. Grammar-based compression of DNA sequences. 2004, [Unpublished work].
29. Cao MD, Dix TI, Allison L, Mears C. A simple statistical algorithm for biological sequence compression. Data Compression Conference 2007, 0:43-52.
30. Matsumoto T, Sadakane K, Imai H. Biological sequence compression algorithms. Genome Informatics 2000, 11:43-52.
31. Sakib MN, Tang J, Zheng WJ, Huang CT. Improving transmission efficiency of large sequence alignment/map (SAM) files. PLoS ONE 2011, 6(12):e28251. [http://dx.doi.org/10.1371], 10.1371/journal.pone.0028251, 3229529, 22164252.
32. Hsi-Yang Fritz M, Leinonen R, Cochrane G, Birney E. Efficient storage of high throughput sequencing data using reference-based compression. Genome Res 2011, 21(5):734-740. [http://genome.cshlp.org/content/early/2011/01/18/gr.114819.110.abstract], 10.1101/gr.114819.110, 3083090, 21245279.
33. BOOST C++ Libraries. [http://www.boost.org].
34. Ohlebusch E, Fischer J, Gog S. CST++. SPIRE'10 2010, 322-333.
35. Consortium GP A map of human genome variation from population-scale sequencing. Nature 2010, 467(7319):1061-1073. [http://dx.doi.org/10.1038/nature09534], 10.1038/nature09534, 3042601, 20981092, Consortium GP.
36. Danecek P, Auton A, Abecasis G, Albers CA, Banks E, DePristo MA, Handsaker RE, Lunter G, Marth GT, Sherry ST, McVean G, Durbin R, 1000 Genomes Project Analysis Group The variant call format and VCFtools. Bioinformatics (Oxford, England) 2011, 27(15):2156-2158. [http://dx.doi.org/10.1093/bioinformatics/btr330], 1000 Genomes Project Analysis Group.
37. Kent WJ, Sugnet CW, Furey TS, Roskin KM, Pringle TH, Zahler AM, Haussler D. The human genome browser at UCSC. Genome Res 2002, 12(6):996-1006. [http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=12045153], 186604, 12045153.