Sorting next generation sequencing data improves compression effectiveness

2010 IEEE International Conference on Bioinformatics and Biomedicine Workshops, BIBMW 2010

Volumn , Issue , 2010, Pages 567-572

  Wan, Raymond ^a,b   Asai, Kiyoshi ^a,b  

^a UNIVERSITY OF TOKYO   (Japan)

^b NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY AIST   (Japan)

Author keywords

Data archiving; Data pre processing; Next generation sequencing; Sorting

Indexed keywords

COMPRESSION SYSTEM; DATA ARCHIVING; DATA PRE-PROCESSING; NEXT GENERATION SEQUENCING;

BIOINFORMATICS; DATA COMPRESSION;

SORTING;

EID: 79952030472     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/BIBMW.2010.5703863     Document Type: Conference Paper

References (15)

1. M. L. Metzker, "Sequencing technologies - the next generation," Nature Reviews Genetics, vol. 11, no. 1, pp. 31-46, Jan. 2010.
2. M. Shumway, G. Cochrane, and H. Sugawara, "Archiving next generation sequencing data," Nucleic Acids Research, vol. 38, pp. D870-D871, Jan. 2010.
3. P. J. A. Cock, C. J. Fields, N. Goto, M. L. Heuer, and P. M. Rice, "The Sanger FASTQ file format for sequences with quality scores, and the Solexa/Illumina FASTQ variants," Nucleic Acids Research, vol. 38, no. 6, pp. 1767-1771, Apr. 2010.
4. J. Gailly and M. Adler, "GZIP program," Source code available from http://www.gzip.org/, 1993.
5. J. Seward, "BZIP program and documentation," Source code available from http://www.bzip.org/, 1996.
6. J. Ziv and A. Lempel, "A universal algorithm for sequential data compression," IEEE Transactions on Information Theory, vol. 23, no. 3, pp. 337-343, May 1977.
7. M. Burrows and D. J. Wheeler, "A block-sorting lossless data compression algorithm," Digital Equipment Corporation, Palo Alto, California, Tech. Rep. 124, May 1994.
8. I. H. Witten, A. Moffat, and T. C. Bell, Managing Gigabytes, 2nd ed. Morgan Kaufmann, 1999.
9. T. H. Cormen, C. E. Leiserson, R. L. Rivest, and C. Stein, Introduction to Algorithms, 3rd ed. Cambridge, USA: The MIT Press, 2009.
10. P. Elias, "Universal codeword sets and representations of the integers," IEEE Transactions on Information Theory, vol. 21, no. 2, pp. 194-203, Mar. 1975.
11. R. Giancarlo, D. Scaturro, and F. Utro, "Textual data compression in computational biology: a synopsis," Bioinformatics, vol. 25, no. 13, pp. 1575-1586, Jul. 2009.
12. C. Kozanitis, C. Saunders, S. Kruglyak, V. Bafna, and G. Varghese, "Compressing genomic sequence fragments using SlimGene," in Proc. 14th International Conference on Computational Molecular Biology (RECOMB), ser. LNBI, vol. 6044, 2010, pp. 310-324.
13. H. Li, B. Handsaker, A. Wysoker, T. Fennell, J. Ruan, N. Homer, G. Marth, G. Abecasis, R. Durbin, and 1000 Genome Project Data Processing Subgroup, "The sequence alignment/map (SAM) format and SAMtools," Bioinformatics, vol. 25, no. 16, pp. 2078-2079, Aug. 2009.
14. H. Liefke and D. Suciu, "XMill: an efficient compressor for XML data," in Proc. ACM SIGMOD 2000 International Conference on Management of Data, May 2000, pp. 153-164.
15. R. Wan and A. Moffat, "Effective compression for the web: Exploiting document linkages," in Proc. 12th Australasian Database Conference, Feb. 2001, pp. 68-75.