Word-based statistical compressors as natural language compression boosters

Data Compression Conference Proceedings

Volumn , Issue , 2008, Pages 162-171

  Fariña, Antonio ^a   Navarro, Gonzalo ^b   Parama, José R ^a  

^a UNIVERSITY OF A CORUÑA   (Spain)

^b UNIVERSITY OF CHILE   (Chile)

Author keywords

[No Author keywords available]

Indexed keywords

CODES (STANDARDS); CODES (SYMBOLS); COMPRESSORS; KETONES; LINGUISTICS; MICROWAVE ANTENNAS; PROGRAMMING THEORY; STATISTICAL METHODS;

COMPRESSION CODES; COMPRESSION RATIOS; DENSE CODING; HUFFMAN CODING; NATURAL LANGUAGE TEXTS; NATURAL LANGUAGES; PRE-PROCESSING STEP; SPACE AND TIME; STATISTICAL COMPRESSORS; TEXT INDEXING;

DATA COMPRESSION;

EID: 50249180341     PISSN: 10680314     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/DCC.2008.14     Document Type: Conference Paper

References (17)

1. N. Abramson. Information Theory and Coding. McGraw-Hill, 1963.
2. J. Adiego and P. de la Fuente. Mapping words into codewords on ppm. In Proc. 13th SPIRE, LNCS 4209, pages 181-192, 2006.
3. J. Adiego, M. Martínez-Prieto, and P. de la Fuente. Edge-guided natural language text compression. In Proc. 14th SPIRE, LNCS 4726, pages 14-25, 2007.
4. T. Bell, J. Cleary, and I. Witten. Data compression using adaptive coding and partial string matching. IEEE Trans. on Communications, 32(4):396-402, 1984.
5. T. C. Bell, J. G. Cleary, and I. H. Witten. Text Compression. Prentice Hall, 1990.
6. N. Brisaboa, A. Fariña, G. Navarro, and J. Parama. Lightweight natural language text compression. Information Retrieval, 10(1): 1-33, 2007.
7. M. Burrows and D. J. Wheeler. A block-sorting lossless data compression algorithm. Technical Report 124, Digital Equipment Corporation, 1994.
8. J.S. Culpepper and A. Moffat. Enhanced byte codes with restricted prefix properties. In Proc. 12th SPIRE, LNCS 3772, pages 1-12, 2005.
9. P. Ferragina, G. Manzini, V. Mäkinen, and G. Navarro. Compressed representations of sequences and full-text indexes. ACM TALG, 3(2):article 20, 2007.
10. Sz. Grabowski, G. Navarro, R. Przywarski, A. Salinger, and V. Mäkinen. A simple alphabet-independent FM-index. International Journal of Foundations of Computer Science (IJFCS), 17(6):1365-1384, 2006.
11. D. A. Huffman. A method for the construction of minimum-redundancy codes. In Proc. of the IRE, volume 40, pages 1098-1101, 1952.
12. A. Moffat. Word-based text compression. Software Practice and Experience, 19(2):185-198, 1989.
13. G. Navarro and V. Mäkinen. Compressed full-text indexes. ACM Computing Surveys, 39(1):article 2, 2007.
14. G. K. Zipf. Human Behavior and the Principle of Least Effort. Addison-Wesley, 1949.
15. J. Ziv and A. Lempel. A universal algorithm for sequential data compression. IEEE Transactions on Information Theory, 23(3):337-343, 1977.
16. J. Ziv and A. Lempel. Compression of individual sequences via variable-rate coding. IEEE Transactions on Information Theory, 24(5):530-536, 1978.
17. N. Ziviani, E. Moura, G. Navarro, and R. Baeza-Yates. Compression: A key for next-generation text retrieval systems. IEEE Computer, 33(11):37-44, 2000.