Compact in-memory models for compression of large text databases

String Processing and Information Retrieval Symposium and International Workshop on Groupware, SPIRE 1999 and CRIWG 1999

Volumn , Issue , 1999, Pages 224-231

  Zobel, Justin ^a   Williams, Hugh E ^a  

^a RMIT UNIVERSITY   (Australia)

Author keywords

Efficient text retrieval; Models for compression; Prfix cod ing; Scaleability and resources; Text database compression

Indexed keywords

COMPUTER SOFTWARE; GROUPWARE; INFORMATION RETRIEVAL;

APPROXIMATE MODEL; CHARACTER-BASED MODELS; MEMORY REQUIREMENTS; PRFIX COD-ING; SCALEABILITY AND RESOURCES; TEXT DATABASE; TEXT RETRIEVAL; WORD-BASED MODEL;

DATABASE SYSTEMS;

EID: 84963895259     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SPIRE.1999.796599     Document Type: Conference Paper

References (14)

1. T.C. Bell, J.G. Cleary, and JR. Witten. Text Cornpre88ion. Prentice-Hall, Englewood Cliffs, New Jersey, 1990.
2. E. Silva de Moura, G. Navarro, N. Ziviano, and R. Baeza-Yates. Fast searching on compressed text allowing errors. Jn R. Wilkinson, B. Croft, K. van Rijsbergen, A. Moffat, and J. Zobel, editors, Proc. ACMSIGIR International Conference on Re8earch and Development in Information Retrieval, pages 298 306, Melbourne, Australia, July 1998.
3. S.W. Golomb. Run-length encodings. IEEE Transac-tions on Information Theory, JT 12(3):399 401, July 1966.
4. D. Harman. Overview of the second text retrieval conference (TREC-2). Information Processing J Management, 31(3):271 289, 1995.
5. U. Manber. A text compression scheme that allows fast searching directly on the compressed file. ACM Transactions on Information Systems, 15(2):124 136, 1997.
6. A. Moffat and L. Stuiver. Exploiting clustering in inverted file compression. Jn J. Storer and M. Cohn, editors, Proc. IEEE Data Compre88ion Conference, pages 82 91, Snowbird, Utah, 1996.
7. A. Moffat and J. Zobel. Self-indexing inverted files for fast text retrieval. ACM Transactions on Information Systems, 14(4):349 379, October 1996.
8. A. Moffat, J. Zobel, and N. Sharman. Text compression for dynamic document databases. IEEE Transac-tions on Knowledge and Data Engineering, 9(2):302 313, 1997.
9. C.E. Shannon. Prediction and entropy of printed English. Bell Systems Technical Journal, 30:55, 1951.
10. H. Williams and J. Zobel. Compression of nucleotide databases for fast searching. Computer Applications in the Biosciences, 13(5):549 554, October 1997.
11. HE. Williams and J. Zobel. Compressing integers for fast file access. Computer Journal, 1999. (To appear).
12. JR. Witten, A. Moffat, and T.C. Bell. Managing Gigabytes: Compressing and Indexing Documents and Images. Van Nostrand Reinhold, New York, 1994.
13. Z. Wu and G. Tseng. Chinese text segmentation for text retrieval: Achievements and problems. Journal of the American Society for Information Science, pages 532 542, October 1993.
14. J. Zobel and A. Moffat. Adding compression to a full-text retrieval system. Software Practice and Experience, 25(8):891 903, 1995.