Compression of inverted indexes for fast query evaluation

SIGIR Forum (ACM Special Interest Group on Information Retrieval)

Volumn , Issue , 2002, Pages 222-229

  Scholer, Falk ^a   Williams, Hugh E ^a   Yiannis, John ^a   Zobel, Justin ^a  

^a RMIT UNIVERSITY   (Australia)

Author keywords

Index compression; Integer coding; Inverted indexes; Retrieval efficiency

Indexed keywords

ALGORITHMS; COMPUTER SOFTWARE SELECTION AND EVALUATION; DATA STORAGE EQUIPMENT; HTML; INFORMATION RETRIEVAL; QUERY LANGUAGES; SEARCH ENGINES;

INTEGER CODING; INVERTED INDEXES;

DATA COMPRESSION;

EID: 0036989596     PISSN: 01635840     EISSN: None     Source Type: Journal    
DOI: 10.1145/564376.564416     Document Type: Conference Paper

References (15)

1. V. Anh, O. de Kretser, and A. Moffat, Vector-Space ranking with effective early termination. In. W. Croft, D. Harper, D. Kraft, and J. Zobel, editors, Proc. ACM-SIGIR International Conference on Research and Development in Information Retrieval, pages 35-42, New York, Sept. 2001.
2. E. de Moura, G. Navarro, N. Ziviani, and R. Baeza-Yates. Fast and flexible word searching on compressed text. ACM Transactions on Information Systems, 18(2):113-139, 2000.
3. P. Elias, Universal codeword sets and representations of the integers. IEEE Transactions on Information Theory, IT-21(2):194-203, Mar. 1975.
4. S. Golomb. Run-length encodings. IEEE Transactions on Information Theory, IT-12(3):399-401, July 1966.
5. D. Hawking, N. Creswell, and P. Thistlewaite. Overview of TREC-7 very large collection track. In E. Voorhees and D. Harman, editors, Proc. Text Retrieval Conference (TREC), pages 91-104, Washington, 1999. National Institute of Standards and Technology Special Publication 500-242.
6. A. Moffat and J. Zobel. Self-indexing inverted files for fast text retrieval. ACM Transactions on Information Systems, 14(4):349-379, Oct. 1996.
7. A. Moffat, J. Zobel, and R. Sacks-Davis. Memory-efficient ranking. Information Processing & Management, 30(6):733-744, 1994.
8. G. Navarro, E. de Moura, M. Neubert, N. Ziviani, and R. Baeza-Yates. Adding compression to block addressing inverted indexes. Information Retrieval, 3(1):49-77, 2000.
9. M. Persin. Document filtering for fast ranking. In W. Croft and C. van Rijsbergen, editors, Proc. ACM-SIGIR International Conference on Research and Development in Information Retrieval, pages 339-348, Dublin, Ireland, 1994.
10. M. Persin, J. Zobel, and R. Sacks-Davis. Filtered document retrieval with frequency-sorted indexes. Journal of the American Society for Information Science, 47(10):749-764, 1996.
11. A. Spink, D. Wolfram, B. J. Jansen, and T. Saracevic. Searching the web: The public and their queries. Journal of the American Society for Information Science, 52(3):226-234, 2001.
12. A. Vo and A. Moffat. Compressed inverted files with reduced decoding overheads. In R. Wilkinson, B. Croft, K. van Rijsbergen, A. Moffat, and J. Zobel, editors, Proc. ACM-SIGIR International Conference on Research and Development in Information Retrieval, pages 290-297, Melbourne, Australia, July 1998.
13. H. Williams and J. Zobel. Compressing integers for fast file access. Computer Journal, 42(3):193-201, 1999.
14. I. Witten, A. Moffat, and T. Bell. Managing Gigabytes: Compressing and Indexing Documents and Images. Morgan Kaufmann Publishers, Los Altos, CA 94022, USA, second edition, 1999.
15. N. Ziviani, E. de Moura, G. Navarro, and R. Baeza-Yates. Compression: A key for next-generation text retrieval systems. IEEE Computer, 33(11):37-44, Nov. 2000.