Assigning identifiers to documents to enhance the clustering property of fulltext indexes

Proceedings of Sheffield SIGIR - Twenty-Seventh Annual International ACM SIGIR Conference on Research and Development in Information Retrieval

Volumn , Issue , 2004, Pages 305-312

  Silvestri, Fabrizio ^a   Orlando, Salvatore ^b   Perego, Raffaele ^c  

^a UNIVERSITY OF PISA   (Italy)

^b CA' FOSCARI UNIVERSITY OF VENICE   (Italy)

^c ISTI CNR   (Italy)

Author keywords

Clustering property; Document Identifier Assignment; Index Compression; Web Search Engines

Indexed keywords

ALGORITHMS; DATA COMPRESSION; DECODING; HEURISTIC METHODS; OPTIMIZATION; QUERY LANGUAGES; SEARCH ENGINES; SET THEORY;

CLUSTERING PROPERTY; DOCUMENT IDENTIFIER ASSIGNMENT; INDEX COMPRESSION; WEB SEARCH ENGINES (WSE);

INDEXING (OF INFORMATION);

EID: 8644240363     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1008992.1009046     Document Type: Conference Paper

References (14)

1. V. Anh and A. Moffat. Inverted index compression using word-aligned binary codes. Information Retrieval, 2004. To appear.
2. V. N. Anh and A. Moffat. Index compression using fixed binary codewords. In K.-D. Schewe and H. Williams, editors, Proc. 15th Australasian Database Conference, Dunedin, New Zealand, Jan. 2004.
3. D. Blandford and G. Blelloch. Index compression through document reordering. In IEEE, editor, Proceedings of the Data Compression Conference (DCC'02). IEEE, 2002.
4. C. Buckley. Implementation of the smart information retrieval system. Technical Report TR85-686, Cornell University, Computer Science Department, May 1985.
5. S. Chakrabarti. Mining the Web - Discovering Knowledge from Hypertext Data. Morgan Kaufmann Publishers, San Francisco, 2003.
6. D. R. Cutting, D. R. Karger, J. O. Pedersen, and J. W. Tukey. Scatter/gather: a cluster-based approach to browsing large document collections. In Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval, pages 318-329. ACM Press, 1992.
7. W. B. Frakes and E. R. Baeza-Yates. Information Retrieval: Data Structures and Algorithms, chapter Clustering Algorithms (E. Rasmussen). Prentice Hall, Englewood Cliffs, NJ, 1992.
8. G. Karypis. Metis: Family of multilevel partitioning algorithms. http://www-users.cs.umn.edu/~karypis/metis/.
9. A. Moffat and L. Stuiver. Binary interpolative coding for effective index compression. Information Retrieval, 3(l):25-47, July 2000.
10. R. Rivest. Rfc 1321: The md5 algorithm.
11. F. Scholer, H. E. Williams, J. Yiannis, and J. Zobel. Compression of inverted index for fast query evaluation. In Proceedings of the 25rd annual international ACM SIGIR conference on Research and development in information retrieval, 2002.
12. W.-Y. Shieh, T.-F. Chen, J. J.-J. Shann, and C.-P. Chung. Inverted file compression through document identifier reassignment. Information Processing and Management, 39(1):117-131, January 2003.
13. F. Silvestri, R. Perego, and S. Orlando. Assigning document identifiers to enhance compressibility of web search. In Proceedings of the 19th Annual ACM Symposium on Applied Computing - Data Mining Track, 2004.
14. I. H. Witten, A. Moffat, and T. C. Bell. Managing Gigabytes - Compressing and Indexing Documents and Images. Morgan Kaufmann Publishing, San Francisco, second edition edition, 1999.