Assigning document identifiers to enhance compressibility of Web search engines indexes

Proceedings of the ACM Symposium on Applied Computing

Volumn 1, Issue , 2004, Pages 600-605

  Silivestri, Fabrizio ^a   Perego, Raffaele ^b   Orlando, Salvatore ^c  

^a UNIVERSITY OF PISA   (Italy)

^b Information Science and Technology Inst   (Italy)

^c CA' FOSCARI UNIVERSITY OF VENICE   (Italy)

Author keywords

Clustering; Document Identifiers Assignment; Index Compression; Inverted Files; Web Search Engines

Indexed keywords

ALGORITHMS; COMPUTER SCIENCE; DATA STORAGE EQUIPMENT; ENCODING (SYMBOLS); FILE EDITORS; INFORMATION SCIENCE; MATHEMATICAL MODELS; PROGRAM DOCUMENTATION; WORLD WIDE WEB;

CLUSTERING; DOCUMENT IDENTIFIERS ASSIGNMENT; INDEX COMPRESSION; INVERTED FILES; WEB SEARCH ENGINES (WSE);

SEARCH ENGINES;

EID: 2442464849     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. Dan Bladford and Guy Blelloch. Index compression through document reordering. In IEEE, editor, Proc. of DCC'02. IEEE, 2002.
2. S. Chakrabarti, M. van den Berg, and B. Dorn. Focused crawling: A new approach to topic-specific web resource discovery. In 8th International World Wide Web Conference, May 1999.
3. Soumen Chakrabarti. Mining the Web - Discovering Knowledge from Hypertext Data. Morgan Kaufmann Pub., 2003.
4. Junghoo Cho, Hector Garcia-Molina, and Lawrence Page. Efficient crawling through url ordering. In 7th World Wide Web Conference (WWW7), Apr 1998.
5. P. Elias. Universal codeword sets and representation of the integers. IEEE Trans. on Information Theory, 21(2):194-203, Feb 1975.
6. W. B. Frakes and Editors R. Baeza-Yates. Information Retrieval: Data Structures and Algorithms, chap. on Clustering Alg. (E. Rasmussen). Prentice Hall, Englewood Cliffs, NJ, 1992.
7. S. Golomb. Run-length encodings. IEEE Trans. on Information Theory, 12(3):399-401, Jul 1966.
8. A. Jain and R. Dubes. Algorithms for Clustering Data. Prentiche Hall, 1988.
9. A. Moffat and T. Bell. In situ generation of compressed inverted files. J. of the American Society for Information Science, 46(7):537-550, 1995.
10. Alistair Moffat and Lang Stuiver. Binary interpolative coding for effective index compression. Information Retrieval, 3(1):25-47, Jul 2000.
11. Anh NgocVo and Alistair Moffat. Compressed inverted files with reduced decoding overheads. In Proc. of the 21st Intl. Conf. on Research and Development in Information Retrieval, pages 290-297, Oct 1998.
12. Falk Scholer, Hugh E. Williams, John Yiannis, and Justin Zobel. Compression of inverted index for fast query evaluation. In SIGIR02, 2002.
13. Wann-Yun Shieh, Tien-Fu Chen, Jean Jyh-Jiun Shann, and Chung-Ping Chung. Inverted file compression through document identifier reassignment. Information Processing and Management, 39(1): 117-131, Jan 2003.
14. T. B. Smith, B. Abali, D. E. Poff, and R. B. Tremaine. Memory expansion technology (mxt): Competitive impact. J. of Research and Development, 45(2):303-309, Feb 2001.
15. E. Voorhees and E. D. K. Harman. Overview of the eighth text retrieval conference (trec-8). In Proc. of the TREC-8, pages 1-24, 1999.
16. H. Williams and J. Zobel. Compressing integers for fast file access. Computer Journal, 42(3):193-201, 1999.
17. Ian H. Witten, Alistair Moffat, and Timothy C. Bell. Managing Gigabytes - Compressing and Indexing Documents and Images. Morgan Kaufmann Pub., 2nd ed., 1999.