Improving index compression using cluster information

Proceedings - 2006 IEEE/WIC/ACM International Conference on Web Intelligence (WI 2006 Main Conference Proceedings), WI'06

Volumn , Issue , 2006, Pages 188-194

  Chen, Jinlin ^a   Zhong, Ping ^b   Cook, Terry ^a  

^a CITY UNIVERSITY OF NEW YORK   (United States)

^b CITY UNIVERSITY OF NEW YORK   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLUSTER ANALYSIS; COMPUTATIONAL COMPLEXITY; DATA COMPRESSION; INFORMATION RETRIEVAL SYSTEMS;

BITWISE CODES; INDEX COMPRESSION;

INDEXING (OF INFORMATION);

EID: 42549139273     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/WI.2006.96     Document Type: Conference Paper

References (21)

1. V. N. Anh, and A. Moffat, "Index compression using fixed binary codewords," In Proc. 15th Austr. DB Conf., New Zealand, 2004, pp. 61-67.
2. V. N. Anh, and A. Moffat, "Inverted Index Compression Using Word-Aligned Binary Codes," Info. Retrieval, vol. 8, No. 1, 2005, pp. 151-166.
3. D. Blandford and G. Blelloch, " Index compression through document reordering, " In Proc. of the Data Compression Conf., UT, USA, 2002, pp. 342-351.
4. A. Bookstein, S. Klein, and T. Raita, "Modeling word occurrences for the compression of concordances, " In Proc. IEEE Data Compr. Conf., UT, 1995, pp. 462-462.
5. P. Elias, "Universal codeword sets and representation of the integers," IEEE Trans. on Infor. Theory, vol. 21 No. 2, 1975, pp. 194-203.
6. S. Golomb, "Run-length encodings," IEEE Trans. on Info. Theory, vol. 12 No. 3, 1966, pp. 399-401.
7. D. Hawking D, E. Voorhees, N. Craswell, and P. Bailey, "Overview of the TREC-8 Web Track," In Proc. of the 8th TREC, NIST Special Pub. 500-246, 2000, pp. 131-150.
8. A. Moffat and L. Stuiver, " Exploiting clustering in inverted file compression, " In Proc. of the 1996 IEEE Data Compression Conf., UT, 1996, pp. 82-91.
9. A. Moffat and L. Stuiver, "Binary interpolative coding for effective index compression," Information Retrieval, vol. 3 No. 1, 2000, pp. 25-47.
10. E. Rillof and L. Hollaar, "Text database and information retrieval," ACM Comput. Surveys, vol. 28 No. 1, 1996, pp. 133-135.
11. F. Scholer, H. E. Williams, H. Yiannis, and J. Zobel, "Compression of inverted index for fast query evaluation," In ACM SIGIR02, Finland, 2002, pp. 222-229.
12. W. Y. Shieh, T. F. Chen, J. J. Shann, and C. P. Chung, " Inverted file compression through document identifier reassignment," Info. Procs. and Management, vol. 39 No. 1, 2003, pp. 117-131.
13. F. Silvestri, R. Perego, and S. Orlando, "Assigning document identifiers to enhance compressibility of web search engine indexes," In Proc. of the 19th ACM Symp. on Applied Comp. - DM Track, Cyprus, 2004, pp. 600-605.
14. A. Trotman, "Compressing inverted files," Information Retrieval, vol. 6, pp. 5-19, 2003.
15. H. E. Williams and J. Zobel, "Compressing integers for fast file access," The Computer Journal, vol. 42 No. 3, 1999, pp. 193-201.
16. I. H. Witten, A. Moffat, and T. C. Bell, Managing Gigabytes - Compressing and Indexing Documents and Images, Morgan Kaufmann Publ., San Francisco, 2e, 1999.
17. J. Zobel, A. Moffat, and K. Ramamohanarao, "Inverted files versus signature files for text indexing", ACM Trans. on DB Systems, vol 23 No. 4, 1998, pp. 453-490.
18. J. S. Vitter, "Algorithm 673: Dynamic Huffman coding," ACM Transactions on Mathematical Software, vol. 15 No. 2,1989, pp. 158-167.
19. D. A. Huffman, "A method for the construction of minimum-redundancy codes, " in Proc. Int. Radio Engineers, vol. 40 No. 9, 1952, pp. 1098-1101.
20. J. Rissanen, and G. G. Langdon, "Arithmetic coding", IBM Journal of Research and Development, vol. 23 No. 2, 1979, pp. 14-162.
21. M. Schindler, " A fast renormalization for arithmetic coding, " In Proc. 1998 IEE Data Compression Conf., Los Alamitos, CA, 1998, pp 572.