Faster top-k document retrieval using block-max indexes

SIGIR'11 - Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval

Volumn , Issue , 2011, Pages 993-1002

  Ding, Shuai ^a   Suel, Torsten ^a  

^a POLYTECHNIC UNIVERSITY   (United States)

Author keywords

Early termination; Inverted index; IR query processing; Top k query processing

Indexed keywords

INDEXING (OF INFORMATION); INFORMATION RETRIEVAL; QUERY LANGUAGES; SEARCH ENGINES;

CONJUNCTIVE QUERIES; EARLY TERMINATION; INVERTED INDEX STRUCTURES; INVERTED INDICES; OPTIMIZATION TECHNIQUES; PERFORMANCE BOTTLENECKS; STATE-OF-THE-ART METHODS; TOP-K QUERY PROCESSING;

QUERY PROCESSING;

EID: 80052124546     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2009916.2010048     Document Type: Conference Paper

References (37)

1. Ismail Sengor Altingovde, Engin Demir, Fazli Can, and Ozgur Ulusoy. Incremental cluster-based retrieval using compressed cluster-skipping inverted files. ACM Transactions on Information Systems, 26(3):1-36, 2008.
2. V. Anh and A. Moffat. Simplified similarity scoring using term ranks. In Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 226-233, 2005.
3. V. Anh and A. Moffat. Pruned query evaluation using pre-computed impacts. In Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 372-379, 2006.
4. Vo Ngoc Anh, Owen de Kretser, and Alistair Moffat. Vector-space ranking with effective early termination. In Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2001.
5. C. Badue, R. Baeza-Yates, B. Ribeiro-Neto, and N. Ziviani. Distributed query processing using partitioned inverted files. In Proceedings of the 9th String Processing and Information Retrieval Symposium, 2002.
6. R. Baeza-Yates and B. Ribeiro-Neto. Modern Information Retrieval. Addision Wesley, 1999.
7. Ricardo Baeza-Yates, Aristides Gionis, Flavio Junqueira, Vanessa Murdock, Vassilis Plachouras, and Fabrizio Silvestri. The impact of caching on search engines. In Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2007.
8. Holger Bast, Debapriyo Majumdar, Ralf Schenkel, Martin Theobald, and Gerhard Weikum. IO-Top-K: Index-access optimized top-k query processing. In Proceedings of the 32th International Conference on Very Large Data Bases, 2006.
9. Roi Blanco and Álvaro Barreiro. TSP and cluster-based solutions to the reassignment of document identifiers. Information Retrieval, 9(4):499-517, 2006. (Pubitemid 44128091)
10. Roi Blanco and Alvaro Barreiro. Probabilistic static pruning of inverted files. ACM Transactions on Information Systems, 28(1), January 2010.
11. Andrei Z. Broder, David Carmel, Michael Herscovici, Aya Soffer, and Jason Zien. Efficient query evaluation using a two-level retrieval process. In Proceedings of the 12th ACM Conference on Information and Knowledge Management, 2003.
12. N. Bruno, L. Gravano, and A. Marian. Evaluating top-k queries over web-accessible databases. In Proceedings of the 18th Annual International Conference on Data Engineering, 2002.
13. C. Buckley and A. F. Lewit. Optimization of inverted vector searches. In Proceedings of the 8th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 1985.
14. Stefan Buttcher and Charles L. A. Clarke. Index compression is good, especially for random access. In Proceedings of the 16th ACM Conference on Information and Knowledge Management, 2007.
15. Kaushik Chakrabarti, Surajit Chaudhuri, and Venkatesh Ganti. Interval-based pruning for top-k processing over compressed lists. In Proceedings of the 27th IEEE International Conference on Data Engineering (ICDE), 2011.
16. J. Cho and A. Ntoulas. Pruning policies for two-tiered inverted index with correctness guarantee. In Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2007.
17. Jeffrey Dean. Challenges in building large-scale information retrieval systems. In Proceedings of the Second ACM International Conference on Web Search and Data Mining, 2009.
18. S. Ding, J. Attenberg, and T. Suel. Scalable techniques for document identifier assignment in inverted indexes. In Proceedings of the 19th International Conference on World Wide Web, 2010.
19. R. Fagin, D. Carmel, D. Cohen, E. Farchi, M. Herscovici, Y. Maarek, and A. Soffer. Static index pruning for information retrieval systems. In Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2001.
20. R. Fagin, A. Lotem, and M. Naor. Optimal aggregation algorithms for middleware. In Proceedings of the ACM Symp. on Principles of Database Systems, 2001.
21. Ronald Fagin. Combining fuzzy information: an overview. SIGMOD Record, 31:2002, 2002.
22. R. Lempel and S. Moran. Optimizing result prefetching in web search engines with segmented indices. In Proceedings of the 28th International Conference on Very Large Data Bases, 2002.
23. X. Long and T. Suel. Optimized query execution in large search engines with global page ordering. In Proceedings of the 29th International Conference on Very Large Data Bases, 2003.
24. S. Melnik, S. Raghavan, B. Yang, and H. Garcia-Molina. Building a distributed full-text index for the web. In Proceedings of the 10th International Conference on World Wide Web, 2000.
25. Michael Persin, Justin Zobel, and Ron Sacks-davis. Filtered document retrieval with frequency-sorted indexes. Journal of the American Society for Information Science, 47:749-764, 1996. (Pubitemid 126607666)
26. W. Shieh, T. Chen, J. Shann, and C. Chung. Inverted file compression through document identifier reassignment. Information Processing and Management, 39(1):117-131, 2003. (Pubitemid 35452381)
27. F. Silvestri and R. Venturini. Vsencoding: efficient coding and fast decoding of integer lists via dynamic programming. In Proceedings of the 19th ACM Conference on Information and Knowledge Management, 2010.
28. Fabrizio Silvestri. Sorting out the document identifier assignment problem. In Proceedings of 29th European Conference on IR Research, pages 101-112, 2007. (Pubitemid 350259543)
29. Fabrizio Silvestri and Domenico LaForenza. Query-driven document partitioning and collection selection. In Proceedings of the First International Conference on Scalable Information Systems, 2006.
30. T. Strohman and W. Bruce Croft. Efficient document retrieval in main memory. In Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2007.
31. Trevor Strohman, Howard Turtle, and Bruce W. Croft. Optimization strategies for complex queries. In Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2005.
32. H. Turtle and J. Flood. Query evaluation: strategies and optimizations. Information Processing and Management, 31(6):831-850, November 1995.
33. HW. Wong and D. Lee. Implementations of partial document ranking using inverted files. Information Processing and Management, 29(5):647-669, 1993.
34. Hao Yan, Shuai Ding, and Torsten Suel. Compressing term positions in web indexes. In Proceedings of the 32th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2009.
35. Hao Yan, Shuai Ding, and Torsten Suel. Inverted index compression and query processing with optimized document ordering. In Proceedings of the 18th International Conference on World Wide Web, 2009.
36. J. Zhang, X. Long, and T. Suel. Performance of compressed inverted list caching in search engines. In Proceedings of the 17th International Conference on World Wide Web, 2008.
37. J. Zobel and A. Moffat. Inverted files for text search engines. ACM Computing Surveys, 38(2), 2006.