Efficient term proximity search with term-pair indexes

International Conference on Information and Knowledge Management, Proceedings

Volumn , Issue , 2010, Pages 1229-1238

  Yan, Hao ^a   Shi, Shuming ^b   Zhang, Fan ^c   Suel, Torsten ^a   Wen, Ji Rong ^b  

^a NEW YORK UNIVERSITY   (United States)

^b MICROSOFT RESEARCH ASIA   (China)

^c NANKAI UNIVERSITY   (China)

Author keywords

Document structure; Term proximity; Term pair index; Top k

Indexed keywords

DATA SETS; DOCUMENT RETRIEVAL; DOCUMENT STRUCTURE; EARLY TERMINATION; EXPERIMENTAL EVALUATION; INVERTED LIST; NEW INDICES; QUERY TERMS; RETRIEVAL MODELS; TERM OCCURRENCES; TERM PROXIMITY; TERM-PAIR INDEX; WEB SEARCHES;

KNOWLEDGE MANAGEMENT; NATURAL LANGUAGE PROCESSING SYSTEMS; QUERY PROCESSING; WORLD WIDE WEB;

INFORMATION RETRIEVAL;

EID: 78651335518     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1871437.1871593     Document Type: Conference Paper

References (37)

1. V. Anh, O. de Kretser, and A. Moffat. Vector-space ranking with effective early termination. In Proc. of the 24th Annual SIGIR Conf. on Research and Development in Information Retrieval (SIGIR'01), 2001.
2. V. Anh and A. Moffat. Pruned query evaluation using pre-computed impact scores. In Proc. of the 29th Annual SIGIR Conf. on Research and Development in Information Retrieval (SIGIR'06), 2006.
3. D. Bahle, H. E. Williams, and J. Zobel. Efficient phrase querying with an auxiliary index, In Proc. of the 25th Annual SIGIR Conf. on Research and Development in Information Retrieval (SIGIR'02), New York, NY, USA, 2002.
4. S. Brin and L. Page. The anatomy of a large-scale hypertextual web search engine. In Proc. of the 7th Intl. Conf. on World Wide Web (WWW'98), 1998.
5. A. Broder, D. Carmel, M. Herscovici, A. Soffer, and J. Zien. Efficient query evaluation using a two-level retrieval process. In Proc. of the 12th Conf. on Information and Knowledge Management (CIKM'03), Nov 2003.
6. S. Büttcher and C. Clarke. A document-centric approach to static index pruning in text retrieval systems. In Proc. of the 15th ACM Intl. Conf. on Information and Knowledge Management (CIKM'06), 2006.
7. th Text Retrieval Conference (TREC'05), 2005.
8. S. Buttcher and C. Clarke, B. Lushman. Term proximity scoring for ad-hoc retrieval on very large text collections. In SIGIR'2006.
9. Carnegie Mellon University, The ClueWeb09 Data set, 2009, http://boston.lti.cs.cmu.edu/Data/clueweb09/
10. R. Fagin, A. Lotem, and M. Naor. Optimal Aggregation Algorithms for Middleware. JCSS, 66(4):614-656, 2003.
11. R. Fagin. Combining fuzzy information from multiple systems. JCSS, 58(1):83-99, 1999.
12. R. Fagin. Combining fuzzy information: an overview. SIGMOD Rec., 31(2):109-118, 2002.
13. U. Güntzer, W. Balke, and W. Kiebling. Optimizing multifeature queries for image databases. In Proc. of the 26th Intl. Conf. on Very Large Data Bases (VLDB'00), pages 419-428, 2000.
14. M. Kaszkiel, J. Zobel, and R. Sacks-Davis. Efficient passage ranking for document databases. ACM Transactions on Information Systems, 17(4):406-439, Oct. 1999.
15. O. Kretser, A. Moffat. Effective document presentation with a locality-based similarity heuristic. In Proc. of the 22th Annual SIGIR Conf. on Research and Development in Information Retrieval, 1999
16. R. Kumar, K. Punera, T. Suel and S. Vassilvitskii, Top-k aggregation using intersections of ranked inputs, In Proc. of the Second ACM Intl. Conf. on Web Search and Data Mining, 2009
17. X. Long and T. Suel. Optimized query execution in large search engines with global page ordering. In Proc. of the 29th Intl. Conf. on Very Large Data Bases, September 2003.
18. X. Long and T. Suel. Three-level caching for efficient query processing in large web search engines. In Proc. of the 14th Intl. Conf. on World Wide Web, pages 257-266, 2005
19. A. Moffat and J. Zobel. Fast ranking in limited space. In Proc. of the 10th IEEE Intl. Conf. on Data Engineering. Houston, TX, February 1994.
20. E. de Moura et al. Improving web search efficiency via a locality based static pruning method. In Proc. of the 14th Intl. Conf. on World Wide Web, pages 235-244, 2005.
21. M. Persin, J. Zobel, and R. Sacks-Davis. Filtered document retrieval with frequency-sorted indexes. JASIS, 47(10):749-764, 1996. (Pubitemid 126607666)
22. Y. Rasolofo and J. Savoy. Term proximity scoring for keyword-based retrieval systems. In Proc. of the 25th European Conf. on IR Research, pages 207-218, April 2003.
23. S. Robertson, S. Walker, S. Jones, M. Hancock-Beaulieu, and M. Gatford. Okapi at trec-3. In Proc. of the 3rd Text Retrieval Conference (TREC), Nov 1994.
24. R. Schenkel, A. Broschart, S. Hwang, M. Theobald and G. Weikum. Efficient text proximity search. In Proc. of the 14th String Processing and Information Retrieval Symposium, 2007.
25. G. Skobeltsyn, F. Junqueira, V. Plachouras, R. Baeza-Yates: ResIn: a combination of results caching and index pruning for high-performance web search engines. In Proc. of the 31st Annual SIGIR Conf. on Research and Development in Information Retrieval, 2008.
26. R. Song, M. Taylor, J. Wen, H. Hon, Y. Yu. Viewing term proximity from a different perspective. vol 4956, pp. 346-357, Springer Berlin / Heidelberg, 2008.
27. T. Strohman and W. Croft, Efficient Document Retrieval in Main Memory, In Proc. of the 30th Annual SIGIR Conf. on Research and Development in Information Retrieval
28. T. Tao and C. Zhai, An exploration of proximity measures in information retrieval, In Proc. of the 30th Annual SIGIR Conf. on Research and Development in Information Retrieval.
29. Y. Tsegay, A. Turpin, and J. Zobel. Dynamic index pruning for effective caching. In Proc. of the ACM 16th Conf. on Information and Knowledge Management, 2007
30. H. Turtle and J. Flood. Query evaluation: strategies and optimizations. Information Processing and Management, 31(6):831-850, 1995.
31. I. Witten, A. Moffat, and T. Bell. Managing gigabytes: compressing and indexing documents and images. Morgan Kaufmann, second edition, 1999
32. H. Yan, S. Ding and T. Suel. Compressing term positions in web indexes, In Proc. of the 32nd Annual SIGIR Conf. on Research and Development in Information Retrieval (SIGIR'09), Boston, July, 2009
33. H. Yan, S. Ding and T. Suel, Inverted Index Compression and Query Processing with Optimized Document Ordering, The 18th Intl. World Wide Web Conference (WWW'09), Madrid, Spain, April 2009
34. F. Zhang, S. Shi, H. Yan and J. Wen. Revisiting globally sorted indexes for efficient document retrieval. In Proc. of the Third ACM Intl. Conf. on Web Search and Data Mining (WSDM'10), 2010.
35. M. Zhu, S. Shi, M. Li, and J.-R. Wen. Effective top-K computation in retrieving structured documents with term-proximity Support. In Proc. of the ACM 16th Conf. on Information and Knowledge Management (CIKM'07), Portugal, 2007.
36. M. Zhu, S. Shi, N. Yu, J.-R. Wen. 2008. Can phrase indexing help to process non-phrase queries? In Proc. of the ACM 17th Conf. on Information and Knowledge Management (CIKM'08), 2008
37. J. Zobel and A. Moffat. 2006. Inverted files for text search engines. ACM Computing Surveys. Vol. 38, No 2, Jul. 2006.