Utilizing inter-passage and inter-document similarities for reranking search results

ACM Transactions on Information Systems

Volumn 29, Issue 1, 2010, Pages

  Krikon, Eyal ^a   Kurland, Oren ^a   Bendersky, Michael ^b  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

^b The Manning College of Information and Computer Sciences   (United States)

Author keywords

Ad hoc retrieval; Document centrality; Inter document similarities; Interpassage similarities; Passage centrality; Passage based retrieval; Reranking

Indexed keywords

AD HOC RETRIEVAL; DOCUMENT CENTRALITY; INTER-DOCUMENT SIMILARITIES; INTERPASSAGE SIMILARITIES; PASSAGE CENTRALITY; PASSAGE-BASED RETRIEVAL; RE-RANKING;

SEARCH ENGINES;

STATE FEEDBACK;

EID: 80051500892     PISSN: 10468188     EISSN: 15582868     Source Type: Journal    
DOI: 10.1145/1877766.1877769     Document Type: Article

References (57)

1. th Text Retrieval Conference (TREC-13). 715-725.
2. BALINSKI, J. AND DANILOWICZ, C. 2005. Re-Ranking method based on inter-document distances. Inform. Process. Manag. 41, 4, 759-775. (Pubitemid 40049175)
3. BENDERSKY, M. AND KURLAND, O. 2008a. Re-Ranking search results using document-passage graphs. In Proceedings of the Annual ACM SIGIR Conference on Research and Development in Information Retrieval. 853-854. Poster.
4. BENDERSKY, M. AND KURLAND, O. 2008b. Utilizing passage-based language models for document retrieval. In Proceedings of the European Conference on IR Research (ECIR). 162-174. (Pubitemid 351499067)
5. BRIN, S. AND PAGE, L. 1998. The anatomy of a large-scale hypertextual web search engine. In Proceedings of the World Wide Web Conference. 107-117.
6. BUCKLEY, C., SALTON, G., ALLAN, J., AND SINGHAL, A. 1994. Automatic query expansion using SMART: TREC3. In Proceedings of the Text Retrieval Conference (TREC-3). 69-80.
7. CAI, D., YU, S., WEN, J., AND MA, W. 2004. Block-Based web search. In Proceedings of the Annual ACM SIGIR Conference on Research and Develoopment in Information Retrieval. 456-463.
8. CALLAN, J. P. 1994. Passage-Level evidence in document retrieval. In Proceedings of the Annual ACM SIGIR Conference on Research and Development in Information Retrieval. 302-310.
9. CROFT, W. B. AND LAFFERTY, J., Eds. 2003. Language Modeling for Information Retrieval. Information Retrieval Book Series, No. 13. Kluwer.
10. DENOYER, L., ZARAGOZA, H., AND GALLINARI, P. 2001. HMM-Based passage models for document classification and ranking. In Proceedings of the European Conference in IR Research (ECIR). 126-135.
11. DIAZ, F. 2005. Regularizing ad hoc retrieval scores. In Proceedings of the ACM International Conference on Information and Knowledge Management (CIKM). 672-679. (Pubitemid 44022244)
12. DIAZ, F. AND METZLER, D. 2006. Improving the estimation of relevance models using large external corpora. In Proceedings of the Annual ACM SIGIR Conference on Research and Devclopment in Information Retrieval. 154-161.
13. ERKAN, G. 2006. Language model based document clustering using random walks. In Proceedings of the Annual Conference on Human Language Technologies and North American Chapter of the Association for Computational Linguistics (HLT/NAACL).
14. ERKAN, G. AND RADEV, D. R. 2004. LexPageRank: Prestige in multi-document text summarization. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP). 365-371. Poster.
15. GOLUB, G. H. AND VAN LOAN, C. F. 1996. Matrix Computations 3rd Ed. The Johns Hopkins University Press.
16. HEARST, M. A. AND PLAUNT, C. 1993. Subtopic structuring for full-length document access. In Proceedings of the Annual ACM SIGIR Conference on Research and Development in Information Retrieval. 56-89.
17. HUSSAIN, M. 2004. Language modeling based passage retrieval for question answering systems. M. S. thesis, Saarland University.
18. JIANG, J. AND ZHAI, C. 2004. UIUC in HARD 2004-Passage retrieval using HMMs. In Proceedings of the Text Retrieval Conference (TREC-13).
19. KASZKIEL, M. AND ZOBEL, J. 1997. Passage retrieval revisited. In Proceedings of the Annual ACM SIGIR Conference on Research and Development in Information Retrieval. 178-185. (Pubitemid 127720318)
20. KASZKIEL, M. AND ZOBEL, J. 2001. Effective ranking with arbitrary passages. J. Amer. Soc. Inform. Sci. 52, 4, 344-364. (Pubitemid 32248265)
21. KLEINBERG, J. 1997. Authoritative sources in a hyperlinked environment. Tech. rep., RJ 10076, IBM.
22. KRIKON, E., KURLAND, O., AND BENDERSKY, M. 2009. Utilizing inter-passage and inter-document similarities for re-ranking search results. In Proceedings of the ACM International Conference on Information and Knowledge Management (CIKM). (To appear).
23. KURLAND, O. 2006. Inter-Document similarities, language models, and ad hoc retrieval. Ph. D. thesis, Cornell University.
24. KURLAND, O. 2008. The opposite of smoothing: A language model approach to ranking queryspecific document clusters. In Proceedings of the Annual ACM SIGIR Conference on Research and Development in Information Retrieval.
25. KURLAND, O. AND LEE, L. 2005. PageRank without hyperlinks: Structural re-ranking using links induced by language models. In Proceedings of the Annual ACM SIGIR Conference on Research and Development in Information Retrieval. 306-313.
26. KURLAND, O. AND LEE, L. 2006. Respect my authority! HITS without hyperlinks utilizing clusterbased language models. In Proceedings of the Annual ACM SIGIR Conference on Research and Development in Information Retrieval. 83-90.
27. LAFFERTY, J. D. AND ZHAI, C. 2001. Document language models, query models, and risk minimization for information retrieval. In Proceedings of the Annual ACM SIGIR Conference on Research and Development in Information Retrieval. 111-119. (Pubitemid 32951063)
28. LAVRENKO, V. 2004. A generative theory of relevance. Ph. D. thesis, University of Massachusetts Amherst.
29. LAVRENKO, V., ALLAN, J., DEGUZMAN, E., LAFLAMME, D., POLLARD, V., AND THOMAS, S. 2002. Relevance models for topic detection and tracking. In Proceedings of the Annual Meeting of the Association for Computational Linguistics on Human Language Technologies (HLT). 104-110.
30. LAVRENKO, V. AND CROFT, W. B. 2001. Relevance-Based language models. In Proceedings of the Annual ACM SIGIR Conference on Research and Development in Information Retrieval. 120-127. (Pubitemid 32951064)
31. LAVRENKO, V. AND CROFT, W. B. 2003. Relevance models in information retrieval. In Language Modeling for Information Retrieval, W. B. Croft and J. Lafferty, Eds. Kluwer, 11-56.
32. LIU, X. AND CROFT, W. B. 2002. Passage retrieval based on language models. In Proceedings of the ACM International Conference on Information and Knowledge Management (CIKM). 375-382.
33. LIU, X. AND CROFT, W. B. 2004. Cluster-Based retrieval using language models. In Proceedings of the Annual ACM SIGIR Conference on Research and Development in Information Retrieval. 186-193.
34. LIU, X. AND CROFT, W. B. 2006. Experiments on retrieval of optimal clusters. Tech. rep. IR-478, Center for Intelligent Information Retrieval (CIIR), University of Massachusetts.
35. LIU, X. AND CROFT, W. B. 2008. Evaluating text representations for retrieval of the best group of documents. In Proceedings of the European Conference on IR Research (ECIR). 454-462. (Pubitemid 351499092)
36. MEI, Q., ZHANG, D., AND ZHAI, C. 2008. A general optimization framework for smoothing language models on graph structures. In Proceedings of the Annual ACM SIGIR Conference on Research and Development in Information Retrieval. 611-618.
37. MIHALCEA, R. 2004. Graph-Based ranking algorithms for sentence extraction, applied to text summarization. In The Companion Volume to the Proceedings of the Meeting of the Association of Computational Linguistics (ACL). 170-173.
38. MIHALCEA, R. AND TARAU, P. 2004. TextRank: Bringing order into texts. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP). 404-411. Poster.
39. MITTENDORF, E. AND SCHAUBLE, P. 1994. Document and passage retrieval based on hidden Markov models. In Proceedings of the Annual ACM SIGIR Conference on Research and Development in Information Retrieval. 318-327.
40. MURDOCK, V. AND CROFT, W. B. 2005. A translation model for sentence retrieval. In Proceedings of the Annual Meeting of the Association for Computational Linguistics on Human Language Technologies and Conference on Empirical Methods in Natural Language Processing (HLT/EMNLP). 684-695.
41. NA, S., KANG, I., LEE, Y., AND LEE, J. 2008. Completely-arbitrary passage retrieval in language modeling approach. In Proceedings of the AIRS Conference. 22-33.
42. OTTERBACHER, J., ERKAN, G., AND RADEV, D. R. 2005. Using random walks for question-focused sentence retrieval. In Proceedings of the Annual Meeting of the Association for Computational Linguistics on Human Language Technologies and Conference on Empirical Methods in Natural Language Processing (HLT/EMNLP). 915-922.
43. PONTE, J. M. AND CROFT, W. B. 1997. Text segmentation by topic. In Proceedings of the European Conference on Research and Advanced Technology for Digital Libraries. 113-125.
44. PONTE, J. M. AND CROFT, W. B. 1998. A language modeling approach to information retrieval. In Proceedings of the Annual ACM SIGIR Conference on Research and Development in Information Retrieval. 275-281.
45. SALTON, G., ALLAN, J., AND BUCKLEY, C. 1993. Approaches to passage retrieval in full text information systems. In Proceedings of the Annual ACM SIGIR Conference on Research and Development in Information Retrieval. 49-58.
46. VOORHEES, E. M. 2005. Overview of the TREC 2005 robust retrieval task. In Proceedings of the 14th Text Retrieval Conference (TREC).
47. VOORHEES, E. M. AND HARMAN, D. K., Eds. 2000. The 8th Text Retrieval Conference (TREC-8). NIST.
48. VOORHEES, E. M. AND HARMAN, D. K. 2005. TREC: Experiments and Evlautaion in Information Retrieval. The MIT Press.
49. WADE, C. AND ALLAN, J. 2005. Passage retrieval and evaluation. Tech. rep. IR-396, Center for Intelligent Information Retrieval (CIIR), University of Massachusetts.
50. WAN, X., YANG, J., AND XIAO, J. 2008. Towards a unified approach to document similarity search using manifold-ranking of blocks. Inform. Process. Manag. 44, 3, 1032-1048. (Pubitemid 351375314)
51. WANG, M. AND SI, L. 2008. Discriminative probabilistic models for passage based retrieval. In Proceedings of the Annual ACM SIGIR Conference on Research and Development in Information Retrieval. 419-426.
52. WILKINSON, R. 1994. Effective retrieval of structured documents. In Proceedings of the Annual ACM SIGIR Conference on Research and Development in Information Retrieval. 311-317.
53. WILLETT, P. 1985. Query specific automatic document classification. Int. Forum Inform. Document. 10, 2, 28-32.
54. XU, J. AND CROFT, W. B. 1996. Query expansion using local and global document analysis. In Proceedings of the Annual ACM SIGIR Conference on Research and Development in Information Retrieval. 4-11.
55. YANG, L., JI, D., ZHOU, G., NIE, Y., AND XIAO, G. 2006. Document re-ranking using cluster validation and label propagation. In Proceedings of the ACM International Conference on Information and Knowledge Management (CIKM). 690-697. (Pubitemid 47203614)
56. ZHAI, C. AND LAFFERTY, J. D. 2001. A study of smoothing methods for language models applied to ad hoc information retrieval. In Proceedings of the Annual ACM SIGIR Conference on Research and Development in Information Retrieval. 334-342. (Pubitemid 32957519)
57. ZHANG, B., LI, H., LIU, Y., JI, L., XI, W., FAN, W., CHEN, Z., AND MA, W. 2005. Improving web search results using affinity graph. In Proceedings of the Annual ACM SIGIR Conference on Research and Development in Information Retrieval. 504-511.