From "identical" to "similar": Fusing retrieved lists based on inter-document similarities

Journal of Artificial Intelligence Research

Volumn 41, Issue , 2011, Pages 267-296

  Kozorovitsky, Anna Khudyak ^a   Kurland, Oren ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

EMPIRICAL EVALUATIONS; FUSION METHODS; GRAPH-BASED METHODS;

INFORMATION RETRIEVAL;

EID: 80052117940     PISSN: None     EISSN: 10769757     Source Type: Journal    
DOI: 10.1613/jair.3214     Document Type: Article

References (67)

1. Aslam, J. A., & Montague, M. (2001). Models for metasearch. In Proceedings of SIGIR, pp. 276-284. (Pubitemid 32951081)
2. Azzopardi, L., Girolami, M., & van Rijsbergen, K. (2003). Investigating the relationship between language model preplexity and IR precision-recall measures. In Proceedings of SIGIR, pp. 369-370. Poster.
3. Baliński, J., & Dani lowicz, C. (2005). Re-ranking method based on inter-document distances. Information Processing and Management, 41(4), 759-775. (Pubitemid 40049175)
4. Beitzel, S. M., Jensen, E. C., Chowdhury, A., Frieder, O., Grossman, D. A., & Goharian, N. (2003). Disproving the fusion hypothesis: An analysis of data fusion via effective information retrieval strategies. In Proceedings of SAC, pp. 823-827.
5. Beitzel, S. M., Jensen, E. C., Frieder, O., Chowdhury, A., & Pass, G. (2005). Surrogate scoring for improved metasearch precision. In Proceedings of SIGIR, pp. 583-584.
6. Belkin, N. J., Cool, C., Croft, W. B., & Callan, J. P. (1993). The effect of multiple query representations on information retrieval system performance. In Proceedings of SIGIR, pp. 339-346.
7. Brin, S., & Page, L. (1998). The anatomy of a large-scale hypertextual web search engine. In Proceedings of the 7th International World Wide Web Conference, pp. 107-117.
8. Callan, J. P., Lu, Z., & Croft, W. B. (1995). Searching distributed collections with inference networks. In SIGIR, pp. 21-28.
9. Carbonell, J. G., & Goldstein, J. (1998). The use of MMR, diversity-based reranking for reordering documents and producing summaries. In Proceedings of SIGIR, pp. 335-336.
10. Carmel, D., & Yom-Tov, E. (2010). Estimating the Query Difficulty for Information Retrieval. Synthesis lectures on information concepts, retrieval, and services. Morgan & Claypool.
11. Chowdhury, A., Frieder, O., Grossman, D. A., & McCabe, M. C. (2001). Analyses of multiple-evidence combinations for retrieval strategies. In Proceedings of SIGIR, pp. 394-395. poster. (Pubitemid 32951098)
12. Craswell, N., Hawking, D., & Thistlewaite, P. B. (1999). Merging results from isolated search engines. In Proceedings of the Australian Database Conference, pp. 189-200.
13. Crestani, F., & Wu, S. (2006). Testing the cluster hypothesis in distributed information retrieval. Information Processing and Management, 42(5), 1137-1150.
14. Croft, W. B. (Ed.). (2000a). Advances in Information Retrieval: Recent Research from the Center for Intelligent Information Retrieval. No. 7 in The Kluwer International Series on Information Retrieval. Kluwer.
15. Croft, W. B. (2000b). Combining approaches to information retrieval. In Croft (Croft, 2000a), chap. 1, pp. 1-36.
16. Croft, W. B., & Thompson, R. H. (1984). I3R: A new approach to the design of document retrieval systems. Journal of the American Society for Information Science and Technology, 38(6), 389-404.
17. Daniłowicz, C., & Baliński, J. (2000). Document ranking based upon Markov chains. Information Processing and Management, 41(4), 759-775.
18. Das-Gupta, P., & Katzer, J. (1983). A study of the overlap among document representations. In Proceedgins of SIGIR, pp. 106-114.
19. Diaz, F. (2005). Regularizing ad hoc retrieval scores. In Proceedings of the Fourteenth International Conference on Information and Knowledge Management (CIKM), pp. 672-679. (Pubitemid 44022244)
20. Diaz, F. (2007). Performance prediction using spatial autocorrelation. In Proceedings of SIGIR, pp. 583-590. (Pubitemid 350165007)
21. Diaz, F. (2008). A method for transferring retrieval scores between collections with non overlapping vocabularies. In Proceedings of SIGIR, pp. 805-806. poster.
22. Dwork, C., Kumar, R., Naor, M., & Sivakumar, D. (2001). Rank aggregation methods for the Web. In Proceedings of the World Wide Web Conference, pp. 613-622, Hong Kong.
23. Erkan, G. (2006). Language model based document clustering using random walks. In Proceedings of HLT/NAACL.
24. Erkan, G., & Radev, D. R. (2004). LexRank: Graph-based lexical centrality as salience in text summarization. Journal of Artificial Intelligence Research, 22, 457-479. (Pubitemid 41525893)
25. Fox, E. A., & Shaw, J. A. (1994). Combination of multiple searches. In Proceedings of TREC-2.
26. Golub, G. H., & Van Loan, C. F. (1996). Matrix Computations (Third edition). The Johns Hopkins University Press.
27. Griffiths, A., Luckhurst, H. C., &Willett, P. (1986). Using interdocument similarity information in document retrieval systems. Journal of the American Society for Information Science (JASIS), 37(1), 3-11. (Pubitemid 16555073)
28. Reprinted in Karen Sparck Jones and Peter Willett, eds., Readings in Information Retrieval, Morgan Kaufmann, pp. 365-373, 1997.
29. Katzer, J., McGill, M., Tessier, J., Frakes, W., & Dasgupta, P. (1982). A study of the overlap among document representations. Information Technology: Research and Development, 1(2), 261-274.
30. Krikon, E., Kurland, O., & Bendersky, M. (2010). Utilizing inter-passage and inter-document similarities for re-ranking search results. ACM Transactions on Information Systems, 29(1).
31. Kurland, O. (2006). Inter-document similarities, language models, and ad hoc retrieval. Ph.D. thesis, Cornell University.
32. Kurland, O., & Lee, L. (2005). PageRank without hyperlinks: Structural re-ranking using links induced by language models. In Proceedings of SIGIR, pp. 306-313.
33. Kurland, O., & Lee, L. (2006). Respect my authority! HITS without hyperlinks utilizing cluster-based language models. In Proceedings of SIGIR, pp. 83-90.
34. Kurland, O., & Lee, L. (2010). Pagerank without hyperlinks: Structural reranking using links induced by language models. ACM Transactions om Information Systems, 28(4).
35. Lavrenko, V., & Croft, W. B. (2001). Relevance-based language models. In Proceedings of SIGIR, pp. 120-127. (Pubitemid 32951064)
36. Lawrence, S., & Giles, C. L. (1998). Inquirus, the neci meta search engine. In Proceedings of the World Wide WEB conference, pp. 95-105.
37. Lee, J. H. (1997). Analyses of multiple evidence combination. In Proceedings of SIGIR, pp. 267-276.
38. Lillis, D., Toolan, F., Collier, R. W., & Dunnion, J. (2006). Probfuse: a probabilistic approach to data fusion. In Proceedings of SIGIR, pp. 139-146.
39. Liu, X., & Croft,W. B. (2004). Cluster-based retrieval using language models. In Proceedings of SIGIR, pp. 186-193.
40. Meister, L., Kurland, O., & Kalmanovich, I. G. (2010). Re-ranking search results using an additional retrieved list. Information Retrieval, 1.
41. Metzler, D., & Croft, W. B. (2005). A Markov random field model for term dependencies. In Proceedings of SIGIR, pp. 472-479.
42. Mihalcea, R., & Tarau, P. (2004). TextRank: Bringing order into texts. In Proceedings of EMNLP, pp. 404-411. Poster.
43. Montague, M., & Aslam, J. A. (2002). Condorcet fusion for improved retrieval. In Proceedings of CIKM, pp. 538-548.
44. Morgan, W., Greiff, W., & Henderson, J. (2004). Direct maximization of average precision by hill-climbing, with a comparison to a maximum entropy approach. Tech. rep. 04-0367, The MITRE Corporation.
45. Otterbacher, J., Erkan, G., & Radev, D. R. (2005). Using random walks for question-focused sentence retrieval. In Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing (HLT/EMNLP), pp. 915-922.
46. Pinski, G., & Narin, F. (1976). Citation influence for journal aggregates of scientific publications: Theory, with application to the literature of physics. Information Processing and Management, 12, 297-312.
47. Saracevic, T., & Kantor, P. (1988). A study of information seeking and retrieving. iii. searchers, searches, and overlap. Journal of the American Society for Information Science, 39(3), 197-216.
48. Selvadurai, S. B. (2007). Implementing a metasearch framework with content-directed result merging. Master's thesis, North Carolina State University.
49. Shokouhi, M. (2007). Segmentation of search engine results for effective data-fusion. In Proceedings of ECIR, pp. 185-197. (Pubitemid 350259550)
50. Shou, X. M., & Sanderson, M. (2002). Experiments on data fusion using headline information. In Proceedgins of SIGIR, pp. 413-414.
51. Soboroff, I., Nicholas, C. K., & Cahan, P. (2001). Ranking retrieval systems without relevance judgments. In Proceedings of SIGIR, pp. 66-73. (Pubitemid 32951057)
52. Tao, T., & Zhai, C. (2006). Regularized esitmation of mixture models for robust pseudorelevance feedback. In Proceedings of SIGIR, pp. 162-169.
53. Tsikrika, T., & Lalmas, M. (2001). Merging techniques for performing data fusion on the web. In Proceedings of CIKM, pp. 127-134. (Pubitemid 34974623)
54. van Rijsbergen, C. J. (1979). Information Retrieval (second edition). Butterworths.
55. Vogt, C. C., & Cottrell, G. W. (1999). Fusion via linear combination of scores. Information Retrieval, 1(3), 151-173.
56. Voorhees, E. M., Gupta, N. K., & Johnson-Laird, B. (1994). The collection fusion problem. In In Proceedings of TREC-3.
57. Voorhees, E. M., & Harman, D. K. (2005). TREC: Experiments and evaluation in information retrieval. The MIT Press.
58. Willett, P. (1985). Query specific automatic document classification. International Forum on Information and Documentation, 10(2), 28-32.
59. Xu, J., & Croft, W. B. (1996). Query expansion using local and global document analysis. In Proceedings of SIGIR, pp. 4-11.
60. Xu, J., & Croft, W. B. (1999). Cluster-based language models for distributed retrieval. In Proceedings of SIGIR, pp. 254-261.
61. Yang, L., Ji, D., Zhou, G., Nie, Y., & Xiao, G. (2006). Document re-ranking using cluster validation and label propagation. In Proceedings of CIKM, pp. 690-697. (Pubitemid 47203614)
62. Young, H. P. (1974). An axiomatization of Borda's rule. Journal of Economic Theory, 9, 43-52.
63. Zamir, O., & Etzioni, O. (1998). Web document clustering: a feasibility demonstration. In Proceedings of SIGIR, pp. 46-54.
64. Zhai, C., Cohen, W. W., & Lafferty, J. D. (2003). Beyond independent relevance: methods and evaluation metrics for subtopic retrieval. In Proceedings of SIGIR, pp. 10-17.
65. Zhai, C., & Lafferty, J. (2002). Two-stage language models for information retrieval. In Proceedings of SIGIR, pp. 49-56.
66. Zhai, C., & Lafferty, J. D. (2001). A study of smoothing methods for language models applied to ad hoc information retrieval. In Proceedings of SIGIR, pp. 334-342. (Pubitemid 32957519)
67. Zhang, B., Li, H., Liu, Y., Ji, L., Xi, W., Fan, W., Chen, Z., & Ma, W.-Y. (2005). Improving web search results using affinity graph. In Proceedings of SIGIR, pp. 504-511.