Re-ranking search results using language models of query-specific clusters

Information Retrieval

Volumn 12, Issue 4, 2009, Pages 437-460

  Kurland, Oren ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Cluster based language models; Cluster based re ranking; Cluster based smoothing; Query specific clusters

Indexed keywords

EID: 67651040478     PISSN: 13864564     EISSN: 15737659     Source Type: Journal    
DOI: 10.1007/s10791-008-9065-9     Document Type: Article

References (55)

1. Abdul-Jaleel, N., Allan, J., Croft, W. B., Diaz, F., Larkey, L., Li, X., Smucker, M. D., & Wade, C. (2004). UMASS at TREC 2004-novelty and hard. In Proceedings of the Thirteenth Text Retrieval Conference (TREC-13) (pp. 715-725).
2. Azzopardi, L., Girolami, M., & van Rijsbergen, K. (2004). Topic based language models for ad hoc information retrieval. In Proceedings of International Conference on Neural Networks and IEEE International Conference on Fuzzy Systems (pp. 3281-3286). (Pubitemid 40011560)
3. J. Baliński C. Daniłowicz 2005 Re-ranking method based on inter-document distances Information Processing and Management 41 4 759 775 (Pubitemid 40049175)
4. D. M. Blei A. Y. Ng M. I. Jordan 2003 Latent dirichlet allocation Journal of Machine Learning Research 3 993 1022
5. Buckley, C., Salton, G., Allan, J., & Singhal, A. (1994). Automatic query expansion using SMART: TREC3. In Proceedings of the Third Text Retrieval Conference (TREC-3) (pp. 69-80).
6. Connell, M., Feng, A., Kumaran, G., Raghavan, H., Shah, C., & Allan, J. (2004). UMass at TDT 2004. TDT2004 System Description.
7. Cover, T. M., & Thomas, J. A. (1991). Elements of Information Theory. Wiley series in telecommunications. Wiley-Interscience, New York.
8. W. B. Croft 1980 A model of cluster searching based on classification Information Systems 5 189 195 (Pubitemid 11473495)
9. Croft, W. B. (1995). What do people want from information retrieval? D-Lib magazine.
10. Croft, W. B., & Lafferty, J. (Eds.). (2003). Language modeling for information retrieval. In No. 13 in Information Retrieval Book Series. Kluwer.
11. Cronen-Townsend, S., Zhou, Y., & Croft, W. B. (2004). A language modeling framework for selective query expansion. Tech. Rep. IR-338, Center for Intelligent Information Retrieval, University of Massachusetts.
12. Cutting, D. R., Karger, D. R., Pedersen, J. O., & Tukey, J. W. (June 1992). Scatter/Gather: A cluster-based approach to browsing large document collections. In 15th Annual International SIGIR (pp. 318-329). Denmark.
13. C. Daniłowicz J. Baliński 2000 Document ranking based upon Markov chains Information Processing and Management 41 4 759 775
14. Diaz, F. (2005). Regularizing ad hoc retrieval scores. In Proceedings of the Fourteenth International Conference on Information and Knowledge Managment (CIKM) (pp. 672-679). (Pubitemid 44022244)
15. Diaz, F., & Metzler, D. (2006). Improving the estimation of relevance models using large external corpora. In Proceedings of SIGIR (pp. 154-161).
16. El-Hamdouchi, A., & Willett, P. (1986). Hierarchic document clustering using ward's method. In Proceedings of SIGIR (pp. 149-156).
17. Griffiths, A., Luckhurst, H. C., & Willett, P. (1986). Using interdocument similarity information in document retrieval systems. Journal of the American Society for Information Science (JASIS), 37(1), 3-11, reprinted in K. S. Jones & P. Willett (Eds.), Readings in information retrieval (pp. 365-373), Morgan Kaufmann, 1997. (Pubitemid 16555073)
18. Hearst, M. A., & Pedersen, J. O. (1996). Reexamining the cluster hypothesis: Scatter/Gather on retrieval results. In Proceedings of SIGIR (pp. 76-84).
19. Hofmann, T., & Puzicha, J. (1998). Unsupervised learning from dyadic data. Tech. Rep. TR-98-042, International Computer Science Institute (ICSI).
20. Hu, X., Bandhakavi, S., & Zhai, C. (2003). Error analysis of difficult TREC topics. In Proceedings of SIGIR (pp. 407-408), poster.
21. Kleinberg, J. (1998). Authoritative sources in a hyperlinked environment. In Proceedings of the 9th ACM-SIAM Symposium on Discrete Algorithms (SODA) (pp. 668-677), extended version in Journal of the ACM, 46, 604-632, 1999.
22. Kurland, O. (2006). Inter-document similarities, language models, and ad hoc retrieval. Ph.D. thesis, Cornell University.
23. Kurland, O. (2008). The opposite of smoothing: A language model approach to ranking query-specific document clusters. In Proceedings of SIGIR.
24. Kurland, O., & Domshlak, C. (2008). A rank-aggregation approach to searching for optimal query-specific clusters. In Proceedings of SIGIR.
25. Kurland, O., & Lee, L. (2004). Corpus structure, language models, and ad hoc information retrieval. In Proceedings of SIGIR (pp. 194-201.
26. Kurland, O., & Lee, L. (2005). PageRank without hyperlinks: Structural re-ranking using links induced by language models. In Proceedings of SIGIR (pp. 306-313).
27. Kurland, O., & Lee, L. (2006). Respect my authority! HITS without hyperlinks utilizing cluster-based language models. In Proceedings of SIGIR (pp. 83-90).
28. Kurland, O., Lee, L., & Domshlak, C. (2005). Better than the real thing? Iterative pseudo-query processing using cluster-based language models. In Proceedings of SIGIR (pp. 19-26).
29. Lafferty, J. D., & Zhai, C. (2001). Document language models, query models, and risk minimization for information retrieval. In Proceedings of SIGIR (pp. 111-119). (Pubitemid 32951063)
30. Lavrenko, V., Allan, J., DeGuzman, E., LaFlamme, D., Pollard, V., & Thomas, S. (2002). Relevance models for topic detection and tracking. In Proceedings of the Human Language Technology Conference (HLT) (pp. 104-110).
31. Lavrenko, V., & Croft, W. B. (2001). Relevance-based language models. In Proceedings of SIGIR (pp. 120-127). (Pubitemid 32951064)
32. Lavrenko, V., & Croft, W. B. (2003). Relevance models in information retrieval. In W. B. Croft & J. Lafferty (Eds.), No. 13 in Information Retrieval Book Series (pp. 11-56).
33. K.-S. Lee Y.-C. Park K.-S. Choi 2001 Re-ranking model based on document clusters Information Processing and Management 37 1 1 14 (Pubitemid 32029117)
34. Leuski, A. (2001). Evaluating document clustering for interactive information retrieval. In Proceedings of the Tenth International Conference on Information and Knowledge Managment (CIKM) (pp. 33-40). (Pubitemid 34974611)
35. Liu, X., & Croft, W. B. (2004). Cluster-based retrieval using language models. In Proceedings of SIGIR (pp. 186-193).
36. Liu, X., & Croft, W. B. (2006a). Experiments on retrieval of optimal clusters. Tech. Rep. IR-478, Center for Intelligent Information Retrieval (CIIR), University of Massachusetts.
37. Liu, X., & Croft, W. B. (2006b). Representing clusters for retrieval. In Proceedings of SIGIR (pp. 671-672), poster.
38. Liu, X., & Croft, W. B. (2008). Evaluating text representations for retrieval of the best group of documents. In Proceedings of ECIR (pp. 454-462).
39. Metzler, D., Diaz, F., Strohman, T., & Croft, W. B. (2005). Using mixtures of relevance models for query expansion. In Proceedings of the Fourteenth Text Retrieval Conference (TREC).
40. Ponte, J. M., & Croft, W. B. (1998). A language modeling approach to information retrieval. In Proceedings of SIGIR (pp. 275-281).
41. Porter, M. F. (1980). An algorithm for suffix stripping. Program, 14(3), 130-137, reprinted in K. S. Jones & P. Willett (Eds.), Readings in information retrieval, Morgan Kaufmann, 1997.
42. Preece, S. E. (1973). Clustering as an output option. In Proceedings of the American Society for Information Science (pp. 189-190).
43. I. Ruthven M. Lalmas 2003 A survey on the use of relevance feedback for information access systems Knowledge Engineering Review 18 2 95 145
44. Shah, C., & Croft, W. B. (2004). Evaluating high accuracy retrieval techniques. In Proceedings of SIGIR (pp. 2-9).
45. Song, F., & Croft, W. B. (1999). A general language model for information retrieval (poster abstract). In Proceedings of SIGIR (pp. 279-280).
46. Tao, T., Wang, X., Mei, Q., & Zhai, C. (2006). Language model information retrieval with document expansion. In Proceedings of HLT/NAACL (pp. 407-414).
47. A. Tombros R. Villa C. van Rijsbergen 2002 The effectiveness of query-specific hierarchic clustering in information retrieval Information Processing and Management 38 4 559 582 (Pubitemid 34232116)
48. van Rijsbergen, C. J. (1979). Information retrieval (2nd ed.). Butterworths.
49. Voorhees, E. M. (2005). Overview of the TREC 2005 robust retrieval task. In Proceedings of the Fourteenth Text Retrieval Conference (TREC).
50. Voorhees, E. M., & Harman, D. K. (2005). TREC: Experiments and evlautaion in information retrieval. The MIT Press.
51. Wei, X., & Croft, W. B. (2006). LDA-based document models for ad-hoc retrieval. In Proceedings of SIGIR (pp. 178-185).
52. Willett, P. (1985). Query specific automatic document classification. International Forum on Information and Documentation, 10(2), 28-32.
53. Zamir, O., & Etzioni, O. (1998). Web document clustering: a feasibility demonstration. In Proceedings of SIGIR (pp. 46-54).
54. Zhai, C., & Lafferty, J. D. (2001). A study of smoothing methods for language models applied to ad hoc information retrieval. In Proceedings of SIGIR (pp. 334-342). (Pubitemid 32957519)
55. Zhang, B., Li, H., Liu, Y., Ji, L., Xi, W., Fan, W., Chen, Z., & Ma, W.-Y. (2005). Improving web search results using affinity graph. In Proceedings of SIGIR (pp. 504-511).