Clickthrough-based translation models for web search: From word models to phrase models

International Conference on Information and Knowledge Management, Proceedings

Volumn , Issue , 2010, Pages 1139-1148

  Gao, Jianfeng ^a   He, Xiaodong ^a   Nie, Jian Yun ^b  

^a MICROSOFT RESEARCH   (United States)

^b UNIVERSITÉ DE MONTRÉAL   (Canada)

Author keywords

Clickthrough data; Language model; Linear ranking model; PLSA; Translation model; Web search

Indexed keywords

CLICKTHROUGH DATA; LANGUAGE MODEL; LINEAR RANKING; PLSA; TRANSLATION MODELS; WEB SEARCHES;

COMPUTATIONAL LINGUISTICS; INFORMATION THEORY; KNOWLEDGE MANAGEMENT; TRANSLATION (LANGUAGES); WORLD WIDE WEB;

INFORMATION RETRIEVAL;

EID: 78651327667     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1871437.1871582     Document Type: Conference Paper

References (37)

1. Microsoft web n-gram services. http://research.microsoft.com/web-ngram
2. Agichtein, E., Brill, E. and Dumais, S. 2006. Improving web search ranking by incorporating user behavior information. In SIGIR, pages 19-26.
3. Baeza-Yates, R. and Tiberi, A. 2007. Extracting semantic relations from query logs. In SIGKDD, pp. 76-85.
4. Bai, J., Nie, J-Y., Cao, G., and Bouchard, H. 2007. Using query contexts in information retrieval. In SIGIR, pp. 15-22.
5. Bai, J., Song, D., Bruza, P., Nie, J-Y., and Cao, G. 2005. Query expansion using term relationships in language models for information retrieval. In CIKM, pp. 688-695.
6. Berger, A., Caruana, R., Cohn, D., Freitag, D., and Mittal, V. 2000. Bridging the lexical chasm: statistical approaches to answer-finding. In SIGIR, pp. 192-199.
7. Berger, A., and Lafferty, J. 1999. Information retrieval as statistical translation. In SIGIR, pp. 222-229.
8. Blei, D. M., Ng, A. Y., and Jordan, M. J. 2003. Latent Dirichlet allocation. In Journal of Machine Learning Research, 3: 993-1022.
9. Brown, P. F., Della Pietra, S. A., Della Pietra, V. J., and Mercer, R. L. 1993. The mathematics of statistical machine translation: parameter estimation. Computational Linguistics, 19(2): 263-311.
10. Buckley, D., Allan, J., and Salton, G. 1995. Automatic retrieval approaches using SMART: TREC-2. Information Processing and Management, 31: 315-326.
11. Cao, G., Nie, J-Y., Gao, J., and Robertson, S. 2008. Selecting good expansion terms for pseudo-relevance feedback. In SIGIR, pp. 243-250.
12. Deerwester, S., Dumais, S. T., Furnas, G. W., Landauer, T., and Harshman, R. 1990. Indexing by latent semantic analysis. Journal of the American Society for Information Science, 41(6): 391-407.
13. Dempster, A., Laird, N., and Rubin, D. 1977. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, 39: 1-38.
14. Gao, J., Nie, J-Y., Wu, G., and Cao, G. 2004. Dependence language model for information retrieval. In SIGIR, pp. 170-177.
15. Gao, J., Qin, H., Xia, X. and Nie, J-Y. 2005. Linear discriminative models for information retrieval. In SIGIR, pp. 290-297.
16. Gao, J., Yuan, W., Li, X., Deng, K., and Nie, J-Y. 2009. Smoothing clickthrough data for web search ranking. In SIGIR, pp. 355-362.
17. Hofmann, T. 1999. Probabilistic latent semantic indexing. In SIGIR, pp. 50-57.
18. Huang, J., Gao, J., Miao, J., Li, X., Wang, K., and Behr, F. 2010. Exploring web scale language models for search query processing. In Proc. WWW 2010, pp. 451-460.
19. Jarvelin, K. and Kekalainen, J. 2000. IR evaluation methods for retrieving highly relevant documents. In SIGIR, pp. 41-48.
20. Jeon, J., Croft, W. B., and Lee, J. H. 2005. Finding similar questions in large question and answer archives. In CIKM, pp. 84-90.
21. Jin, R., Hauptmann, A. G., and Zhai, C. 2002. Title language model for information retrieval. In SIGIR, pp. 42-48.
22. Jones, K. S., Walker S., and Robertson, S. 1998. A probabilistic model of information retrieval: development and status. Technical Report TR-446, Cambridge University Computer Laboratory.
23. Koehn, P., Och, F., and Marcu, D. 2003. Statistical phrase-based translation. In HLT/NAACL, pp. 127-133.
24. Murdock, V., and Croft, W. B. 2005. A statisitcal model for sentence retrieval. In HLT/EMNLP, pp. 684-691.
25. Metzler, D., and Croft, W. B. 2005. A Markov random field model for term dependencies. In SIGIR, pp. 472-479.
26. Nguyen, P., Gao, J., and Mahajan, M. 2007. MSRLM: a scalable language modeling toolkit. Technical report TR-2007-144, Microsoft Research.
27. Och, F. 2002. Statistical machine translation: from singleword models to alignment templates. PhD thesis, RWTH Aachen.
28. Och, F., and Ney, H. 2004. The alignment template approach to statistical machine translation. Computational Linguistics, 30(4): 417-449. (Pubitemid 41399543)
29. Press, W. H., Teukolsky, S. A., Vetterling, W. T., and Flannery, B. P. 1992. Numerical Recipes In C. Cambridge Univ. Press.
30. Rocchio, J. 1971. Relevance feedback in information retrieval. In The SMART retrieval system: experiments in automatic document processing, pp. 313-323, Prentice-Halll Inc.
31. Song, F., and Croft, B. 1999. A general language model for information retrieval. In: CIKM'99, pp. 316-321.
32. Sparck Jones, K. 1998. What is the role of NLP in text retrieval? In: Naturnal language information retrieval (Ed. T. Strzalkowski), Dordrecht: Kluwer.
33. Svore, K., and Burges, C. 2009. A machine learning approach for improved BM25 retrieval. In CIKM, pp. 1811-1814.
34. Wen, J. Nie, J.Y. and Zhang, H. 2002. Query Clustering Using User Logs, ACM TOIS, 20 (1): 59-81.
35. Xu, J., and Croft, W. B. 2000. Improving effectiveness of information retrieval with local context analysis. In: ACM TOIS, 18(1): 79-112.
36. Xue, X., Jeon, J., and Croft, B. 2008. Retrieval models for question and answer archives. In SIGIR, pp. 475-482.
37. Zhai, C., and Lafferty, J. 2001. A study of smoothing methods for language models applied to ad hoc information retrieval. In SIGIR, pp. 334-342.