Multi-style language model for web scale information retrieval

SIGIR 2010 Proceedings - 33rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval

Volumn , Issue , 2010, Pages 467-474

  Wang, Kuansan ^a   Li, Xiaolong ^b   Gao, Jianfeng ^a  

^a MICROSOFT RESEARCH   (United States)

^b Bing Search Ranking and Intent Group   (United States)

Author keywords

Information retrieval; Mixture language models; Parameter estimation; Probabilistic relevance model; Smoothing

Indexed keywords

CARDINALITIES; COMPONENT LANGUAGE; CROSS ENTROPY; EMPIRICAL PARAMETERS; LABELED DATA; LANGUAGE MODEL; LANGUAGE MODELING; LARGE-SCALE ANALYSIS; MIXTURE COMPONENTS; MIXTURE MODEL; MODEL TRAINING; RELEVANCE MODELS; SEARCH QUERIES; SMOOTHING; SMOOTHING TECHNIQUES; STYLE LANGUAGES; TEXT STREAMS; WEB DOCUMENT; WEB DOCUMENT RETRIEVAL;

COMPUTATIONAL LINGUISTICS; COMPUTER HARDWARE DESCRIPTION LANGUAGES; ENTROPY; MIXTURES; NATURAL LANGUAGE PROCESSING SYSTEMS; PARAMETER ESTIMATION; WORLD WIDE WEB;

INFORMATION RETRIEVAL;

EID: 77956050646     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1835449.1835528     Document Type: Conference Paper

References (33)

1. Berger, A. and Lafferty, J. 1999. Information retrieval as statistical translation. In Proc. SIGIR-99, 222-229.
2. Brown, P., della Pietra, S. A., della Pietra, V. J., Lai, J., Mercer, R. L. 1992. An estimate of an upper bound for the entropy of English. Computational Linguistics, 18(1), 31-40.
3. Bulyko, I., Ostendorff, M., Siu, M., Ng, T., Stolcke, A., and Cetin, O. 2007. Web resources for language modeling in conversational speech recognition. ACM Trans. on Speech and Language Processing, 5(1), December, 2005, 1-25.
4. Clark, C. L. A., and Craswell, N. 2009. Report on the TREC 2009 Web Track. In Proc. TREC 2009.
5. Collins-Thompson, K. and Callan, J. 2005. Query expansion using random walk models. In Proc. CIKM' 05, Bremen, Germany, 704-711.
6. Croft, W. B., Metzler, D., and Strohman, T. 2009. Search Engines: information retrieval in practice, Addison Wesley.
7. Duda, R. O., Hart, P. E. 1973. Pattern Classification and Scene Analysis, Wiley, New York.
8. Fang, H., Tao, T., Zhai, C. 2004. A formal study of information retrieval heuristics. In Proc. SIGIR-04, 49-56.
9. Gao, J., Nie, J., Wu, G., Cao, G. 2004. Dependence language model for information retrieval. In Proc. SIGIR-04, 170-177.
10. Hiemstra, D. and Kraaij, W. 2005. 21 language models at TREC: A language modeling approach to the text retrieval conference. In TREC: Experimental and Evaluation in Information Retrieval, MIT Press, E. M. Voorhees and D. Harman (eds).
11. Huang, X. D., Acero, A., and Hon, H.-W. 2001. Spoken Language Processing, Prentice Hall PTR, New Jersey.
12. Huang, J., Gao, J., Miao, J., Li, X., Wang, K., and Behr, F. 2010. Exploring web scale language models for search query processing. In Proc. WWW 2010.
13. Jaynes, E. T. 1957. Information theory and statistical mechanics. In Physical Review Series II, American Physical Society, 106(4), 620-630.
14. Jin, R., Hauptmann, and Zhai, C. 2002. Title language model for information retrieval. In Proc. SIGIR-02, 42-48.
15. Kraaij, W., Westerveld, T., and Hiemstra, D., 2002. The importance of prior probabilities for entry page search. In Proc. SIGIR'02, Tampere, Finland, 27-32.
16. Lafferty, J. and Zhai, C. 2001. Document language models, query models, and risk minimization for information retrieval. In Proc. SIGIR'01, New Orleans, LA, 111-119.
17. Lavrenko, V., and Croft, W. B. 2001. Relevance-based language models. In Proc. SIGIR'01, New Orleans, LA, 120-127.
18. Manning, C., Raghavan, P., and Schutze, H. 2008. Introduction to information retrieval, Cambridge University Press.
19. Maron, M., and Kuhns, J. 1960. On relevance, probabilistic indexing and information retrieval. Journal of ACM, 7, 216-244.
20. Microsoft web n-gram services. http://research.microsoft.com/web-ngram
21. Miller, D., Leek, T., Schwartz, R. M. 1999. A hidden Markov model information retrieval system. In Proc. SIGIR-99, 214-222.
22. Ogilvie, P. and Callan, J. 2003. Combining document representations for known item search. In Proc. SIGIR-03, 143-151.
23. Orlitsky, A., Santhanam, N. P., and Zhang, J. 2003. Always Good Turing: asymptotically optimal probability estimation. Science, 302(5644), 427-431.
24. Ponte, J., and W. B. Croft. 1998. A language model approach to information retrieval. In Proc. SIGIR-98, 275-281.
25. Robertson, S. E., Walker, S., Sparck-Jones, K. S., Hancock-Beaulieu, M. M., and Gatford, M. 1994. Okapi at TREC-3. In Proc. the third text retrieval conference (TREC-3), D. K. Harman (eds.), NIST special publication 500-225, Gaithersburg, MD, 109-126.
26. Robertson, S. E., Zaragoza, H., and Taylor, M. 2004. Simple BM25 extension to multiple weighted fields. In Proc. CIKM-2004, 42-49.
27. Stolcke, A. 1998. Entropy-based pruning of backoff language models. In Proc. DARPA Broadcast News Transcription and Understanding Workshop, 270-274.
28. Svore, K. M. and Burges, C. J. C. 2009. A machine learning approach for improved BM25 retrieval. In Proc. CIKM'09, Hong Kong, China.
29. Wang, K. and Li, X. 2009. Efficacy of a constantly adaptive language model technique for web-scale applications. In Proc. ICASSP-2009, Taipei, Taiwan, 4733-4736.
30. Wang, Y.-M., Ma, M., Niu, Y., and Chen, H. 2007. Spam double-funnel: connecting web spammers with advertisers. In Proc. WWW-2007, 291-300.
31. Zhai, C. 2008. Statistical language models for information retrieval: a critical review. Foundations and Trends in Information Retrieval, Vol. 2(3), 137-215.
32. Zhai, C. and Lafferty, J. 2001. A study of smoothing methods for language models applied to ad hoc information retrieval. In Proc. SIGIR'01, New Orleans, LA, 334-342.
33. Zhai, C., and Lafferty, J. 2002. Two-stage language models for information retrieval. In Proc. SIGIR'02, Tampere, Finland, 49-56.