Exploring web scale language models for search query processing

Proceedings of the 19th International Conference on World Wide Web, WWW '10

Volumn , Issue , 2010, Pages 451-460

  Huang, Jian ^a   Gao, Jianfeng ^b   Miao, Jiangbo ^c   Li, Xiaolong ^b   Wang, Kuansan ^b   Behr, Fritz ^d   Giles, C Lee ^a  

^a PENNSYLVANIA STATE UNIVERSITY   (United States)

^b MICROSOFT RESEARCH   (United States)

^c FACEBOOK   (United States)

^d MICROSOFT   (United States)

Author keywords

language models; search query processing; very large scale experiments; web n gram

Indexed keywords

ACCURACY INDICATORS; COUNTS-AS; LANGUAGE MODEL; LARGE SCALE EXPERIMENTS; LARGE-SCALE ANALYSIS; LONG QUERIES; N-GRAM LANGUAGE MODELS; SEARCH QUERIES; SPELLING CORRECTION; TEXT STREAMS; WEB DOCUMENT;

COMPUTATIONAL LINGUISTICS; EXPERIMENTS; NATURAL LANGUAGE PROCESSING SYSTEMS; QUERY LANGUAGES; QUERY PROCESSING; WORLD WIDE WEB;

COMPUTER HARDWARE DESCRIPTION LANGUAGES;

EID: 77954614449     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1772690.1772737     Document Type: Conference Paper

References (31)

1. Hitwise 2009 press releases, 2009.
2. Special issue on web as corpus. Computational Linguistics, 29(3), September 2003.
3. E. Agichtein, E. Brill, and S. Dumais. Improving web search ranking by incorporating user behavior information. In Proceedings of 29th international ACM conference on Research and development in information retrieval (SIGIR), pages 19-26, 2006.
4. M. Banko and E. Brill. Scaling to very very large corpora for natural language disambiguation. In Proceedings of 39th Annual Meeting on Association for Computational Linguistics (ACL), pages 26-33, 2001.
5. C. Barr, R. Jones, and M. Regelson. The linguistic structure of english web-search queries. In Proc. of Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 1021-1030, 2008.
6. S. Bergsma, D. Lin, and R. Goebel. Web-scale n-gram models for lexical disambiguation. In Proceedings of the 21st International Joint Conference on Artificial Intelligence (IJCAI), pages 1507-1512, 2009.
7. S. Bergsma and Q. I. Wang. Learning noun phrase query segmentation. In Proceedings of the Joint Conference on Empirical Methods in Natural Language Processing (EMNLP) and Computational Natural Language Learning (CoNLL), pages 819-826, 2007.
8. T. Brants and A. Franz. Web 1T 5-gram corpus version 1.1. Technical report, Google Research, 2006.
9. T. Brants, A. C. Popat, P. Xu, F. J. Och, and J. Dean. Large language models in machine translation. In Proceedings of the Joint Conference on Empirical Methods in Natural Language Processing (EMNLP) and Computational Natural Language Learning (CoNLL), pages 858-867, 2007.
10. S. F. Chen and J. Goodman. An empirical study of smoothing techniques for language modeling. Computer Speech and Language, 13(10):359-394, 1999.
11. K. Church, T. Hard, and J. Gao. Compressing trigram language models with Golomb coding. In Proceedings of EMNLP and CoNLL, pages 199-207, 2007.
12. S. Cucerzan and E. Brill. Spelling correction as an iterative process that exploits the collective knowledge of web users. In EMNLP, pages 293-300, 2004.
13. M. Gamon, J. Gao, C. Brockett, A. Klementiev, W. Dolan, D. Belenko, and L. Vanderwende. Using contextual speller techniques and language modeling for ESL error correction. In Proc. of IJCNLP, 2008.
14. J. Gao, J. Goodman, and J. Miao. The use of clustering techniques for language modelling - application to Asian languages. Computational Linguistics and Chinese Language Processing, 6(1):27-60, 2001.
15. J. Gao, W. Yuan, X. Li, K. Deng, and J.-Y. Nie. Smoothing clickthrough data for web search ranking. In Proceedings of the 32nd international SIGIR conference on Research and development in information retrieval (SIGIR), pages 355-362, 2009.
16. A. R. Golding and Y. Schabes. Combining trigram-based and feature-based methods for context-sensitive spelling correction. In Proceedings of the 34th ACL, pages 71-78, 1996.
17. A. Halevy, P. Norvig, and F. Pereira. The unreasonable effectiveness of data. IEEE Intelligent Systems, 24(2):8-12, 2009.
18. X. Huang, A. Acero, and H.-W. Hon. Spoken Language Processing: A Guide to Theory, Algorithm and System Development. Prentice Hall PTR, 2001.
19. R. Jones, B. Rey, O. Madani, and W. Greiner. Generating query substitutions. In Proc. of 15th World Wide Web (WWW), pages 387-396, 2006.
20. R. Kneser and H. Ney. Improved backing-off for M-gram language modeling. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 1:181-184, 1995.
21. G. Kumaran and V. R. Carvalho. Reducing long queries using query quality predictors. In Proc. of 32nd international conf. on Research and development in information retrieval (SIGIR), pages 564-571, 2009.
22. M. Lapata and F. Keller. The web as a baseline: Evaluating the performance of unsupervised web-based models for a range of NLP tasks. In Proc. of Human Language Technologies - North American Chapter of the Association for Computational Linguistics (HLT-NAACL), pages 121-128, 2004.
23. M. Lauer. Corpus statistics meet the noun compound: some empirical results. In Proceedings of the 33rd annual meeting on Association for Computational Linguistics (ACL), pages 47-54, 1995.
24. P. Nakov and M. Hearst. Search engine statistics beyond the n-gram: Application to noun compound bracketing. In Proc. of 9th Conf. on Computational Natural Language Learning, pages 17-24, 2005.
25. P. Nguyen, J. Gao, and M. Mahajan. MSRLM: a scalable language modeling toolkit. Technical report TR-2007-144, Microsoft Research, 2007.
26. A. Spink, D. Wolfram, M. B. J. Jansen, and T. Saracevic. Searching the web: the public and their queries. Journal of American Society for Information Science and Technology, 52(3):226-234, 2001.
27. K. Svore and C. Burges. A machine learning approach for improved bm25 retrieval. In Proceedings of 18th ACM Conference on Information and Knowledge Management (CIKM), pages 1811-1814, 2009.
28. B. Tan and F. Peng. Unsupervised query segmentation using generative language models and Wikipedia. In Proceeding of the 17th international conference on World Wide Web (WWW), pages 347-356, 2008.
29. D. Vadas and J. R. Curran. Corpus statistics meet the noun compound: some empirical results. In Proceedings of 10th Conference of the Pacific Association for Computational Linguistics (PACLING), pages 104-112, 2007.
30. K. Wang and X. Li. Efficacy of a constantly adaptive language modeling technique for web-scale applications. In Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 4733-4736, 2009.
31. C. Zhai and J. Lafferty. A study of smoothing methods for language models applied to information retrieval. ACM Transactions on Information Systems, 22(2):179-214, 2004.