Unsupervised query segmentation using generative language models and wikipedia

Proceeding of the 17th International Conference on World Wide Web 2008, WWW'08

Volumn , Issue , 2008, Pages 347-356

  Tan, Bin ^a   Peng, Fuchun ^b  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^b YAHOO INC   (United States)

Author keywords

Concept discovery; Query segmentation

Indexed keywords

ADDITIONAL KNOWLEDGES; CONCEPT DISCOVERY; EM OPTIMIZATIONS; EXPECTATION MAXIMIZATIONS; INTERSECTION TESTS; LANGUAGE MODELS; MINIMUM DESCRIPTION LENGTHS; MUTUAL INFORMATIONS; OBJECTIVE FUNCTIONS; QUERY MODELS; QUERY SEGMENTATION; UNSUPERVISED APPROACHES; WEB SEARCHES; WIKIPEDIA;

COMPUTATIONAL LINGUISTICS; FEATURE EXTRACTION; INTERNET; LINGUISTICS; OPTIMIZATION;

WORLD WIDE WEB;

EID: 57349162751     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1367497.1367545     Document Type: Conference Paper

References (26)

1. R. K. Ando and L. Lee. Mostly-Unsupervised Statistical Segmentation of Japanese Kanji Sequences. Journal of Natural Language Engineering,9:127- 149, 2003.
2. P. Anick. Exploiting clustering and phrases for context-based information retrieval. ACM SIGIR Forum, 31:314-323.
3. A. Arampatzis, T. van der Weide, C. Koster, and P. van Bomtnel. Phrase-based Information Retrieval. Information Processing and Management, 34(6):693 - 707, 1998.
4. S. Bergsma and Q. I. Wang. Learning Noun Phrase Query Segmentation. In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL), pages 819-826, 2007.
5. M. R. Brent and T. A. Cartwright. Distributional regularity and phonotactic constraints are useful for segmentation. Cognition, 61:93 -125, 1996.
6. E. Brill and G. Ngai. Man vs. Machine: A Case Study in Base Noun Phrase Learning. In Proceedings of 37th Annual Meeting of the Association for Computational Linguistics (ACL), pages 65-72, 1999.
7. R. Bunescu and M. Pasca. Using Encyclopedic Knowledge for Named Entity Disambiguation. In Proceedings of 11th Conference of European Chapter of the Association for Computational Linguistics (EACL), pages 9-16, 2006.
8. Y. Chang, I. Ounis, and M. Kim. Query Reformulation Using Automatically Generated Query Concepts from a Document Space. Information Processing and Management, 42 (2):453 - 468, 2006.
9. S. Cucerzan. Large-Scale Named Entity Disambiguation Based on Wikipedia Data. In Proceedings of EMNLP-CoNLL 2007, pages 708-716, 2007.
10. D. Ahn and V. Jijkoun and G. Mishne and K. Muller and M. de. Rijke, Using Wikipedia at the TREC QA Track. In The Thirteenth Text Retrieval Conference (TREC 2004), 2005.
11. D. Evans and C. Zhai. Noun-phrase Analysis in Unrestricted Text for Information Retrieval. In 34th Annual Meeting of the Association Computational Linguistics (ACL), pages 17-24, 1996.
12. E. Gabrilovich and S. Markovitch. Overcoming the Brittleness Bottleneck using Wikipedia: Enhancing Text Categorization with Encyclopedic Knowledge. In Proceedings of the Twenty-First National Conference on Artificial Intelligence (AAA1), pages 1301-1306, 2006.
13. P. Grunwald. A Minimum Description Length Approach to Grammar Inference. In G. S. S. Wermter, E. Riloff, editor, Symbolic, Connectionist and Statistical Approaches to Learning for Natural Language Processing, pages 203-216, 1996.
14. R. Jones, B. Rey, O. Madani, and W. Greiner. Generating query substitutions. In Proceedings of 15th International World Wide Web Conference (WWW), pages 387-396, 2006.
15. H. Li and N. Abe. Clustering Words with the MDL Principle. In Proceedings of the 16th International Conference on Computational Linguistics (COL1NG), pages 5-9, 1996.
16. C. G. D. Marcken. Unsupervised language acquisition. PhD thesis, MIT, 1996. Supervisor: Robert C. Berwick.
17. G. Pass, A. Chowdhury, and C. Torgeson. A Picture of Search. In The First International Conference on Scalable Information Systems, 2006.
18. F. Peng, F. Feng, and A. McCallum. Chinese Segmentation and New Word Detection using Conditional Random Fields. In Proceedings of The 20th International Conference on Computational Linguistics (COLING), pages 562-568, 2004.
19. F. Peng and D. Schuurmans. Self-Supervised Chinese Word Segmentation. In IDA '01: Proceedings of the 4th International Conference on Advances in Intelligent Data-Analysis, pages 238-247, 2001.
20. S. P. Ponzetto and M. Strube. Exploiting Semantic Role Labeling, WordNet and Wikipedia for Coreference Resolution. In Proceedings of the main conference on Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics, pages 192-199, 2006.
21. Y. Qiu and H.-P. Frei. Concept based Query Expansion. In Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval (SIGIR), pages 160-169, 1993.
22. L. Ramshaw and M. Marcus. Text Chunking Using Transformation-Based Learning. In Proceedings of the Third Workshop on Very Large Corpora, pages 82-94, 1995.
23. K. M. Risvik, T. Mikolajewski, and P. Boros. Query-Segmentation for Web Search. In The Twelfth International World Wide Web Conference (WWW), 2003.
24. J. I. Serrano and L. Araujo. Statistical Recognition of Noun Phrases in Unrestricted Text. In IDA '05: Proceedings of the 6th International Conference on Advances in Intelligent Data Analysis, pages 397-408, 2005.
25. R. Sproat, W. Gale, C. Shih, and N. Chang. A Stochastic Finite-state Word Segmentation Algorithm for Chinese. Computational Linguistics, 22(3):377-404, 1996.
26. C. Zhai. Fast Statistical Parsing of Noun Phrases for Document Indexing. In Proceedings of the fifth Conference on Applied Natural Language Processing (ANLP), pages 312 -319, 1997.