Discovering key concepts in verbose queries

ACM SIGIR 2008 - 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Proceedings

Volumn , Issue , 2008, Pages 491-498

  Bendersky, Michael ^a   Croft, W Bruce ^a  

^a Biologically Inspired Neural and Dynamical Systems Laboratory   (United States)

Author keywords

Information retrieval; Key concepts extraction; Verbose queries

Indexed keywords

AUTOMATIC EXTRACTIONS; IN PROCESSING; INVERSE DOCUMENT FREQUENCIES; KEY CONCEPTS EXTRACTION; NATURAL LANGUAGES; PROBABILISTIC MODELS; RETRIEVAL EFFECTIVENESSES; VERBOSE QUERIES; WEB COLLECTIONS; WEIGHTING METHODS;

FEATURE EXTRACTION; INFORMATION SERVICES; INTEGRATION; RESEARCH AND DEVELOPMENT MANAGEMENT; SEARCH ENGINES;

INFORMATION RETRIEVAL;

EID: 57349175533     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1390334.1390419     Document Type: Conference Paper

References (34)

1. J. Allan, M.E. Connell, W.B. Croft, F.F. Feng, D. Fisher, and X. Li. INQUERY and TREC-9. Proceedings of the Ninth Text Retrieval Conference (TREC-9), pages 551-562, 2000.
2. James Allan, Jamie Callan, W. Bruce Croft, Lisa Ballesteros, John Broglio, Jinxi Xu, and Hongmin Shu. INQUERY at TREC-5. pages 119-132. NIST, 1997.
3. L. Bentivogli and E. Pianta. Beyond lexical units: Enriching wordnets with phrasets. Proceedings of the Research Note Sessions of the 10th Conference of the European Chapter of the Association for Computational Linguistics (EACLOS), pages 67-70, 2003.
4. D.M. Bikel, R. Schwartz, and R.M. Weischedel. An Algorithm that Learns What's in a Name. Machine Learning, 34(1):211-231, 1999.
5. Thorsten Brants and Alex Franz. Web IT 5-gram Version 1, 2006.
6. Chris Buckley, Mandar Mitra, Janet A. Walz, and Claire Cardie. Using clustering and superconcepts within SMART: TREC 6. Information Processing and Management, 36(1):109-131, 2000.
7. James P. Callan, W. Bruce Croft, and John Broglio. TREC and tipster experiments with INQUERY. Information Processing and Management, 31(3):327-343, 1995.
8. Kenneth W. Church and William A. Gale. Poisson mixtures. Natural Language Engineering, 1(2):163-190, 1995.
9. K. Collins-Thompson and J. Callan. Query expansion using random walk models. Proceedings of the 14th ACM international conference on Information and knowledge management, pages 704-711, 2005.
10. W. Bruce Croft and John Lafferty, editors. Language Modeling for Information Retrieval. Number 13 in Information Retrieval Book Series. Kluwer, 2003.
11. J.F. da Silva, J. Mexia, C.A. Coelho, and J.G.P. Lopes. Document Clustering and Cluster Topic Extraction in Multilingual Corpora. Proceedings of the 2001 IEEE International Conference on Data Mining, pages 513-520, 2001.
12. E. Frank, G.W. Paynter, I.H. Witten, C. Gutwin, and C.G. Nevill-Manning. Domain-specific keyphrase extraction. Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence (IJGAI-99), pages 668-673, 1999.
13. Y. Freund and R.E. Schapire. Experiments with a new boosting algorithm. Machine Learning: Proceedings of the Thirteenth International Conference, 148:156, 1996.
14. Djoerd Hiemstra. Term-specific smoothing for the language modeling approach to information retrieval: the importance of a query term. In SIGIR '02: Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, pages 35-41. ACM, 2002.
15. A. Hulth. Improved automatic keyword extraction given more linguistic knowledge. Proceedings of the 2003 Conference on Empirical Methods in Natural Language Processing, pages 216-223, 2003.
16. Kevin Knight and Daniel Marcu. Statistics-based summarization - step one: Sentence compression. In AAAI/IAAI, pages 703-710, 2000.
17. Giridhar Kumaran and James Allan. A case for shorter queries, and helping user create them. In Proceedings of Human Language Technologies: The Annual Conference of the North American Chapter of the Association for Computational Linguistics, pages 220-227, 2006.
18. O. Kurland and L. Lee. Corpus structure, language models, and ad hoc information retrieval. Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval, pages 194-201, 2004.
19. Hugo Liu. MontyLingua: An end-to-end natural language processor with common sense, 2004. Available at: web.media.mit.edu/hugo/montylingua.
20. X. Liu and W.B. Croft. Cluster-based retrieval using language models. Proceedings of the 27th annual international conference on Research and developement in information retrieval, pages 186-193, 2004.
21. Q. Mei, H. Fang, and C. Zhai. A study of poisson query generation model for information retrieval. In SIGIR '07: Proceedings of the 30th annual international A CM SIGIR conference on Research and development in information retrieval, pages 319-326. ACM, 2007.
22. D. Metzler and W.B. Croft. A Markov random field model for term dependencies. Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, pages 472-479, 2005.
23. D. Metzler and W.B. Croft. Latent concept expansion using markov random fields. Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, pages 311-318, 2007.
24. P. Ogilvie and J. Callan. Experiments using the Lemur toolkit. Proceedings of the Tenth Text Retrieval Conference (TREC-10), pages 103-108, 2001.
25. Jay M. Ponte and W. Bruce Croft. A language modeling approach to information retrieval. In Proceedings of SIGIR, pages 275-281, 1998.
26. M. Porter. The Porter Stemming Algorithm. Accessible at http://www.tartarus.org/martin/PorterStemmer.
27. Gerard Salton and Christopher Buckley. Term-weighting approaches in automatic text retrieval. Inf. Process. Manage., 24(5):513-523, 1988.
28. T. Strohman, D. Metzler, H. Turtle, and W.B. Croft. Indri: A language model-based search engine for complex queries. Proceedings of the International Conference on Intelligence Analysis, 2004.
29. P.D. Turney. Learning Algorithms for Keyphrase Extraction. Information Retrieval, 2(4):303-336, 2000.
30. X. Wei and W.B. Croft. LDA-based document models for ad-hoc retrieval. Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, pages 178-185, 2006.
31. I.H. Witten and E. Frank. Data Mining: Practical Machine Learning Tools and Techniques. Morgan Kaufmann, 2005.
32. J. Xu and W.B. Croft. Query expansion using local and global document analysis. Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval, pages 4-11, 1996.
33. Wen T. Yih, Joshua Goodman, and Vitor R. Carvalho. Finding advertising keywords on web pages. In WWW '06: Proceedings of the 15th international conference on World Wide Web, pages 213-222, New York, NY, USA, 2006. ACM.
34. Y. Zhou and W.B. Croft. Query performance prediction in web search environments. Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, pages 543-550, 2007.