Discovering and understanding word level user intent in Web search queries

Journal of Web Semantics

Volumn 30, Issue , 2015, Pages 22-38

  Saha Roy, Rishiraj ^a   Katare, Rahul ^a   Ganguly, Niloy ^a   Laxman, Srivatsan ^b   Choudhury, Monojit ^c  

^a INDIAN INSTITUTE OF TECHNOLOGY   (India)

^b Scibler Technologies Private Limited   (India)

^c MICROSOFT RESEARCH   (United States)

Author keywords

Co occurrence entropy; Intent words; Query intent; Query understanding

Indexed keywords

COMPUTATIONAL LINGUISTICS; ENTROPY; FEATURE EXTRACTION; FUNCTION EVALUATION; SEMANTICS; WORLD WIDE WEB;

CO-OCCURRENCE; DISTRIBUTIONAL FEATURES; DISTRIBUTIONAL PROPERTY; INTELLIGENT PROCESSING; INTENT WORDS; OPERATIONAL DEFINITION; QUERY INTENT; QUERY UNDERSTANDING;

INFORMATION RETRIEVAL;

EID: 84924193130     PISSN: 15708268     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.websem.2014.07.010     Document Type: Article

References (58)

1. P. Haase, D. Herzig, M. Musen, and T. Tran Semantic Wiki search The Semantic Web: Research and Applications 2009 Springer 445 460
2. D. Tumer, M.A. Shah, and Y. Bitirim An empirical evaluation on semantic search performance of keyword-based and semantic search engines: Google, Yahoo, MSN and Hakia Internet Monitoring and Protection, 2009 ICIMP'09, Fourth International Conference on IEEE 2009 51 55
3. S. Ferré, and A. Hermann Semantic search: Reconciling expressive querying and exploratory search The Semantic Web-ISWC 2011 2011 Springer 177 192
4. A. Broder A taxonomy of Web search SIGIR Forum 36 2002 3 10
5. U. Lee, Z. Liu, and J. Cho Automatic identification of user goals in Web search Proceedings of the 14th International Conference on World Wide Web 2005 ACM 391 400
6. B.J. Jansen, D.L. Booth, and A. Spink Determining the informational, navigational, and transactional intent of Web queries Inf. Process. Manage. 44 3 2008 1251 1266
7. J. Gao, J.-Y. Nie, G. Wu, and G. Cao Dependence language model for information retrieval Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval SIGIR'04 2004 ACM New York, NY, USA 170 177 10.1145/1008992.1009024
8. D. Metzler, and W.B. Croft A Markov random field model for term dependencies Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval SIGIR'05 2005 ACM New York, NY, USA 472 479 10.1145/1076034.1076115
9. M. Bendersky, W.B. Croft, and D.A. Smith Two-stage query segmentation for information retrieval Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval SIGIR'09 2009 ACM New York, NY, USA 810 811 10.1145/1571941.1572140
10. T. Tao, and C. Zhai An exploration of proximity measures in information retrieval Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 2007 ACM 295 302
11. R. Cummins, and C. O'Riordan Learning in a pairwise term-term proximity framework for information retrieval Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval 2009 ACM 251 258
12. R. Song, M.J. Taylor, J.-R. Wen, H.-W. Hon, and Y. Yu Viewing term proximity from a different perspective Proceedings of the IR Research, 30th European Conference on Advances in Information Retrieval ECIR'08 2008 Springer-Verlag Berlin, Heidelberg 346 357 URL http://dl.acm.org/citation.cfm?id=1793274.1793317
13. J. Bai, Y. Chang, H. Cui, Z. Zheng, G. Sun, and X. Li Investigation of partial query proximity in Web search Proceedings of the 17th International Conference on World Wide Web WWW'08 2008 ACM New York, NY, USA 1183 1184 10.1145/1367497.1367717
14. B. He, J.X. Huang, and X. Zhou Modeling term proximity for probabilistic information retrieval models Inform. Sci. 181 14 2011 10.1016/j.ins.2011.03.007
15. J.L. Morgan, and K. Demuth Signal to Sintax: Bootstrapping from Speech to Grammar in Early Acquisition: [chapters Presented at a Conference Held Feb. 19-21, 1993, Brown University, Providence, RI] 1996 Psychology Press
16. R. Jackendoff X-Bar Syntax 1977 The MIT Press Cambridge, MA
17. N. Chomsky Barriers 1986 MIT Press
18. N. Fukui, M. Speas, Specifiers and projection, in: MIT Working papers in Linguistics, Vol. 8, No. 128, 1986.
19. R. Saha Roy, N. Ganguly, M. Choudhury, and S. Laxman An IR-based Evaluation Framework for Web Search Query Segmentation SIGIR'12 2012 ACM 881 890
20. G. Salton, and M.J. McGill Introduction to Modern Information Retrieval 1986 McGraw-Hill, Inc.
21. R. Baeza-Yates, and B. Ribeiro-Neto Modern Information Retrieval 1999 Addison-Wesley Longman Publishing Company, Inc. Boston, MA, USA
22. C.E. Shannon A mathematical theory of communication Bell Syst. Tech. J. 27 1948 379 423
23. G. Salton The SMART Retrieval System: Experiments in Automatic Document Processing 1971 Prentice-Hall, Inc. Upper Saddle River, NJ, USA
24. P. Koehn, Europarl: A parallel corpus for statistical machine translation, in: MT Summit, vol. 5, 2005, pp. 79-86.
25. J. Huang, J. Gao, J. Miao, X. Li, K. Wang, F. Behr, and C.L. Giles Exploring Web scale language models for search query processing Proceedings of the 19th International Conference on World Wide Web WWW'10 2010 ACM New York, NY, USA 451 460 10.1145/1772690.1772737
26. R. Saha Roy, M. Choudhury, and K. Bali Are Web search queries an evolving protolanguage? Proceedings of the 9th International Conference on the Evolution of Language, Evolang 9 2012 World Scientific Publishing Co. Singapore 304 311
27. S. Bergsma, Q.I. Wang, Learning noun phrase query segmentation, in: EMNLP-CoNLL'07, 2007, pp. 819-826.
28. M. Manshadi, and X. Li Semantic tagging of Web search queries Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2 ACL'09 2009 Association for Computational Linguistics Stroudsburg, PA, USA 861 869 URL http://dl.acm.org/citation.cfm?id=1690219.1690267
29. M. Hagen, M. Potthast, B. Stein, and C. Bräutigam Query segmentation revisited Proceedings of the 20th International Conference on World Wide Web WWW'11 2011 ACM New York, NY, USA 97 106 10.1145/1963405.1963423
30. R. Saha Roy, N. Ganguly, M. Choudhury, and N.K. Singh Complex network analysis reveals kernel-periphery structure in Web search queries QRU'11 2011 ACM New York, NY, USA 5 8
31. E. Guichard, L'Internet: mesures des appropriations d'une technique intellectuelle, These, Ecole des hautes études en sciences sociales, October 2002. URL http://tel.archives-ouvertes.fr/tel-00294711/en/.
32. A. Spink, D. Wolfram, M.B.J. Jansen, and T. Saracevic Searching the Web: the public and their queries J. Am. Soc. Inf. Sci. Technol. 52 2001 226 234 URL http://dl.acm.org/citation.cfm?id=362968.362979
33. C. Barr, R. Jones, and M. Regelson The linguistic structure of english Web-search queries Proceedings of the Conference on Empirical Methods in Natural Language Processing EMNLP'08 2008 Association for Computational Linguistics Stroudsburg, PA, USA 1021 1030 URL http://dl.acm.org/citation.cfm?id=1613715.1613848
34. G. Pass, A. Chowdhury, and C. Torgeson A picture of search Proceedings of the 1st International Conference on Scalable Information Systems InfoScale'06 2006 ACM New York, NY, USA 1 7 10.1145/1146847.1146848
35. Y. Li, B.-J.P. Hsu, C. Zhai, and K. Wang Unsupervised query segmentation using clickthrough for information retrieval Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval SIGIR'11 2011 ACM New York, NY, USA 285 294 10.1145/2009916.2009957
36. M. Paşca, and B. Van Durme What you seek is what you get: extraction of class attributes from query logs Proceedings of the 20th International Joint Conference on Artifical Intelligence IJCAI'07 2007 Morgan Kaufmann Publishers Inc. San Francisco, CA, USA 2832 2837 URL http://dl.acm.org/citation.cfm?id=1625275.1625731
37. R. Jones, and K.L. Klinkner Beyond the session timeout: automatic hierarchical segmentation of search topics in query logs Proceedings of the 17th ACM Conference on Information and Knowledge Management CIKM'08 2008 ACM New York, NY, USA 699 708 10.1145/1458082.1458176
38. E. Agichtein, R.W. White, S.T. Dumais, and P.N. Bennet Search, interrupted: Understanding and predicting search task continuation Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval SIGIR'12 2012 ACM New York, NY, USA 315 324 10.1145/2348283.2348328
39. S. Debnath, N. Ganguly, and P. Mitra Feature weighting in content based recommendation system using social network analysis Proceedings of the 17th International Conference on World Wide Web WWW'08 2008 ACM New York, NY, USA 1041 1042
40. J. Guo, G. Xu, X. Cheng, and H. Li Named entity recognition in query Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval SIGIR'09 2009 ACM New York, NY, USA 267 274 10.1145/1571941.1571989
41. J. Cohen A coefficient of agreement for nominal scales Educ. Psychol. Meas. 20 1 1960 37 46 10.1177/001316446002000104
42. M. Porter An algorithm for suffix stripping Program 14 1980 130
43. H. Yu, and F. Ren Role-explicit query identification and intent role annotation Proceedings of the 21st ACM International Conference on Information and Knowledge Management CIKM'12 2012 ACM New York, NY, USA 1163 1172 10.1145/2396761.2398416
44. X. Li Understanding the semantic structure of noun phrase queries Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics ACL'10 2010 Association for Computational Linguistics Stroudsburg, PA, USA 1337 1345 URL http://dl.acm.org/citation.cfm?id=1858681.1858817
45. X. Yin, and S. Shah Building taxonomy of Web search intents for name entity queries Proceedings of the 19th International Conference on World Wide Web WWW'10 2010 ACM New York, NY, USA 1001 1010
46. X. Yin, W. Tan, X. Li, and Y. Tu Automatic extraction of clickable structured Web contents for name entity queries Proceedings of the 19th International World Wide Web Conference WWW'10 2010 ACM New York, NY, USA 991 1000 10.1145/1772690.1772791
47. K. Järvelin, and J. Kekäläinen Cumulated gain-based evaluation of IR techniques ACM Trans. Inf. Syst. 20 2002 422 446
48. M. Paşca, and B. Van Durme Weakly-supervised acquisition of open-domain classes and class attributes from Web documents and query logs Proceedings of ACL-08: HLT 2008 Association for Computational Linguistics Columbus, Ohio 19 27 URL http://www.aclweb.org/anthology/P/P08/P08-1003
49. M. Paşca Outclassing Wikipedia in open-domain information extraction: weakly-supervised acquisition of attributes over conceptual hierarchies Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics 2009 Association for Computational Linguistics 639 647
50. J. Reisinger, and M. Paşca Low-cost supervision for multiple-source attribute extraction Proceedings of the 10th International Conference on Computational Linguistics and Intelligent Text Processing CICLing'09 2009 Springer-Verlag Berlin, Heidelberg 382 393
51. E. Alfonseca, M. Paşca, E. Robledo-Arnuncio, Acquisition of instance attributes via labeled and related instances, in: Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR'10, 2010, pp. 58-65.
52. M. Paşca, Attribute extraction from synthetic Web search queries, in: IJCNLP'11, 2011, pp. 401-409.
53. T. Lin, P. Pantel, M. Gamon, A. Kannan, and A. Fuxman Active objects: actions for entity-centric search Proceedings of the 21st International Conference on World Wide Web WWW'12 2012 ACM New York, NY, USA 589 598 10.1145/2187836.2187916
54. A. Jain, and M. Pennacchiotti Open entity extraction from Web search query logs Proceedings of the 23rd International Conference on Computational Linguistics COLING'10 2010 Association for Computational Linguistics Stroudsburg, PA, USA 510 518 URL http://dl.acm.org/citation.cfm?id=1873781.1873839
55. R. Baeza-Yates, and A. Tiberi Extracting semantic relations from query logs Proceedings of the 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 2007 ACM 76 85
56. B. Van Durme, M. Paşca, Finding cars, goddesses and enzymes: Parametrizable acquisition of labeled instances for open-domain information extraction, in: Twenty-Third AAAI Conference on Artificial Intelligence, AAAI'08, 2008, pp. 1243-1248.
57. V.B. Nguyen, M.Y. Kan, Functional faceted Web query analysis, in: Proceedings of the Workshop on Query Log Analysis: Social and Technological Challenges, WWW'07, 2007, pp. 1-8.
58. C. González-Caro, and R. Baeza-Yates A multi-faceted approach to query intent classification R. Grossi, F. Sebastiani, F. Silvestri, SPIRE'11 Lecture Notes in Computer Science vol. 7024 2011 Springer Berlin, Heidelberg 368 379