Clustering and diversifying web search results with graph-based word sense induction

Computational Linguistics

Volumn 39, Issue 3, 2013, Pages 709-754

  Di Marco, Antonio ^a   Navigli, Roberto ^a  

^a SAPIENZA UNIVERSITY OF ROME   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

GRAPHIC METHODS; INFORMATION RETRIEVAL; SEMANTICS; WEBSITES;

AUTOMATIC DISCOVERY; INFORMATION SEARCH; LEXICAL AMBIGUITY; SEARCH-RESULT SNIPPET; SEMANTIC SIMILARITY; TEXTUAL SIMILARITIES; WEB SEARCH RESULTS; WORD SENSE INDUCTIONS;

SEARCH ENGINES;

EID: 84875488756     PISSN: 08912017     EISSN: 15309312     Source Type: Journal    
DOI: 10.1162/COLI_a_00148     Document Type: Article

References (107)

1. Agirre, Eneko, David Martínez, Oier López de Lacalle, and Aitor Soroa. 2006a. Evaluating and optimizing the parameters of an unsupervised graph-based WSD algorithm. In Proceedings of the 1st Workshop on Graph-Based Algorithms for Natural Language Processing, 89-96, New York.
2. Agirre, Eneko, David Martínez, Oier López de Lacalle, and Aitor Soroa. 2006b. Two graph-based algorithms for state-of-the-art WSD. In Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing, 585-593, Sydney.
3. th International Workshop on Semantic Evaluations, 346-349, Prague.
4. Agrawal, Rakesh, Sreenivas Gollapudi, Alan Halverson, and Samuel Ieong. 2009. Diversifying search results. In Proceedings of the 2nd International Conference on Web Search and Web Data Mining, 5-14, Barcelona.
5. Baroni, Marco and Alessandro Lenci. 2010. Distributional memory: A general framework for corpus-based semantics. Computational Linguistics, 36(4):673-721.
6. Basile, Pierpaolo, Annalina Caputo, and Giovanni Semeraro. 2009. Exploiting disambiguation and discrimination in Information Retrieval systems. In Proceedings of the 2009 IEEE/WIC/ ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology - Volume 03, 539-542, Washington, DC.
7. Bennett, Paul N. and Nam Nguyen. 2009. Refined experts: Improving classification in large taxonomies. In Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 11-18, Boston, MA.
8. Bernardini, Andrea, Claudio Carpineto, and Massimiliano D'Amico. 2009. Full-subtopic retrieval with keyphrase-based search results clustering. In Proceedings of 2009 IEEE/WIC/ACM International Conference on Web Intelligence, 206-213, Milan.
9. Biemann, Chris. 2006. Chinese whispers-an efficient graph clustering algorithm and its application to Natural Language Processing problems. In Proceedings of the 1st Workshop on Graph-Based Algorithms for Natural Language Processing, 73-80, New York.
10. Boleda, Gemma, Sabine Schulte im Walde, and Toni Badia. 2012. Modeling regular polysemy: A study on the semantic classification of Catalan adjectives. Computational Linguistics, 38(3):575-616.
11. Branson, S. and A. Greenberg. 2002. Clustering Web search results using suffix tree methods. In Technical Report CS276A Final Project, Stanford University.
12. Brants, Thorsten and Alex Franz. 2006. Web 1T 5-gram, ver. 1, ldc2006t13. In Linguistic Data Consortium, Philadelphia, PA.
13. Brody, Samuel and Mirella Lapata. 2009. Bayesian Word Sense Induction. In Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics, 103-111, Athens.
14. Bruza, Peter, Robert McArthur, and Simon Dennis. 2000. Interactive Internet search: Keyword, directory and query reformulation mechanisms compared. In Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 280-287, Athens.
15. Bunescu, Razvan C. and Marius Pasca. 2006. Using encyclopedic knowledge for named entity disambiguation. In Proceedings of 11th Conference of the European Chapter of the Association for Computational Linguistics, 9-16, Trento.
16. Carbonell, Jaime and Jade Goldstein. 1998. The use of MMR, diversity-based reranking for reordering documents and producing summaries. In Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 335-336, Melbourne.
17. Carmel, David, Haggai Roitman, and Naama Zwerdling. 2009. Enhancing cluster labeling using Wikipedia. In Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 139-146, Boston, MA.
18. Carpineto, Claudio, Massimiliano D'Amico, and Andrea Bernardini. 2011. Full discrimination of subtopics in search results with keyphrase-based clustering. Web Intelligence and Agent Systems, 9(4):337-349.
19. Carpineto, Claudio, Stanislaw Osiński, Giovanni Romano, and Dawid Weiss. 2009. A survey of Web clustering engines. ACM Computing Surveys, 41(3):1-38.
20. Carpineto, Claudio and Giovanni Romano. 2004. Exploiting the potential of concept lattices for Information Retrieval with CREDO. Journal of Universal Computer Science, 10(8):985-1013.
21. Chandar, Praveen and Ben Carterette. 2010. Diversification of search results using webgraphs. In Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, 869-870, Geneva.
22. Chapelle, Olivier, Yi Chang, and Tie-Yan Liu. 2011. Future directions in learning to rank. Journal of Machine Learning Research-Proceedings Track, 14:91-100.
23. Chen, Harr and David R. Karger. 2006. Less is more: Probabilistic models for retrieving fewer relevant documents. In Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 429-436, Seattle, WA.
24. Chen, Jiyang, Osmar R. Zäiane, and Randy Goebel. 2008. An unsupervised approach to cluster web search results based on word sense communities. In Proceedings of 2008 IEEE/WIC/ACM International Conference on Web Intelligence, 725-729, Sydney.
25. Cheng, David, Santosh Vempala, Ravi Kannan, and Grant Wang. 2005. A divide-and-merge methodology for clustering. In Proceedings of the 24th ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems, 196-205, Baltimore, MD.
26. Clarke, Daoud. 2012. A context-theoretic framework for compositionality in distributional semantics. Computational Linguistics, 38(1):41-71.
27. Clough, Paul, Mark Sanderson, Murad Abouammoh, Sergio Navarro, and Monica Lestari Paramita. 2009. Multiple approaches to analysing query diversity. In Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 734-735, Boston, MA.
28. Crabtree, Daniel, Xiaoying Gao, and Peter Andreae. 2005. Improving Web clustering by cluster selection. In Proceedings of 2005 IEEE/WIC/ACM International Conference on Web Intelligence, 172-178, Compiegne.
29. Cutting, Douglass R., David R. Karger, Jan O. Pedersen, and John W. Tukey. 1992. Scatter/Gather: A cluster-based approach to browsing large document collections. In Proceedings of the 15th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 318-329, Copenhagen.
30. Di Giacomo, Emilio, Walter Didimo, Luca Grilli, and Giuseppe Liotta. 2007. Graph visualization techniques for Web clustering engines. IEEE Transactions on Visualization and Computer Graphics, 13(2):294-304.
31. Di Marco, Antonio and Roberto Navigli. 2011. Clustering Web search results with maximum spanning trees. In Proceedings of the XIIth International Conference of the Italian Association for Artificial Intelligence, 201-212, Palermo.
32. Dorow, Beate, Dominic Widdows, Katarina Ling, Jean-Pierre Eckmann, Danilo Sergi, and Elisha Moses. 2005. Using curvature and Markov clustering in graphs for lexical acquisition and word sense discrimination. In Proceedings of the Meaning-2005 Workshop, Trento.
33. Erk, Katrin, Sebastian Padó, and Ulrike Padó. 2010. A flexible, corpus-driven model of regular and inverse selectional preferences. Computational Linguistics, 36(4):723-763.
34. Fellbaum, Christiane, editor. 1998. WordNet: An Electronic Database. MIT Press, Cambridge, MA.
35. Ferraresi, Adriano, Eros Zanchetta, Marco Baroni, and Silvia Bernardini. 2008. Introducing and evaluating ukWaC, a very large Web-derived corpus of English. In Proceedings of the 4th Web as Corpus Workshop (WAC-4), 47-54, Marrakech.
36. Furnas, G. W., T. K. Landauer, L. M. Gomez, and S. T. Dumais. 1987. The vocabulary problem in human-system communication. Commununications of ACM, 30(11):964-971.
37. Gabrilovich, Evgeniy and Shaul Markovitch. 2009. Wikipedia-based semantic interpretation for natural language processing. Journal of Artificial Intelligence Research (JAIR), 34:443-498.
38. Geiss, Johanna. 2009. Creating a gold standard for sentence clustering in multi-document summarization. In Proceedings of the 47th Annual Meeting of the Association for Computational Linguistics and the 4th International Joint Conference on Natural Language Processing of the AFNLP, 96-104, Singapore.
39. Gelgi, Fatih, Hasan Davulcu, and Srinivas Vadrevu. 2007. Term ranking for clustering Web search results. In Proceedings of 10th International Workshop on the Web and Databases, Beijing, China.
40. Gonzalo, Julio, Anselmo Penas, and Felisa Verdejo. 1999. Lexical ambiguity and Information Retrieval revisited. In Proceedings of the Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora, 195-202, College Park, MD.
41. Harris, Zellig. 1954. Distributional structure. Word, 10:146-162.
42. Hubert, L. and P. Arabie. 1985. Comparing partitions. Journal of Classification, 2(1):193-218.
43. Kamvar, Maryam and Shumeet Baluja. 2006. A large scale study of wireless search behavior: Google mobile search. In Proceedings of the 2006 Conference on Human Factors in Computing Systems, 701-709, Montréal.
44. Ke, Weimao, Cassidy R. Sugimoto, and Javed Mostafa. 2009. Dynamicity vs. effectiveness: Studying online clustering for Scatter/Gather. In Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 19-26, Boston, MA.
45. Kim, Sang-Bum, Hee-Cheol Seo, and Hae-Chang Rim. 2004. Information Retrieval using word senses: Root sense tagging approach. In Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 258-265, Sheffield.
46. Korkontzelos, Ioannis and Suresh Manandhar. 2010. UoY: Graphs of unambiguous vertices for word sense induction and disambiguation. In Proceedings of the 5th International Workshop on Semantic Evaluation, 355-358, Uppsala.
47. Krovetz, Robert and William B. Croft. 1992. Lexical ambiguity and Information Retrieval. ACM Transactions on Information Systems, 10(2):115-141.
48. Kurland, Oren. 2008. The opposite of smoothing: A language model approach to ranking query-specific document clusters. In Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 171-178, Singapore.
49. Kurland, Oren and Carmel Domshlak. 2008. A rank-aggregation approach to searching for optimal query-specific clusters. In Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 547-554, Singapore.
50. Lee, Kyung Soon, W. Bruce Croft, and James Allan. 2008. A cluster-based resampling method for pseudo-relevance feedback. In Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 235-242, Singapore.
51. th International Conference on Computational Linguistics, 768-774, Montreal.
52. th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 613-619, Edmonton.
53. Liu, Shuang, Clement Yu, and Weiyi Meng. 2005. Word Sense Disambiguation in queries. In Proceedings of the 2005 ACM CIKM International Conference on Information and Knowledge Management, 525-532, Bremen.
54. Liu, Tie-Yan, Yiming Yang, Hao Wan, Hua-Jun Zeng, Zheng Chen, and Wei-Ying Ma. 2005. Support vector machines classification with a very large-scale taxonomy. SIGKDD Explorations, 7(1):36-43.
55. Liu, Ying, Wenyuan Li, Yongjing Lin, and Liping Jing. 2008. Spectral geometry for simultaneously clustering and ranking query search results. In Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 539-546, Singapore.
56. Ma, Hao, Michael R. Lyu, and Irwin King. 2010. Diversifying query suggestion results. In Proceedings of the 24th AAAI Conference on Artificial Intelligence, AAAI 2010, 1,399-1,404, Atlanta, GA.
57. Maarek, Yoelle, Ron Fagin, Israel Ben-Shaul, and Dan Pelleg. 2000. Ephemeral document clustering for Web applications. IBM Research Report RJ 10186. Haifa.
58. Manandhar, Suresh, Ioannis P. Klapaftis, Dmitriy Dligach, and Sameer S. Pradhan. 2010. SemEval-2010 task 14: Word sense induction & disambiguation. In Proceedings of the 5th International Workshop on Semantic Evaluation, 63-68, Uppsala.
59. Mandala, Rila, Takenobu Tokunaga, and Hozumi Tanaka. 1998. The use of WordNet in Information Retrieval. In Proceedings of the COLING-ACL workshop on Usage of Wordnet in Natural Language Processing, 31-37, Montréal.
60. Matsuo, Yutaka, Takeshi Sakaki, Kôki Uchiyama, and Mitsuru Ishizuka. 2006. Graph-based word clustering using a Web search engine. In Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing, 542-550, Sydney.
61. Mihalcea, Rada. 2007. Using Wikipedia for automatic Word Sense Disambiguation. In Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics, 196-203, Rochester, NY.
62. Mihalkova, L. and R. Mooney. 2009. Learning to disambiguate search queries from short sessions. In Proceedings of Machine Learning and Knowledge Discovery in Databases (2), 111-127, Bled.
63. Miller, George A., R. T. Beckwith, Christiane D. Fellbaum, D. Gross, and K. Miller. 1990. WordNet: an online lexical database. International Journal of Lexicography, 3(4):235-244.
64. Mitchell, Jeff and Mirella Lapata. 2010. Composition in distributional models of semantics. Cognitive Science, 34(8):1388-1429.
65. Navigli, Roberto. 2009. Word Sense Disambiguation: A survey. ACM Computing Surveys, 41(2):1-69.
66. Navigli, Roberto. 2012. A quick tour of Word Sense Disambiguation, induction and related approaches. In Proceedings of the 38th Conference on Current Trends in Theory and Practice of Computer Science, 115-129, Spindleruv Mlýn.
67. Navigli, Roberto and Giuseppe Crisafulli. 2010. Inducing word senses to improve Web search result clustering. In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, 116-126, Boston, MA.
68. Navigli, Roberto and Simone Paolo Ponzetto. 2012. The automatic construction, evaluation and application of a wide-coverage multilingual semantic network. Artificial Intelligence, 193:217-250.
69. Ngo, Chi Lang and Hung Son Nguyen. 2005. A method of Web search result clustering based on rough sets. In Proceedings of 2005 IEEE/WIC/ACM International Conference on Web Intelligence, 673-679, Compiegne.
70. Nguyen, Cam-Tu, Xuan-Hieu Phan, Susumu Horiguchi, Thu-Trang Nguyen, and Quang-Thuy Ha. 2009. Web search clustering and labeling with hidden topics. ACM Transactions on Asian Language Information Processing, 8(3):1-40.
71. Osinski, Stanislaw and Dawid Weiss. 2005. A concept-driven algorithm for clustering search results. IEEE Intelligent Systems, 20(3):48-54.
72. Rand, W. M. 1971. Objective criteria for the evaluation of clustering methods. Journal of the American Statistical Association, 66(336):846-850.
73. Reisinger, Joseph and Marius Pasca. 2011. Fine-grained class label markup of search queries. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, 1,200-1,209, Portland, OR.
74. Rosenberg, Andrew and Julia Hirschberg. 2007. V-measure: A conditional entropy-based external cluster evaluation measure. In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, 410-420, Prague.
75. Sanderson, Mark. 1994. Word Sense Disambiguation and Information Retrieval. In Proceedings of the 17th Annual International ACM-SIGIR Conference on Research and Development in Information Retrieval, 142-151, Dublin.
76. Sanderson, Mark. 2000. Retrieving with good sense. Information Retrieval, 2(1):49-69.
77. Sanderson, Mark. 2008. Ambiguous queries: Test collections need more sense. In Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 499-506, Singapore.
78. Santamaŕi{dotless}a, Celina, Julio Gonzalo, and Javier Artiles. 2010. Wikipedia as sense inventory to improve diversity in Web search results. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistie, ACL 2010, 1,357-1,366, Uppsala.
79. Schütze, Hinrich. 1992. Dimensions of meaning. In Proceedings of the 1992 ACM/IEEE Conference on Supercomputing, 787-796, Los Alamitos, CA.
80. Agirre, Eneko, David Martínez, Oier López de Lacalle, and Aitor Soroa. 1998. Automatic word sense discrimination. Computational Linguistics, 24(1):97-124.
81. Schütze, Hinrich and Jan Pedersen. 1995. Information Retrieval based on word senses. In Proceedings of SDAIR'95, 161-175, Las Vegas, NV.
82. Silberer, Carina and Mirella Lapata. 2012. Grounded models of semantic representation. In Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, 1,423-1,433, Jeju Island.
83. Smadja, Frank, Kathleen R. McKeown, and Vasileios Hatzivassiloglou. 1996. Translating collocations for bilingual lexicons: A statistical approach. Computational Linguistics, 22(1):1-38.
84. Song, Ruihua, Zhenxiao Luo, Jian-Yun Nie, Yong Yu, and Hsiao-Wuen Hon. 2009. Identification of ambiguous queries in Web search. Information Processing and Management, 45:216-229.
85. Steinley, Doug. 2004. Properties of the Hubert-Arabie adjusted Rand index. Psychological Methods, 9(3):386-396.
86. Stokoe, Christopher, Michael J. Oakes, and John I. Tait. 2003. Word Sense Disambiguation in Information Retrieval revisited. In Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 159-166, Toronto.
87. Swaminathan, Ashwin, Cherian V. Mathew, and Darko Kirovski. 2009. Essential pages. In Proceedings of 2009 IEEE/WIC/ACM International Conference on Web Intelligence, 173-182, Milan.
88. Udani, Goldee, Shachi Dave, Anthony Davis, and Tim Sibley. 2005. Noun sense induction using Web search results. In Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 657-658, Salvador.
89. Van de Cruys, Timand Marianna Apidianaki. 2011. Latent semantic word sense induction and disambiguation. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, 1,476-1,485, Portland, OR.
90. van Rijsbergen, C. J. 1979. Information Retrieval, second edition. Butterworths, London.
91. Veronis, Jean. 2004. HyperLex: Lexical cartography for information retrieval. Computer, Speech and Language, 18(3):223-252.
92. von Luxburg, Ulrike, Robert C. Williamson, and Isabelle Guyon. 2012. Clustering: Science or art? Journal of Machine Learning Research-Proceedings Track, 27:65-80.
93. Voorhees, Ellen M. 1993. Using WordNet to disambiguate word senses for text retrieval. In Proceedings of the 16th Annual International ACM-SIGIR Conference on Research and Development in Information Retrieval, 171-180, Pittsburgh, PA.
94. Wang, Xuanhui, Deepayan Chakrabarti, and Kunal Punera. 2009. Mining broad latent query aspects from search sessions. In Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 867-876, Paris.
95. Wang, Xuanhui and ChengXiang Zhai. 2007. Learn from Web search logs to organize search results. In Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 87-94, Amsterdam.
96. Widdows, Dominic and Beate Dorow. 2002. A graph model for unsupervised lexical acquisition. In Proceedings of the 19th International Conference on Computational Linguistics, 1-7, Taipei.
97. Wu, Fei, Jayant Madhavan, and Alon Y. Halevy. 2011. Identifying aspects for Web-search queries. Journal of Artificial Intelligence Research (JAIR), 40:677-700.
98. Xue, Gui-Rong, Dikan Xing, Qiang Yang, and Yong Yu. 2008. Deep classification in large-scale text hierarchies. In Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 619-626, Singapore.
99. Xue, Xiaobing and Xiaoxin Yin. 2011. Topic modeling for named entity queries. In Proceedings of the 20th ACM International Conference on Information and Knowledge Management, 2009-2012, New York.
100. Yarowsky, David. 1993. One sense per collocation. In Proceedings of the ARPA Workshop on Human Language Technology, 266-271, Princeton, NJ.
101. Zamir, Oren and Oren Etzioni. 1998. Web document clustering: A feasibility demonstration. In Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 46-54 Melbourne.
102. Zamir, Oren, Oren Etzioni, Omid Madani, and Richard M. Karp. 1997. Fast and intuitive clustering of Web documents. In Proceedings of the Third International Conference on Knowledge Discovery and Data Mining, 287-290 Newport Beach, CA.
103. Zeng, Hua-Jun, Qi-Cai He, Zheng Chen, Wei-Ying Ma, and Jinwen Ma. 2004. Learning to cluster Web search results. In Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 210-217, Sheffield.
104. Zhai, Cheng Xiang, William W. Cohen, and John Lafferty. 2003. Beyond independent relevance: Methods and evaluation metrics for subtopic retrieval. In Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 10-17, Toronto.
105. Zhang, Benyu, Hua Li, Yi Liu, Lei Ji, Wensi Xi, Weiguo Fan, Zheng Chen, and Wei-Ying Ma. 2005. Improving Web search results using affinity graph. In Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2005, 504-511, Salvador.
106. Zhang, Xiaodan, Xiaohua Hu, and Xiaohua Zhou. 2008. A comparative evaluation of different link types on enhancing document clustering. In Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 555-562, Singapore.
107. Zhao, Ying and George Karypis. 2004. Empirical and theoretical comparisons of selected criterion functions for document clustering. Machine Learning, 55(3):311-331.