Computing text semantic relatedness using the contents and links of a hypertext encyclopedia

Artificial Intelligence

Volumn 194, Issue , 2013, Pages 176-202

  Yazdani, Majid ^a,b   Popescu Belis, Andrei ^a  

^a IDIAP RESEARCH INSTITUTE   (Switzerland)

^b EPFL   (Switzerland)

Author keywords

Distance metric learning; Document clustering; Information retrieval; Learning to rank; Random walk; Text classification; Text semantic relatedness; Text similarity; Word similarity

Indexed keywords

DISTANCE METRIC LEARNING; DOCUMENT CLUSTERING; LEARNING TO RANK; RANDOM WALK; SEMANTIC RELATEDNESS; TEXT CLASSIFICATION; TEXT SIMILARITY; WORD SIMILARITY;

APPROXIMATION ALGORITHMS; CLASSIFICATION (OF INFORMATION); INFORMATION RETRIEVAL; INFORMATION RETRIEVAL SYSTEMS; NATURAL LANGUAGE PROCESSING SYSTEMS; RANDOM PROCESSES;

HYPERTEXT SYSTEMS;

EID: 84870301800     PISSN: 00043702     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.artint.2012.06.004     Document Type: Article

References (88)

1. A. Budanitsky, and G. Hirst Evaluating WordNet-based measures of semantic distance Computational Linguistics 32 2006 13 47 (Pubitemid 43764024)
2. S. Patwardhan, S. Banerjee, T. Pedersen, Using measures of semantic relatedness for word sense disambiguation, in: Proceedings of CICLing 2003 (4th International Conference on Computational Linguistics and Intelligent Text Processing), in: LNCS, vol. 2588, Mexico City, Mexico, pp. 241-257.
3. U.S. Kohomban, W.S. Lee, Learning semantic classes for word sense disambiguation, in: Proceedings of ACL 2005 (43rd Annual Meeting of the Association for Computational Linguistics), Ann Arbor, MI, pp. 34-41.
4. S.P. Ponzetto, and M. Strube Knowledge derived from Wikipedia for computing semantic relatedness Journal of Artificial Intelligence Research 30 2007 181 212
5. M. Stevenson, M. Greenwood, A semantic approach to IE pattern induction, in: Proceedings of ACL 2005 (43rd Annual Meeting of the Association for Computational Linguistics), Ann Arbor, MI, pp. 379-386.
6. M. Baziz, M. Boughanem, N. Aussenac-Gilles, C. Chrisment, Semantic cores for representing documents in IR, in: Proceedings of SAC 2005 (ACM Symposium on Applied Computing), Santa Fe, NM, pp. 1011-1017.
7. D. Newman, J.H. Lau, K. Grieser, T. Baldwin, Automatic evaluation of topic coherence, in: Proceedings of HLT-NAACL 2010 (Annual Conference of the North American Chapter of the Association for Computational Linguistics), Los Angeles, CA, pp. 100-108,.
8. P. Resnik, Using information content to evaluate semantic similarity in a taxonomy, in: Proceedings of IJCAI 1995 (14th International Joint Conference on Artificial Intelligence), Montreal, pp. 448-453.
9. C. Fellbaum WordNet: An Electronic Lexical Database 1998 The MIT Press Cambridge, MA
10. D.B. Lenat CYC: A large-scale investment in knowledge infrastructure Communications of the ACM 38 1995 33 38
11. M. Jarmasz, Rogets Thesaurus as a lexical resource for natural language processing, Masters thesis, University of Ottawa, 2003.
12. J. Morris, G. Hirst, Non-classical lexical semantic relations, in: Proceedings of the HLT-NAACL 2006 Workshop on Computational Lexical Semantics, Boston, MA, pp. 46-51.
13. M. Halliday, and R. Hasan Cohesion in English 1976 Longman London
14. J. Hobbs Why is discourse coherent? F. Neubauer, Coherence in Natural Language Texts 1983 Buske Hamburg 29 70
15. R. Hasan Coherence and cohesive harmony J. Flood, Understanding Reading Comprehension: Cognition, Language and the Structure of Prose 1984 International Reading Association Newark, DE 181 219
16. M. Halliday, and R. Hasan Language, Context, and Text: Aspects of Language in a Social-Semiotic Perspective 2nd edition 1989 Oxford University Press London
17. S. Mohammad, and G. Hirst Distributional measures as proxies for semantic distance: A survey available online (consulted on April 15, 2012) at http://www.cs.toronto.edu/pub/gh/Mohammad+Hirst-2005.pdf 2005
18. J.E. Weeds, Measures and applications of lexical distributional similarity, PhD thesis, University of Sussex, 2003.
19. S. Deerwester, S.T. Dumais, G.W. Furnas, T.K. Landauer, and R. Harshman Indexing by latent semantic analysis Journal of the American Society for Information Science 41 1990 391 407
20. S. Padó, and M. Lapata Dependency-based construction of semantic space models Computational Linguistics 33 2007 161 199
21. T. Hofmann, Probabilistic latent semantic indexing, in: Proceedings of SIGIR 1999 (22nd ACM SIGIR Conference on Research and Development in Information Retrieval), Berkeley, CA, pp. 50-57.
22. D.M. Blei, A.Y. Ng, and M.I. Jordan Latent Dirichlet allocation Journal of Machine Learning Research 3 2003 993 1022
23. M. Jarmasz, S. Szpakowicz, Rogets thesaurus and semantic similarity, in: Proceedings of RANLP 2003 (Conference on Recent Advances in Natural Language Processing), Borovetz, Bulgaria, pp. 111-120.
24. R. Rada, H. Mili, E. Bicknell, and M. Blettner Development and application of a metric to semantic nets IEEE Transactions on Systems, Man and Cybernetics 19 1989 17 30
25. C. Leacock, and M. Chodorow Combining local context and WordNet similarity for word sense identification C. Fellbaum, WordNet: An Electronic Lexical Database 1998 The MIT Press Cambridge, MA 265 283
26. P. Resnik Semantic similarity in a taxonomy: An information-based measure and its application to problems of ambiguity in natural language Journal of Artificial Intelligence Research 11 1999 95 130 (Pubitemid 129628761)
27. D. Lin, An information-theoretic definition of similarity, in: Proceedings of ICML 1998 (15th International Conference on Machine Learning), Madison, WI, pp. 296-304.
28. J.-C. Chappelier Topic-based generative models for text information access E. Gaussier, F. Yvon, Textual Information Access: Statistical Models 2012 ISTE/Wiley London, UK 129 178
29. J. Chang, J. Boyd-Graber, S. Gerrish, C. Wang, and D.M. Blei Reading tea leaves: How humans interpret topic models Y. Bengio, D. Schuurmans, J. Lafferty, C.K.I. Williams, A. Culotta, Advances in Neural Information Processing Systems vol. 22 2009 The MIT Press Cambridge, MA 288 296
30. R. Mihalcea, C. Corley, C. Strapparava, Corpus-based and knowledge-based measures of text semantic similarity, in: Proceedings of AAAI 2006 (21st National Conference on Artificial Intelligence), Boston, MA, pp. 775-782.
31. T. Hughes, D. Ramage, Lexical semantic relatedness with random graph walks, in: Proceedings of EMNLP-CoNLL 2007 (Conference on Empirical Methods in Natural Language Processing and Conference on Computational Natural Language Learning), Prague, Czech Republic, pp. 581-589.
32. T.H. Haveliwala Topic-sensitive PageRank: A context-sensitive ranking algorithm for web search IEEE Transactions on Knowledge and Data Engineering 15 2003 784 796
33. C. Bizer, J. Lehmann, G. Kobilarov, S. Auer, C. Becker, R. Cyganiak, and S. Hellmann DBpedia - A crystallization point for the web of data Journal of Web Semantics 7 2009 154 165
34. R. Navigli, S.P. Ponzetto, BabelNet: Building a very large multilingual semantic network, in: Proceedings of ACL 2010 (48th Annual Meeting of the Association for Computational Linguistics), Uppsala, Sweden, pp. 216-225.
35. V. Nastase, M. Strube, B. Boerschinger, C. Zirn, A. Elghafari, WikiNet: A very large scale multi-lingual concept network, in: Proceedings of LREC 2010 (7th International Conference on Language Resources and Evaluation), Valletta, Malta.
36. F. Suchanek, G. Kasneci, and G. Weikum Yago: A large ontology from Wikipedia and WordNet Journal of Web Semantics 6 2008 203 217
37. M. Strube, S.P. Ponzetto, WikiRelate! Computing semantic relatedness using Wikipedia, in: Proceedings of AAAI 2006 (21st National Conference on Artificial Intelligence), Boston, MA, pp. 1419-1424.
38. S.P. Ponzetto, and M. Strube Taxonomy induction based on a collaboratively built knowledge repository Artificial Intelligence 175 2011 1737 1756
39. D. Milne, I.H. Witten, An effective, low-cost measure of semantic relatedness obtained from Wikipedia links, in: Proceedings of WIKIAI 2008 (1st AAAI Workshop on Wikipedia and Artificial Intelligence), Chicago, IL, pp. 25-30.
40. Z.S. Syed, T. Finin, A. Joshi, Wikipedia as an ontology for describing documents, in: Proceedings of the Second International Conference on Weblogs and Social, Media, Seattle, WA, pp. 136-144.
41. D. Milne, I.H. Witten, Learning to link with Wikipedia, in: Proceedings of CIKM 2008 (17th ACM Conference on Information and Knowledge Management), Napa Valley, CA, pp. 509-518.
42. K. Coursey, R. Mihalcea, W. Moen, Using encyclopedic knowledge for automatic topic identification, in: Proceedings of CoNLL 2009 (13th Conference on Computational Natural Language Learning), Boulder, CO, pp. 210-218.
43. R. Mihalcea, A. Csomai, Wikify!: Linking documents to encyclopedic knowledge, in: Proceedings of ACM CIKM 2007 (16th ACM Conference on Information and Knowledge Management), Lisbon, Portugal, pp. 233-242.
44. D. Ramage, A.N. Rafferty, C.D. Manning, Random walks for text semantic similarity, in: Proceedings of TextGraphs-4 (4th Workshop on Graph-Based Methods for Natural Language Processing), Singapore, pp. 23-31.
45. M. Yazdani, A. Popescu-Belis, A random walk framework to compute textual semantic similarity: a unified model for three benchmark tasks, in: Proceedings of IEEE ICSC 2010 (4th IEEE International Conference on Semantic Computing), Pittsburgh, PA, pp. 424-429.
46. E. Gabrilovich, S. Markovitch, Computing semantic relatedness using Wikipedia-based explicit semantic analysis, in: Proceedings of IJCAI 2007 (20th International Joint Conference on Artificial Intelligence), Hyderabad, India, pp. 6-12.
47. E. Gabrilovich, and S. Markovitch Wikipedia-based semantic interpretation for natural language processing Journal of Artificial Intelligence Research 34 2009 443 498
48. S. Hassan, R. Mihalcea, Cross-lingual semantic relatedness using encyclopedic knowledge, in: Proceedings of EMNLP 2009 (Conference on Empirical Methods in Natural Language Processing), Singapore, pp. 1192-1201.
49. T. Zesch, C. Müller, I. Gurevych, Using Wiktionary for computing semantic relatedness, Proceedings of AAAI 2008 (23rd National Conference on Artificial Intelligence), vol. 2, Chicago, IL, pp. 861-866.
50. P. Cimiano, A. Schultz, S. Sizov, P. Sorg, S. Staab, Explicit vs. latent concept models for cross-language information retrieval, in: Proceedings of IJCAI 2009 (21st International Joint Conference on Artificial Intelligence), Pasadena, CA, pp. 1513-1518.
51. E. Yeh, D. Ramage, C.D. Manning, E. Agirre, A. Soroa, WikiWalk: random walks on Wikipedia for semantic relatedness, in: Proceedings of TextGraphs-4 (4th Workshop on Graph-Based Methods for Natural Language Processing), Singapore, pp. 41-49.
52. E. Agirre, A. Soroa, Personalizing PageRank for word sense disambiguation, in: Proceedings of EACL 2009 (12th Conference of the European Chapter of the Association for Computational Linguistics), Athens, Greece, pp. 33-41.
53. P. Turney, Mining the web for synonyms: PMI-IR versus LSA on TOEFL, in: Proceedings of ECML 2001 (12th European Conference on Machine Learning), Freiburg, Germany, pp. 491-502.
54. P. Berkhin A survey on PageRank computing Internet Mathematics 2 2005 73 120
55. R. Navigli, and M. Lapata An experimental study of graph connectivity for unsupervised word sense disambiguation IEEE Transactions on Pattern Analysis and Machine Intelligence 32 2010 678 692
56. R. Ion, D. Ştefǎnescu, Unsupervised word sense disambiguation with lexical chains and graph-based context formalization, in: Proceedings of LTC 2009 (4th Language and Technology Conference), in: LNAI, vol. 6562, Poznan, Poland, pp. 435-443.
57. R. Navigli A structural approach to the automatic adjudication of word sense disagreements Natural Language Engineering 14 2008 547 573
58. M. Saerens, F. Fouss, L. Yen, P. Dupont, The principal components analysis of a graph, and its relationships to spectral clustering, in: Proceedings of ECML 2004 (15th European Conference on Machine Learning), Pisa, Italy, pp. 371-383.
59. M. Brand, A random walks perspective on maximizing satisfaction and profit, in: Proceedings of the 2005 SIAM International Conference on Data Mining, Newport Beach, CA, pp. 12-19.
60. D. Liben-Nowell, J. Kleinberg, The link prediction problem for social networks, in: Proceedings of CIKM 2003 (12th ACM International Conference on Information and Knowledge Management), New Orleans, LA, pp. 556-559.
61. Q. Mei, D. Zhou, K. Church, Query suggestion using hitting time, in: Proceeding of CIKM 2008 (17th ACM International Conference on Information and Knowledge Management), Napa Valley, CA, pp. 469-478.
62. P. Sarkar, A. Moore, A tractable approach to finding closest truncated-commute-time neighbors in large graphs, in: Proceedings of UAI 2007 (23rd Conference on Uncertainty in Artificial Intelligence), Vancouver, BC, pp. 335-343.
63. Metaweb Technologies Freebase Wikipedia Extraction (WEX) http://download.freebase.com/wex/ 2010
64. V. Grishchenko Wikipedia as an ant-hill, web page consulted on April 15, 2012 http://no-gritzko-here.livejournal.com/22900.html 2008
65. D.J. Watts, and S.H. Strogatz Collective dynamics of 'small-world' networks Nature 393 1998 440 442 (Pubitemid 28292183)
66. T. Opsahl, and P. Panzarasa Clustering in weighted networks Social Networks 31 2009 155 163
67. D. Bollegala, Y. Matsuo, M. Ishizuka, Measuring semantic similarity between words using web search engines, in: Proceedings of WWW 2007 (16th International Conference on World Wide Web), Banff, Alberta, pp. 757-766.
68. E. Agirre, E. Alfonseca, K. Hall, J. Kravalova, M. Paşca, A. Soroa, A study on similarity and relatedness using distributional and WordNet-based approaches, in: Proceedings of HLT-NAACL 2009 (Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics), Boulder, CO, pp. 19-27.
69. H. Rubenstein, and J.B. Goodenough Contextual correlates of synonymy Communications of the ACM 8 1965 627 633
70. G.A. Miller, and W.G. Charles Contextual correlates of semantic similarity Language and Cognitive Processes 6 1991 1 28
71. L. Finkelstein, E. Gabrilovich, Y. Matias, E. Rivlin, Z. Solan, G. Wolfman, and E. Ruppin Placing search in context: The concept revisited ACM Transactions on Information Systems (TOIS) 20 2002 116 131 (Pubitemid 44642309)
72. Z. Wu, M. Palmer, Verb semantics and lexical selection, in: Proceedings of ACL 1994 (32nd Annual Meeting of Association for Computational Linguistics), Las Cruces, NM, pp. 133-138.
73. S. Patwardhan, T. Pedersen, Using WordNet-based context vectors to estimate the semantic relatedness of concepts, in: Proceedings of the EACL 2006 Workshop on Making Sense of Sense, Trento, Italy, pp. 1-8.
74. M.A. Alvarez, S.J. Lim, A graph modeling of semantic similarity between words, in: Proceedings of ICSC 2007 (1st International Conference on Semantic Computing), Irvine, CA, pp. 355-362.
75. M.D. Lee, B. Pincombe, M. Welsh, An empirical evaluation of models of text document similarity, in: Proceedings of CogSci 2005 (27th Annual Conference of the Cognitive Science Society), Stresa, Italy, pp. 1254-1259.
76. S. Hassan, R. Mihalcea, Semantic relatedness using salient semantic analysis, in: Proceedings of AAAI 2011 (25th AAAI Conference on Artificial Intelligence), San Francisco, CA, pp. 884-889.
77. T.M. Mitchell Machine Learning 1997 McGraw-Hill New York, NY
78. X. Hu, X. Zhang, C. Lu, E. Park, X. Zhou, Exploiting Wikipedia as external knowledge for document clustering, in: Proceedings of KDD 2009 (15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining), Paris, France, pp. 389-396.
79. G. Bordogna, G. Pasi, Hierarchical-hyperspherical divisive fuzzy C-means (H2D-FCM) clustering for information retrieval, in: Proceedings of WI-IAT 2009 (IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology), vol. 1, Milan, Italy, pp. 614-621.
80. K. Weinberger, J. Blitzer, and L. Saul Distance metric learning for large margin nearest neighbor classification Y. Weiss, B. Schölkopf, J. Platt, Advances in Neural Information Processing Systems vol. 18 2006 The MIT Press Cambridge, MA 1473 1480
81. C.-C. Chang, and C.-J. Lin LIBSVM: A library for support vector machines ACM Transactions on Intelligent Systems and Technology 2 2011 article n. 27
82. M. Ranzato, M. Szummer, Semi-supervised learning of compact document representations with deep networks, in: Proceedings of ICML 2008 (25th International Conference on Machine Learning), Helsinki, Finland, pp. 792-799.
83. E.M. Voorhees, D. Harman, Overview of the Eighth Text REtrieval Conference (TREC-8), in: Proceedings of TREC-8, Gaithersburg, MD, pp. 1-24.
84. O. Egozi, S. Markovitch, and E. Gabrilovich Concept-based information retrieval using explicit semantic analysis ACM Transactions on Information Systems (TOIS) 29 2011 article n. 8
85. H. Li Learning to Rank for Information Retrieval and Natural Language Processing 2011 Morgan and Claypool San Rafael, CA
86. W.-T. Yih, K. Toutanova, J.C. Platt, C. Meek, Learning discriminative projections for text similarity measures, in: Proceedings of CoNLL 2011 (15th Conference on Computational Natural Language Learning), Portland, OR, pp. 247-256.
87. K. Collins-Thompson, J. Callan, Query expansion using random walk models, in: Proceedings of CIKM 2005 (14th ACM Conference on Information and Knowledge Management), Bremen, Germany, pp. 704-711.
88. P. Sarkar, A.W. Moore, A. Prakash, Fast incremental proximity search in large graphs, in: Proceedings of ICML 2008 (25th International Conference on Machine Learning), Helsinki, Finland, pp. 896-903.