Text relatedness based on aword thesaurus

Journal of Artificial Intelligence Research

Volumn 37, Issue , 2010, Pages 1-39

  Tsatsaronis, George ^a   Varlamis, Iraklis ^b   Vazirgiannis, Michalis ^c  

^a NORWEGIAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Norway)

^b HAROKOPIO UNIVERSITY   (Greece)

^c ATHENS UNIVERSITY OF ECONOMICS AND BUSINESS   (Greece)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION AND CLUSTERING; DATA SETS; EXPERIMENTAL EVALUATION; HYBRID APPROACH; IMPLICIT SEMANTICS; NEW APPROACHES; SEMANTIC RELATEDNESS; SENTENCE SIMILARITY; TEXT RETRIEVAL; TEXT SEGMENTS; WORD SIMILARITY;

CHARACTER RECOGNITION; TEXT PROCESSING; THESAURI;

SEMANTICS;

EID: 77952719619     PISSN: None     EISSN: 10769757     Source Type: Journal    
DOI: 10.1613/jair.2880     Document Type: Article

References (98)

1. Agirre, E., Alfonseca, E., Hall, K., Kravalova, J., Pasca, M., & Soroa, A. (2009). A study on similarity and relatedness using distributional and wordnet-based approaches.. In Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), pp. 19-27.
2. Agirre, E., & Rigau, G. (1995). A proposal for word sense disambiguation using conceptual distance. In Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP).
3. Agresti, A. (1990). Categorical Data Analysis. Wiley, Hoboken, NJ.
4. Aizawa, A. (2003). An information-theoretic perspective of TF-IDF measures. Information Processing and Management, 39(1), 45-65.
5. Banerjee, S., & Pedersen, T. (2003). Extended gloss overlaps as a measure of semantic relatedness. In Proceedings of the Eighteenth International Joint Conference on Artificial Intelligence (IJCAI), pp. 805-810.
6. Barzilay, R., & Elhadad, M. (1997). Using lexical chains for text summarization. In Proceedings of the ACL 97/EACL 97 Workshop on Intelligent Scalable Text Summarization, pp. 10-17.
7. Barzilay, R., Elhadad, M., & McKeown, K. (2002). Inferring strategies for sentence ordering in multidocument news summarization. Journal of Artificial Intelligence Research, 17, 35-55.
8. Basili, R., Cammisa, M., & Moschitti, A. (2005). A semantic kernel to exploit linguistic knowledge. In Proceedings of Advances in Artificial Intelligence, Ninth Congress of the Italian Association for Artificial Intelligence (AI*IA), pp. 290-302.
9. Bicici, E., & Yuret, D. (2006). Clustering word pairs to answer analogy questions. In Proceedings of the Fifteenth Turkish Symposium on Artificial Intelligence and Neural Networks.
10. Bollegala, D., Matsuo, Y., & Ishizuka, M. (2008). WWW sits the sat: Measuring relational similarity from the web. In Proceedings of the Eighteenth European Conference on Artificial Intelligence (ECAI), pp. 333-337.
11. Budanitsky, A., & Hirst, G. (2006). Evaluating wordnet-based measures of lexical semantic relatedness. Computational Linguistics, 32(1), 13-47.
12. Clough, P., & Stevenson, M. (2004). Cross-language information retrieval using EuroWordNet and word sense disambiguation. In Proceedings of the Twenty Sixth European Conference on Information Retrieval (ECIR), pp. 327-337.
13. Cormen, T., Leiserson, C., & Rivest, R. (1990). Introduction to Algorithms. The MIT Press.
14. Dolan,W., Quirk, C., &Brockett, C. (2004). Unsupervised construction of large paraphrase corpora: Exploiting massively parallel news sources. In Proceedings of the Twentieth International Conference on Computational Linguistics (COLING).
15. Fellbaum, C. (1998). WordNet - an electronic lexical database. MIT Press.
16. Finch, A., Hwang, Y., & Sumita, E. (2005). Using machine translation evaluation techniques to determine sentence-level semantic equivalence. In Proceedings of the 3rd International Workshop on Paraphrasing,.
17. Finkelstein, L., Gabrilovich, E.,Matias, Y., Rivlin, E., Solan, Z.,Wolfman, G., & Ruppin, E. (2002). Placing search in context: The concept revisited. ACM Transactions on Information Systems, 20(1), 116-131.
18. Fisher, R. (1915). Frequency distribution of the values of the correlation coefficient in samples of an indefinitely large population. Biometrika, 10, 507-521.
19. Gabrilovich, E., & Markovitch, R. (2007). Computing semantic relatedness using Wikipedia-based explicit semantic analysis. In Proceedings of the Twentieth International Joint Conference on Artificial Intelligence (IJCAI), pp. 1606-1611.
20. Gabrilovich, E., & Markovitch, R. (2009). Wikipedia-based semantic interpretation for natural language processing. Journal of Artificial Intelligence Research, 34, 443-498.
21. Gentner, D. (1983). Structure-mapping: A theoretical framework for analogy. Cognitive Science, 7(2), 155-170.
22. Guyon, I., Gunn, S., Nikravesh, M., & Zadeh, L. (2006). Feature Extraction, Foundations and Applications. Springer.
23. Harabagiu, S., & Hickl, A. (2006). Methods for using textual entailment in open-domain question answering.. In Proceedings of the Joint Conference of the International Committee on Computational Linguistics and the Association for Computational Linguistics (COLING-ACL), pp. 905-912.
24. Hirao, T., Fukusima, T., Okumura, M., Nobata, C., & Nanba, H. (2005). Corpus and evaluation measures for multiple document summarization with multiple sources. In Proceedings of the Twentieth International Conference on Computational Linguistics (COLING), pp. 535-541.
25. Hirst, G., & St-Onge, D. (1998). Lexical chains as representations of context for the detection and correction of malapropisms. In WordNet: An Electronic Lexical Database, chapter 13, pp. 305-332 Cambridge. The MIT Press.
26. Hughes, T., & Ramage, D. (2007). Lexical semantic relatedness with random graph walks. In Proceedings of the Conference on EmpiricalMethods in Natural Language Processing (EMNLP), pp. 581-589.
27. Ide, N., & Veronis, J. (1998). Word Sense Disambiguation: The State of the Art. Computational Linguistics, 24(1), 1-40.
28. Islam, A., & Inkpen, D. (2008). Semantic text similarity using corpus-based word similarity and string similarity. ACM Transactions on Knowledge Discovery from Data, 2(2), 1-25.
29. Jaccard, P. (1901). Étude comparative de la distribution florale dans une portion des alpes et des jura.. Bulletin del la Société Vaudoise des Sciences Naturelles, 37, 547-579.
30. Jarmasz, M. (2003). Roget's thesaurus and semantic similarity. Master's Thesis, University of Ottawa.
31. Jarmasz,M., & Szpakowicz, S. (2003). Roget's thesaurus and semantic similarity. In Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP), pp. 212-219.
32. Jiang, J., & Conrath, D. (1997). Semantic similarity based on corpus statistics and lexical taxonomy. In Proceedings of the International Conference Research on Computational Linguistics (ROCLING X), pp. 19-33.
33. Kucera, H., Francis, W., & Caroll, J. (1967). Computational Analysis of Present Day American English. Brown University Press.
34. Landauer, T., & Dumais, S. (1997). A solution to Plato's problem: The latent semantic analysis theory of the acquisition, induction, and representation of knowledge. Psychological Review, 104(2), 211-240.
35. Landauer, T., Foltz, P., & Laham, D. (1998). Introduction to latent semantc analysis. Discourse Processes, 25, 259-284.
36. Leacock, C., Miller, G., & Chodorow, M. (1998). Using corpus statistics andWordNet relations for sense identification. Computational Linguistics, 24(1), 147-165.
37. Lesk, M. (1986). Automated sense disambiguation using machine-readable dictionaries: How to tell a pine cone from an ice cream cone. In Proceedings of the Fifth Annual International Conference on Systems Documentation (SIGDOC), pp. 24-26.
38. Li, P. (2008). Estimators and tail bounds for dimension reduction in lα (0 < α ≤ 2) using stable random projections. In Proceedings of the Nineteenth Annual ACM-SIAM Symposium on Discrete Algorithms (SODA), pp. 10-19.
39. Li, Y., McLean, D., Bandar, Z., O'Shea, J., & Crockett, K. (2006). Sentence similarity based on semantic nets and corpus statistics. IEEE Transactions on Knowledge and Data Engineering, 18(8), 1138-1150.
40. Lin, D. (1998). An information-theoretic definition of similarity. In Proceedings of the Fifteenth International Conference on Machine Learning (ICML), pp. 296-304.
41. Madnani, N., Zajic, D., Dorr, B., Fazil Ayan, N., & Lin, J. (2007). Multiple alternative sentence compressions for automatic text summarization. In Proceedings of the HLT/NAACL Document Understanding Conference (DUC).
42. Matveeva, I., Levow, G., Farahat, A., & Royer, C. (2005). Generalized latent semantic analysis for term representation. In Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP).
43. Mavroeidis, D., Tsatsaronis, G., Vazirgiannis,M., Theobald,M., &Weikum, G. (2005). Word sense disambiguation for exploiting hierarchical thesauri in text classification. In Proceedings of the Ninth European Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD), pp. 181-192.
44. Mihalcea, R., Corley, C., & Strapparava, C. (2006). Corpus-based and knowledge-based measures of text semantic similarity. In Proceedings of the Twenty First Conference on Artificial Intelligence (AAAI), pp. 775-780.
45. Mihalcea, R., & Moldovan, D. (1999). A method for word sense disambiguation of unrestricted text. In Proceedings of the 37th annual meeting of the Association for Computational Linguistics (ACL), pp. 152-158.
46. Mihalcea, R., Tarau, P., & Figa, E. (2004). PageRank on semantic networks with application to word sense disambiguation. In Proceedings of the Twentieth International Conference on Computational Linguistics (COLING).
47. Miller, G., & Charles, W. (1991). Contextual correlates of semantic similarity. Language and Cognitive Processes, 6(1), 1-28.
48. Milne, D., & Witten, I. (2008). An effective, low-cost measure of semantic relatedness obtained from Wikipedia links. In Proceedings of the first AAAI Workshop on Wikipedia and Artificial Intelligence (WIKIAI).
49. Morris, J., & Hirst, G. (1991). Lexical cohesion computed by thesaural relations as an indicator of the structure of text. Computational Linguistics, 17, 21-48.
50. Navigli, R. (2008). A structural approach to the automatic adjudication of word sense disagreements. Natural Language Engineering, 14(4), 547-573.
51. O'Shea, J., Bandar, Z., Crocket, K., & McLean, D. (2008). A comparative study of two short text semantic similarity measures. In Proceedings of the Agent and Multi-Agent Systems: Technologies and Applications, Second KES International Symposium (KES-AMSTA), pp. 172-181.
52. Pado, S., & Lapata, M. (2007). Dependency-based construction of semantic space models. Computational Linguistics, 33(2), 161-199.
53. Palmer, M., Fellbaum, C., & Cotton, S. (2001). English tasks: All-words and verb lexical sample. In Proceedings of Senseval-2, pp. 21-24.
54. Pasca, M. (2003). Open-domain question answering from large text collections. In CSLI Studies in Computational Linguistics. CSLI Publications, Distributed by the University of Chicago Press.
55. Pasca, M. (2005). Mining paraphrases from self-anchored web sentence fragments. In Proceedings of the Ninth European Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD), pp. 193-204.
56. Patwardhan, S., Banerjee, S., & Pedersen, T. (2003). Using measures of semantic relatedness for word sense disambiguation. In Proceedings of the Fourth International Conference on Intelligent Text Processing and Computational Linguistics (CICLing), pp. 241-257.
57. Patwardhan, S., & Pedersen, T. (2006). Using WordNet based context vectors to estimate the semantic relatedness of concepts. In Proceedings of the EACL 2006 Workshop Making Sense of Sense - Bringing Computational Linguistics and Psycholinguistics Together, pp. 1-8.
58. Ponzetto, S., & Strube, M. (2007a). Knowledge derived from Wikipedia for computing semantic relatedness. Journal of Artificial Intelligence Research, 30, 181-212.
59. Ponzetto, S., & Strube, M. (2007b). Deriving a large-scale taxonomy from Wikipedia. In Proceedings of the Twenty Second Conference on Artificial Intelligence (AAAI), pp. 1440-1445.
60. Qiu, L., Kan, M., & Chua, T. (2006). Paraphrase recognition via dissimilarity significance classification. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 18-26.
61. Quilian, R. (1969). The teachable language comprehender: a simulation program and theory of language. Communications of ACM, 12(8), 459-476.
62. Resnik, P. (1995). Using information content to evaluate semantic similarity. In Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence (IJCAI), pp. 448-453.
63. Resnik, P. (1999). Semantic similarity in a taxonomy: An information-based measure and its application to problems of ambiguity in natural language. Journal of Artificial Intelligence Research, 11, 95-130.
64. Richardson, R., & Smeaton, A. (1995). Using WordNet in a knowledge-based approach to information retrieval. In Proceedings of the BCS-IRSG Colloquium.
65. Rubenstein, H., & Goodenough, J. (1965). Contextual correlates of synonymy. Communications of the ACM, 8(10), 627-633.
66. Ruiz-Casado, M., Alfonseca, E., & Castells, P. (2005). Using context-window overlapping in synonym discovery and ontology extension. In Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP).
67. Salton, G., Buckley, C., & Yu, C. (1982). An evaluation of term dependence models in information retrieval. In Proceedings of the Fifth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 151-173.
68. Salton, G., & McGill, M. (1983). Introduction to Modern Information Retrieval. McGraw-Hill.
69. Sanderson, M. (1994). Word sense disambiguation and information retrieval. In Proceedings of the Seventeenth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 142-151.
70. Sanderson, M. (2008). Ambiguous queries: Test collections need more sense. In Proceedings of the Thirty First Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 499-506.
71. Shinyama, Y., & Sekine, S. (2003). Paraphrase acquisition for information extraction. In Proceedings of the ACL 2nd Workshop on Paraphrasing: Paraphrase Acquisition and Applications, pp. 65-71.
72. Sinclair, J. (2001). Collins Cobuild English Dictionary for Advanced Learners, 3rd edn. Harper Collins, New York.
73. Smeaton, A., Kelledy, F., & O'Donnell, R. (1995). TREC-4 experiments at Dublin City University: Thresholding posting lists, query expansion with WordNet and POS tagging of Spanish. In Proceedings of the Fourth Text REtrieval Conference (TREC).
74. Snyder, B., & Palmer, M. (2004). The English All-words task. In Proceedings of Senseval-3, pp. 41-43.
75. Song, Y., Han, K., & Rim, H. (2004). A term weighting method based on lexical chain for automatic summarization. In Proceedings of the Fifth International Conference on Intelligent Text Processing and Computational Linguistics (CICLing), pp. 636-639.
76. Stokoe, C., Oakes, M., & Tait, J. (2003). Word sense disambiguation in information retrieval revisited. In Proceedings of the Twenty Sixth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 159-166.
77. Strube, M., & Ponzetto, S. (2006). WikiRelate! Computing semantic relatedness using Wikipedia. In Proceedings of the Twenty First Conference on Artificial Intelligence (AAAI), pp. 1419- 1424.
78. Sussna, M. (1993). Word sense disambiguation for free-text indexing using a massive semantic network. In Proceedings of the Second International Conference on Information and Knowledge Management (CIKM), pp. 67-74.
79. Terra, E., & Clarke, C. (2003). Frequency estimates for statistical word similarity measures. In Proceedings of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies Conference (HLT/NAACL)., pp. 244-251.
80. Tsang, V. (2008). A Graph Approach to Measuring Text Distance. PhD Thesis, University of Toronto.
81. Tsatsaronis, G., & Panagiotopoulou, V. (2009). A generalized vector space model for text retrieval based on semantic relatedness. In Proceedings of the the 12th Conference of the European Chapter of the Association for Computational Linguistics (EACL - Student Research Workshop), pp. 70-78.
82. Tsatsaronis, G., Varlamis, I., Nørvåg, K., & Vazirgiannis, M. (2009). Omiotis: A thesaurus-based measure of text relatedness. In Proceedings of the European Conference onMachine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML-PKDD), pp. 742- 745.
83. Tsatsaronis, G., Varlamis, I., & Vazirgiannis, M. (2008). Word sense disambiguation with semantic networks. In Proceedings of the 11th International Conference on Text, Speech and Dialogue (TSD), pp. 219-226.
84. Tsatsaronis, G., Vazirgiannis, M., & Androutsopoulos, I. (2007). Word sense disambiguation with spreading activation networks generated from thesauri. In Proceedings of the Twentieth International Joint Conference on Artificial Intelligence (IJCAI), pp. 1725-1730.
85. Turney, P. (2001). Mining the Web for synonyms: PMI-IR versus LSA on TOEFL. In Proceedings of the Twelfth European Conference on Machine Learning (ECML), pp. 491-502.
86. Turney, P. (2006). Similarity of semantic relations. Computational Linguistics, 32(3), 379-416.
87. Turney, P. (2008a). The latent relation mapping engine: Algorithm and experiments. Journal of Artificial Intelligence Research, 33, 615-655.
88. Turney, P. (2008b). A uniform approach to analogies, synonyms, antonyms, and associations. In Proceedings of the Twenty Second International Conference on Computational Linguistics (COLING), pp. 905-912.
89. Turney, P., & Littman, M. (2005). Corpus-based learning of analogies and semantic relations. Machine Learning, 60(1-3), 251-278.
90. Turney, P., Littman, M., Bigham, J., & Shnayder, V. (2003). Combining independent modules to solve multiple-choice synonym and analogy problems. In Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP), pp. 482-489.
91. van Rijsbergen, C. (1979). Information Retrieval. Butterworth.
92. Vapnik, V. (1995). The nature of statistical learning theory. Springer.
93. Veale, T. (2004). WordNet sits the SAT: A knowledge-based approach to lexical analogy. In Proceedings of the Sixteenth European Conference on Artificial Intelligence (ECAI), pp. 606-612.
94. Veronis, J., & Ide, N. (1990). Word sense disambiguation with very large neural networks extracted from machine readable dictionaries. In Proceedings of the Thirteenth International Conference on Computational Linguistics (COLING), pp. 389-394.
95. Voorhees, E. (1993). Using WordNet to disambiguate word sense for text retrieval. In Proceedings of the Sixteenth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 171-180.
96. Wan, S., Dras, M., Dale, R., & Paris, C. (2006). Using dependency-based features to take the parafarce out of paraphrase. In Proceedings of the Australasian Language Technology Workshop, pp. 131-138.
97. Wu, Z., & Palmer, M. (1994). Verb semantics and lexical selection. In Proceedings of the Thirty Second Annual Meeting of the Association for Computational Linguistics (ACL), pp. 133- 138.
98. Zhang, Y., & Patrick, J. (2005). Paraphrase identification by text canonicalization. In Proceedings of the Australasian Language Technology Workshop, pp. 160-166.