Learning semantic relatedness from term discrimination information

Expert Systems with Applications

Volumn 36, Issue 2 PART 1, 2009, Pages 1860-1875

  Cai, D ^a   van Rijsbergen, C J ^a  

^a UNIVERSITY OF GLASGOW   (United Kingdom)

Author keywords

Good discriminators; Information retrieval; Informative terms; Learning of semantic relations; Measurement of discrimination information; Query expansion; Relatedness measures

Indexed keywords

INFORMATION RETRIEVAL;

GOOD DISCRIMINATORS; INFORMATIVE TERMS; LEARNING OF SEMANTIC RELATIONS; MEASUREMENT OF DISCRIMINATION INFORMATION; QUERY EXPANSION; RELATEDNESS MEASURES;

SEMANTICS;

EID: 56349109063     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2007.12.072     Document Type: Article

References (74)

1. Aitchison J. Review: M. Lynne Murphy. Semantic relations and the lexicon: Antonymy, synonymy and other paradigms. International Journal of Lexicography 18 1 (2005) 106-109
2. Amati G., and van Rijsbergen C.J. Probabilistic models of information retrieval based on measuring the divergence from randomness. ACM Transactions on Information Systems 20 4 (2002) 357-389
3. ANSI/NISO Z39.19-2005. (2005). Guidelines for the construction, format, and management of monolingual thesauri. National Information Standards Organization.
4. Banerjee, S., & Pedersen, T. (2003). Extended gloss overlaps as a measure of semantic relatedness. In Proceedings of the Eighteenth International Joint Conference on Artificial Intelligence (pp. 805-810).
5. Berger, A., & Lafferty, J. (1999). Information retrieval as statistical translation. In Proceedings of the 22nd Annual International ACM-SIGIR Conference on Research and Development in Information Retrieval (pp. 222-229).
6. Biru T., El-Hamdouchi A., Rees R.S., and Willett P. Inclusion of relevance information in the term discrimination model. Journal of Documentation 45 2 (1989) 85-109
7. Buckley, C., & Salton, G. (1995). Optimisation of relevance feedback weights. In Proceedings of the 18th Annual International ACM-SIGIR Conference on Research and Development in Information Retrieval (pp. 351-357).
8. Budanitsky, A., & Hirst, G. (2001). Semantic distance in WordNet: An experimental, application-oriented evaluation of five measures. In Proceedings of the Workshop on WordNet and Other Lexical Resources, Second Meeting of the North American Chapter of the Association for Computational Linguistics (pp. 29-34).
9. Budanitsky A., and Hirst G. Evaluating WordNet-based measures of lexical semantic relatedness. Computational Linguistics 32 1 (2006) 13-47
10. Cai, D. (2004). IfD-Information for Discrimination. PhD thesis, University of Glasgow, Glasgow, Scotland.
11. Cai, D., & Van Rijsbergen, C. J. (2007). Reconsidering the fundamentals of measurement of discrimination information. In Proceedings of the 1st International Conference on Theory of Information Retrieval (ICTIR'07) (pp. 151-158).
12. Carmel, D., Farchi, E., Petruschka, Y., & Soffer, A. (2002). Automatic query refinement using lexical affinities with maximal information gain. In Proceedings of the 25th Annual International ACM-SIGIR Conference on Research and Development in Information Retrieval (pp. 283-290).
13. Carpineto C., Mori R., and Romano G. Informative term selection for automatic query expansion. The 7th Text REtrieval Conference (TREC-7) (1998), NIST Special Publication 363-369
14. Carpineto C., Mori R.D., Romano G., and Bigi B. An information-theoretic approach to automatic query expansion. ACM Transactions on Information Systems 19 1 (2001) 1-27
15. Chiarello C., Burgess C., Richards L., and Pollock A. Semantic and associative priming in the cerebral hemispheres: Some words do, some words don't ... sometimes, some places. Brain and Language 38 1 (1990) 75-104
16. Church K.W., and Hanks P. Word association norms, mutual information, and lexicography. Journal of the American Society for Information Science 16 1 (1990) 22-29
17. Corley, C., & Mihalcea, R. (2005). Measuring the semantic similarity of texts. In Proceedings of the ACL Workshop on Empirical Modeling of Semantic Equivalence and Entailment (pp. 13-18).
18. Crammer K., and Singer Y. A family of additive online algorithms for category ranking. Journal of Machine Learning 3 (2003) 1025-1058
19. Cronen-Townsend, S., Zhou, Y., & Croft, W. B. (2002). Predicting query performance. In Proceedings of the 25th Annual International ACM-SIGIR Conference on Research and Development in Information Retrieval (pp. 299-306).
20. Dagan I. Contextual word similarity. Handbook of Natural Language Processing (2000) 459-475
21. Dagan I., Lee L., and Pereira F.C.N. Similarity-based models of word cooccurrence probabilities. Machine Learning 34 1-3 (1999) 43-69 (Special issue on natural language learning)
22. Fan W., Gordon M.D., and Pathak P. Effective profiling of consumer information retrieval needs: A unified framework and empirical comparison. Decision Support Systems 40 2 (2005) 213-233
23. Fellbaum C. Co-occurrence and antonymy. International Journal of Lexicography 8 4 (1995) 281-303
24. Fellbaum C. WordNet: An Electronic Lexical Database (1998), The MIT Press, Cambridge, MA
25. Florian, R., & Yarowsky, D. (2002) Modeling consensus: Classifier combination for word sense disambiguation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (pp. 25-32).
26. Gauch S., Wang J., and Rachakonda S.M. A corpus analysis approach for automatic query expansion and its extension to multiple databases. ACM Transactions on Information Systems 17 3 (1999) 250-269
27. Good I.J. Probability and the Weighing of Evidence (1950), Charles Griffin, London
28. Halliday M.A.K., and Hasan R. Cohesion in English (1976), Longman, London
29. Han L., Sun L., Chen G., and Xie L. ADSS: An approach to determining semantic similarity. Advances in Engineering Software 37 2 (2006) 129-132
30. Harris Z.S. Mathematical Structures of Language (1968), John Wiley, New York
31. Hirst G., and Budanitsky A. Correcting real-word spelling errors by restoring lexical cohesion. Natural Language Engineering 11 1 (2005) 87-111
32. Jardine N., and Sibson R. Mathematical Taxonomy (1971), John Wiley & Sons Ltd
33. Jiang, J. J., & Conrath, D. W. (1997). Semantic similarity based on corpus statistics and lexical taxonomy. In Proceedings of the 10th International Conference on Research in Computational Linguistics (pp. 19-33).
34. Kang H., and Choi K. Two-level document ranking using mutual information in natural language information retrieval. Information Processing and Management 33 3 (1997) 289-306
35. Kim M., and Choi K. A comparison of collocation-based similarity measures in query expansion. Information Processing and Management 35 1 (1999) 19-30
36. Kullback S. Information Theory and Statistics (1959), Wiley, New York
37. Kwon, O., Kim, M., & Choi, K. (1994). Query expansion using domain-adapted, weighted thesaurus in an extended Boolean model. In Proceedings of the 3rd International Conference on Information and Knowledge Management (ACM-CIKM) (pp. 140-146).
38. Lafferty, J., & Zhai, C. (2001). Document language models, query models, and risk minimization for information retrieval. In Proceedings of the 24th Annual International ACM-SIGIR Conference on Research and Development in Information Retrieval (pp. 111-119).
39. Landauer T.K., and Dumais S.T. A solution to Plato's problem: The latent semantic analysis theory of the acquisition, induction, and representation of knowledge. Psychological Review 104 2 (1997) 211-240
40. Lee J.H., Kim M.H., and Lee Y.J. Information retrieval based on conceptual distance in is-a hierarchies. Journal of Documentation 49 (1993) 188-207
41. Lee, L. (1999). Measures of distributional similarity. In Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics (pp. 25-32).
42. Mandala R., Tokunaga T., and Tanaka H. Query expansion using heterogeneous thesauri. Information Processing and Management 36 3 (2000) 361-378
43. Marx I., Dagan Z., Buhmann J., and Shamir E. Coupled clustering: A method for detecting structural correspondence. Journal of Machine Learning Research 3 (2002) 747-780
44. McCarthy, D., Koeling, R., Weeds, J., & Carroll, J. (2004). Finding predominant word senses in untagged text. In Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics (pp. 280-287).
45. Medin D.L., Goldstone R.L., and Gentner D. Similarity involving attributes and relations: Judgments of similarity and difference are not inverses. Psychological Science 1 1 (1990) 64-69
46. Miller G. WordNet: An on-line lexical database. International Journal of Lexicography 3 4 (1990) 235-244 [Special issue]
47. Mohammad, S., & Hirst, G. (submitted for publication). Distributional measures as proxies for semantic relatedness. Available from: .
48. Mohammad, S., & Hirst, G. (2006a). Determining word sense dominance using a thesaurus. In Proceedings of the 11th Conference of the European Chapter of the Association for Computational Linguistics (pp. 121-128).
49. Mohammad, S., & Hirst, G. (2006b). Distributional measures of concept-distance: A task-oriented evaluation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing.
50. Moldovan, D., Badulescu, A., Tatu, M., Antohe, D., & Girju, R. (2004). Models for the semantic classification of noun phrases. In Proceedings of the Workshop on Computational Lexical Semantics (pp. 60-67).
51. Morris J., and Hirst G. Lexical cohesion computed by thesaural relations as an indicator of the structure of text. Computational Linguistics 17 1 (1991) 21-48
52. Morris, J., & Hirst, G. (2004). Non-classical lexical semantic relations. In Proceedings of the HLT-NAACL Workshop on Computational Lexical Semantics (pp. 46-51).
53. Nastase, V., & Szpakowicz, S. (2003). Exploring noun-modifier semantic relations. In Fifth International Workshop on Computational Semantics (pp. 285-301).
54. Pantel, P., & Lin, D. (2002). Discovering word senses from text. In Proceedings of ACM SIGKDD Conference on Knowledge Discovery and Data Mining (pp. 613-619).
55. Patwardhan, S., Banerjee, S., & Pedersen, T. (2003). Using measures of semantic relatedness for word sense disambiguation. In Proceedings of the 4th International Conference on Intelligent Text Processing and Computational Linguistics (pp. 241-257).
56. Pekar, V., & Staab, S. (2003). Word classification based on combined measures of distributional and semantic similarity. In Proceedings of the Research Note Sessions of the 10th Conference of the European Chapter of the Association for Computational Linguistics (pp. 147-150).
57. Rao C.R. Diversity and dissimilarity coefficients: A unified approach. Journal of Theoretical Population Biology 21 (1982) 24-43
58. Resnik P. Semantic similarity in a taxonomy: An information-based measure and its application to problems of ambiguity in natural language. Journal of Artificial Intelligence Research 11 (1999) 95-130
59. Richardson, R., Smeaton, A., & Murphy, J. (1994). Using WordNet as a knowledge base for measuring semantic similarity between words. In Proceedings of AICS Conference.
60. Rocchio, J. J. (1971). Relevance feedback in information retrieval. In The SMART retrieval system-experiments in automatic document processing (pp. 313-323).
61. Rodriguez M.A., and Egenhofer M.J. Determining semantic similarity among entity classes from different ontologies. IEEE Transactions on Knowledge and Data Engineering 15 2 (2003) 442-456
62. Seco, N., Veale, T., & Hayes, J. (2004). An intrinsic information content metric for semantic similarity in WordNet. In Proceedings of the 16th European Conference on Artificial Intelligence.
63. Shannon C.E. A mathematical theory of communication. Bell System and Technical Journal 27 (1948) 379-423 623-656
64. Sibson R. Information radius. Zeitschrift fur Wahrscheinlichkeitstheorie und Verwandte Gebiete 14 (1969) 149-160
65. Stevenson, M., & Greenwood, M. A. (2005). A semantic approach to IE pattern induction. In Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (pp. 379-386).
66. Turney P.D. Similarity of semantic relations. Computational Linguistics 32 3 (2006) 379-416
67. Turney, P. D., Littman, M. L., Bigham, J., & Shnayder, V. (2003). Combining independent modules to solve multiple-choice synonym and analogy problems. In Proceedings of the International Conference on Recent Advances in Natural Language Processing (pp. 482-489).
68. van Rijsbergen C.J. Information Retrieval. 2nd ed. (1979), Butterworths, London
69. Voorhees E.M., and Harman D. Overview of the Seventh Text REtrieval Conference (TREC-7). The 7th Text REtrieval Conference (TREC-7) (1999), NIST Special Publication 1-23
70. Weeds J., and Weir D. Co-occurrence retrieval: A flexible framework for lexical distributional similarity. Computational Linguistics 31 4 (2005) 439-475
71. Wong S.K.M., and Yao Y.Y. A probability distribution model for information retrieval. Information Processing and Management 25 1 (1989) 39-53
72. Wong S.K.M., and Yao Y.Y. An information-theoretic measure of term specificity. Journal of the American Society for Information Science 43 1 (1992) 54-61
73. Xu, J., & Croft, W. B. (1996). Query expansion using local and global document analysis. In Proceedings of the 19th Annual International ACM-SIGIR Conference on Research and Development in Information Retrieval (pp. 4-11).
74. Zhai, C., & Lafferty, J. (2001). Model-based feedback in the language modeling approach to information retrieval. In Proceedings of the 24th Annual International ACM-SIGIR Conference on Research and Development in Information Retrieval (pp. 403-410).