An inference-based model of word meaning in context as a paraphrase distribution

ACM Transactions on Intelligent Systems and Technology

Volumn 4, Issue 3, 2013, Pages

  Moon, Taesun ^a,b   Erk, Katrin ^a  

^a UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^b UNIVERSITY OF MARYLAND   (United States)

Author keywords

Lexical semantics; Loopy belief propagation; Paraphrases; Probabilistic graphical models; Probabilistic inference; Semantics

Indexed keywords

LEXICAL SEMANTICS; LOOPY BELIEF PROPAGATION; PARAPHRASES; PROBABILISTIC GRAPHICAL MODELS; PROBABILISTIC INFERENCE;

PROBABILITY DISTRIBUTIONS; SPEECH RECOGNITION;

SEMANTICS;

EID: 84880231437     PISSN: 21576904     EISSN: 21576912     Source Type: Journal    
DOI: 10.1145/2483669.2483675     Document Type: Article

References (58)

1. AGIRRE, E. AND SOROA, A. 2009. Personalizing pagerank for word sense disambiguation. In Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics (EACL'09). 33-41.
2. AJI, S. AND MCELIECE, R. 2000. The generalized distributive law. IEEE Trans. Inf. Theory 46, 2, 325-343.
3. BANNARD, C. AND CALLISON-BURCH, C. 2005. Paraphrasing with bilingual parallel corpora. In Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL'05).
4. BARONI, M., BERNARDINI, S., FERRARESI, A., AND ZANCHETTA, E. 2009. The wacky wide web: A collection of very large linguistically processed web-crawled corpora. Lang. Resourc. Eval. 43, 3, 209-226.
5. BARONI, M. AND ZAMPARELLI, R. 2010. Nouns are vectors, adjectives are matrices: Representing adjective-noun constructions in semantic space. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 1183-1193.
6. BARZILAY, R. AND MCKEOWN, K. 2001. Extracting paraphrases from a parallel corpus. In Proceedings of the 39th Annual Meeting of the Association for Computational Linguistics (ACL/EACL'01).
7. BERANT, J.,DAGAN, I., AND GOLDBERGER, J. 2010. Global learning of focused entailment graphs. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 1220-1229.
8. BIEMAN, C. AND NYGAARD, V. 2010. Crowdsourcing wordnet. In Proceedings of the 5th Global WordNet Conference.
9. BLEI, D. M., NG, A. Y., AND JORDAN, M. I. 2003. Latent dirichlet allocation. J. Mach. Learn. Res. 3, 993-1022.
10. BRODY, S. AND LAPATA, M. 2009. Bayesian word sense induction. In Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguitics (EACL'09).
11. CHKLOVSKI, T. AND PANTEL, P. 2004. Verbocean: Mining the web for fine-grained semantic verb relations. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP'04), D. Lin and D. Wu, Eds., Association for Computational Linguistics, 33-40.
12. CLARK, S. AND CURRAN, J. R. 2007.Wide-coverage efficient statistical parsing with CCG and log-linear models. Comput. Linguist. 33, 4.
13. CRUSE, D. A. 1995. Polysemy and related phenomena from a cognitive linguistic viewpoint. In Computational Lexical Semantics, P. Saint-Dizier and E. Viegas, Eds., Cambridge University Press, 33-49.
14. DESCHACHT, K. AND MOENS, M. 2009. Semi-supervised semantic role labeling using the latent words language model. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP'09). 21-29.
15. DINU, G. AND LAPATA, M. 2010. Measuring distributional similarity in context. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 1162-1172.
16. DREYER, M. AND EISNER, J. 2009. Graphical models over multiple strings. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP'09). 101-110.
17. EDMONDS, P. AND COTTON, S., EDS. Senseval-2: Overview. In Proceedings of the 2nd International Workshop on Evaluating Word Sense Disambiguation Systems (Senseval-2'01). 1-6.
18. ERK, K., MCCARTHY, D., AND GAYLORD, N. 2009. Investigations on word senses and word usages. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, vol. 1.
19. ERK, K. AND PADO, S. 2008. A structured vector space model for word meaning in context. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP'08).
20. ERK, K. AND PADO, S. 2009. Paraphrase assessment in structured vector space: Exploring parameters and datasets. In Proceedings of the EACLWorkshop on Geometrical Methods for Natural Language Semantics (GEMS).
21. ERK, K. AND PADO, S. 2010. Exemplar-based models for word meaning in context. In Proceedings of the ACL Conference Short Papers.
22. GREFENSTETTE, E. AND SADRZADEH, M. 2011. Experimental support for a categorical compositional distributional model of meaning. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 1394-1404.
23. HANKS, P. 2000. Do word meanings exist? Comput. Human. 34, 1-2, 205-215.
24. KILGARRIFF, A. 1997. I don't believe in word senses. Comput. Human. 31, 2, 91-113.
25. KINTSCH, W. 2001. Predication. Cogn. Sci. 25, 173-202.
26. KINTSCH,W. 2007. Meaning in context. In Handbook of Latent Semantic Analysis, T. Landauer, D. McNamara, S. Dennis, and W. Kintsch, Eds., Erlbaum, Mahwah, NJ, 89-105.
27. KSCHISCHANG, F., FREY, B., AND LOELIGER, H.-A. 2001. Factor graphs and the sum-product algorithm. IEEE Trans. Inf. Theory 47, 2, 498-519.
28. LAFFERTY, J. D., MCCALLUM, A., AND PEREIRA, F. C. N. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of the 18th International Conference on Machine Learning (ICML'01). Morgan Kaufmann Publishers, San Francisco, CA, 282-289.
29. LANDAUER, T. AND DUMAIS, S. 1997. A solution to platos problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychol. Rev. 104, 2, 211-240.
30. LIN, D. AND PANTEL, P. 2001. Dirt - Discovery of inference rules from text. In Proceedings of ACM Conference on Knowledge Discovery and Data Mining (KDD'01). 323-328.
31. MCCALLUM, A. K. 2002. MALLET: A machine learning for language toolkit. http://mallet.cs.umass.edu.
32. MCCARTHY, D. AND NAVIGLI, R. 2009. The English lexical substitution task. Lang. Resourc. Eval. 43, 2, 139-159.
33. MIHALCEA, R., CHKLOVSKI, T., AND KILGARIFF, A. 2004a. The senseval-3 english lexical sample task. In Proceedings of the 3rd International Workshop on the Evaluation of Systems for the Semantic Analysis of Text Proceedings of SensEval-3.
34. MIHALCEA, R., TARAU, P., AND FIGA, E. 2004b. PageRank on semantic networks, with application to word sense disambiguation. In Proceedings of the 20th International Conference on Computational Linguistics.
35. MITCHELL, J. AND LAPATA, M. 2008. Vector-based models of semantic composition. In Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics.
36. MITCHELL, J. AND LAPATA, M. 2010. Composition in distributional models of semantics. Cogn. Sci. 34, 8, 1388-1429.
37. MURPHY, K.,WEISS, Y., AND JORDAN, M. 1999. Loopy belief propagation for approximate inference: An empirical study. In Proceedings of the 15th Conference on Uncertainty in Artificial Intelligence. 467-475.
38. NASTASE, V. 2008. Unsupervised all-words word sense disambiguation with grammatical dependencies. In Proceedings of the 3rd International Joint Conference on Natural Language Processing.
39. PADO, S. AND LAPATA, M. 2007. Dependency-based construction of semantic space models. Comput. Linguist. 33, 2, 161-199.
40. PANTEL, P., BHAGAT, R., CHKLOVSKI, T., AND HOVY, E. 2007. Isp: Learning inferential selectional preferences. In Proceedings of the North American Chapter of the Association for Computational Linguistics (NAACL'07).
41. POON, H. AND DOMINGOS, P. 2009. Unsupervised semantic parsing. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. 1-10.
42. REISINGER, J. AND MOONEY, R. 2010. Multi-prototype vector-space models of word meaning. In Proceedings of the Human Language Technologies at the Annual Conference of the North American Chapter of the Association for Computational Linguistics.
43. RIEDEL, S. AND MEZA-RUIZ, I. 2008. Collective semantic role labelling with markov logic. In Proceedings of the 12th Conference on Computational Natural Language Learning (CoNLL'08). 193-197.
44. RITTER, A.,MAUSAM, AND ETZIONI, O. 2010. A latent dirichlet allocation method for selectional preferences. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, 424-434.
45. SHAROFF, S. 2006. Open-source corpora: Using the net to fish for linguistic data. Int. J. Corpus Linguist. 11, 4, 435-462.
46. SMITH, D. AND EISNER, J. 2008. Dependency parsing by belief propagation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 145-156.
47. SMOLENSKY, P. 1990. Tensor product variable binding and the representation of symbolic structures in connectionist systems. Artif. Intell. 46, 159-216.
48. SNYDER, B. AND PALMER, M. 2004. The english all-words task. In 3rdInternational Workshop on Semantic Evaluations (SensEval-3). ACL.
49. SUTTON, C.,MCCALLUM, A., AND ROHANIMANESH, K. 2007. Dynamic conditional random fields: Factorized probabilistic models for labeling and segmenting sequence data. J. Mach. Learn. Res. 8, 693-723.
50. SZPEKTOR, I. AND DAGAN, I. 2008. Learning entailment rules for unary templates. In Proceedings of 22nd International Conference on Computational Linguistics (COLING'08).
51. SZPEKTOR, I., DAGAN, I., BAR-HAIM, R., AND GOLDBERGER, J. 2008. Contextual preferences. In Proceedings of ACL-08: HLT. Association for Computational Linguistics, 683-691.
52. THATER, S., DINU, G., AND PINKAL, M. 2009. Ranking paraphrases in context. In Proceedings of the ACL Workshop on Applied Textual Inference.
53. THATER, S., FURSTENAU, H., AND PINKAL, M. 2010. Contextualizing semantic representations using syntactically enriched vector models. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics (ACL'10).
54. TUGGY, D. H. 1993. Ambiguity, polysemy and vagueness. Cogn. Linguist. 4, 2, 273-290.
55. WEAVER,W. 1949. Translation. In Machine Translation of Languages: Fourteen Essays,W. Locke and A. Booth, Eds., MIT Press, Cambridge, MA.
56. WEISS, Y. 2000. Correctness of local probability propagation in graphical models with loops. Neural Comput. 12, 1, 1-41.
57. YOSHIKAWA, K., RIEDEL, S., ASAHARA, M., AND MATSUMOTO, Y. 2009. Jointly identifying temporal relations with markov logic. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP. Association for Computational Linguistics, 405-413.
58. YURET, D.,HAN, A., AND TURGUT, Z. 2010. Semeval-2010 task 12: Parser evaluation using textual entailments. In Proceedings of the 5th InternationalWorkshop on Semantic Evaluation. Association for Computational Linguistics. 51-56.