Distributional memory: A general framework for corpus-based semantics

Computational Linguistics

Volumn 36, Issue 4, 2010, Pages 675-721

  Baroni, Marco ^a   Lenci, Alessandro ^b  

^a UNIVERSITY OF TRENTO   (Italy)

^b UNIVERSITY OF PISA   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

SEMANTICS; TENSORS;

DISTRIBUTIONAL INFORMATION; EMPIRICAL TESTING; QUALIA STRUCTURE; SELECTIONAL PREFERENCES; SEMANTIC PROBLEMS; STATE-OF-THE-ART METHODS; THIRD-ORDER TENSORS; TYPICAL PROPERTIES;

CLASSIFICATION (OF INFORMATION);

EID: 78650686637     PISSN: 08912017     EISSN: 15309312     Source Type: Journal    
DOI: 10.1162/coli_a_00016     Document Type: Article

References (116)

1. Aerts, Diederik and Marek Czachor. 2004. Quantum aspects of semantic analysis and symbolic artificial intelligence. Journal of Physics A: Mathematical and General, 37:123-132.
2. Alishahi, Afra and Suzanne Stevenson. 2008. A distributional account of the semantics of multiword expressions. Italian Journal of Linguistics, 20(1):157-179.
3. Almuhareb, Abdulrahman. 2006. Attributes in Lexical Acquisition. Ph.D. thesis, University of Essex.
4. Almuhareb, Abdulrahman and Massimo Poesio. 2004. Attribute-based and value-based clustering: An evaluation. In Proceedings of EMNLP, pages 158-165, Barcelona.
5. Almuhareb, Abdulrahman and Massimo Poesio. 2005. Concept learning andcategorization from the web. In Proceedings of CogSci, pages 103-108, Stresa.
6. Baldwin, Timothy, Valia Kordoni, and Aline Villavicencio. 2009. Prepositions in applications: A survey and introduction to the special issue. Computational Linguistics, 35(2):119-149.
7. Baroni, Marco, Eduard Barbu, Brian Murphy, and Massimo Poesio. 2010. Strudel: A distributional semantic model based on properties and types. Cognitive Science, 34(2):222-254.
8. Baroni, Marco, Stefan Evert, and Alessandro Lenci, editors. 2008. Bridging the Gap between Semantic Theory and Computational Simulations: Proceedings of the ESSLLI Workshop on Distributional Lexical Semantic. FOLLI, Hamburg.
9. Baroni, Marco and Alessandro Lenci. 2008. Concepts and properties in word spaces. Italian Journal of Linguistics, 20(1):55-88.
10. Baroni, Marco and Alessandro Lenci. 2009. One distributional memory, many semantic tasks. In Proceedings of the EACL GEMS Workshop, pages 1-8, Athens.
11. Bicic̈i, Ergun and Deniz Yuret. 2006. Clustering word pairs to answer analogy questions. In Proceedings of the Fifteenth Turkish Symposium on Artificial Intelligence and Neural Networks, pages 277-284, Mügla.
12. Bruza, Peter and Richard Cole. 2005. Quantum logic of semantic space:An exploratory investigation of context effects in practical reasoning. In Sergei Artemov, Howard Barringer, Arthur d'Avila Garcez, Luis C. Lamb, and JohnWoods, editors, We Will Show Them: Essays in Honour of Dov Gabbay, volume one. College Publications, London, pages 339-361.
13. Buitelaar, Paul, Philipp Cimiano, and Bernardo Magnini. 2005. Ontology Learning from Text. IOS Press, Amsterdam.
14. Bullinaria, John and Joseph Levy. 2007. Extracting semantic representations from word co-occurrence statistics: A computational study. Behavior Research Methods, 39:510-526.
15. Chen, Hsin-Hsi, Ming-Shun Lin, and Yu-Chuan Wei. 2006. Novel association measures usingWeb search with double checking. In Proceedings of COLING-ACL, pages 1009-1016, Sydney.
16. Church, Kenneth and Peter Hanks. 1990. Word association norms, mutual information, and lexicography. Computational Linguistics, 16(1):22-29.
17. Cimiano, Philipp and Johanna Wenderoth. 2007. Automatic acquisition of ranked qualia structures from the Web. In Proceedings of ACL, pages 888-895, Prague.
18. Clark, Stephen and Stephen Pulman. 2007. Combining symbolic and distributional models of meaning. In Proceedings of the AAAI Spring Symposium on Quantum Interaction, pages 52-55, Stanford, CA.
19. Curran, James and Marc Moens. 2002. Improvements in automatic thesaurus extraction. In Proceedings of the ACL Workshop on Unsupervised Lexical Acquisition, pages 59-66, Philadelphia, PA.
20. Davidov, Dmitry and Ari Rappoport. 2008a. Classification of semantic relationships between nominals using pattern clusters. In Proceedings of ACL, pages 227-235, Columbus, OH.
21. Davidov, Dmitry and Ari Rappoport. 2008b. Unsupervised discovery of generic relationships using pattern clusters and its evaluation by automatically generated SAT analogy questions. In Proceedings of ACL, pages 692-700, Columbus, OH.
22. Dietterich, Thomas. 1998. Approximate statistical tests for comparing supervised classification learning algorithms. Neural Computation, 10(7):1895-1924.
23. Dowty, David. 1977. Word Meaning and Montague Grammar. Kluwer, Dordrecht.
24. Dunning, Ted. 1993. Accurate methods for the statistics of surprise and coincidence. Computational Linguistics, 19(1):61-74.
25. Efron, Bradley and Robert Tibshirani. 1994. An Introduction to the Bootstrap. Chapman and Hall, Boca Raton, FL.
26. Erk, Katrin. 2007. A simple, similarity-based model for selectional preferences. In Proceedings of ACL, pages 216-223, Prague.
27. Erk, Katrin and Sebastian Padó. 2008. A structured vector space model for wordmeaning in context. In Proceedings of EMNLP, pages 897-906, Honolulu, HI.
28. Erk, Katrin and Sebastian Padó. 2009. Paraphrase assessment in structured vector space: Exploring parameters and datasets. In Proceedings of the EACL GEMS Workshop, pages 57-65, Athens.
29. Evert, Stefan. 2005. The Statistics of Word Cooccurrences. Ph.D. dissertation, Stuttgart University.
30. Fellbaum, Christiane, editor. 1998. WordNet: An Electronic Lexical Database. MIT Press, Cambridge, MA.
31. Garrard, Peter, Matthew Lambon Ralph, John Hodges, and Karalyn Patterson. 2001. Prototypicality, distinctiveness, and intercorrelation: Analyses of the semantic attributes of living and nonliving concepts. Cognitive Neuropsychology, 18(2):25-174.
32. Geeraerts, Dirk. 2010. Theories of Lexical Semantics. Oxford University Press, Oxford.
33. Girju, Roxana, Adriana Badulescu, and Dan Moldovan. 2006. Automatic discovery of part-whole relations. Computational Linguistics, 32(1):83-135.
34. Girju, Roxana, Preslav Nakov, Vivi Nastase, Stan Szpakowicz, Peter Turney, and Deniz Yuret. 2007. SemEval-2007 task 04: Classification of semantic relations between nominals. In Proceedings of SemEval 2007, pages 13-18, Prague.
35. Grefenstette, Gregory. 1994. Explorations in Automatic Thesaurus Discovery. Kluwer, Boston, MA.
36. Griffiths, Tom, Mark Steyvers, and Josh Tenenbaum. 2007. Topics in semantic representation. Psychological Review, 114:211-244.
37. Harris, Zellig. 1954. Distributional structure. Word, 10(2-3):1456-1162.
38. Hearst, Marti. 1992. Automatic acquisition of hyponyms from large text corpora. In Proceedings of COLING, pages 539-545, Nantes.
39. Hearst, Marti. 1998. Automated discovery of WordNet relations. In Christiane Fellbaum, editor, WordNet: An Electronic Lexical Database. MIT Press, Cambridge, MA, pages 131-151.
40. Herdag̈delen, Amac̈ and Marco Baroni. 2009. Bag Pack: A general framework to represent semantic relations. In Proceedings of the EACL GEMS Workshop, pages 33-40, Athens.
41. Herdag̈delen, Amac̈, Katrin Erk, and Marco Baroni. 2009. Measuring semantic relatedness with vector space models and random walks. In Proceedings of TextGraphs-4, pages 50-53, Singapore.
42. Heylen, Kris, Yves Peirsman, Dirk Geeraerts, and Dirk Speelman. 2008. Modelling word similarity: An evaluation of automatic synonymy extraction algorithms. In Proceedings of LREC, pages 3243-3249, Marrakech.
43. Hou, Yuexian and Dawei Song. 2009. Characterizing pure high-order entanglements in lexical semantic spaces via information geometry. In Peter Bruza, Donald Sofge, William Lawless, and C. J. van Rijsbergen, editors, Quantum Interaction: Third International Symposium, QI 2009. Springer, Berlin, pages 237-250.
44. Jackendoff, Ray. 1990. Semantic Structures. MIT Press, Cambridge, MA.
45. Joanis, Eric, Suzanne Stevenson, and David James. 2008. A general feature space for automatic verb classification. Natural Language Engineering, 14(3):337-367.
46. Jones, Michael and Douglas Mewhort. 2007. Representing word meaning and order information in a composite holographic lexicon. Psychological Review, 114:1-37.
47. Karypis, George. 2003. CLUTO: A clustering toolkit. Technical Report 02-017, University of Minnesota Department of Computer Science, Minneapolis.
48. Kilgarriff, Adam, Pavel Rychly, Pavel Smrz, and David Tugwell. 2004. The Sketch Engine. In Proceedings of Euralex, pages 105-116, Lorient.
49. Kolda, Tamara. 2006. Multilinear operators for higher-order decompositions. Technical Report 2081, SANDIA, Albuquerque, NM.
50. Kolda, Tamara and Brett Bader. 2009. Tensor decompositions and applications. SIAM Review, 51(3):455-500.
51. Kolda, Tamara and Jimeng Sun. 2008. Scalable tensor decompositions for multi-aspect data mining. In Proceedings of ICDM, pages 94-101, Pisa.
52. Landauer, Thomas and Susan Dumais. 1997. A solution to Plato's problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychological Review, 104(2):211-240.
53. Lenci, Alessandro. 2008. Distributional approaches in linguistic and cognitive research. Italian Journal of Linguistics, 20(1):1-31.
54. Lenci, Alessandro. 2010. The life cycle of knowledge. In Chu-Ren Huang, Nicoletta Calzolari, Aldo Gangemi, Alessandro Lenci, Alessandro Oltramari, and Laurent Prévot, editors, Ontology and the Lexicon. A Natural Language Processing Perspective. Cambridge University Press, Cambridge, UK, pages 241-257.
55. Levin, Beth. 1993. English Verb Classes and Alternations: A Preliminary Investigation. University of Chicago Press, Chicago, IL.
56. Levin, Beth and Malka Rappaport-Hovav. 2005. Argument Realization. Cambridge University Press, Cambridge, UK.
57. Lin, Dekang. 1998a. Automatic retrieval and clustering of similar words. In Proceedings of COLING-ACL, pages 768-774, Montreal.
58. Lin, Dekang. 1998b. An information-theoretic definition of similarity. In Proceedings of ICML, pages 296-304, Madison, WI.
59. Liu, Hugo and Push Singh. 2004. Concept Net: A practical commonsense reasoning toolkit. BT Technology Journal, pages 211-226.
60. Lowe, Will. 2001. Towards a theory of semantic space. In Proceedings of CogSci, pages 576-581, Edinburgh, UK.
61. Lund, Kevin and Curt Burgess. 1996. Producing high-dimensional semantic spaces from lexical co-occurrence. Behavior Research Methods, 28:203-208.
62. Manning, Chris and Hinrich Schütze. 1999. Foundations of Statistical Natural Language Processing. MIT Press, Cambridge, MA.
63. Markman, Arthur B. 1999. Knowledge Representation. Psychology Press, New York, NY.
64. Matveeva, Irina, Gina-Anne Levow, Ayman Farahat, and Christian Royer. 2005. Generalized latent semantic analysis for term representation. In Proceedings of RANLP, pages 60-68, Borovets.
65. McRae, Ken, George Cree, Mark Seidenberg, and Chris McNorgan. 2005. Semantic feature production norms for a large set of living and nonliving things. Behavior Research Methods, 37(4):547-559.
66. McRae, Ken, Michael Spivey-Knowlton, and Michael Tanenhaus. 1998. Modeling the influence of thematic fit (and other constraints) in on-line sentence comprehension. Journal of Memory and Language, 38:283-312.
67. Merlo, Paola and Suzanne Stevenson. 2001. Automatic verb classification based on statistical distributions of argument structure. Computational Linguistics, 27(3):373-408.
68. Meyer, Carl. 2000. Matrix Analysis and Applied Linear Algebra. SIAM, Philadelphia, PA.
69. Miller, George and Walter Charles. 1991. Contextual correlates of semantic similarity. Language and Cognitive Processes, 6:1-28.
70. Minkov, Einat and William Cohen. 2007. Learning to rank typed graph walks: Local and global approaches. In Proceedings of WebKDD/SNA-KDD, pages 1-8, San José, CA.
71. Minkov, Einat and William Cohen. 2008. Learning graph walk based similarity measures for parsed text. In Proceedings of EMNLP, pages 907-916, Honolulu, HI.
72. Mitchell, Jeff and Mirella Lapata. 2008. Vector-based models of semantic composition. In Proceedings of ACL, pages 236-244, Columbus, OH.
73. Murphy, Gregory. 2002. The Big Book of Concepts. MIT Press, Cambridge, MA.
74. Nastase, Vivi and Stan Szpakowicz. 2003. Exploring noun-modifier semantic relations. In Proceedings of the Fifth International Workshop on Computational Semantics, pages 285-301, Tilburg, The Netherlands.
75. O'Séaghdha, Diarmuid and Ann Copestake. 2009. Using lexical and relational similarity to classify semantic relations. In Proceedings of EACL, pages 621-629, Athens.
76. Padó, Sebastian and Mirella Lapata. 2007. Dependency-based construction of semantic space models. Computational Linguistics, 33(2):161-199.
77. Padó, Ulrike. 2007. The Integration of Syntax and Semantic Plausibility in a Wide-Coverage Model of Sentence Processing. Ph.D. dissertation, Saarland University, Saarbrücken.
78. Padó, Ulrike, Sebastian Padó, and Katrin Erk. 2007. Flexible, corpus-based modeling of human plausibility judgements. In Proceedings of EMNLP, pages 400-409, Prague.
79. Pantel, Patrick and Marco Pennacchiotti. 2006. Espresso: Leveraging generic patterns for automatically harvesting semantic relations. In Proceedings of COLING-ACL, pages 113-120, Sydney.
80. Peirsman, Yves and Dirk Speelman. 2009. Word space models of lexical variation. In Proceedings of the EACL GEMS Workshop, pages 9-16, Athens.
81. Pustejovsky, James. 1995. The Generative Lexicon. MIT Press, Cambridge, MA.
82. Quesada, Jose, Praful Mangalath, and Walter Kintsch. 2004. Analogy-making as predication using relational information and LSA vectors. In Proceedings of CogSci, page 1623, Chicago, IL.
83. Raghunathan, Trivellore. 2003. An approximate test for homogeneity of correlated correlation coefficients. Quality & Quantity, 37:99-110.
84. Rapp, Reinhard. 2003. Word sense discovery based on sense descriptor dissimilarity. In Proceedings of the 9th MT Summit, pages 315-322, New Orleans, LA.
85. Rapp, Reinhard. 2004. A freely available automatically generated thesaurus of related words. In Proceedings of LREC, pages 395-398, Lisbon.
86. Rogers, Timothy and James McClelland. 2004. Semantic Cognition: A Parallel Distributed Processing Approach. MIT Press, Cambridge, MA.
87. Rothenhäusler, Klaus and Hinrich Schütze. 2009. Unsupervised classification with dependency based word spaces. In Proceedings of the EACL GEMS Workshop, pages 17-24, Athens, Greece.
88. Rubenstein, Herbert and John Goodenough. 1965. Contextual correlates of synonymy. Communications of the ACM, 8(10):627-633.
89. Ruiz-Casado, Maria, Enrique Alfonseca, and Pablo Castells. 2005. Using context-window overlapping in synonym discovery and ontology extension. In Proceedings of RANLP, pages 1-7, Borovets.
90. Sagi, Eyal, Stefan Kaufmann, and Brady Clark. 2009. Semantic density analysis: Comparing word meaning across time and phonetic space. In Proceedings of the EACL GEMS Workshop, pages 104-111, Athens.
91. Sahlgren, Magnus. 2005. An introduction to random indexing. http://www.sics.se/~mange/papers/RIintro.pdf.
92. Sahlgren, Magnus. 2006. The Word-Space Model. Ph.D. dissertation, Stockholm University.
93. Schulteim Walde, Sabine. 2006. Experiments on the automatic induction of German semantic verb classes. Computational Linguistics, 32:159-194.
94. Schütze, Hinrich. 1997. Ambiguity Resolution in Natural Language Learning. CSLI Publications, Stanford, CA.
95. Smolensky, Paul. 1990. Tensor product variable binding and the representation of symbolic structures in connectionist systems. Artificial Intelligence, 46:159-216.
96. Smolensky, Paul and Geraldine Legendre. 2006. The Harmonic Mind. From Neural Computation to Optimality-theoretic Grammar. MIT Press, Cambridge, MA.
97. Terra, Egidio and Charles Clarke. 2003. Frequency estimates for statistical word similarity measures. In Proceedings of HLT-NAACL, pages 244-251, Edmonton.
98. Turney, Peter. 2001. Mining the Web for synonyms: PMI-IR versus LSA on TOEFL. In Proceedings of ECML, pages 491-502, Freiburg.
99. Turney, Peter. 2006a. Expressing implicit semantic relations without supervision. In Proceedings of COLING-ACL, pages 313-320, Sydney.
100. Turney, Peter. 2006b. Similarity of semantic relations. Computational Linguistics, 32(3):379-416.
101. Turney, Peter. 2007. Empirical evaluation of four tensor decomposition algorithms. Technical Report ERB-1152, NRC, Ottawa.
102. Turney, Peter. 2008. A uniform approach to analogies, synonyms, antonyms and associations. In Proceedings of COLING, pages 905-912, Manchester.
103. Turney, Peter and Michael Littman. 2005. Corpus-based learning of analogies and semantic relations. Machine Learning, 60(1-3):251-278.
104. Turney, Peter and Patrick Pantel. 2010. From frequency to meaning: Vector space models of semantics. Journal of Artificial Intelligence Research, 37:141-188.
105. Van de Cruys, Tim. 2009. A non-negative tensor factorization model for selectional preference induction. In Proceedings of the EACL GEMS Workshop, pages 83-90, Athens.
106. Van Overschelde, James, Katherine Rawson, and John Dunlosky. 2004. Category norms: An updated and expanded version of the Battig and Montague (1969) norms. Journal of Memory and Language, 50:289-335.
107. Van Rijsbergen, C. J. 2004. The Geometry of Information Retrieval. Cambridge University Press, Cambridge, UK.
108. Veale, Tony and Yanfen Hao. 2008. Acquiring naturalistic concept descriptions from theWeb. In Proceedings of LREC, pages 1121-1124, Marrakech.
109. Vinson, David and Gabriella Vigliocco. 2008. Semantic feature production norms for a large set of objects and events. Behavior Research Methods, 40(1):183-190.
110. Widdows, Dominic. 2004. Geometry and Meaning. CSLI Publications, Stanford, CA.
111. Widdows, Dominic. 2008. Semantic vector products: Some initial investigations. In Proceedings of the Second AAAI Symposium on Quantum Interaction, pages 1-8, Oxford.
112. Widdows, Dominic and Beate Dorow. 2002. A graph model for unsupervised lexical acquisition. In Proceedings of ICCL, pages 1-7, Taipei.
113. Widdows, Dominic and Stanley Peters. 2003. Word vectors and quantum logic. In Proceedings of the Eighth Mathematics of Language Conference, pages 1-14, Bloomington, IN.
114. Zarcone, Alessandra and Alessandro Lenci. 2008. Computational models of event type classification in context. In Proceedings of LREC, pages 1232-1238, Marrakech.
115. Zhao, Ying and George Karypis. 2003. Criterion functions for document clustering: Experiments and analysis. Technical Report 01-40, University of Minnesota Department of Computer Science, Minneapolis.
116. Zhitomirsky-Geffet, Maayan and Ido Dagan. 2009. Bootstrapping distributional feature vector quality. Computational Linguistics, 35(3):435-461.