Domain and function: A dual-space model of semantic relations and compositions

Journal of Artificial Intelligence Research

Volumn 44, Issue , 2012, Pages 533-585

  Turney, Peter D ^a  

^a NATIONAL RESEARCH COUNCIL CANADA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

HOUSES; SEMANTICS; WOOD;

BEST MODEL; DUAL SPACES; FUNCTION SIMILARITY; MODELING RELATIONS; SEMANTIC COMPOSITION; SEMANTIC RELATIONS; VECTOR SPACE MODELS;

VECTOR SPACES;

ALGORITHMS; HOUSES; MATHEMATICAL MODELS; WOOD;

EID: 84866880930     PISSN: None     EISSN: 10769757     Source Type: Journal    
DOI: 10.1613/jair.3640     Document Type: Article

References (84)

1. Aerts, D., & Czachor, M. (2004). Quantum aspects of semantic analysis and symbolic artificial intelligence. Journal of Physics A: Mathematical and General, 37, L123-L132.
2. Baroni, M., & Zamparelli, R. (2010). Nouns are vectors, adjectives are matrices: Representing adjective-noun constructions in semantic space. In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing (EMNLP 2010), pp. 1183-1193.
3. Bengio, Y., Ducharme, R., Vincent, P., & Jauvin, C. (2003). A neural probabilistic language model. Journal of Machine Learning Research, 3, 1137-1155.
4. Biçici, E., & Yuret, D. (2006). Clustering word pairs to answer analogy questions. In Proceedings of the Fifteenth Turkish Symposium on Artificial Intelligence and Neural Networks (TAINN 2006), Akyaka, Mugla, Turkey.
5. Biemann, C., & Giesbrecht, E. (2011). Distributional semantics and compositionality 2011: Shared task description and results. In Proceedings of the Workshop on Distributional Semantics and Compositionality (DiSCo 2011), pp. 21-28, Portland, Oregon.
6. Bollegala, D., Matsuo, Y., & Ishizuka, M. (2009). Measuring the similarity between implicit semantic relations from the Web. In Proceedings of the 18th International Conference on World Wide Web (WWW 2009), pp. 651-660.
7. Brants, T., & Franz, A. (2006). Web 1T 5-gram Version 1. Linguistic Data Consortium, Philadelphia.
8. Bullinaria, J., & Levy, J. (2007). Extracting semantic representations from word cooccurrence statistics: A computational study. Behavior Research Methods, 39 (3), 510-526.
9. Büttcher, S., & Clarke, C. (2005). Efficiency vs. effectiveness in terabyte-scale information retrieval. In Proceedings of the 14th Text REtrieval Conference (TREC 2005), Gaithersburg, MD.
10. Caron, J. (2001). Experiments with LSA scoring: Optimal rank and basis. In Proceedings of the SIAM Computational Information Retrieval Workshop, pp. 157-169, Raleigh, NC.
11. Chiarello, C., Burgess, C., Richards, L., & Pollock, A. (1990). Semantic and associative priming in the cerebral hemispheres: Some words do, some words don't . . . sometimes, some places. Brain and Language, 38, 75-104.
12. Chomsky, N. (1975). The Logical Structure of Linguistic Theory. Plenum Press.
13. Church, K., & Hanks, P. (1989). Word association norms, mutual information, and lexicography. In Proceedings of the 27th Annual Conference of the Association of Computa-tional Linguistics, pp. 76-83, Vancouver, British Columbia.
14. Clark, S., Coecke, B., & Sadrzadeh, M. (2008). A compositional distributional model of meaning. In Proceedings of the 2nd Symposium on Quantum Interaction, pp. 133-140, Oxford, UK.
15. Clark, S., & Pulman, S. (2007). Combining symbolic and distributional models of meaning. In Proceedings of the AAAI Spring Symposium on Quantum Interaction, pp. 52-55, Stanford, CA.
16. Conway, J. H., & Sloane, N. J. A. (1998). Sphere Packings, Lattices and Groups. Springer.
17. Daganzo, C. F. (1994). The cell transmission model: A dynamic representation of highway traffic consistent with the hydrodynamic theory. Transportation Research Part B: Methodological, 28 (4), 269-287.
18. Davidov, D., & Rappoport, A. (2008). Unsupervised discovery of generic relationships using pattern clusters and its evaluation by automatically generated SAT analogy questions. In Proceedings of the 46th Annual Meeting of the ACL and HLT (ACL-HLT-08), pp. 692-700, Columbus, Ohio.
19. Erk, K., & Padó, S. (2008). A structured vector space model for word meaning in context. In Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing (EMNLP-08), pp. 897-906, Honolulu, HI.
20. Fellbaum, C. (Ed.). (1998). WordNet: An Electronic Lexical Database. MIT Press.
21. Firth, J. R. (1957). A synopsis of linguistic theory 1930-1955. In Studies in Linguistic Analysis, pp. 1-32. Blackwell, Oxford.
22. Fodor, J., & Lepore, E. (2002). The Compositionality Papers. Oxford University Press.
23. Gärdenfors, P. (2004). Conceptual Spaces: The Geometry of Thought. MIT Press.
24. Garey, M. R., & Johnson, D. S. (1979). Computers and Intractability: A Guide to the Theory of NP-Completeness. Freeman.
25. Gentner, D. (1983). Structure-mapping: A theoretical framework for analogy. Cognitive Science, 7 (2), 155-170.
26. Gentner, D. (1991). Language and the career of similarity. In Gelman, S., & Byrnes, J. (Eds.), Perspectives on Thought and Language: Interrelations in Development, pp. 225-277. Cambridge University Press.
27. Golub, G. H., & Van Loan, C. F. (1996). Matrix Computations (Third edition). Johns Hopkins University Press, Baltimore, MD.
28. Grefenstette, E., & Sadrzadeh, M. (2011). Experimenting with transitive verbs in a DisCo-Cat. In Proceedings of the GEMS 2011 Workshop on GEometrical Models of Natural Language Semantics.
29. Grice, H. P. (1989). Studies in the Way of Words. Harvard University Press, Cambridge, MA.
30. Guevara, E. (2010). A regression model of adjective-noun compositionality in distributional semantics. In Proceedings of the 2010 Workshop on GEometrical Models of Natural Language Semantics (GEMS 2010), pp. 33-37.
31. Harris, Z. (1954). Distributional structure. Word, 10 (23), 146-162.
32. Hearst, M. (1992). Automatic acquisition of hyponyms from large text corpora. In Proceed-ings of the 14th Conference on Computational Linguistics (COLING-92), pp. 539-545.
33. Herdaǧdelen, A., & Baroni, M. (2009). Bagpack: A general framework to represent semantic relations. In Proceedings of the EACL 2009 Geometrical Models for Natural Language Semantics (GEMS) Workshop, pp. 33-40.
34. Hirst, G., & St-Onge, D. (1998). Lexical chains as representations of context for the detection and correction of malapropisms. In Fellbaum, C. (Ed.), WordNet: An Electronic Lexical Database, pp. 305-332. MIT Press.
35. Jiang, J. J., & Conrath, D. W. (1997). Semantic similarity based on corpus statistics and lexical taxonomy. In Proceedings of the International Conference on Research in Computational Linguistics (ROCLING X), pp. 19-33, Tapei, Taiwan.
36. Johannsen, A., Alonso, H. M., Rishøj, C., & Søgaard, A. (2011). Shared task system description: Frustratingly hard compositionality prediction. In Proceedings of the Workshop on Distributional Semantics and Compositionality (DiSCo 2011), pp. 29-32, Portland, Oregon.
37. Jones, M. N., & Mewhort, D. J. K. (2007). Representing word meaning and order information in a composite holographic lexicon. Psychological review, 114, 1-37.
38. Jurgens, D. A., Mohammad, S. M., Turney, P. D., & Holyoak, K. J. (2012). SemEval-2012 Task 2: Measuring degrees of relational similarity. In Proceedings of the First Joint Conference on Lexical and Computational Semantics (*SEM), pp. 356-364, Montréal, Canada.
39. Kintsch, W. (2000). Metaphor comprehension: A computational theory. Psychonomic Bul-letin & Review, 7 (2), 257-266.
40. Kintsch, W. (2001). Predication. Cognitive Science, 25 (2), 173-202.
41. Kolda, T., & Bader, B. (2009). Tensor decompositions and applications. SIAM Review, 51 (3), 455-500.
42. Landauer, T. K. (2002). On the computational basis of learning and cognition: Arguments from LSA. In Ross, B. H. (Ed.), The Psychology of Learning and Motivation: Advances in Research and Theory, Vol. 41, pp. 43-84. Academic Press.
43. Landauer, T. K., & Dumais, S. T. (1997). A solution to Plato's problem: The latent semantic analysis theory of the acquisition, induction, and representation of knowledge. Psychological Review, 104 (2), 211-240.
44. Landauer, T. K., McNamara, D. S., Dennis, S., & Kintsch, W. (2007). Handbook of Latent Semantic Analysis. Lawrence Erlbaum, Mahwah, NJ.
45. Leacock, C., & Chodrow, M. (1998). Combining local context and WordNet similarity for word sense identification. In Fellbaum, C. (Ed.), WordNet: An Electronic Lexical Database. MIT Press.
46. Lee, D. D., & Seung, H. S. (1999). Learning the parts of objects by nonnegative matrix factorization. Nature, 401, 788-791.
47. Lepage, Y., & Shin-ichi, A. (1996). Saussurian analogy: A theoretical account and its application. In Proceedings of the 16th International Conference on Computational Linguistics (COLING 1996), pp. 717-722.
48. Lin, H., & Bilmes, J. (2011). A class of submodular functions for document summarization. In The 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies (ACL-HLT), pp. 510-520.
49. Mangalath, P., Quesada, J., & Kintsch, W. (2004). Analogy-making as predication using relational information and LSA vectors. In Proceedings of the 26th Annual Meeting of the Cognitive Science Society, p. 1623, Austin, TX.
50. McRae, K., Khalkhali, S., & Hare, M. (2011). Semantic and associative relations in adolescents and young adults: Examining a tenuous dichotomy. In Reyna, V., Chapman, S., Dougherty, M., & Confrey, J. (Eds.), The Adolescent Brain: Learning, Reasoning, and Decision Making, pp. 39-66. APA, Washington, DC.
51. Mitchell, J., & Lapata, M. (2008). Vector-based models of semantic composition. In Proceed-ings of ACL-08: HLT, pp. 236-244, Columbus, Ohio. Association for Computational Linguistics.
52. Mitchell, J., & Lapata, M. (2010). Composition in distributional models of semantics. Cognitive Science, 34 (8), 1388-1429.
53. Moschitti, A., & Quarteroni, S. (2008). Kernels on linguistic structures for answer extraction. In Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics on Human Language Technologies: Short Papers, p. 113116, Columbus, OH.
54. Nakov, P., & Hearst, M. (2006). Using verbs to characterize noun-noun relations. In Pro-ceedings of the 12th International Conference on Artificial Intelligence: Methodology, Systems, and Applications (AIMSA 2006), pp. 233-244, Varna, Bulgaria.
55. Nakov, P., & Hearst, M. (2007). UCB: System description for SemEval Task 4. In Proceed-ings of the Fourth International Workshop on Semantic Evaluations (SemEval 2007), pp. 366-369, Prague, Czech Republic.
56. Nastase, V., Sayyad-Shirabad, J., Sokolova, M., & Szpakowicz, S. (2006). Learning nounmodifier semantic relations with corpus-based and WordNet-based features. In Pro-ceedings of the 21st National Conference on Artificial Intelligence (AAAI-06), pp. 781-786.
57. Nastase, V., & Szpakowicz, S. (2003). Exploring noun-modifier semantic relations. In Proceedings of the Fifth International Workshop on Computational Semantics (IWCS-5), pp. 285-301, Tilburg, The Netherlands.
58. Niwa, Y., & Nitta, Y. (1994). Co-occurrence vectors from corpora vs. distance vectors from dictionaries. In Proceedings of the 15th International Conference On Computational Linguistics, pp. 304-309, Kyoto, Japan.
59. Óséaghdha, D., & Copestake, A. (2009). Using lexical and relational similarity to classify semantic relations. In Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics (EACL-09), Athens, Greece.
60. Pantel, P., & Lin, D. (2002). Discovering word senses from text. In Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 613-619, Edmonton, Canada.
61. Plate, T. (1995). Holographic reduced representations. IEEE Transactions on Neural Net-works, 6 (3), 623-641.
62. Pustejovsky, J. (1991). The generative lexicon. Computational Linguistics, 17 (4), 409-441.
63. Rapp, R. (2003). Word sense discovery based on sense descriptor dissimilarity. In Proceed-ings of the Ninth Machine Translation Summit, pp. 315-322.
64. Resnik, P. (1995). Using information content to evaluate semantic similarity in a taxonomy. In Proceedings of the 14th International Joint Conference on Artificial Intelligence (IJCAI-95), pp. 448-453, San Mateo, CA. Morgan Kaufmann.
65. Rosario, B., & Hearst, M. (2001). Classifying the semantic relations in noun-compounds via a domain-speci-c lexical hierarchy. In Proceedings of the 2001 Conference on Empirical Methods in Natural Language Processing (EMNLP-01), pp. 82-90.
66. Rosario, B., Hearst, M., & Fillmore, C. (2002). The descent of hierarchy, and selection in relational semantics. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL-02), pp. 247-254.
67. Sahlgren, M. (2006). The Word-Space Model: Using distributional analysis to represent syn-tagmatic and paradigmatic relations between words in high-dimensional vector spaces. Ph.D. thesis, Department of Linguistics, Stockholm University.
68. Santorini, B. (1990). Part-of-speech tagging guidelines for the Penn Treebank Project. Tech. rep., Department of Computer and Information Science, University of Pennsylvania. (3rd revision, 2nd printing).
69. Schütze, H. (1998). Automatic word sense discrimination. Computational Linguistics, 24 (1), 97-124.
70. Smolensky, P. (1990). Tensor product variable binding and the representation of symbolic structures in connectionist systems. Artificial Intelligence, 159-216.
71. Socher, R., Huang, E. H., Pennington, J., Ng, A. Y., & Manning, C. D. (2011). Dynamic pooling and unfolding recursive autoencoders for paraphrase detection. In Advances in Neural Information Processing Systems (NIPS 2011), pp. 801-809.
72. Socher, R., Manning, C. D., & Ng, A. Y. (2010). Learning continuous phrase representations and syntactic parsing with recursive neural networks. In Proceedings of the NIPS-2010 Deep Learning and Unsupervised Feature Learning Workshop.
73. Thater, S., Fürstenau, H., & Pinkal, M. (2010). Contextualizing semantic representations using syntactically enriched vector models. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pp. 948-957.
74. Turney, P. D. (2001). Mining the Web for synonyms: PMI-IR versus LSA on TOEFL. In Proceedings of the Twelfth European Conference on Machine Learning (ECML-01), pp. 491-502, Freiburg, Germany.
75. Turney, P. D. (2006a). Expressing implicit semantic relations without supervision. In Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics (Coling/ACL-06), pp. 313-320, Sydney, Australia.
76. Turney, P. D. (2006b). Similarity of semantic relations. Computational Linguistics, 32 (3), 379-416.
77. Turney, P. D. (2008a). The latent relation mapping engine: Algorithm and experiments. Journal of Artificial Intelligence Research, 33, 615-655.
78. Turney, P. D. (2008b). A uniform approach to analogies, synonyms, antonyms, and associations. In Proceedings of the 22nd International Conference on Computational Linguistics (Coling 2008), pp. 905-912, Manchester, UK.
79. Turney, P. D., & Littman, M. L. (2005). Corpus-based learning of analogies and semantic relations. Machine Learning, 60 (1-3), 251-278.
80. Turney, P. D., Littman, M. L., Bigham, J., & Shnayder, V. (2003). Combining independent modules to solve multiple-choice synonym and analogy problems. In Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP-03), pp. 482-489, Borovets, Bulgaria.
81. Turney, P. D., & Pantel, P. (2010). From frequency to meaning: Vector space models of semantics. Journal of Artificial Intelligence Research, 37, 141-188.
82. Utsumi, A. (2009). Computational semantics of noun compounds in a semantic space model. In Proceedings of the 21st International Joint Conference on Artificial Intelligence (IJCAI-09), pp. 1568-1573.
83. Veale, T. (2004). WordNet sits the SAT: A knowledge-based approach to lexical analogy. In Proceedings of the 16th European Conference on Artificial Intelligence (ECAI 2004), pp. 606-612, Valencia, Spain.
84. Widdows, D. (2008). Semantic vector products: Some initial investigations. In Proceedings of the 2nd Symposium on Quantum Interaction, Oxford, UK.