Integrating Experiential and Distributional Data to Learn Semantic Representations

Psychological Review

Volumn 116, Issue 3, 2009, Pages 463-498

  Andrews, Mark ^a   Vigliocco, Gabriella ^a   Vinson, David ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Bayesian models; computational models; distributional data; probabilistic models; semantic representations

Indexed keywords

ARTICLE; ASSOCIATION; BAYES THEOREM; CONCEPT FORMATION; HUMAN; LEARNING; LINGUISTICS; PSYCHOLOGICAL MODEL; PSYCHOMOTOR PERFORMANCE; SEMANTICS; SPEECH; STATISTICAL DISTRIBUTION; STATISTICAL MODEL; WRITING;

ASSOCIATION; BAYES THEOREM; CONCEPT FORMATION; HUMANS; MODELS, PSYCHOLOGICAL; MODELS, STATISTICAL; PSYCHOLINGUISTICS; PSYCHOMOTOR PERFORMANCE; SEMANTICS; SPEECH; STATISTICAL DISTRIBUTIONS; VERBAL LEARNING; WRITING;

EID: 67651176167     PISSN: 0033295X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0016261     Document Type: Article

References (116)

1. Anderson J. The architecture of cognition (1983), Harvard University Press, Cambridge, MA
2. Aziz-Zadeh L., Wilson S.M., Rizzolatti G., and Iacoboni M. Congruent embodied representations for visually presented actions and linguistic phrases describing actions. Current Biology 16 (2006) 1818-1823
3. Barsalou L.W., and Wiemer-Hastings K. Situating abstract concepts. In: Pecher D., and Zwaan R.A. (Eds). Grounding cognition: The role of perception and action in memory, language, and thinking (2005), Cambridge University Press, Cambridge, England 129-163
4. Beauchamp M.S., Lee K.E., Haxby J.V., and Martin A. Parallel visual motion processing streams for manipulable objects and human movements. Neuron 34 (2002) 149-159
5. Blei D., Ng A., and Jordan M. Latent Dirichlet allocation. Journal of Machine Learning Research 3 (2003) 993-1022
6. Bock J.K. A sketchbook of production problems. Journal of Psycholinguistic Research 20 (1991) 141-160
7. Box G.E.P., and Tiao G.C. Bayesian inference in statistical analysis (1973), Addison-Wesley, Reading, MA
8. Buccino G., Riggio L., Melli G., Binkofski F., Gallese V., and Rizzolatti G. Listening to action-related sentences modulates the activity of the motor system: A combined TMS and behavioural study. Cognitive Brain Research 24 (2005) 355-363
9. Burgess C., and Lund K. Modeling parsing constraints with high-dimensional context space. Language and Cognitive Processes 12 (1997) 177-210
10. Burnard L. What is the BNC? (2009). http://www.natcorp.ox.ac.uk/corpus/index.xml Retrieved June 1, 2009, from http://www.natcorp.ox.ac.uk/corpus/index.xml
11. Butterworth B. Lexical access and representation in speech production. In: Marslen-Wilson W. (Ed). Lexical representation and process (1989), MIT Press, Cambridge, MA 108-135
12. Carey S. Conceptual change in infancy (1985), MIT Press, Cambridge, MA
13. Chao L.L., Haxby J., and Martin A. Attribute-based neural substrates in temporal cortex for perceiving and knowing about objects. Nature Neuroscience 2 (1999) 913-919
14. Chao L.L., and Martin A. Representation of manipulable man-made objects in the dorsal stream. NeuroImage 12 (2000) 478-484
15. Chao L.L., Weisberg J., and Martin A. Experience-dependent modulation of category-related cortical activity. Cerebral Cortex 12 (2002) 545-551
16. Chomsky N. Knowledge of language: Its nature, origin and use (1986), Greenwood Press, New York
17. Collins A., and Loftus E.F. A spreading-activation theory of semantic processing. Psychological Review 82 (1975) 407-428
18. Collins A., and Quillian M. Retrieval time from semantic memory. Journal of Verbal Learning and Verbal Behavior 12 (1969) 240-247
19. Coltheart M. The MRC psycholinguistic database. Quarterly Journal of Experimental Psychology: Human Experimental Psychology 33 A (1981) 497-505
20. Cree G.S., McRae K., and McNorgan C. An attractor model of lexical conceptual processing: Simulating semantic priming. Cognitive Science 23 (1999) 371-414
21. Damasio H., Grabowski T.J., Tranel D., Ponto L.L.B., Hichwa R.D., and Damasio A.R. Neural correlates of naming actions and of naming spatial relations. NeuroImage 13 (2001) 1053-1064
22. Deerwester S., Dumais S., Furnas G., Landauer T., and Harshman R. Indexing by latent semantic analysis. Journal of the American Society for Information Science 41 (1990) 391-407
23. Dell G.S. A spreading activation theory of retrieval in sentence production. Psychological Review 93 (1986) 283-321
24. Devlin J.T., Gonnerman L.M., Andersen E.S., and Seidenberg M.S. Category-specific semantic deficits in focal and widespread brain damage: A computational account. Journal of Cognitive Neuroscience 10 (1998) 77-94
25. Farah M., and McClelland J.L. A computational model of semantic memory impairment: Modality specificity and emergent category specificity. Journal of Experimental Psychology: General 120 (1991) 339-357
26. Firth J.R. A synopsis of linguistic theory 1930-1955. Studies in linguistic analysis (1957), Blackwell Publishers, Oxford, England 1-32
27. Garrett M.F. The organization of processing structure for language production: Applications to aphasic speech. In: Caplan D., Lecours A.R., and Smith A. (Eds). Biological perspectives on language (1984), MIT Press, Cambridge, MA 172-193
28. Garrett M.F. Lexical retrieval processes: Semantic field effects. In: Lehrer A., and Kittay E.F. (Eds). Frames, fields and contrasts: New essays in semantic and lexical organization (1992), Erlbaum, Hillsdale, NJ 377-395
29. Garrett M.F. Errors and their relevance for models of language production. In: Blanken G., Dittman J., Grim H., Marshall J., and Wallesch C. (Eds). Linguistic disorders and pathologies: An international handbook (1993), Walter de Gruyter, Berlin, Germany 72-91
30. Gelman A., Carlin J.B., Stern H.S., and Rubin D.B. Bayesian data analysis. 2nd ed. (2003), Chapman & Hall
31. Gelman S.A., and Markman E.M. Categories and induction in young children. Cognition 23 (1986) 183-209
32. Gerlach C., Law I., and Paulson O.B. When action turns to words: Activation of motor-based knowledge during categorisation of manipulable objects. Journal of Cognitive Neuroscience 14 (2002) 1230-1239
33. Gibson J.J. The theory of affordances. In: Shaw R.E., and Bransford J. (Eds). Perceiving, acting and knowing: Toward an ecological psychology (1977), Erlbaum, Hillsdale, NJ 67-82
34. Gibson J.J. The ecological approach to visual perception (1979), Houghton, Mifflin, Boston
35. Gilks W.R., and Wild P. Adaptive rejection sampling for Gibbs sampling. Applied Statistics 41 (1992) 337-348
36. Glaser W.R., and Düngelhoff R. The time course of picture-word interference. Journal of Experimental Psychology: Human Perception and Performance 10 (1984) 640-654
37. Glenberg A.M., and Robertson D.A. Symbol grounding and meaning: A comparison of high-dimensional and embodied theories of meaning. Journal of Memory and Language 43 (2000) 379-401
38. Glenberg A.M., Sato M., and Cattaneo L. Use-induced motor plasticity affects the processing of abstract and concrete language processing. Current Biology 18 (2008) 290-291
39. Grabowski T.J., Damasio H., and Damasio A.R. Premotor and prefrontal correlates of category-related lexical retrieval. NeuroImage 7 (1998) 232-243
40. Griffiths T., and Steyvers M. A probabilistic approach to semantic representation. In: Gray W.D., and Schunn C. (Eds). Proceedings of the Twenty-Fourth Annual Conference of the Cognitive Science Society (2002), Erlbaum, Mahwah, NJ 381-386
41. Griffiths T., and Steyvers M. Prediction and semantic association. In: Becker S.T.S., and Obermayer K. (Eds). Advances in neural information processing systems 15 (2003), MIT Press, Cambridge, MA 11-18
42. Griffiths T., and Steyvers M. Finding scientific topics. Proceedings of the National Academy of Sciences, USA 101 (2004) 5228-5235
43. Griffiths T., Steyvers M., and Tenenbaum J. Topics in semantic representation. Psychological Review 114 (2007) 211-244
44. Harley T.A. A critique of top-down independent levels models of speech production: Evidence from non-plan-internal speech errors. Cognitive Science 8 (1984) 191-219
45. Harley T.A., and MacAndrew S.B.G. Modelling paraphasias in normal and aphasic speech. Proceedings of the 14th Annual Conference of the Cognitive Science Society (1993), Erlbaum, Hillsdale, NJ 378-383
46. Harley T.A., and MacAndrew S.B.G. Constraints upon word substitution speech errors. Journal of Psycholinguistic Research 30 (2001) 395-418
47. Harris Z. Distributional structure. Word 10 (1954) 146-162
48. Hinton G.E., and Shallice T. Lesioning an attractor network: Investigation of acquired dyslexia. Psychological Review 93 (1991) 74-95
49. Hofmann T. Probabilistic latent semantic analysis. In: Laskey K.B., and Prade H. (Eds). Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence (1999), Morgan Kaufmann, San Francisco 289-296
50. Hofmann T. Probabilistic latent semantic indexing. Proceedings of the Twenty-Second Annual International SIGIR Conference on Research and Development in Information Retrieval (1999), ACM, New York 50-57
51. Howell S., and Becker S. Modelling language acquisition: Grammar from the lexicon?. In: Moore J.D., and Stenning K. (Eds). Proceedings of the 23rd Annual Conference of the Cognitive Science Society (2001), Erlbaum, Mahwah, NJ 457-462
52. Howell, S., Becker, S., & Jankowicz, D. (2001). Modelling language acquisition: Lexical grounding through perceptual features. In R. Pfeifer & G. Westermann (Eds.), Proceedings of the 2001 Workshop on Developmental Embodied Cognition (DECO-2001) (pp. 36-40). Edinburgh, Scotland: [no publisher named].
53. Howell S., Jankowicz D., and Becker S. A model of grounded language acquisition: Sensorimotor features improve grammar learning. Journal of Memory and Language 53 (2005) 258-276
54. Ishai A., Ungerleider L.G., Martin A., Schouten J.L., and Haxby J.V. Distributed representation of objects in the human ventral visual pathway. Proceedings of the National Academy of Sciences, USA 96 (1999) 9379-9384
55. Kass R.E., and Raftery A.E. Bayes factors. Journal of the American Statistical Association 90 (1995) 773-795
56. Keil F.C. Semantic and conceptual development: An ontological perspective (1979), Harvard University Press, Cambridge, MA
57. Keil F.C. Concepts, kinds and cognitive development (1989), MIT Press, Cambridge, MA
58. Kiss G., Armstrong C., Milroy R., and Piper J. An associative thesaurus of English and its computer analysis. In: Aitken A., Bailey R., and Hamilton-Smith N. (Eds). The computer and literary studies (1973), University Press, Edinburgh, Scotland 153-165
59. Landau B., and Gleitman L. Language and experience (1985), Harvard University Press, Cambridge, MA
60. Landauer T., and Dumais S. A solution to Plato's problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychological Review 104 (1997) 211-240
61. Landauer T., Laham D., and Foltz P. Learning human-like knowledge by singular-value decomposition: A progress report. In: Jordan M.I., Kearns M.J., and Solla S.A. (Eds). Advances in neural information processing systems (1998), MIT Press, Cambridge, MA 45-51
62. Landauer T., Laham D., Rehder B., and Schreiner M. How well can passage meaning be derived without using word order? A comparison of latent semantic analysis and humans. In: Shafto M.G., and Langley P. (Eds). Proceedings of the nineteenth annual conference of the cognitive science society (1997), Erlbaum, Mahwah, NJ 412-417
63. Lee P.M. Bayesian statistics: An introduction (2004), Hodder Arnold, London, England
64. Levelt W.J.M., Roelofs A., and Meyer A. A theory of lexical access in speech production. Behavioral and Brain Sciences 22 (1999) 1-28
65. Locke J. An essay concerning human understanding (1975), Clarendon Press, Oxford, England (Original work published 1689)
66. Louwerse M.M. Embodied relations are encoded in language. Psychonomic Bulletin & Review 15 (2008) 838-844
67. Lund K., and Burgess C. Producing high-dimensional semantic spaces from lexical co-occurrence. Behavior Research Methods, Instruments, & Computers 28 (1996) 203-208
68. Lund K., Burgess C., and Atchley R.A. Semantic and associative priming in high-dimensional semantic space. In: Moore J.D., and Lehman J.F. (Eds). Proceedings of the Seventeenth Annual Conference of the Cognitive Science Society (1995), Erlbaum, Mahwah, NJ 660-665
69. Lupker S. Semantic nature of response competition in the picture-word interference task. Memory & Cognition 7 (1979) 485-495
70. Macario J.F. Young children's use of color in classification: Foods and canonically colored objects. Cognitive Development 6 (1991) 17-46
71. Mandler J.M. Perceptual and conceptual processes in infancy. Journal of Cognitive Development 1 (2000) 2-36
72. Mandler J.M., Bauer P.J., and McDonough L. Separating the sheep from the goats. Cognitive Psychology 23 (1991) 263-298
73. Martin A., and Chao L.L. Semantic memory and the brain: Structure and processes. Current Opinion in Neurobiology 11 (2001) 194-201
74. Martin A., Haxby J.V., Lalonde F.M., Wiggs C.L., and Ungerleider L.G. Discrete cortical regions associated with knowledge of color and knowledge of action. Science 270 (1995, October 6) 102-105
75. Martin A., Wiggs C.L., Ungerleider L.G., and Haxby J.V. Neural correlates of category-specific knowledge. Nature 379 (1996, February 15) 649-652
76. McClelland J., and Rogers T. The parallel distributed processing approach to semantic cognition. Nature Reviews Neuroscience 4 (2003) 310-322
77. McClelland J., and Rumelhart D. Distributed memory model and the representation of general and specific information. Journal of Experimental Psychology: General 114 (1985) 159-188
78. McRae K., and Boisvert S. Automatic semantic similarity priming. Journal of Experimental Psychology: Learning, Memory, and Cognition 24 (1998) 558-572
79. McRae K., de Sa V., and Seidenberg M. On the nature and scope of featural representation of word meaning. Journal of Experimental Psychology: General 126 (1997) 99-130
80. Meyer D., and Schvaneveldt R. Facilitation in recognizing pairs of words: Evidence of a dependence between retrieval operations. Journal of Experimental Psychology 90 (1971) 227-234
81. Nelson D., McEvoy C., and Schreiber T. The University of South Florida word association, rhyme and word fragment norms. Behavior Research Methods, Instruments, & Computers 36 (2004) 408-420
82. Newton M.A., and Raftery A.E. Approximate Bayesian inference with the weighted likelihood bootstrap. Journal of the Royal Statistical Society: Methodological 56 B (1994) 3-48
83. Norman D.A. The psychology of everyday things (1988), Basic Books, New York
84. Oliveri M., Finocchiaro C., Shapiro K., Gangitano M., Caramazza A., and Pascual-Leone A. All talk and no action: A transcranial magnetic stimulation study of motor cortex activation during action word production. Journal of Cognitive Neuroscience 16 (2004) 374-381
85. Paivio A. Imagery and verbal processes (1971), Holt, Rinehart & Winston, New York
86. Paivio A. Mental representations: A dual-coding approach (1990), Oxford University Press, New York (Original work published 1986)
87. Phillips J., Noppeney U., Humphreys G.W., and Price C.J. Can segregation within the semantic system account for category-specific deficits?. Brain 125 (2002) 2067-2080
88. Plaut D.C., and Shallice T. Deep dyslexia: A case study of connectionist neuropsychology. Cognitive Neuropsychology 10 (1993) 377-500
89. Poesio M., and Almuhareb A. Feature-based vs. property-based KR: An empirical perspective. In: Varzi A.C., and Vieu L. (Eds). Formal ontology in information systems: Proceedings of the third conference (FOIS-2004) (2004), IOS Press, Amsterdam 177-184
90. Pulvermüller F. Words in the brain's language. Behavioral and Brain Sciences 22 (1999) 253-336
91. Pulvermüller F. Brain reflections of words and their meanings. Trends in Cognitive Sciences 5 (2001) 517-524
92. Pulvermüller F., and Hauk O. Category-specific conceptual processing of color and form in left fronto-temporal cortex. Cerebral Cortex 16 (2005) 1193-1201
93. Pulvermüller F., Hauk O., Nikulin V.V., and Ilmoniemi R.J. Functional links between motor and language systems. European Journal of Neuroscience 21 (2005) 793-797
94. Quillian M.R. Word concepts: A theory and simulation of some basic semantic capabilities. Behavioral Science 12 (1967) 410-430
95. Quillian M.R. The teachable language comprehender: A simulation program and theory of language. Communications of the ACM 12 (1969) 459-476
96. Rips L.J., Shoben E.J., and Smith E.E. Semantic distance and the verification of semantic relations. Journal of Verbal Learning and Verbal Behavior 12 (1973) 1-20
97. Rogers T., and McClelland J. Semantic cognition: A parallel distributed processing account (2005), MIT Press, Cambridge, MA
98. Rosch E., Mervis C.B., Gray W.D., Johnson D.M., and Boyes-Braem P. Basic objects in natural categories. Cognitive Psychology 8 (1976) 382-439
99. Rosinski R. Picture-word interference is semantically based. Child Development 48 (1977) 643-647
100. Roy D.K., and Pentland A.P. Learning words from sights and sounds: A computational model. Cognitive Science 26 (2002) 113-146
101. Salton G., and McGill M.J. Introduction to modern information retrieval (1983), McGraw-Hill, New York
102. Schütze H. Dimensions of meaning (1992), IEEE Computer Society Press, Washington, DC
103. Schriefers H., Meyer A., and Levelt W. Exploring the time course of lexical access in language production: Picture-word interference studies. Journal of Memory and Language 29 (1990) 86-102
104. Sivia D.S., and Skilling J. Data analysis: A Bayesian tutorial (2006), Oxford University Press, Oxford, England
105. Smith E., Shoben E., and Rips L. Structure and process in semantic memory: Featural model for semantic decisions. Psychological Review 81 (1974) 214-241
106. Smith L.B., and Yu C. Infants rapidly learn word-referent mappings via cross-situational statistics. Cognition 106 (2008) 333-338
107. Stroop J. Studies of interference in serial verbal reactions. Journal of Experimental Psychology 8 (1935) 291-309
108. Tettamanti M., Buccino G., Saccuman M.C., Gallese V., Danna M., Scifo P., et al. Listening to action-related sentences activates fronto-parietal motor circuits. Journal of Cognitive Neuroscience 17 (2005) 273-281
109. Tyler L.K., Moss H.E., Durrant-Peatfield M.R., and Levy J.P. Conceptual structure and the structure of concepts: A distributed account of category-specific deficits. Brain and Language 75 (2000) 195-231
110. Vigliocco G., Vinson D.P., Lewis W., and Garrett M.F. Representing the meanings of object and action words: The featural and unitary semantic space hypothesis. Cognitive Psychology 48 (2004) 422-488
111. Vigliocco G., Warren J., Siri S., Arciuli J., Scott S., and Wise R. The role of semantics and grammatical class in the neural representation of words. Cerebral Cortex 16 (2006, December) 1790-1796
112. Vinson D., and Vigliocco G. A semantic analysis of noun-verb dissociations in aphasia. Journal of Neurolinguistics 15 (2002) 317-351
113. Vuilleumier P., Henson R.N., Driver J., and Dolan R.J. Multiple levels of visual object constancy revealed by event-related fMRI of repetition priming. Nature Neuroscience 5 (2002) 491-499
114. Wauters L.N., Tellings A.E., Van Bon W.H., and Van Haaften A.W. Mode of acquisition of word meanings: The viability of a theoretical construct. Applied Psycholinguistics 24 (2003) 385-406
115. Wittgenstein L. Philosophical investigations (1997), Blackwell Publishers, Oxford, England (Original work published 1953)
116. Yu C., and Smith L.B. Rapid word learning under uncertainty via cross-situational statistics. Psychological Science 18 (2007) 414-420