Spatial language, visual attention, and perceptual simulation

Brain and Language

Volumn 112, Issue 3, 2010, Pages 202-213

  Coventry, Kenny R ^a,b   Lynott, Dermot ^c   Cangelosi, Angelo ^d   Monrouxe, Lynn ^e   Joyce, Dan ^f   Richardson, Daniel C ^g  

^a NORTHUMBRIA UNIVERSITY   (United Kingdom)

^b Hanse Institute for Advanced Studies   (Germany)

^c UNIVERSITY OF MANCHESTER   (United Kingdom)

^d UNIVERSITY OF PLYMOUTH   (United Kingdom)

^e CARDIFF UNIVERSITY   (United Kingdom)

^f KING'S COLLEGE LONDON   (United Kingdom)

^g UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Motion processing; Perceptual simulation; Spatial language; Visual attention

Indexed keywords

ARTICLE; BRAIN FUNCTION; CONTROLLED STUDY; EYE TRACKING; HUMAN; HUMAN EXPERIMENT; LANGUAGE; LANGUAGE ABILITY; LINGUISTICS; NORMAL HUMAN; PERCEPTIVE DISCRIMINATION; SENSORY STIMULATION; TASK PERFORMANCE; VISION; VISUAL DISCRIMINATION;

ANALYSIS OF VARIANCE; ATTENTION; EYE MOVEMENT MEASUREMENTS; FIXATION, OCULAR; HUMANS; JUDGMENT; LANGUAGE; LANGUAGE TESTS; MODELS, PSYCHOLOGICAL; NEUROPSYCHOLOGICAL TESTS; PHOTIC STIMULATION; PSYCHOLINGUISTICS; SPACE PERCEPTION; TIME FACTORS; VISUAL PERCEPTION;

EID: 77649341660     PISSN: 0093934X     EISSN: 10902155     Source Type: Journal    
DOI: 10.1016/j.bandl.2009.06.001     Document Type: Article

References (39)

1. Allopena P.D., Magnuson J.S., and Tanenhaus M.K. Tracking the time course of spoken word recognition using eye movements: Evidence for continuous mapping models. Journal of Memory and Language 38 (1998) 419-439
2. Altmann G.T.M., and Kamide Y. The real-time mediation of visual attention by language and world knowledge: Linking anticipatory (and other) eye movements to linguistic processing. Journal of Memory and Language 57 (2007) 502-518
3. Barsalou L.W. Perceptual symbol systems. Behavioral and Brain Sciences 22 4 (1999) 577-660
4. Cangelosi A., Coventry K.R., Rajapakse R., Joyce D., Bacon A., Richards L., et al. Grounding language in perception: A connectionist model of spatial terms and vague quantifiers. In: Cangelosi A., Bugmann G., and Borisyuk R. (Eds). Modelling language, cognition and action (2005), World Scientific, Singapore 47-56
5. Carlson L.A., Regier T., Lopez B., and Corrigan B. Attention unites form and function in spatial language. Spatial Cognition and Computation 6 (2006) 295-308
6. Carlson-Radvansky L.A., Covey E.S., and Lattanzi K.M. "What" effects on "where": Functional influences on spatial relations. Psychological Science 10 (1999) 516-521
7. Carlson-Radvansky L.A., and Tang Z. Functional influences on orienting a reference frame. Memory & Cognition 28 5 (2000) 812-820
8. Chambers C.G., Tanenhaus M.K., Eberhard K.M., Filip H., and Carlson G.N. Circumscribing referential domains during real-time language comprehension. Journal of Memory and Language 47 1 (2002) 30-49
9. Coventry K.R., Cangelosi A., Rajapakse R., Bacon A., Newstead S.N., Joyce D., et al. Spatial prepositions and vague quantifiers: Implementing the functional geometric framework. In: Freksa C., Knauff B., Krieg-Bruckner B., and Nebel B. (Eds). Spatial cognition IV. Reasoning, action and interaction. Lecture notes in computer science (2005), Springer-Verlag 98-110
10. Coventry, K. R., Christophel, T., Fehr, T., Valdés, B., & Herrmann, M. (in preparation). MT+ activation for static images is driven by knowledge of functional relations and language.
11. Coventry K.R., and Garrod S.C. Saying, seeing and acting. The psychological semantics of spatial prepositions (2004), Psychology Press Taylor & Francis Group, Hove and New York
12. Coventry K.R., and Garrod S.C. Spatial prepositions and the functional geometric framework. Towards a classification of extra-geometric influences. In: Carlson L.A., and van der Zee E. (Eds). Functional features in language and space: Insights from perception, categorisation and development (2005), Oxford University Press, Oxford, UK 163-173
13. Coventry K.R., Prat-Sala M., and Richards L. The interplay between geometry and function in the comprehension of over, under, above and below. Journal of Memory and Language 44 3 (2001) 376-398
14. Damasio H., Grabowski T.J., Tranel D., Ponto L.L.B., Hichwa R.D., and Damasio A.D. Neural correlates of naming actions and of naming spatial relations. NeuroImage 13 (2001) 1053-1064
15. Dupont P., Orban G.A., De Bruyn B., Verbruggen A., and Mortelmans I. Many areas in the human brain respond to visual motion. Journal of Neurophysiology 72 (1994) 1420-1424
16. Edelman S. Constraining the neural representation of the world. Trends in Cognitive Science 6 (2002) 125-131
17. Elman J.L. Finding structure in time. Cognitive Science 14 (1990) 179-211
18. Garrod S., Ferrier G., and Campbell S. In and on: Investigating the functional geometry of spatial prepositions. Cognition 72 (1999) 167-189
19. Georgopolous A.P., Schwartz A.B., and Kettner R.E. Neuronal population coding of movement direction. Science 223 (1986) 1416-1419
20. Hayward W.G., and Tarr M.J. Spatial language and spatial representation. Cognition 55 (1995) 39-84
21. Jaeger T.F. Categorical data analysis: Away from ANOVAs (transformation or not) and towards logit mixed models. Journal of Memory and Language 59 (2008) 434-446
22. Joyce D., Richards L., Cangelosi A., and Coventry K.R. Object representation-by-fragments in the visual system: A neurocomputational model. In: Wang L., Rajapakse J.C., Fukushima K., Lee S.Y., and Yao X. (Eds). Proceedings of the 9th international conference on neural information processing (ICONP02) (2002), IEEE Press, Singapore
23. Joyce D.W., Richards L.V., Cangelosi A., and Coventry K.R. On the foundations of perceptual symbol systems: Specifying embodied representations via connectionism. In: Dretje F., Dorner D., and Schaub H. (Eds). The logic of cognitive systems. Proceedings of the fifth international conference on cognitive modelling (2003), Universitats-Verlag Bamberg, Germany 147-152
24. Kaschak M.P., and Glenberg A.M. This construction needs learned. Journal of Experimental Psychology: General 133 (2004) 450-467
25. Kemmerer D. The semantics of space: Integrating linguistic typology and cognitive neuroscience. Neuropsychologia 44 (2006) 1607-1621
26. Knoeferle P., and Crocker M. The coordinated interplay of scene, utterance, and world knowledge: Evidence from eye tracking. Cognitive Science 30 (2006) 481-529
27. Kourtzi Z., and Kanwisher N. Activation in human MT/MST by static images with implied movement. Journal of Cognitive Neuroscience 12 (2000) 48-55
28. Landau B., and Jackendoff R. 'What' and 'where' in spatial language and cognition. Behavioural and Brain Sciences 16 2 (1993) 217-265
29. Lin E.L., and Murphy G.L. Effect of background knowledge on object categorization and part detection. Journal of Experimental Psychology: Human Perception and Performance 23 (1997) 1153-1169
30. Logan G., and Sadler D. A computational analysis of the apprehension of spatial relations. In: Bloom P., Peterson M., Nadel L., and Garrett M. (Eds). Language and space (1996), MIT Press, Cambridge, MA 493-529
31. Pulvermüller F. Words in the brain's language. Behavioral and Brain Sciences 22 (1999) 253-336
32. Regier T. The human semantic potential: Spatial language and constrained connectionism (1996), MIT Press, Cambridge MA
33. Regier T., and Carlson L. Grounding spatial language in perception: An empirical and computational investigation. Journal of Experimental Psychology; General 130 2 (2001) 273-298
34. Talmy L. How language structures space. In: Pick H., and Acredolo L. (Eds). Spatial orientation: Theory. research and application (1983), Plenum Press, New York 225-282
35. Tanenhaus M.K., Spivey-Knowlton M.J., Eberhard K.M., and Sedivy J.C. Integration of visual and linguistic information in spoken language comprehension. Science 268 5217 (1995) 1632-1634
36. Tyler A., and Evans V. The semantics of english prepositions: Spatial scenes, embodied experience and cognition (2003), Cambridge University Press, Cambridge
37. Ullman S. High-level vision: Object recognition and visual cognition (1996), MIT Press, Cambridge, MA
38. Vandeloise C. Spatial prepositions. A case study from French (1991), University of Chicago Press
39. Zwaan R.A. The immersed experiencer: Toward an embodied theory of language comprehension. In: Ross B.H. (Ed). The psychology of learning and motivation Vol. 43 (2004), Academic Press, New York 35-62