Now you see it, now you don't: Mediating the mapping between language and the visual world

The Interface of Language, Vision, and Action: Eye Movements and the Visual World

Volumn , Issue , 2004, Pages 347-386

  Altmann, Gerry T M ^a   Kamide, Yuki ^b  

^a UNIVERSITY OF YORK   (United Kingdom)

^b UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84909247990     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4324/9780203488430     Document Type: Chapter

References (38)

1. Allopenna, P. D., Magnuson, J. S., & Tanenhaus, M. K. (1998). Tracking the time course of spoken word recognition using eye movements: Evidence for continuous mapping models. Journal of Memory and Language, 38 (4), 419-439.
2. Altmann, G. T. M. (1997). The ascent of Babel: An exploration of language, mind, and understanding. Oxford: Oxford University Press.
3. Altmann, G. T. M. (1999). Thematic role assignment in context. Journal of Memory and Language, 41, 124-145.
4. Altmann, G. T. M., & Kamide, Y. (1999). Incremental interpretation at verbs: Restricting the domain of subsequent reference. Cognition, 73 (3), 247-264.
5. Altmann, G. T. M. (in press). Languagemediated eye movements in the absence of a visual world: The "blank screen paradigm." Cognition.
6. Altmann, G. T. M., & Steedman, M. J. (1988). Interaction with context during human sentence processing. Cognition, 30 (3), 191-238.
7. Ballard, D. H., Hayhoe, M. M., Pook, P. K., & Rao, R. P. N. (1997). Deictic codes for the embodiment of cognition. Behavioral and Brain Sciences, 20(4), 723-767.
8. Barsalou, L. W. (1999). Perceptual symbol systems. Behavioral and Brain Sciences, 22 (4), 577-660.
9. Barsalou, L. W., Simmons, W. K., Barbey, A. K., & Wilson, C. D. (2003). Grounding conceptual knowledge in modality-specific systems. Trends in Cognitive Sciences, 7 (2), 84-91.
10. Brandt, S. A., & Stark, L. W. (1997). Spontaneous eye movements during visual imagery reflect the content of the visual scene. Journal of Cognitive Neuroscience, 9, 27-38.
11. Cooper, R. M. (1974). The control of eye fixation by the meaning of spoken language: A new methodology for the real-time investigation of speech perception, memory, and language processing. Cognitive Psychology, 6 (1), 84-107.
12. Crain, S., & Steedman, M. J. (1985). On not being led up the garden path: the use of context by the psychological parser. In D. Dowty, L. Karttunen & A. Zwicky (Eds.), Natural Language Parsing: Psychological, Computational, and Theoretical perspectives (pp. 320-358). Cambridge: Cambridge University Press.
13. Fischer, B. & Weber, H. (1993). Express saccades and visual attention. Behavioral and Brain Sciences, 16, 553-561.
14. Fodor, J. A., Bever, T. G., & Garrett, M. F. (1974). The psychology of language: An introduction to psycholinguistics and generative grammar. New York: McGraw-Hill.
15. Freyd, J. L. (1987). Dynamic mental representations. Psychological Review, 94 (4), 427-438.
16. Freyd, J. L., & Finke, R. A. (1984). Representational momentum. Journal of Experimental Psychology: Learning, Memory and Cognition, 10 (1), 126-132.
17. Freyd, J. L., Pantzer, T. M., & Chenk, J. L. (1988). Representing statics as forces in equilibrium. Journal of Experimental Psychology: General, 117(4), 395-407.
18. Glenberg, A. M. (1997). What memory is for. Behavioral and Brain Sciences, 20, 1-19.
19. Griffin, Z. M. (2001). Gaze durations during speech reflect word selection and phonological encoding. Cognition, 82, B1-B14.
20. Kamide, Y., Altmann, G. T. M., & Haywood, S. L. (2003). The time-course of prediction in incremental sentence processing: Evidence from anticipatory eye movements. Journal of Memory and Language, 49 (1), 133-156.
21. Laeng, B., & Teodorecu, D. (2002). Eye scanpaths during visual imagery reenact those of perception of the same visual scene. Cognitive Science, 26, 207-231.
22. Lakoff, G., & Johnson, M. (1999). Philosophy in the flesh: The embodied mind and its challenge to western thought. New York: Basic Books.
23. Marslen-Wilson, W. D. (1987). Functional parallelism in spoken word recognition. Cognition, 25, 71-102.
24. Matin, E., Shao, K., & Boff, K. (1993). Saccadic overhead: information processing time with and without saccades. Perception and Psychophysics, 53, 372-380.
25. McRae, K., Ferretti, T. R., & Amyote, L. (1997). Thematic roles as verb-specific concepts. Language and Cognitive Processes, 12 (2/3), 137-176.
26. Rayner, K., Slowiaczek, M.L., Clifton, C., & Bertera, J.H. (1983). Latency of sequential eye movements: implications for reading. Journal of Experimental Psychology: Human Perception and Performance, 9, 912-922.
27. Richardson, D. C., & Spivey, M.J. (2000). Representation, space and Hollywood squares: looking at things that aren't there anymore. Cognition, 76, 269-295.
28. Saslow, M. G. (1967). Latency for saccadic eye movement. Journal of the Optical Society of America, 57, 1030-1033.
29. Spivey, M.J., & Geng, J. J. (2001). Oculomotor mechanisms activated by imagery and memory: eye movements to absent objects. Psychological Research, 65, 235-241.
30. Tanenhaus, M. K., Carlson, G., & Trueswell, J. C. (1989). The role of thematic structures in interpretation and parsing. Language and Cognitive Processes, 4 (3/4), SI 211-234.
31. Tanenhaus, M. K., Spivey-Knowlton, M. J., Eberhard, K. M., & Sedivy, J. C. (1995). Integration of Visual and Linguistic Information in Spoken Language Comprehension. Science, 268, 1632-1634.
32. Travis, R. C. (1936). The latency and velocity of the eye in saccadic movements. Psychological Monographs, 47, 242-249.
33. Tyler, L. K., & Marslen-Wilson, W. D. (1977). The on-line effects of semantic context on syntactic processing. Journal of Verbal Learning and Verbal Behavior, 16, 683-692.
34. Van der Meer, E., Beyer, R., Heinze, B., & Badel, I. (2002). Temporal order relations in language comprehension. Journal of Experimental Psychology: Learning, Memory and Cognition, 28 (4), 770-779.
35. Zambarbieri, D., Schmid, R., Magenes, G., & Prablanc, C. (1982). Saccadic responses evoked by presentation of visual and auditory targets. Experimental Brain Research, 47, 417-427.
36. Zwaan, R.A. (1996). Processing narrative time shifts. Journal of Experimental Psychology: Learning, Memory and Cognition, 22 (5), 1196-1207.
37. Zwaan, R.A., Langston, M.C., & Graesser, A.C. (1995). The construction of situation models in narrative comprehension- An event-indexing model. Psychological Science, 6 (5), 292-297.
38. Zwitserlood, P. (1989). The locus of the effects of sentential-semantic context in spokenword processing. Cognition, 32, 25-64.