The influence of recent scene events on spoken comprehension: Evidence from eye movements

Journal of Memory and Language

Volumn 57, Issue 4, 2007, Pages 519-543

  Knoeferle, Pia ^a   Crocker, Matthew W ^a  

^a SAARLAND UNIVERSITY   (Germany)

Author keywords

Coordinated interplay account; Eye tracking; Language vision interaction; Priority of depicted events; Situated comprehension

Indexed keywords

EID: 34848862804     PISSN: 0749596X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jml.2007.01.003     Document Type: Article

References (26)

1. Altmann G.T.M. Language-mediated eye-movements in the absence of a visual world: The 'blank screen paradigm'. Cognition 93 (2004) B79-B87
2. Altmann G.T.M., and Kamide Y. Incremental interpretation at verbs: Restricting the domain of subsequent reference. Cognition 73 (1999) 247-264
3. Baayen R.H., Pipenbrock R., and Gulikers L. The celex lexical database (cd-rom) (1995), Linguistic Data Consortium, University of Pennsylvania, Philadelphia, PA
4. Baddeley A.D. Working memory (1986), Oxford University Press, Oxford, UK; New York
5. Ballard D., Hayhoe M., Pook P., and Rao R. Deictic codes for the embodiment of cognition. Behavioral and Brain Sciences 20 (1997) 723-767
6. Chambers C.G., Tanenhaus M.K., and Magnuson J.S. Actions and affordances in syntactic ambiguity resolution. Journal of Experimental Psychology: Learning, Memory, and Cognition 30 (2004) 687-696
7. de Almeida, R. G., di Nardo, J., & von Grunau, M. W. (2006). Understanding sentences in dynamic scenes. In Proceedings of the 19th Annual CUNY Conference. New York.
8. Dunham P.J., Dunham F., and Curwin A. Joint-attentional states and lexical acquisition at 18 months. Developmental Psychology 29 (1993) 827-831
9. Harris M., Jones D., Brookes S., and Grant J. Relations between the non-verbal context of maternal speech and rate of language development. British Journal of Developmental Psychology 4 (1986) 261-268
10. Henderson J.M., and Ferreira F. Scene perception for psycholinguists. In: Henderson J.M., and Ferreira F. (Eds). The interface of language, vision, and action: Eye movements and the visual world (2004), Psychology Press, New York 1-58
11. Howell D.C. Statistical methods for psychology. 5th ed. (2002), Duxbury, Pacific Grove
12. Jackendoff R. Foundations of language: Brain, meaning, grammar, evolution (2002), Oxford University Press, Oxford, UK
13. Kaiser E., and Trueswell J.C. The role of discourse context in the processing of a flexible word-order language. Cognition 94 (2005) 113-147
14. Kamide Y., Scheepers C., and Altmann G.T.M. Integration of syntactic and semantic information in predictive processing: Cross-linguistic evidence from German and English. Journal of Psycholinguistic Research 32 (2003) 37-55
15. Knoeferle, P. (in press). Comparing the time-course of processing initially ambiguous and unambiguous german SVO/OVS sentences in depicted events. In R. van Gompel, M. Fischer, W. Murray & R. Hill (Eds.), Eye movement research: insights into mind and brain. Oxford: Elsevier.
16. Knoeferle P., and Crocker M.W. The coordinated interplay of scene, utterance, and world knowledge: vidence from eye tracking. Cognitive Science 30 (2006) 481-529
17. Knoeferle P., Crocker M.W., Scheepers C., and Pickering M.J. The influence of the immediate visual context on incremental thematic role-assignment: Evidence from eye-movements in depicted events. Cognition 95 (2005) 95-127
18. Mayberry, M., Crocker, M. W., & Knoeferle, P. (2006). A connectionist model of the coordinated interplay of scene, utterance, and world knowledge. In Proceedings of the 28th Annual Conference of the Cognitive Science Society.
19. Richardson D.C., and Dale R. Looking to understand: The coupling between speakers' and listeners eye movements and its relationship to discourse comprehension. Cognitive Science 29 (2005) 1045-1060
20. Richardson, D.C., Dale, R., & Kirkham, N. (in press). The art of conversation is coordination: common ground and the coupling of eye movements during dialogue. Psychological Science.
21. Richardson D.C., and Spivey M.J. Representation, space and hollywood squares: Looking at things that aren't there anymore. Cognition 76 (2000) 269-295
22. Sedivy J.C., Tanenhaus M.K., Chambers C.G., and Carlson G.N. Achieving incremental semantic interpretation through contextual representation. Cognition 71 (1999) 109-148
23. Snow C. Mothers' speech research: From input to interaction. In: Snow C., and Ferguson C.A. (Eds). Talking to children: Language input and acquisition (1977), Cambridge University Press, Cambridge, MA
24. Spivey M.J., and Geng J.J. Oculomotor mechanisms activated by imagery and memory: Eye movements to absent objects. Psychological Research 65 (2001) 235-241
25. Spivey M.J., Richardson D.C., and Fitneva S. Thinking outside the brain: Spatial indices to linguistic and visual information. In: Henderson J., and Ferreira F. (Eds). The integration of language, vision and action (2004), Psychology Press, New York 161-189
26. Tanenhaus M.K., Spivey-Knowlton M.J., Eberhard K., and Sedivy J.C. Integration of visual and linguistic information in spoken language comprehension. Science 268 (1995) 632-634