Can speaker gaze modulate syntactic structuring and thematic role assignment during spoken sentence comprehension?

Frontiers in Psychology

Volumn 3, Issue DEC, 2012, Pages

  Knoeferle, Pia ^a   Kreysa, Helene ^a  

^a BIELEFELD UNIVERSITY   (Germany)

Author keywords

Eye tracking; Sentence structure; Speaker gaze; Visual context effects; Visually situated sentence comprehension

Indexed keywords

EID: 84874571027     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2012.00538     Document Type: Article

References (29)

1. Altmann, G. T. M. (2004). Language-mediated eye-movements in the absence of a visual world: the 'blank screen paradigm'.Cognition 93, B79- B87.
2. Altmann, G. T. M., and Kamide, Y. (2007). The real-time mediation of visual attention by language and world knowledge: linking anticipatory (and other) eye movements to linguistic processing. J. Mem. Lang. 57, 502-518.
3. Altmann, G. T. M., and Kamide, Y. (2009). Discourse-mediation of the mapping between language and the visual world: eye movements and mental representation. Cognition 111, 55-71.
4. Campana, E., Silverman, L., Tanenhaus, M. K., Bennetto, L., and Packard, S. (2005). Real-Time Integration of Gesture and Speech During Reference Resolution, pp. 378-383. Mahwah, NJ: Lawrence Erlbaum.
5. Carpenter, P. A., and Just, M. A. (1975). Sentence comprehension: a psy-cholinguistic processing model of verification. Psychol. Rev. 82, 45-73.
6. Chambers, C.G., Tanenhaus, M. K.,and Magnuson, J. S. (2004). Actions and affordances in syntactic ambiguity resolution. J. Exp. Psychol. Learn. Mem. Cogn. 30, 687-696.
7. Clark, H. H., and Chase, W. G. (1972). On the process of comparing sentences against pictures. Cogn. Psychol. 3, 472-517.
8. Cline, M. (1967). The perception of where a person is looking. Am. J. Psychol. 80, 41-50.
9. Dahan, D., and Tanenhaus, M. (2005). Looking at the rope when looking for the snake: conceptually mediated eye movements during spoken-word recognition. Psychon. Bull. Rev. 12, 453-459.
10. Field, A.(2005).Introduction to Statistics Using SPSS. London: Sage Publications.
11. Gibson, J., and Pick, A. (1963). Perception of another person's looking behavior. Am. J. Psychol. 76, 386-394.
12. Gough, P.B.(1965).Grammaticaltrans-formations and speed of understanding. J. Verbal Learning Verbal Behav. 5, 107-111.
13. Hanna, J., and Brennan, S. (2008). Speaker's eye gaze disambiguates referring expressions early during face-to-face conversation. JML 57, 596-615.
14. Hemforth, B. (1993). Kognitives Parsing: Repräsentation und Verar-beitung sprachlichen Wissens. Sankt Augustin: Infix-Verlag.
15. Holle, H., Obermeier, C., Schmidt-Kassow, M., Friederici, A. D., Ward, J., and Gunter, T. C. (2012). Gesture facilitates the syntactic analysis of speech. Front. Psychol. 3:74. doi:10.3389/fpsyg.2012.00074.
16. Huettig, F., and Altmann, G. T. M. (2004). "The online processing of ambiguous and unambiguous words in context: evidence from head-mounted eye-tracking," in The On-Line Study of Sentence Comprehension: Eyetracking, ERP and Beyond, eds M. Carreiras and C. Clifton (New York: Psychology Press), 187-207.
17. Kamide, Y., Scheepers, C., and Alt-mann, G. T. M. (2003). Integration of syntactic and semantic information in predictive processing: cross-linguistic evidence from German and English. J. Psycholinguist. Res.32, 37-55.
18. Knoeferle, P., Carminati, M. N., Abashidze, D., and Essig, K. (2011). Preferential inspection of recent real-world events over future events: evidence from eye tracking during spoken sentence comprehension. Front. Cogn. (special issue edited by A. Myachykov, C. Scheepers, and Y. Shtyrov) 2:376. doi:10.3389/fpsyg.2011.00376
19. Knoeferle, P., and Crocker, M. W. (2006). The coordinated interplay of scene, utterance, and world knowledge: evidence from eye tracking. Cogn. Sci. 30, 481-529.
20. Knoeferle, P., and Crocker, M. W. (2007). The influence of recent scene events on spoken comprehension: evidence from eye-movements. J. Mem. Lang. 75, 519-543.
21. Knoeferle, P., and Crocker, M. W. (2009). Constituent order and semantic parallelism in on-line comprehension: eye-tracking evidence from German. Q. J. Exp. Psychol. 62, 2338-2371.
22. Knoeferle, P., Crocker, M. W., Scheepers, C., and Pickering, M. J. (2005). The influence of the immediate visual context on incremental thematic role-assignment: evidence from eye-movements in depicted events. Cognition 95, 95-127.
23. Richardson, D. C., and Dale, R. (2005). Looking to understand: the coupling between speakers and listeners eye movements and its relationship to discourse comprehension. Cogn. Sci. 29, 1045-1060.
24. Salverda, A. P., Brown, M., and Tanen-haus, M. K. (2011). A goal-based perspective on eye movements in visual-world studies. Acta Psychol. 137, 172-180.
25. Sedivy, J. C., Tanenhaus, M. K., Chambers, C. G., and Carlson, G. N. (1999). Achieving incremental semantic interpretation through contextual representation. Cognition 71, 109-148.
26. Staudte, M., and Crocker, M.W. (2011). Investigating joint attention mechanisms through spoken human- robot interaction. Cognition 120, 268-291.
27. Tanenhaus, M.K., Spivey-Knowlton, M. J., Eberhard, K., and Sedivy, J. C. (1995). Integration of visual and linguistic information in spoken language comprehension. Science 268, 632-634.
28. Weber, A., Grice, M.,and Crocker, M.W. (2006). The role of prosody in the interpretation of structural ambiguities: a study of anticipatory eye movements. Cognition 99, B63-B72.
29. Wu, Y.C.,andCoulson, S.(2005). Meaningful gestures: electrophysiological indicesoficonic gesture comprehension. Psychophysiology 42, 654-667.