Effects of speaker gaze on spoken language comprehension: Task matters

Expanding the Space of Cognitive Science - Proceedings of the 33rd Annual Meeting of the Cognitive Science Society, CogSci 2011

Volumn , Issue , 2011, Pages 1557-1562

  Kreysa, Helene ^a   Knoeferle, Pia ^a  

^a BIELEFELD UNIVERSITY   (Germany)

Author keywords

eye tracking; speaker gaze; spoken sentence comprehension; syntactic structuring; task effects

Indexed keywords

BEHAVIORAL RESEARCH; EYE MOVEMENTS;

COMPREHENSION TASKS; EYE-TRACKING; LANGUAGE COMPREHENSIONS; SENTENCE STRUCTURES; SPEAKER GAZE; SPOKEN LANGUAGES; SPOKEN SENTENCE COMPREHENSION; SUBTASK; SYNTACTIC STRUCTURING; TASK EFFECTS;

EYE TRACKING;

EID: 84879397286     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (31)

1. Altmann, G. T. M., & Kamide, Y. (1999). Incremental interpretation at verbs: restricting the domain of subsequent reference. Cognition, 73, 247–264.
2. Altmann, G. T. M., & Kamide, Y. (2007). The real-time mediation of visual attention by language and world knowledge: Linking anticipatory (and other) eye movements to linguistic processing. JML, 57, 502-518.
3. Bock, K., Irwin, D., Davidson, D., & Levelt, W. (2003). Minding the clock. JML, 48, 653–685.
4. Brennan, S., Chen, X., Dickinson, C., Neider, M., & Zelinsky, G. (2008). Coordinating cognition: The costs and benefits of shared gaze during collaborative search. Cognition, 106, 1465-1477.
5. Carletta, J., Hill, R., Nicol, C., Taylor, T., de Ruiter, J., & Bard, E. (2010). Eyetracking for two-person tasks with manipulation of a virtual world. Behavior_Research_Methods, 42, 254-265.
6. Castelhano, M., Mack, M., & Henderson, J. (2009). Viewing task influences eye movement control during active scene perception. Journal_of_Vision, 9, 115.
7. Gleitman, L., January, D., Nappa, R., & Trueswell, J. (2007). On the”give” and”take” between event apprehension and utterance formulation. JML, 57, 544-569.
8. Grant, E., & Spivey, M. J. (2003). Eye movements and problem solving: Guiding attention guides thought. Psychological_Science, 14, 462-466.
9. Griffin, Z., & Bock, K. (2000). What the eyes say about speaking. Psychological_Science, 11, 274–279.
10. Hanna, J., & Brennan, S. (2007). Speakers’ eye gaze disambiguates referring expressions early during face-to-face conversation. JML, 57, 596–615.
11. Kamide, Y., Scheepers, C., & Altmann, G. (2003). Integration of syntactic and semantic information in predictive processing: Cross-linguistic evidence from German and English. Journal_of_Psycholinguistic_Research, 32, 37–55.
12. Knoeferle, P., & Crocker, M. W. (2006). The coordinated interplay of scene, utterance, and world knowledge: Evidence from eye tracking. Cognitive_Science, 30, 481–529.
13. Knoeferle, P., Crocker, M. W., Scheepers, C., & Pickering, M. J. (2005). The influence of the immediate visual context on incremental thematic role-assignment: Evidence from eye-movements in depicted events. Cognition, 95, 95–127.
14. Kreysa, H. (2009). Coordinating_speech-related_eye movements_between_comprehension_and_production. Unpublished doctoral dissertation, Edinburgh University, UK.
15. Kreysa, H., & Knoeferle, P. (2011). Peripheral speaker gaze facilitates spoken language comprehension: Syntactic structuring and thematic role assignment in German. In Proceedings_of_the_European_Conference_on_Cognitive Science in Sofia.
16. Langton, S., O’Donnell, C., Riby, D., & Ballantyne, C. (2006). Gaze cues influence the allocation of attention in natural scene viewing. Quarterly_Journal_of_Experimental Psychology, 59, 2056-2064.
17. Mayberry, M., Crocker, M. W., & Knoeferle, P. (2009). Learning to attend: A connectionist model of situated language comprehension. Cognitive_Science, 33, 449–496.
18. Meyer, A. S., Sleiderink, A. M., & Levelt, W. J. M. (1998). Viewing and naming objects: Eye-movements during noun phrase production. Cognition, 66, B25–B33.
19. Meyer, A. S., van der Meulen, F., & Brooks, A. (2004). Eye movements during speech planning: Talking about present and remembered objects. Visual_Cognition, 11, 553-576.
20. Nappa, R., & Arnold, J. (2009). Paying attention to intention: Effects of intention (but not egocentric attention) on pronoun resolution. In Proceedings_of_the_CUNY_Conference.
21. Nappa, R., Wessel, A., McEldoon, K., Gleitman, L., & Trueswell, J. (2009). Use of speaker’s gaze and syntax in verb learning. Language_Learning_and_Development, 5, 1–32.
22. Rayner, K., & Raney, G. E. (1996). Eye-movement control in reading and visual search: Effects of word frequency. Psychonomic_Bulletin_&_Review, 3, 245–248.
23. Ricciardelli, P., Bricolo, E., Aglioti, S., & Chelazzi, L. (2002). My eyes want to look where your eyes are looking: Exploring the tendency to imitate another individual’s gaze. NeuroReport, 13, 2259-2264.
24. Spivey, M. J., Tanenhaus, M. K., Eberhard, K. M., & Sedivy, J. C. (2002). Eye-movements and spoken language comprehension: Effects of visual context on syntactic ambiguity resolution. Cognitive_Psychology, 45, 447–481.
25. Staudte, M., & Crocker, M. (2009). The effect of robot gaze on processing robot utterances. In N. Taatgen & H. van Rijn (Eds.), Proceedings_of_the_31st_Annual_Meeting_of_the Cognitive_Science_Society (pp. 431–436). Cognitive Science Society, Inc.
26. Stein, R., & Brennan, S. (2004). Another person’s eye gaze as a cue in solving programming problems. In Proceedings_of the_6th_International_Conference_on_Multimodal_Interface (p. 9-15). Penn State University.
27. Tatler, B., Wade, N., Kwan, H., Findlay, J., & Velichkovsky, B. (2010). Yarbus, eye movements, and vision. i-Perception, 1, 7-27.
28. Tomlin, R. S. (1995). Focal attention, voice, and word order. In P. A. Dowing & M. Noonan (Eds.), Word_Order_in Discourse (p. 517-552). Amsterdam: John Benjamins.
29. Weber, A., Grice, M., & Crocker, M. W. (2006). The role of prosody in the interpretation of structural ambiguities: A study of anticipatory eye movements. Cognition, 99, B63-B72.
30. Yarbus, A. L. (1967). Eye_movements_and_vision. New York: Plenum Press.
31. Zelinsky, G. J., & Murphy, G. L. (2000). Synchronizing visual and language processing: An effect of object name length on eye movements. Psychological_Science, 11, 125–131.