A goal-based perspective on eye movements in visual world studies

Acta Psychologica

Volumn 137, Issue 2, 2011, Pages 172-180

  Salverda, Anne Pier ^a   Brown, Meredith ^a   Tanenhaus, Michael K ^a  

^a UNIVERSITY OF ROCHESTER   (United States)

Author keywords

Eye movements; Spoken language processing; Visual search; Visual world paradigm

Indexed keywords

ARTICLE; ATTENTION; EYE MOVEMENT; HUMAN; LANGUAGE; MOTIVATION; PHYSIOLOGY; VISION;

ATTENTION; EYE MOVEMENTS; GOALS; HUMANS; LANGUAGE; VISUAL PERCEPTION;

EID: 79957965483     PISSN: 00016918     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.actpsy.2010.09.010     Document Type: Article

References (69)

1. Allopenna P.D., Magnuson J.S., Tanenhaus M.K. Tracking the time course of spoken word recognition using eye movements: Evidence for continuous mapping models. Journal of Memory and Language 1998, 38(4):419-439.
2. Altmann G.T.M. Language-mediated eye movements in the absence of a visual world: The 'blank screen paradigm'. Cognition 2004, 93(2):B79-B87.
3. Altmann G.T.M., Kamide Y. Incremental interpretation at verbs: Restricting the domain of subsequent reference. Cognition 1999, 73(3):247-264.
4. Altmann G.T.M., Kamide Y. The real-time mediation of visual attention by language and world knowledge: Linking anticipatory (and other) eye movements to linguistic processing. Journal of Memory and Language 2007, 57(4):502-518.
5. Altmann G.T.M., Kamide Y. Discourse mediation of the mapping between language and the visual world: Eye movements and mental representation. Cognition 2009, 111(1):55-71.
6. Altmann G., Steedman M. Interaction with context during human sentence processing. Cognition 1988, 30(3):191-238.
7. Alvarez G.A., Cavanagh P. The capacity of visual short-term memory is set both by visual information load and by number of objects. Psychological Science 2004, 15(2):106-111.
8. Ballard D.H., Hayhoe M.M., Pelz J.B. Memory representations in natural tasks. Journal of Cognitive Neuroscience 1995, 7(1):66-80.
9. Ballard D.H., Hayhoe M.M., Pook P.K., Rao R.P.N. Deictic codes for the embodiment of cognition. Behavioral and Brain Sciences 1997, 20(4):723-767.
10. Brown-Schmidt S., Tanenhaus M.K. Real-time investigation of referential domains in unscripted conversation: A targeted language game approach. Cognitive Science 2008, 32(4):643-684.
11. Buswell G.T. How people look at pictures 1935, University of Chicago Press, Chicago.
12. Chambers C.G., Tanenhaus M.K., Eberhard K.M., Filip H., Carlson G.N. Circumscribing referential domains during real-time language comprehension. Journal of Memory and Language 2002, 47(1):30-49.
13. Chambers C.G., Tanenhaus M.K., Magnuson J.S. Actions and affordances in syntactic ambiguity resolution. Journal of Experimental Psychology: Learning, Memory, and Cognition 2004, 30(3):687-696.
14. Clayards M., Tanenhaus M.K., Aslin R.N., Jacobs R.A. Perception of speech reflects optimal use of probabilistic speech cues. Cognition 2008, 108(3):804-809.
15. Cooper R.M. The control of eye fixation by the meaning of spoken language: A new methodology for the real-time investigation of speech perception, memory, and language processing. Cognitive Psychology 1974, 6(1):84-107.
16. Dahan D., Magnuson J.S., Tanenhaus M.K. Time course of frequency effects in spoken word recognition: Evidence from eye movements. Cognitive Psychology 2001, 42(4):317-367.
17. Dahan D., Magnuson J.S., Tanenhaus M.K., Hogan E.M. Subcategorical mismatches and the time course of lexical access: Evidence for lexical competition. Language and Cognitive Processes 2001, 16(5-6):507-534.
18. Dahan D., Tanenhaus M.K. Looking at the rope when looking for the snake: Conceptually mediated eye movements during spoken-word recognition. Psychonomic Bulletin & Review 2005, 12(3):453-459.
19. Droll J.A., Hayhoe M.M. Trade-offs between gaze and working memory use. Journal of Experimental Psychology: Human Perception and Performance 2007, 33(6):1352-1365.
20. Eberhard K.M., Spivey-Knowlton M.J., Sedivy J.C., Tanenhaus M.K. Eye-movements as a window into real-time spoken language comprehension in natural contexts. Journal of Psycholinguistic Research 1995, 24(6):409-436.
21. Ferreira F., Tanenhaus M.K. Introduction to the special issue on language-vision interactions. Journal of Memory and Language 2007, 57(4):455-459.
22. Green C.S., Bavelier D. Action video game modifies visual selective attention. Nature 2003, 423(6939):534-537.
23. Hayhoe M. Vision using routines: A functional account of vision. Visual Cognition 2000, 7(1-3):43-64.
24. Hayhoe M.M., Shrivastava A., Mruczek R., Pelz J.B. Visual memory and motor planning in a natural task. Journal of Vision 2003, 3(1):49-63.
25. Henderson J.M., Ferreira F. The interface of language, vision, and action: Eye movements and the visual world 2004, Psychology Press, New York.
26. Henderson J.M., Malcolm G.L., Schandl C. Searching in the dark: Cognitive relevance drives attention in real-world scenes. Psychonomic Bulletin & Review 2009, 16(5):850-856.
27. Huettig F., Altmann G.T.M. Visual-shape competition during language-mediated attention is based on lexical input and not modulated by contextual appropriateness. Visual Cognition 2007, 15(8):985-1018.
28. Irwin D.E. Information integration across saccadic eye-movements. Cognitive Psychology 1991, 23(3):420-456.
29. Jackendoff R. Foundations of language: Brain, meaning, grammar, evolution 2002, Oxford University Press, Oxford.
30. Jovancevic-Misic J., Hayhoe M. Adaptive gaze control in natural environments. The Journal of Neuroscience 2009, 29(19):6234-6238.
31. Kaiser E., Trueswell J.C. Interpreting pronouns and demonstratives in Finnish: Evidence for a form-specific approach to reference resolution. Language and Cognitive Processes 2008, 23(5):709-748.
32. Knoeferle P., Crocker M.W. The coordinated interplay of scene, utterance, and world knowledge: Evidence from eye tracking. Cognitive Science 2006, 30(3):481-529.
33. Koch C., Ullman S. Shifts in selective visual attention: Towards the underlying neural circuitry. Human Neurobiology 1985, 4(4):219-227.
34. Land M.F., Fernald R.D. The evolution of eyes. Annual Review of Neuroscience 1992, 15:1-29.
35. Land M.F., Lee D.N. Where we look when we steer. Nature 1994, 369(6483):742-744.
36. Land M.F., McLeod P. From eye movements to actions: How batsmen hit the ball. Nature Neuroscience 2000, 3(12):1340-1345.
37. Land M., Mennie N., Rusted J. The roles of vision and eye movements in the control of activities of daily living. Perception 1999, 28(11):1311-1328.
38. Levy R. Expectation-based syntactic comprehension. Cognition 2008, 106(3):1126-1177.
39. MacDonald M.C., Pearlmutter N.J., Seidenberg M.S. The lexical nature of syntactic ambiguity resolution. Psychological Review 1994, 101(4):676-703.
40. Magnuson J.S., Tanenhaus M.K., Aslin R.N., Dahan D. The time course of spoken word learning and recognition: Studies with artificial lexicons. Journal of Experimental Psychology: General 2003, 132(2):202-227.
41. Mayberry M.R., Crocker M.W., Knoeferle P. Learning to attend: A connectionist model of situated language comprehension. Cognitive Science 2009, 33(3):449-496.
42. McMurray B., Tanenhaus M.K., Aslin R.N. Gradient effects of within category phonetic variation on lexical access. Cognition 2002, 86(2):B33-B42.
43. McMurray B., Tanenhaus M.K., Aslin R.N. Within-category VOT affects recovery from "lexical" garden-paths: Evidence against phoneme-level inhibition. Journal of Memory and Language 2009, 60(1):65-91.
44. Novick J.M., Thompson-Schill S.L., Trueswell J.C. Putting lexical constraints in context into the visual-world paradigm. Cognition 2008, 107(3):850-903.
45. O'Regan J.K. Solving the "real" mysteries of visual perception: The world as an outside memory. Canadian Journal of Psychology 1992, 46(3):461-488.
46. Parkhurst D., Law K., Niebur E. Modeling the role of salience in the allocation of overt visual attention. Vision Research 2002, 42(1):107-123.
47. Patsenko E.G., Altmann E.M. How planful is routine behavior? A selective-attention model of performance in the Tower of Hanoi. Journal of Experimental Psychology: General 2010, 139(1):95-116.
48. Runner J.T., Sussman R.S., Tanenhaus M.K. Assignment of reference to reflexives and pronouns in picture noun phrases: Evidence from eye movements. Cognition 2003, 89(1):B1-B13.
49. Runner J.T., Sussman R.S., Tanenhaus M.K. Processing reflexives and pronouns in picture noun phrases. Cognitive Science 2006, 30(2):193-241.
50. Sailer U., Flanagan J.R., Johannson R.S. Eye-hand coordination during learning of a novel visuomotor task. Journal of Neuroscience 2005, 25(39):8833-8842.
51. Salverda, A. P., & Altmann, G. T. M. (in revision). Attentional capture of objects referred to by spoken language.
52. Salverda A.P., Tanenhaus M.K. Tracking the time course of orthographic information in spoken-word recognition. Journal of Experimental Psychology: Learning, Memory, and Cognition 2010, 36(5):1108-1117.
53. Sedivy J.C., Tanenhaus M.K., Chambers C.G., Carlson G.N. Achieving incremental semantic interpretation through contextual representation. Cognition 1999, 71(2):109-147.
54. Simons D.J., Levin D.T. Change blindness. Trends in Cognitive Sciences 1997, 1(7):261-267.
55. Spivey M.J., Geng J.J. Oculomotor mechanisms activated by imagery and memory: Eye movements to absent objects. Psychological Research 2001, 65(4):235-241.
56. Spivey M.J., Tanenhaus M.K., Eberhard K.M., Sedivy J.C. Eye movements and spoken language comprehension: Effects of visual context on syntactic ambiguity resolution. Cognitive Psychology 2002, 45(4):447-481.
57. Sprague N., Ballard D., Robinson A. Modeling embodied visual behaviors. ACM Transactions on applied perception 2007, 4(2).
58. Tanenhaus M.K. Eye movements and spoken language processing. Eye movements: A window on mind and brain 2007, 443-469. Elsevier, Oxford. R.P.G. van Gompel, M.H. Fischer, W.S. Murray, R.L. Hill (Eds.).
59. Tanenhaus M.K. Spoken language comprehension: Insights from eye movements. Oxford Handbook of Psycholinguistics 2007, 309-326. Oxford University Press, Oxford. G. Gaskell (Ed.).
60. Tanenhaus M.K., Spivey-Knowlton M.J., Eberhard K.M., Sedivy J.C. Integration of visual and linguistic information in spoken language comprehension. Science 1995, 268(5217):1632-1634.
61. Tanenhaus M.K., Trueswell J.C. Eye movements and spoken language comprehension. Handbook of Psycho-linguistics 2006, 863-900. Elsevier Academic Press, New York. Second edition. M.J. Traxler, M.A. Gernsbacher (Eds.).
62. Treisman A.M., Gelade G. Feature-integration theory of attention. Cognitive Psychology 1980, 12(1):97-136.
63. Trueswell J.C., Sekerina I., Hill N.M., Logrip M.L. The kindergarten-path effect: Studying on-line sentence processing in young children. Cognition 1999, 73(2):89-134.
64. Trueswell J.C., Tanenhaus M.K., Garnsey S.M. Semantic influences on parsing: Use of thematic role information in syntactic ambiguity resolution. Journal of Memory and Language 1994, 33(3):285-318.
65. Turano K.A., Geruschat D.R., Baker F.H. Oculomotor strategies for the direction of gaze tested with a real-world activity. Vision Research 2003, 43(3):333-346.
66. Ullman S. Visual routines. Cognition 1984, 18(1-3):97-159.
67. van Gompel R.P.G., Fischer M.H., Murray W.S., Hill R.L. Eye-movement research: An overview of current and past developments. Eye movements: A window on mind and brain 2007, 1-28. Elsevier, Oxford. R.P.G. van Gompel, M.H. Fischer, W.S. Murray, R.L. Hill (Eds.).
68. Viviani P. Eye movements in visual search: Cognitive, perceptual, and motor control aspects. Reviews of oculomotor research 1990, Vol. 4:353-393. Elsevier, Amsterdam. E. Kowler (Ed.).
69. Yarbus A.L. Eye movements and vision 1967, Plenum Press, New York.