The real-time mediation of visual attention by language and world knowledge: Linking anticipatory (and other) eye movements to linguistic processing

Journal of Memory and Language

Volumn 57, Issue 4, 2007, Pages 502-518

  Altmann, Gerry T M ^a   Kamide, Yuki ^b  

^a UNIVERSITY OF YORK   (United Kingdom)

^b UNIVERSITY OF DUNDEE   (United Kingdom)

Author keywords

Affordances; Language mediated eye movements; Visual attention

Indexed keywords

EID: 34748856776     PISSN: 0749596X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jml.2006.12.004     Document Type: Article

References (65)

1. Allopenna P.D., Magnuson J.S., and Tanenhaus M.K. Tracking the time course of spoken word recognition using eye movements: evidence for continuous mapping models. Journal of Memory and Language 38 (1998) 419-439
2. Altmann G.T.M. Language-mediated eye movements in the absence of a visual world: the 'blank screen paradigm'. Cognition 93 (2004) 79-87
3. Altmann G.T.M., and Kamide Y. Incremental interpretation at verbs: restricting the domain of subsequent reference. Cognition 73 (1999) 247-264
4. Ballard D.H., Hayhoe M.M., Pook P.K., and Rao R.P.N. Deictic codes for the embodiment of cognition. Behavioral and Brain Sciences 20 (1997) 723-767
5. Burgess C., and Lund K. Modelling parsing constraints with high-dimensional context space. Language and Cognitive Processes 12 (1997) 177-210
6. Chambers C.G., Tanenhaus M.K., Eberhard K.M., Filip H., and Carlson G.N. Circumscribing referential domains during real-time language comprehension. Journal of Memory and Language 47 (2002) 30-49
7. Chambers C.G., Tanenhaus M.K., and Magnuson J.S. Actions and affordances in syntactic ambiguity resolution. Journal of Experimental Psychology: Learning, Memory and Cognition 30 (2004) 687-696
8. Christ S.E., and Abrams R.A. Just like new: newly segregated old objects capture attention. Perception & Psychophysics 68 (2006) 301-309
9. Collins A.M., and Loftus E.F. A spreading-activation theory of semantic processing. Psychological Review 82 (1975) 407-428
10. Cooper R.M. The control of eye fixation by the meaning of spoken language: a new methodology for the real-time investigation of speech perception, memory, and language processing. Cognitive Psychology 6 (1974) 84-107
11. Cree G.S., and McRae K. Analyzing the factors underlying the structure and computation of the meaning of chipmunk, cherry, chisel, cheese, and cello (and many other such concrete nouns). Journal of Experimental Psychology: General 132 (2003) 163-201
12. Dahan D., Magnuson J.S., Tanenhaus M.K., and Hogan E.M. Subcategorical mismatches and the time course of lexical access: evidence for lexical competition. Language and Cognitive Processes 16 (2001) 507-534
13. Dahan D., and Tanenhaus M.K. Continuous mapping from sound to meaning in spoken-language comprehension: immediate effects of verb-based thematic constraints. Journal of Experimental Psychology: Learning, Memory, and Cognition 30 (2004) 498-513
14. Dahan D., and Tanenhaus M. Looking at the rope when looking for the snake: conceptually mediated eye movements during spoken-word recognition. Psychonomic Bulletin & Review 12 (2005) 453-459
15. DeLong K.A., Urbach T.P., and Kutas M. Probabilistic word pre-activation during language comprehension inferred from electrical brain activity. Nature Neuroscience 8 (2005) 1117-1121
16. Elman J.L. Finding structure in time. Cognitive Science 14 (1990) 179-211
17. Field A. Discovering statistics using SPSS. 2nd ed. (2005), Sage Publications, London
18. Frisson S., Rayner K., and Pickering M. Journal of Experimental Psychology: Learning, Memory, and Cognition 31 (2005) 862-877
19. Gibson J.J. The theory of affordances. In: Bransford J. (Ed). Perceiving acting and knowing (1977), Erlbaum, Killsdale, NJ
20. Glenberg A.M. What memory is for?. Behavioral and Brain Sciences 20 (1997) 1-19
21. Glenberg A.M., Meyer M., and Lindem K. Mental models contribute to foregrounding during text comprehension. Journal of Memory and Language 26 (1987) 69-83
22. Gredebäck G., and von Hofsten C. Infants' evolving representation of moving objects between 6 and 12 months of age. Infancy 6 (2004) 165-184
23. Griffin Z.M. The eyes are right when the mouth is wrong. Psychological Science 15 (2004) 814-821
24. Griffin Z.M., and Bock K. What the eyes say about speaking. Psychological Science 11 (2000) 274-279
25. Hayhoe M.M., and Ballard D. Eye movements in natural behavior. Trends in Cognitive Sciences 9 (2005) 188-194
26. Hayhoe M.M., Shrivastava A., Mruczek R., and Pelz J.B. Journal of Vision 3 (2003) 49-63
27. Henderson J.M., and Ferreira F. Scene perception for psycholinguists. In: Henderson J.M., and Ferreira F. (Eds). The interface of language vision and action (2004), Psychology Press, Hove 1-58
28. Hommel B., Müsseler J., Aschersleben G., and Prinz W. The theory of event coding (TEC): a framework for perception and action planning. Behavioral and Brain Sciences 24 (2001) 849-878
29. Huettig F., and Altmann G.T.M. The online processing of ambiguous and unambiguous words in context: evidence from head-mounted eye-tracking. In: Carreiras M., and Clifton C. (Eds). The on-line study of sentence comprehension: Eye-tracking ERP, and beyond (2004), Psychology Press, New York, NY 187-207
30. Huettig F., and Altmann G.T.M. Word meaning and the control of eye fixation: semantic competitor effects and the visual world paradigm. Cognition 96 (2005) 23-32
31. Huettig, F., & Altmann, G. T. M. (in press). Visual-shape competition during language-mediated attention is based on lexical input and not modulated by contextual appropriateness. Visual Cognition.
32. Huettig F., Quinlan P., McDonald S., and Altmann G.T.M. Models of high-dimensional semantic space predict language-mediated eye movements in the visual world. Acta Psychologica 121 (2006) 65-80
33. Kamide Y., Altmann G.T.M., and Haywood S.L. The time-course of prediction in incremental sentence processing: evidence from anticipatory eye movements. Journal of Memory and Language 49 (2003) 133-159
34. Kaschak M.P., and Glenberg A.M. Constructing meaning: the role of affordances and grammatical constructions in sentence comprehension. Journal of Memory and Language 43 (2000) 509-529
35. Knoeferle P., and Crocker M. The coordinated interplay of scene, utterance, and world knowledge: Evidence from eye tracking. Cognitive Science 30 (2006) 481-529
36. Landauer T.K., and Dumais S.T. A solution to Plato's problem: the latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychological Review 104 (1997) 211-240
37. Land M., Mennie N., and Rusted J. Eye movements and the roles of vision in activities of daily living: making a cup of tea. Perception 28 (1999) 1311-1328
38. Law M.B., and Abrams R.A. Object-based selection within and beyond the focus of spatial attention. Perception & Psychophysics 64 (2002) 1017-1027
39. McDonald S.A., and Shillcock R.C. Low-level predictive inference in reading: the influence of transitional probabilities on eye movements. Vision Research 43 (2003) 1735-1751
40. McMurray B., and Aslin R.N. Anticipatory eye movements reveal infants' auditory and visual categories. Infancy 6 (2004) 203-229
41. McMurray B., Tanenhaus M.K., and Aslin R.N. Gradient effects of within-category phonetic variation on lexical access. Cognition 86 (2002) B33-B42
42. McRae K., de Sa V.R., and Seidenberg M.S. On the nature and scope of featural representations of word meaning. Journal of Experimental Psychology: General 126 (1997) 99-130
43. McRae K., Ferretti T.R., and Amyote L. Thematic roles as verb-specific concepts. Language and Cognitive Processes 12 (1997) 137-176
44. Moores E., Laiti L., and Chelazzi L. Associative knowledge controls deployment of visual selective attention. Nature Neuroscience 6 (2003) 182-189
45. Myung J.-Y., Blumstein S.E., and Sedivy S. Playing on the typewriter, typing on the piano: manipulation knowledge of objects. Cognition 98 (2006) 223-243
46. Neely J.H. Semantic priming and retrieval from lexical memory. Roles of inhibitionless spreading activation and limited-capacity attention. Journal of Experimental Psychology: General 106 (1977) 226-254
47. O'Regan J.K. Solving the 'real' mysteries of visual perception: the world as an outside memory. Canadian Journal of Psychology 46 (1992) 461-488
48. Pelz J.B., and Canosa R. Oculomotor behavior and perceptual strategies in complex tasks. Vision Research 41 (2001) 3587-3596
49. Richardson D.C., and Spivey M.J. The TEC as a theory of embodied cognition. Behavioral and Brain Sciences 24 (2001) 900-901
50. Richardson D.C., and Spivey M.J. Representation, space and Hollywood squares: looking at things that aren't there anymore. Cognition 76 (2000) 269-295
51. Rinck M., and Bower G.H. Temporal and spatial distance in situation models. Memory & Cognition 28 (2000) 1310-1320
52. Rogers T.T., and McClelland J.L. Semantic cognition: A parallel distributed processing approach (2004), MIT Press, Cambridge, MA
53. In: Rumelhart D.E., and McClelland J.L. (Eds). Parallel distributed processing: Explorations in the microstructure of cognition (1986), MIT Press, Cambridge, MA
54. Salverda A.P., Dahan D., and McQueen J.M. The role of prosodic boundaries in the resolution of lexical embedding in speech comprehension. Cognition 90 (2003) 51-89
55. Scheepers C. Syntactic priming of relative clause attachments: persistence of structural configuration in sentence production. Cognition 89 (2003) 179-205
56. Schwanenflugel P.J., and LaCount K. Semantic relatedness and the scope of facilitation for upcoming words in sentences. Journal of Experimental Psychology: Learning, Memory, and Cognition 14 (1988) 344-354
57. Tanenhaus M.K., Magnuson J.S., Dahan D., and Chambers C. Eye movements and lexical access in spoken-language comprehension: evaluating a linking hypothesis between fixations and linguistic processing. Journal of Psycholinguistic Research 29 (2000) 557-580
58. Tanenhaus M.K., Spivey-Knowlton M.J., Eberhard K.M., and Sedivy J.C. Integration of visual and linguistic information in spoken language comprehension. Science 268 5217 (1995) 1632-1634
59. Tyler L.K., and Moss H.E. Towards a distributed account of conceptual knowledge. Trends in Cognitive Sciences 5 (2001) 244-252
60. Van Berkum J.J.A., Brown C.M., Zwitserlood P., Kooijman V., and Hagoort P. Anticipating upcoming words in discourse: evidence from ERPs and reading times. Journal of Experimental Psychology: Learning, Memory, and Cognition 31 (2005) 443-467
61. Vigliocco G., Vinson D.P., Lewis W., and Garrett M.F. Representing the meanings of object and action words: the featural and unitary semantic space hypothesis. Cognitive Psychology 48 (2004) 422-488
62. Yee E., and Sedivy J.C. Eye movements to pictures reveal transient semantic activation during spoken word recognition. Journal of Experimental Psychology: Learning, Memory, and Cognition 32 (2006) 1-14
63. Zwaan R.A. Processing narrative time shifts. Journal of Experimental Psychology: Learning, Memory, and Cognition 22 (1996) 1196-1207
64. Zwaan R.A., Madden C.J., and Whitten S.N. The presence of an event in the narrated situation affects its activation. Memory & Cognition 28 (2000) 1022-1028
65. Zwaan R.A., and Radvansky G.A. Situation models in language comprehension and memory. Psychological Bulletin 123 (1998) 162-185