Eye movements during reading, visual search, and scene perception: An overview

Cognitive and Cultural Influences on Eye Movements

Volumn , Issue , 2023, Pages 3-33

  Castelhano, Monica S ^a   Rayner, Keith ^b,c  

^a QUEEN S UNIVERSITY   (Canada)

^b UNIVERSITY OF MASSACHUSETTS   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85162673304     PISSN: None     EISSN: None     Source Type: Book    
DOI: None     Document Type: Chapter

References (119)

1. Antes, J. R. (1974). The time course of picture viewing. Journal of Exper- imental Psychology, 103, 62-70.
2. Baddeley, R. J., & Tatler, B. W. (2006). High frequency edges (but not contrast) predict where we fixate: A Bayesian system identification analysis. Vision Research, 46, 2824-2833.
3. Beck, M. R., Peterson, M.S., Boot, W.R., Vomela, M., & Kramer, A.F. (2006). Explicit memory for rejected distractors during visual search. Visual Cognition, 14, 150-174.
4. Beck, M. R., Peterson, M. S., & Vomela, M. (2006). Memory for where, but not what, is used during visual search. Journal of Experimental Psychology: Human Perception and Performance, 32, 235-250.
5. Becker, M. W., Pashler, H., & Lubin, J. (2007). Object-intrinsic oddities draw early saccades. Journal of Experimental Psychology: Human Per- ception and Performance, 33, 20-30.
6. Becker, W., & Jürgens, R. (1979). Analysis of the saccadic system by means of double step stimuli. Vision Research, 19, 967-983.
7. Bertera, J. H., & Rayner, K. (2000). Eye movements and the span of effective stimulus in visual search. Perception & Psychophysics, 62, 576- 585.
8. Boutsen, L., Lamberts, K., & Verfaillie, K. (1998). Recognition times of different views of 56 depth-rotated objects: A note concerning Verfaillie and Boutsen (1995). Perception & Psychophysics, 60, 900-907.
9. Buswell, G. T. (1935). How people look at pictures. Chicago: University of Chicago Press.
10. Carroll, P. J., & Slowiaczek, M. L. (1986). Constraints on semantic priming in reading: A fixation time analysis. Memory & Cognition, 14, 509-522.
11. Castelhano, M. S., & Henderson, J. M. (2007). Initial scene representations facilitate eye movement guidance in visual search. Journal of Experimental Psychology: Human Perception and Performance, 33, 753- 763.
12. Castelhano, M. S., & Henderson, J. M. (2008). The influence of color on perception of scene gist. Journal of Experimental Psychology: Human Perception and Performance, 34, 660-675.
13. De Graef, P. (2005). Semantic effects on object selection in real-world scene perception. In G. Underwood (Ed.), Cognitive processes in eye guidance. Oxford: Oxford University Press.
14. De Graef, P., Christiaens, D., & d'Ydewalle, G. (1990). Perceptual effects of scene context on object identification. Psychological Research, 52, 317-329.
15. Deubel, H., & Schneider, W. X. (1996). Saccade target selection and object recognition: Evidence for a common attentional mechanism. Vision Research, 36, 1827-1837.
16. Duffy, S. A., Morris, R. K., & Rayner, K. (1988). Lexical ambiguity and fixation times in reading. Journal of Memory and Language, 27, 429-446.
17. Ehrlich, S. E., & Rayner, K. (1981). Contextual effects on word perception and eye movements during reading. Journal of Verbal Learning and Verbal Behavior, 20, 641-655.
18. Findlay, J. M. (2004). Eye scanning and visual search. In J. M. Henderson, & F. Ferreira (Eds.), The interface of language, vision, and action: Eye movements and the visual world (pp.135-160). New York: Psychology Press.
19. Findlay, J. M., & Gilchrist, I. D. (1998). Eye guidance and visual search. In G. Underwood (Ed.), Eye guidance in reading and scene perception (pp. 295-312). Oxford, England: Elsevier.
20. Findlay, J. M., & Gilchrist, I. D. (2003). Active vision: The psychology of looking and seeing. Oxford: Oxford University Press.
21. Friedman, A. (1979). Framing pictures: The role of knowledge in automatized encoding and memory for gist. Journal of Experimental Psychology: General, 108, 316-355.
22. Greene, H. (2006). The control of fixation duration in visual search. Per- ception, 35, 303-315.
23. Greene, H., & Rayner, K. (2001a). Eye movements and familiarity effects in visual search. Vision Research, 41, 3763-3773.
24. Greene, H., & Rayner, K. (2001b). Eye-movement control in directioncoded visual search. Perception, 29, 363-372.
25. Grimes, J. (1996). On the failure to detect changes in scenes across saccades. In K. Akins (Ed.), Vancouver studies in cognitive science: Vol. 5. Perception (pp.89-110). New York: Oxford University Press.
26. Grimes, J., & McConkie, G. (1995). On the insensitivity of the human visual system to image changes made during saccades. In K. Akins, (Ed.), Problems in perception. Oxford, UK: Oxford University Press.
27. Henderson, J. M. (1992). Identifying objects across saccades: Effects of extrafoveal preview and flanker object context. Journal of Experi- mental Psychology: Learning, Memory, and Cognition, 18, 521-530.
28. Henderson, J. M, & Castelhano, M. S. (2005). Eye movements and visual memory for scenes. In G. Underwood (Ed.), Cognitiveprocesses in eye guidance (pp. 213-235). Oxford University Press.
29. Henderson, J. M., & Ferreira, F. (1990). Effects of foveal processing difficulty on the perceptual span in reading: Implications for attention and eye movement control. Journal of Experimental Psychology: Learning, Memory, and Cognition, 16(3), 417-429.
30. Henderson, J. M., & Ferreira, F. (2004). Scene perception for psycholinguists. In J. M. Henderson, & F. Ferreira (Eds.), The interface of lan-guage, vision, and action: Eye movements and the visual world (pp. 1-58). New York: Psychology Press.
31. Henderson, J. M, & HoUingworth, A. (1999). High-level scene perception. Annual Review of Psychology, 50, 243-271.
32. Henderson, J. M., McClure, K. K., Pierce, S., & Schrock, G. (1997). Object identification without foveal vision: Evidence from an artificial scotoma paradigm. Perception & Psychophysics, 59, 323-346.
33. Henderson, J. M., Pollatsek, A., & Rayner, K. (1987). The effects of foveal priming and extrafoveal preview on object identification. Journal of Experimental Psychology: Human Perception and Performance, 13, 449-463.
34. Henderson, J. M, Pollatsek, A., & Rayner, K. (1989). Covert visual attention and extrafoveal information use during object identification. Perception & Psychophysics, 45, 196-208.
35. Henderson, J. M., Weeks, P. A. Jr., & HoUingworth, A. (1999). Effects of semantic consistency on eye movements during scene viewing. Journal of Experimental Psychology: Human Perception and Perform- ance, 25, 210-228.
36. Henderson, J. M, Williams, C. C., Castelhano, M. S., & Falk, R. J. (2003). Eye movements and picture processing during recognition. Per- ception & Psychophysics, 65, 725-734.
37. Hidalgo-Sotelo, B., Oliva, A., & Torralba, A. (2005). Human learning of contextual priors for object search: Where does the time go? Proceedingsof 3rd Workshop on Attention and Performance at the International Conference in Computer Vision and Pattern Recognition (CVPR), San Diego CA.
38. Hoffman, J. E., & Subramaniam, B. (1995). The role of visual attention in saccadic eye movements. Perception & Psychophysics, 57, 787-795.
39. Hollingworth, A. (2003). Failures of retrieval and comparison constrain change detection in natural scenes. Journal of Experimental Psychol- ogy: Human Perception and Performance, 29, 388-403.
40. Hollingworth, A., & Henderson, J. M. (1998). Does consistent scene context facilitate object perception? Journal of Experimental Psychology: General, 127, 398-415.
41. Hollingworth, A., & Henderson, J. M. (2002). Accurate visual memory for previously attended objects in natural scenes. Journal of Experi-mental Psychology: Human Perception and Performance, 28, 113-136.
42. Hooge, I. T. C, & Erkelens, C. J. (1996). Control of fixation duration during a simple search task. Perception & Psychophysics, 58, 969-976.
43. Hooge, I. T. C, & Erkelens, C. J. (1998). Adjustment of fixation duration during visual search. Vision Research, 38, 1295-1302.
44. Horowitz, T. S., & Wolfe, J. M. (1998). Visual search has no memory. Na- ture, 94, 575-577.
45. Inhoff, A. W., & Rayner, K. (1986). Parafoveal word processing during eye fixations in reading: Effects of word frequency. Perception & Psychophysics, 40, 431-439.
46. Irwin, D. E. (2004). Fixation location and fixation duration as indices of cognitive processing. In J.M. Henderson, & F. Ferreira (Eds.), The in-terface of language, vision, and action: Eye movements and the visual world (pp. 105-134). New York: Psychology Press.
47. Ishida, T., & Ikeda, M. (1989). Temporal properties of information extraction in reading studied by a text-mask replacement technique.Journal of the Optical Society A: Optics and Image Science, 6, 1624-1632.
48. Itti., L., & Koch, C. (2000). A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Research, 40, 1489-1506.
49. Itti, L., & Koch, C. (2001). Computational modeling of visual attention. Nature Reviews: Neuroscience, 2, 194-203.
50. Jacobs, A. M. (1986). Eye movement control in visual search: How direct is visual span control? Perception & Psychophysics, 39, 47-58.
51. Juhasz, B. J., & Rayner, K. (2003). Investigating the effects of a set of intercorrelated variables on eye fixation durations in reading. Journal of Experimental Psychology: Learning, Memory, and Cognition, 29, 1312-1318.
52. Juhasz, B. J., & Rayner, K (2006). The role of age-of-acquisition and word frequency in reading: Evidence from eye fixation durations. Visual Cognition, 13, 846-863.
53. Kowler, E., Anderson, E., Dosher, B., & Blaser, E. (1995). The role of attention in programming saccades. Vision Research, 35, 1897-1916.
54. Land, M. F., & Hayhoe, M. (2001). In what ways do eye movements contribute to everyday activities? Vision Research, 41, 3559-3565.
55. Levin, D. T., & Simons, D. J. (1997). Failure to detect changes to attended objects in morion pictures. Psychonomic Bulletin & Review, 4 (4), 501-506.
56. Liversedge, S. P., Rayner, K., White, S. J., Vergilino-Perez, D., Findlay, J. M., & Kentridge, R.W. (2004). Eye movements while reading disappearing text: Is there a gap effect in reading? Vision Research, 44, 1013-1024.
57. Loftus, G. R., & Mackworth, N. H. (1978). Cognitive determinants of fixation location during picture viewing. Journal of Experimental Psy- chology: Human Perception and Performance, 4, 565-572.
58. Mackworth, N. H., & Morandi, A. J. (1967). The gaze selects informative details within pictures. Perception & Psychophysics, 2, 547-552.
59. Mannan, S. K., Ruddock, K. H., & Wooding, D. S. (1995). Automatic control of saccadic eye movements made in visual inspection of briefly presented 2-D images. Spatial Vision, 9, 363-386.
60. Mannan, S. K., Ruddock, K. H., & Wooding, D. S. (1996). The relationship between the locations of spatial features and those of fixation made during visual examination of briefly presented images. Spa- tial Vision, 10, 165-188.
61. McConkie, G.W. (1991). Perceiving a stable visual world. In Proceedings of the Sixth European Conference on Eye Movements, pages 5-7. Leuven, Belgium: Laboratory of Experimental Psychology.
62. McConkie, G. W., & Rayner, K. (1975). The span of the effective stimulus during a fixation in reading. Perception & Psychophysics, 17, 578-586.
63. McConkie, G. W., & Zola, D. (1979). Is visual information integrated across successive fixations in reading? Perception & Psychophysics, 25, 221-224.
64. McPeek, R. M., Skavenski, A. A., & Nakayama, K. (2000). Concurrent processing of saccades in visual search. Vision Research, 40, 2499- 2516.
65. Morris, R. K. (1994). Lexical and message-level sentence context effects on fixation times in reading. Journal of Experimental Psychology:Learning, Memory, and Cognition, 20, 92-103.
66. Morrison, R. E., & Rayner, K. (1981). Saccade size in reading depends upon character spaces and not visual angle. Perception & Psy- chophysics, 30, 395-396.
67. Najemnik, J., & Geisler, W. S. (2005). Optimal eye movement strategies in visual search. Nature, 434, 387-391.
68. Neider, M. B., & Zelinsky, G. J. (2006). Scene context guides eye movements during search. V/szon Research, 46(5), 614-621.
69. Nelson, W. W., & Loftus, G. R. (1980). The functional visual field during picture viewing. Journal of Experimental Psychology: Human Learning and Memory, 6, 391-399.
70. Nodine, C. E, Carmody, D. P., & Herman, E. (1979). Eye movements during visual search for artistically embedded targets. Bulletin of the Psychonomic Society, 13, 371-374.
71. Oliva, A. (2005). Gist of the scene. In L. Itti, G. Rees, & J. K. Tsotsos (Eds.), The encyclopedia of neurobiology of attention (pp. 251-256). San Diego: Elsevier.
72. O'Regan, J. K., Rensink, R. A., & Clark, J. J. (1999). Change blindness as a result of 'mudsplashes'. Nature, 398, 34.
73. Parker, R. E. (1978). Picture processing during recognition. Journal of Ex-perimental Psychology: Human Perception and Performance, 4, 284-293.
74. Parkhurst, D. J., & Niebur, E. (2003). Scene content selected by active vision. Spatial Vision, 16, 125-154.
75. Parkhurst, D., Law, K., & Niebur, E. (2002). Modeling the role of salience in the allocation of overt visual attention. Vision Research, 42, 107- 123.
76. Peterson, M. S., Kramer, A. F., Wang, R. F., Irwin, D. E., & McCarley, J. S. (2001). Visual search has memory. Psychological Science, 12, 287- 292.
77. Pollatsek, A., Rayner, K.,& Collins, W. E. (1984). Integrating pictorial information across eye movements. Journal of Experimental Psychol- ogy: General, 113, 426-442.
78. Pollatsek, A., Rayner, K., & Henderson, J. M. (1990). Role of spatial location in integration of pictorial information across saccades. Jour-nal of Experimental Psychology: Human Perception and Performance, 16, 199-210.
79. Pollatsek, A., Reichle, E. D., & Rayner, K. (2006). Tests of the E-Z Reader model: Exploring the interface between cognition and eye-movement control. Cognitive Psychology, 52, 1-52.
80. Posner, M. I. (1980). Orienting of attention. Quarterly Journal ofExperi-mental Psychology, 32, 3-25.
81. Potter, M. (1999). Understanding sentences and scenes: The role of conceptual short-term memory. In V. Coltheart (Ed.), Fleeting memories (pp. 13-46). Boston: MIT Press.
82. Rayner, K. (1975). The perceptual span and peripheral cues in reading. Cognitive Psychology, 7, 65-81.
83. Rayner, K. (1978). Eye movements in reading and information processing. Psychological Bulletin, 85, 618-660.
84. Rayner, K. (1995). Eye movements and cognitive processes in reading, visual search, and scene perception. In J. M. Findlay, R. Walker, & R.W. Kentridge (Eds.), Eye movement research: Mechanisms, processes and applications (pp. 3-22). Amsterdam: North Holland.
85. Rayner, K. (1998). Eye movements in reading and information processing: 20 years of research. Psychological Bulletin, 85, 618-660.
86. Rayner, K., Ashby, J., Pollatsek, A., & Reichle, E. D. (2004). The effects of frequency and predictability on eye fixations in reading: Implications for the E-Z Reader model. Journal of Experimental Psychol-ogy: Human Perception and Performance, 30, 720-732.
87. Rayner, K., & Bertera, J. H. (1979). Reading without a fovea. Science, 206, 468-469.
88. Rayner, K., & Duffy, S. A. (1986). Lexical complexity and fixation times in reading: Effects of word frequency, verb complexity, and lexical ambiguity. Memory & Cognition, 14, 191-201.
89. Rayner, K., & Fisher, D. L. (1987a). Eye movements and the perceptual span during visual search. In J. K. O'Regan, & A. Levy-Schoen (Eds.), Eye movements: From physiology to cognition (pp. 293-302). Amsterdam: North Holland.
90. Rayner, K., & Fisher, D. L. (1987b). Letter processing during eye fixations in visual search. Perception & Psychophysics, 42, 87-100.
91. Rayner, K., Inhoff, A. W., Morrison, R. E., Slowiaczek, M. L., & Bertera, J. H. (1981). Masking of foveal and parafoveal vision during eye fixations in reading. Journal of Experimental Psychology: Human Per- ception and Performance, 7, 167-179.
92. Rayner, K., Liversedge, S. P., & White, S. J. (2006). Eye movements when reading disappearing text: The importance of the word to the right of fixation. Vision Research, 46, 310-323.
93. Rayner, K., Liversedge, S. P., White, S. J., & Vergilino-Perez, D. (2003). Reading disappearing text: Cognitive control of eye movements. Psychological Science, 14, 385-389.
94. Rayner, K., McConkie, G. W., & Ehrlich, S. F. (1978). Eye movements and integrating information across saccades. Journal of Experimen- tal Psychology: Human Perception and Performance, 4, 529-544.
95. Rayner, K., McConkie, G. W., & Zola, D. (1980). Integrating information across eye movements. Cognitive Psychology, 12, 206-226.
96. Rayner, K., & PoUatsek, A. (1989). The Psychology of Reading. Englewood Cliffs, NJ: Prentice Hall.
97. Rayner, K., & PoUatsek, A. (1992). Eye movements and scene perception. Canadian Journal of Psychology, 46, 342-376.
98. Rayner, K., Reichle, E. D., & PoUatsek, A. (1998). Eye movement control in reading: An overview and model. In G. Underwood (Ed.), Eye guidance in reading and scene perception (pp. 243-268). Oxford, England: Elsevier.
99. Rayner, K., Slowiaczek, M. L., Clifton, C, & Bertera, J. H. (1983). Latency of sequential eye movements: Implications for reading. Jour- nal of Experimental Psychology: Human Perception and Performance, 9, 912-922.
100. Rayner, K., Warren, T., Juhasz, B. J., & Liversedge, S. P. (2004). The effect of plausibility on eye movements in reading. Journal of Experi- mental Psychology: Learning, Memory, and Cognition, 30, 1290-1301.
101. Rayner, K., & Well, A. D. (1996). Effects of contextual constraint on eye movements in reading: A further examination. Psychonomic Bulletin & Review, 3, 504-509.
102. Reichle, E. D., PoUatsek, A., Fisher, D. L., & Rayner, K. (1998). Toward a model of eye movement control in reading. Psychological Review, 105, 125-157.
103. Reichle, E. D., PoUatsek, A., & Rayner, K. (2006). E-Z Reader: A cognitive- control, serial-attention model of eye-movement behavior during reading. Cognitive Systems Research, 7, 4-22.
104. Reichle, E. D., Rayner, K., & PoUatsek, A. (2003). The E-Z Reader model of eye movement control in reading: Comparison to other models. Behavioral and Brain Sciences. 26, 507-526.
105. Rensink, R. A., O'Regan, J. K., & Clark, J. J. (1997). To see or not to see: The need for attention to perceive changes in scenes. Psychological Science, 8, 368-373.
106. Saida, S., & Ikeda, M. (1979). Useful field size for pattern perception. Perception & Psychophysics, 25, 119-125.
107. Sereno, S. C, O'Donnell, P. J., & Rayner, K. (2006). Eye movements and lexical ambiguity resolution: Investigating the subordinate bias effect. Journal of Experimental Psychology: Human Perception and Per- formance, 32, 335-350.
108. Tanenhaus, M. K., Chambers, C. G., & Hanna, J. E. (2004). Referential domains in spoken language comprehension: Using eye movements to bridge the product and action traditions. In J. M. Henderson, & F. Ferreira (Eds.), The interface of language, vision, and action: Eye movements and the visual world (pp. 279-318). New York: Psychology Press.
109. Torralba, A., Oliva, A., Castelhano, M. S., & Henderson, J. M. (2006). Contextual guidance of attention in natural scenes. Psychological Re- view, 113, 766-786.
110. Van Diepen, E. M. J., & d'Ydewalle, G. (2003). Early peripheral and foveal processing in fixations during scene perception. Visual Cog-nition, 10, 79-100.
111. Van Diepen, E. M. J., Wampers, M, & d'Ydewalle, G. (1998). Functional division of the visual field: Moving masks and moving windows. In G. Underwood (Ed.), Eye guidance in reading and scene perception (pp. 337-356). Oxford, England: Elsevier.
112. Van Zoest, L. J. F. M, Donk, M, & Theeuwes, J. (2004). The role of bottom- up control in saccadic eye movements. Journal of Experimental Psychology: Human Perception and Performance, 30, 746-759.
113. Vaughan, J. (1982). Control of fixation duration in visual search and memory search: Another look. Journal of Experimental Psychology: Human Perception and Performance, 8, 709-723.
114. Vlaskamp, B. N. S., & Hooge, I. T. C. (2006). Crowding degrades saccadic search performance. Vision Research, 46, 417-425.
115. Williams, C. C, Henderson, J. M., & Zacks, R. T. (2005). Incidental visual memory for targets and distractors in visual search. Perception & Psychophysics, 67, 816-827.
116. Williams, R. S., & Morris, R. K. (2004). Eye movements, word familiarity, and vocabulary acquisition. European Journal of Cognitive Psy- chology, 16, 312-339.
117. Yarbus, A. (1967). Eye movements and vision. New York: Plenum Press.
118. Zelinsky, G. (2005). Specifying the components of attention in a visual search task. In L. Itti, G. Rees, & J. Tsotsos (Eds.), Neurobiology of at- tention (pp. 395-400). Elsevier, Inc.
119. Zelinsky, G. J., Rao, R. P. N., Hayhoe, M. M, & Ballard, D. H. (1997). Eye movements reveal the spatiotemporal dynamics of visual search. Psychological Science, 8(6), 448-453