Eye movements during scene recollection have a functional role, but they are not reinstatements of those produced during encoding

Journal of Experimental Psychology: Human Perception and Performance

Volumn 38, Issue 5, 2012, Pages 1289-1314

  Johansson, Roger ^a   Holsanova, Jana ^a   Dewhurst, Richard ^a   Holmqvist, Kenneth ^a  

^a LUND UNIVERSITY   (Sweden)

Author keywords

Encoding; Eye movements; Memory retrieval; Recall; Scene description; Spatial cognition; Visual attention; Visual imagery

Indexed keywords

ADULT; ARTICLE; ATTENTION; COMPARATIVE STUDY; DEPTH PERCEPTION; EYE FIXATION; EYE MOVEMENT; FEMALE; HUMAN; INSTRUMENTATION; MALE; NEUROPSYCHOLOGICAL TEST; OCULOGRAPHY; PATTERN RECOGNITION; PHYSIOLOGY; RECALL; VISION;

ADULT; ATTENTION; EYE MOVEMENT MEASUREMENTS; EYE MOVEMENTS; FEMALE; FIXATION, OCULAR; HUMANS; MALE; MENTAL RECALL; NEUROPSYCHOLOGICAL TESTS; PATTERN RECOGNITION, VISUAL; SPACE PERCEPTION; VISUAL PERCEPTION; YOUNG ADULT;

EID: 84874430154     PISSN: 00961523     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0026585     Document Type: Article

References (94)

1. Altmann, G. T. M., & Kamide, Y. (2009). Discourse-mediation of the mapping between language and the visual world: Eye-movements and mental representation. Cognition, 111, 55-71. doi:10.1016/j.cognition.2008.12.005
2. Altmann, G. T. M. (2004). Language-mediated eye movements in the absence of a visual world: The 'blank screen paradigm'. Cognition, 93, B79-B87. doi:10.1016/j.cognition.2004.02.005
3. Andersson, R., Ferreira, F., & Henderson, J. M. (2011). I see what you're saying: The integration of complex speech and scenes during language comprehension. Acta Psychologica. doi:10.1016/j.actpsy.2011.01.007
4. Antrobus, J. S., Antrobus, J. S., & Singer, J. L. (1964). Eye movements accompanying daydreaming, visual imagery, and thought suppression. Journal of Abnormal and Social Psychology, 69, 244-252. doi:10.1037/h0041846
5. Ballard, D. H., Hayhoe, M. M., Pook, P. K., & Rao, R. P. N. (1997). Deictic codes for the embodiment of cognition. Behavioral and Brain Sciences, 20, 723-742. doi:10.1017/S0140525X97001611
6. Bar, M. (2004). Visual objects in context. Nature Reviews Neuroscience, 5, 617-629. doi:10.1038/nrn1476
7. Barsalou, L. W. (2008). Grounded cognition. Annual Review of Psychology, 59, 617-645. doi:10.1146/annurev.psych.59.103006.093639
8. Bergstrom, K. J., & Hiscock, M. (1988). Factors influencing ocular motility during the performance of cognitive tasks. Canadian Journal of Psychology/Revue Canadienne de psychologie, 42, 1-23. doi:10.1037/h0084174
9. Bourlon, C., Oliviero, N., Wattiez, P., Pouget, P., & Bartolomeo, P. (2011). Visual mental imagery: What the head's eye tells the mind's eye. Brain Research, 1367, 287-297. doi:10.1016/j.brainres.2010.10.039
10. Bower, G. H., & Morrow, D. G. (1990). Mental models in narrative comprehension. Science, 247, 44-48. doi:10.1126/science.2403694
11. Brandt, S. A., & Stark, L. W. (1997). Spontaneous eye movements during visual imagery reflect the content of the visual scene. Journal of Cognitive Neuroscience, 9, 27-38. doi:10.1162/jocn.1997.9.1.27
12. Brown, B. B. (1968). Visual recall ability and eye movements. Psycho-physiology, 4, 300-306. doi:10.1111/j.1469-8986.1968.tb02771.x
13. Chafe, W. (1980). The deployment of consciousness in the production of a narrative. In W. Chafe (Ed.), The pear stories: Cognitive, cultural, and linguistic aspects of narrative production (pp. 9-55). Norwood, NJ: Ablex.
14. Chafe, W. (1987). Cognitive constraints on information flow. In Russell Tomlin (ed.), Coherence and grounding in discourse (pp. 21-51). Am-sterdam, The Netherlands: John Benjamins.
15. Chafe, W. (1996). How consciousness shapes language. Pragmatics and Cognition, 4, 35-54. doi:10.1075/pc.4.1.04cha
16. Clark, H. (1916). Visual imagery and attention: An analytical study. The American Journal of Psychology, 27, 461-492. doi:10.2307/1412990
17. Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37-46. doi:10.1177/001316446002000104
18. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: L. Erlbaum Associates.
19. Deckert, G. H. (1964). Pursuit eye movements in the absence of a moving visual stimulus. Science, 143, 1192-1193. doi:10.1126/science.143.3611.1192
20. Demarais, A. M., & Cohen, B. H. (1998). Evidence for image-scanning eye movements during transitive inference. Biological Psychology, 49, 229-247. doi:10.1016/S0301-0511(98)00042-8
21. Deubel, H., & Schneider, W. X. (1996). Saccade target selection and object recognition: Evidence for a common attentional mechanism. Vision Research, 36, 1827-1837. doi:10.1016/0042-6989(95)00294-4
22. Ehrlichman, H., & Barrett, J. (1983). "Random" saccadic eye movements during verbal-linguistic and visual-imaginal tasks. Acta Psychologica, 53, 9-26. doi:10.1016/0001-6918(83)90013-6
23. Farah, M. J., Hammond, K. M., Levine, D. N., & Calvanio, R. (1988). Visual and spatial mental imagery: Dissociable systems of representation. Cognitive Psychology, 20, 439-462. doi:10.1016/0010-0285(88)90012-6
24. Ferreira, F. Apel, A., & Henderson, J. M. (2008). Taking a new look at looking at nothing. Trends in Cognitive Science, 12, 405-410. doi: 10.1016/j.tics.2008.07.007
25. Finke, R. A. (1989). Principles of mental imagery. Cambridge, MA: MIT Press.
26. Foulsham, T., & Underwood, G. (2008). What can saliency models predict about eye movements? Spatial and sequential aspects of fixations during encoding and recognition. Journal of Vision, 8:, 6, 1-17.
27. Ganis, G., Thompson, W. L., & Kosslyn, S. M. (2004). Brain areas underlying visual mental imagery and visual perception: An fMRI study. Cognitive Brain Research, 20, 226-241. doi:10.1016/j.cogbrainres.2004.02.012
28. Gazzaniga, M. S., Ivry, R., & Mangun, G. R. (2008). Cognitive Neuroscience: The Biology of the Mind. W. W. Norton, New York, (3rd Edition).
29. Gbadamosi, J., & Zangemeister, W. H. (2001). Visual imagery in hemi-anopic patients, Journal of Cognitive Neuroscience. 13, 855-866. doi: 10.1162/089892901753165782
30. Geng, J. J., Ruff, C. C., & Driver, J. (2009). Saccades to a remembered location elicit spatially specific activation in the human retinotopic visual cortex. Journal of Cognitive Neuroscience, 21, 230-245. doi: 10.1162/jocn.2008.21025
31. Glenberg, A. M., Schroeder, J. L., & Robertson, D. A. (1998). Averting the gaze disengages the environment and facilitates remembering. Memory & Cognition, 26, 651-658. doi:10.3758/BF03211385
32. Goldberg, J. H., & Kotval, X. P. (1999). Computer interface evaluation using eye movements: Methods and construct. International Journal of Industrial Ergonomics, 24, 631-645. doi:10.1016/S0169-8141(98)00068-7
33. Goldin-Meadow, S., Nusbaum, H., Kelly, S. D., & Wagner, S. (2001). Explaining math: Gesturing lightens the load. Psychological Science, 12, 516-522. doi:10.1111/1467-9280.00395
34. Goldthwait, C. (1933). Relation of eye movements to visual imagery. The American Journal of Psychology, 45, 106-110. doi:10.2307/1414189
35. Hale, S. M., & Simpson, H. M. (1971). Effects of eye movements on the rate of discovery and the vividness of visual images. Perception & Psychophysics, 9, 242-246.
36. Hebb, D. O. (1968). Concerning imagery. Psychological Review, 75, 466-477. doi:10.1037/h0026771
37. Henderson, J. M. (2007). Regarding scenes. Current Directions in Psychological Science, 16, 219-222. doi:10.1111/j.1467-8721.2007.00507.x
38. Hesslow, G. (2011). The current status of the simulation theory of cognition. Brain Research. (Epub ahead of print.). doi:10.1016/j.brainres.2011.06.026
39. Hiscock, M., & Bergstrom, K. J. (1981). Ocular motility as an indicator of verbal and visuospatial processing. Memory & Cognition, 9, 332-338. doi:10.3758/BF03196967
40. Hollingworth, A. (2006). Scene and position specificity in visual memory for objects. Journal of Experimental Psychology: Learning, Memory, and Cognition, 32, 58-69. doi:10.1037/0278-7393.32.1.58
41. Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., & van de Weijer, J. (2011). Eye tracking: A comprehensive guide to methods and measures. New York, NY: Oxford University Press.
42. Holsanova, J., Hedberg, B., & Nilsson, N. (1999). Visual and verbal focus patterns when describing pictures. In Becker, Deubel, & Mergner (Eds.), Current oculomotor research: Physiological and psychological aspects. New York, NY: Plenum.
43. Holsanova, J. (2001). Picture viewing and picture description: Two windows on the mind. Doctoral dissertation. Lund University Cognitive Studies 83. ISSN 1101-8453. ISBN 91-856843-76.
44. Holsanova, J. (2008). Discourse, vision, and cognition. Human Cognitive Processes 23. Amsterdam, The Netherlands: John Benjamins Publishing Company.
45. Hoover, M. A., & Richardson, D. C. (2008). When facts go down the rabbit hole: Contrasting features and objecthood as indexes to memory. Cognition, 108, 533-542. doi:10.1016/j.cognition.2008.02.011
46. Huijbers, W., Pennartz, C. M., Rubin, D. C., & Daselaar, S. M. (2011). Imagery and retrieval of auditory and visual information: Neural correlates of successful and unsuccessful performance. Neuropsychologia, 49, 1730-1740. doi:10.1016/j.neuropsychologia.2011.02.051
47. Humphrey, K., & Underwood, G. (2008). Fixation sequences in imagery and in recognition during the processing of pictures of real-world scenes. Journal of Eye Movement Research, 2(3), 1-15.
48. Intons-Peterson, M. J. (1983). Imagery paradigms: How vulnerable are they to experimenters' expectations? Journal of Experimental Psychology: Human Perception and Performance, 9, 394-412. doi:10.1037/0096-1523.9.3.394
49. Irwin, D. E., & Gordon, R. D. (1998). Eye movements, attention and trans-saccadic memory. Visual Cognition, 5,127-155. doi:10.1080/713756783
50. Irwin, D. E. (1996). Integrating information across saccadic eye movements. Current Directions in Psychological Science, 5, 94-100. doi: 10.1111/1467-8721.ep10772833
51. Jacobson, E. (1932). Electrophysiology of mental activities. The American Journal of Psychology, 44, 677-694. doi:10.2307/1414531
52. Janssen, W. H., & Nodine, C. F. (1974). Eye movements and visual imagery in free recall. Acta Psychologica, 38, 267-276. doi:10.1016/0001-6918(74)90011-0
53. Johansson, R., Holsanova, J., & Holmqvist, K. (2006). Pictures and spoken descriptions elicit similar eye movements during mental imagery, both in light and in complete darkness. Cognitive Science: A Multidisciplinary Journal, 30, 1053-1079. doi:10.1207/s15516709cog0000_86
54. Johansson, R., Holsanova, J., & Holmqvist, K. (2010). Eye movements during mental imagery are not reenactments of perception. In: Ohlsson, Stellan & Catrambone, Richard (Eds.), Proceedings of the 32nd annual meeting of the Cognitive Science Society (pp. 1968-1973). Austin, TX: Cognitive Science Society.
55. Johansson, R., Holsanova, J., & Holmqvist, K. (2011). The dispersion of eye movements during visual imagery is related to individual differences in spatial imagery ability. In L. Carlson, C. Hölscher, & T. Shipley (Eds.), Proceedings of the 33rd annual meeting of the Cognitive Science Society (pp. 1200-1205). Austin, TX: Cognitive Science Society.
56. Keehner, M., Hegarty, M., Cohen, C. A., Khooshabeh, P., & Montello, D. R. (2008). Spatial reasoning with external visualizations: What matters is what you see, not whether you interact. Cognitive Science: A Multidisciplinary Journal, 32, 1099-1132. doi:10.1080/03640210801898177
57. Kent, C., & Lamberts, K. (2008). The encoding-retrieval relationship: Retrieval as mental simulation. Trends in Cognitive Sciences, 12, 92-98. doi:10.1016/j.tics.2007.12.004
58. Knoeferle, P., & Crocker, M. W. (2007). The influence of recent scene events on spoken comprehension: Evidence from eye movements. Journal of Memory and Language, 57, 519-543. doi:10.1016/j.jml.2007.01.003
59. Kosslyn, S. M., Thompson, W. L., & Ganis, G. (2006). The case for mental imagery. New York, NY: Oxford University Press. doi:10.1093/acprof: oso/9780195179088.001.0001
60. Kosslyn, S. M. (1994). Image and brain. Cambridge, MA: MIT Press.
61. Kozhevnikov, M., Kosslyn, S., & Shephard, J. (2005). Spatial versus object visualizers: A new characterization of visual cognitive style. Memory & Cognition, 33, 710-726. doi:10.3758/BF03195337
62. Laeng, B., & Teodorescu, D.-S. (2002). Eye scanpaths during visual imagery reenact those of perception of the same visual scene. Cognitive Science: A Multidisciplinary Journal, 26, 207-231. doi:10.1207/s15516709cog2602_3
63. Marks, D. F. (1973). Visual imagery differences and eye movements in the recall of pictures. Perception & Psychophysics, 14, 407-412. doi: 10.3758/BF03211175
64. Micic, D., Ehrlichman, H., & Chen, R. (2010). Why do we move our eyes while trying to remember? The relationship between non-visual gaze patterns and memory. Brain and Cognition, 74, 210-224. doi:10.1016/j.bandc.2010.07.014
65. Neisser, U. (1967). Cognitive psychology. New York: Appleton-Century-Crofts.
66. Nordqvist, S. (1990). Kackel i trädgårdslandet [Festus and mercury: Ruckus in the Garden]. Bromma, Sweden: Opal.
67. Noton, D., & Stark, L. W. (1971a). Scanpaths in saccadic eye movements while viewing and recognizing patterns. Vision Research, 11, 929-942. doi:10.1016/0042-6989(71)90213-6
68. Noton, D., & Stark, L. W. (1971b). Scanpaths in eye movements during perception. Science, 171, 308-311. doi:10.1126/science.171.3968.308
69. O'Regan, J. K. (1992). Solving the 'real' mysteries of visual perception: The world as an outside memory. Canadian Journal of Psychology/Revue Canadienne de psychologie, 46, 461-488. doi:10.1037/h0084327
70. Paivio, A. (1991). Dual coding theory: Retrospect and current status. Canadian Journal of Psychology/Revue Canadienne de psychologie, 45, 255-287. doi:10.1037/h0084295
71. Perky, C. W. (1910). An experimental study of imagination. The American Journal of Psychology, 21, 422-452. doi:10.2307/1413350
72. Pollatsek, A., Rayner, K., & Henderson, J. M. (1990). Role of spatial location in integration of pictorial information. Journal of Experimental Psychology: Human Perception and Performance, 16, 199-210. doi: 10.1037/0096-1523.16.1.199
73. Postle, B. R., Idzikowski, C., Della Salla, S., Logie, R. H., & Baddeley, A. D. (2006). The selective disruption of spatial working memory by eye movements. Quarterly Journal of Experimental Psychology. 59, 100-120. doi:10.1080/17470210500151410
74. Pylyshyn, Z. (1981). The imagery debate: Analogue media versus tacit knowledge. Psychological Review, 88, 16-45. doi:10.1037/0033-295X.88.1.16
75. Pylyshyn, Z. W. (2002). Mental imagery: In search of a theory. Behavioral and Brain Sciences, 25, 157-182. doi:10.1017/S0140525X02000043
76. Richardson, D. C., Altmann, G. T. M., Spivey, M. J., & Hoover, M. A. (2009). Much ado about eye movements to nothing: A response to Ferreira et al.,: Taking a new look at looking at nothing, Trends in Cognitive Sciences, 13, 235-236. doi:10.1016/j.tics.2009.02.006
77. Richardson, D. C., & Kirkham, N. Z. (2004). Multimodal events and moving locations: Eye movements of adults and 6-month-olds reveal dynamic spatial indexing. Journal of Experimental Psychology: Gen-eral, 133, 46-62. doi:10.1037/0096-3445.133.1.46
78. Richardson, D. C., & Spivey, M. J. (2000). Representation, space and Hollywood Squares: Looking at things that aren't there anymore. Cognition, 76, 269-295. doi:10.1016/S0010-0277(00)00084-6
79. Scholz, A., Melhorn, K., Bocklisch, F., & Krems, J. F. (2011). Looking at nothing diminishes with practice. In L. Carlson, C. Hölscher, & T. Shipley (Eds.), Proceedings of the 33rd annual meeting of the Cognitive Science Society (pp. 1070-1075). Austin, TX: Cognitive Science Society.
80. Slotnick, S. D., Thompson, W. L., & Kosslyn, S. M. (2005). Visual mental imagery induces retinotopically organized activation of early visual areas. Cerebral Cortex, 15, 1570-1583. doi:10.1093/cercor/bhi035
81. Spivey, M. J., & Geng, J. (2001). Oculomotor mechanisms activated by imagery and memory: Eye movements to absent objects. Psychological Research/Psychologische Forschung, 65, 235-241. doi:10.1007/s004260100059
82. Spivey, M., Tyler, M., Richardson, D., & Young, E. (2000). Eye move-ments during comprehension of spoken scene descriptions. Proceedings of the 22nd annual conference of the Cognitive Science Society (pp. 487-492). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
83. Stoy, E. G. (1930). A preliminary study of ocular attitudes in thinking of spatial relations. Journal of General Psychology, 4, 379-385. doi: 10.1080/00221309.1930.9918326
84. Tanenhaus, M. K., Spivey-Knowlton, M. J., Eberhard, K. M., & Sedivy, J. C. (1995). Integration of visual and linguistic information in spoken language comprehension. Science, 268(5217), 1632-1634. doi:10.1126/science.7777863
85. Theeuwes, J., Belopolsky, A., & Olivers, C. N. L. (2009). Interactions between working memory, attention and eye movements. Acta Psycho-logica, 132, 106-114. doi:10.1016/j.actpsy.2009.01.005
86. Theeuwes, J., Olivers, C. N. L., & Chizk, C. L. (2005). Remembering a location makes the eyes curve away. Psychological Science, 16, 196-199. doi:10.1111/j.0956-7976.2005.00803.x
87. Thomas, L. E., & Lleras, A. (2009). Covert shifts of attention function as an implicit aid to insight. Cognition, 111, 168-174. doi:10.1016/j.cognition.2009.01.005
88. Thomas, N. J. T. (2009). Visual imagery and consciousness. In W. P. Banks (Ed.), Encyclopedia of consciousness (volume 2, pp. 445-457). Oxford, UK: Elsevier/Academic Press. doi:10.1016/B978-012373873-8.00083-9
89. Totten, E. (1935). Eye movement during visual imagery. Comparative Psychology Monographs, 11, 46.
90. Van den Berg, R., Cornelissen, F. W., & Roerdink, J. B. (2009). A crowding model of visual clutter, Journal of Vision, 9, 24, 1-11.
91. Weiner, S. L., & Ehrlichman, H. (1976). Ocular motility and cognitive process. Cognition, 4, 31-43. doi:10.1016/0010-0277(76)90009-3
92. Wilcoxon, F. (1945). Individual comparison by ranking methods. Biometrics, 1, 80-83. doi:10.2307/3001968
93. Wooding, D. S. (2002). Fixation maps: Quantifying eye-movement traces. Proceedings of the 2002 symposium on Eye tracking research & applications, New Orleans, Louisiana.
94. Zangemeister, W. H., & Liman, T. (2007). Foveal versus parafoveal scanpaths of visual imagery in virtual hemianopic subjects. Computers in Biology and Medicine, 37, 975-982. doi:10.1016/j.compbiomed.2007.01.015