Visual attention and stability

Philosophical Transactions of the Royal Society B: Biological Sciences

Volumn 366, Issue 1564, 2011, Pages 516-527

  Mathôt, Sebastiaan ^a   Theeuwes, Jan ^a  

^a VU UNIVERSITY AMSTERDAM   (Netherlands)

Author keywords

Assumption of stability; Remapping; Trans saccadic memory; Visual attention; Visual stability

Indexed keywords

EYE; MOVEMENT; SENSORY SYSTEM; STABILIZATION; VISUAL CUE;

EID: 79951821205     PISSN: 09628436     EISSN: 14712970     Source Type: Journal    
DOI: 10.1098/rstb.2010.0187     Document Type: Review

References (102)

1. Findlay, J. M. & Gilchrist, I. D. 2003 Active vision: the psychology of looking and seeing. Oxford, UK: Oxford University Press.
2. Merriam, E. P. & Colby, C. L. 2005 Active vision in parietal and extrastriate cortex. Neuroscientist 11, 484-493. (doi:10.1177/1073858405276871) (Pubitemid 41339232)
3. Bashinski, H. S. & Bacharach, V. R. 1980 Enhancement of perceptual sensitivity as the result of selectively attending to spatial locations. Percept. Psychophys. 28, 241-248.
4. Carrasco, M., Penpeci-Talgar, C. & Eckstein, M. 2000 Spatial covert attention increases contrast sensitivity across the CSF: support for signal enhancement. Vis. Res. 40, 1203-1215. (doi:10.1016/S0042-6989 (00) 00024-9) (Pubitemid 30216444)
5. Posner, M. I. 1980 Orienting of attention. Q. J. Exp. Psychol. 32, 3-25.
6. Bahcall, D. O. & Kowler, E. 1999 Attentional interference at small spatial separations. Vis. Res. 39, 71-86. (doi:10.1016/S0042-6989 (98) 00090-X) (Pubitemid 28526830)
7. Mathôt, S., Hickey, C. & Theeuwes, J. 2010 From reorienting of attention to biased competition: evidence from hemifield effects. Atten. Percept. Psychophys. 72, 651-657. (doi:10.3758/APP. 72.3.651)
8. Mounts, J. R. W. 2000 Evidence for suppressive mechanisms in attentional selection: feature singletons produce inhibitory surrounds. Perc ept. Psychophys. 62, 969-983.
9. Reynolds, J. H., Pasternak, T. & Desimone, R. 2000 Attention increases sensitivity of V4 neurons. Neuron 26, 703-714. (doi:10.1016/S0896-6273 (00) 81206-4)
10. Spitzer, H., Desimone, R. & Moran, J. 1988 Increased attention enhances both behavioral and neuronal performance. Science 240, 338-340. (doi:10.1126/science.3353728)
11. Moran, J. & Desimone, R. 1985 Selective attention gates visual processing in the extrastriate cortex. Science 229, 782-784. (doi:10.1126/science.4023713) (Pubitemid 15049827)
12. Reynolds, J. H. & Chelazzi, L. 2004 Attentional modulation of visual processing. Annu. Rev. Neurosci. 27, 611-647. (doi:10.1146/annurev. neuro.26.041002. 131039) (Pubitemid 39050415)
13. Saenz, M., Buracas, G. T. & Boynton, G. M. 2002 Global effects of feature-based attention in human visual cortex. Nat. Neurosci. 5, 631-632. (doi:10.1038/nn876) (Pubitemid 34742977)
14. Rensink, R. A., O'Regan, J. K. & Clark, J. J. 1997 The need for attention to perceive changes in scenes. Psychol. Sci. 8, 368-373. (doi:10.1111/j.1467-9280.1997. tb00427.x) (Pubitemid 127455296)
15. Mack, A. & Rock, I. 1998 Inattentional blindness: perception without attention. In Visual attention (ed. R. D. Wright), pp. 55-76. Oxford, UK: Oxford University Press.
16. Noë, A. & O'Regan, J. K. 2000 Perception, attention, and the grand illusion. Psyche 6, 6-15.
17. Irwin, D. E. 1996 Integrating information across saccadic eye movements. Curr. Dir. Psychol. Sci. 5, 94-100. (doi:10.1111/1467-8721.ep10772833)
18. McConkie, G. W. & Rayner, K. 1976 Identifying the span of the effective stimulus in reading: literature review and theories of reading. In Theoretical models and processes of reading (eds H. Singer & R. B. Ruddell), pp. 137-162. Newark, DE: International Reading Association.
19. Trehub, A. 1977 Neuronal models for cognitive processes: networks for learning, perception and imagination. J. Theor. Biol. 65, 141-169. (doi:10.1016/0022-5193 (77) 90081-9) (Pubitemid 8036676)
20. Breitmeyer, B. G., Kropfl, W. & Julesz, B. 1982 The existence and role of retinotopic and spatiotopic forms of visual persistence. Acta Psychol. 52, 175-196. (doi:10.1016/0001-6918 (82) 90007-5)
21. Jonides, J., Irwin, D. E. & Yantis, S. 1982 Integrating visual information from successive fixations. Science 215, 192-194. (doi:10.1126/science.7053571) (Pubitemid 12178112)
22. Bridgeman, B. & Mayer, M. 1983 Failure to integrate visual information from successive fixations. B. Psychon. Soc. 21, 285-286.
23. Irwin, D. E., Yantis, S. & Jonides, J. 1983 Evidence against visual integration across saccadic eye movements. Percept. Psychophys. 34, 49-57.
24. O'Regan, J. K. & Lévy-Schoen, A. 1983 Integrating visual information from successive fixations: does trans-saccadic fusion exist? Vis. Res. 23, 765-768. (Pubitemid 13035191)
25. Di Lollo, V. 1980 Temporal integration in visual memory. J. Exp. Psychol. Gen. 109, 75-97. (doi:10. 1037/0096-3445.109.1.75)
26. Irwin, D. E. 1991 Information integration across saccadic eye movements. Cogn. Psychol. 23, 420-456. (doi:10.1016/0010-0285 (91) 90015-G)
27. Irwin, D. E. 1992 Memory for position and identity across eye movements. J. Exp. Psychol. Learn. 18, 307-317. (doi:10.1037/0278-7393.18.2.307)
28. Irwin, D. E. & Andrews, R. 1996 Integration and accumulation of information across saccadic eye movements. In Attention and performance XVI: information integration in perception and communication (eds T. Inui & J. L. McClelland), pp. 125-155. Cambridge, MA: MIT Press.
29. Deubel, H. & Schneider, W. X. 1996 Saccade target selection and object recognition: evidence for a common attentional mechanism. Vis. Res. 36, 1827-1837. (doi:10.1016/0042-6989 (95) 00294-4) (Pubitemid 26166009)
30. Kowler, E., Anderson, E., Dosher, B. & Blaser, E. 1995 The role of attention in the programming of saccades. Vis. Res. 35, 1897-1916. (doi:10.1016/0042-6989 (94) 00279-U)
31. Prime, S., Tsotsos, L., Keith, G. & Crawford, J. 2007 Visual memory capacity in transsaccadic integration. Exp. Brain. Res. 180, 609-628. (doi:10.1007/s00221-007-0885-4) (Pubitemid 46988109)
32. Melcher, D. 2009 Selective attention and the active remapping of object features in trans-saccadic perception. Vis. Res. 49, 1249-1255. (doi:10.1016/j.visres.2008.03.014)
33. Henderson, J. M., Pollatsek, A. & Rayner, K. 1987 Effects of foveal priming and extrafoveal preview on object identification. J. Exp. Psychol. Hum. 13, 449-463. (doi:10.1037/0096-1523.13.3.449)
34. Pollatsek, A., Rayner, K. & Henderson, J. M. 1990 Role of spatial location in integration of pictorial information across saccades. J. Exp. Psychol. Hum. 16, 199-210. (doi:10.1037/0096-1523.16.1.199)
35. Demeyer, M., De Graef, P., Wagemans, J. & Verfaillie, K. 2009 Transsaccadic identification of highly similar artificial shapes. J. Vis. 9, 1-14. (doi:10.1167/9.4.28)
36. Demeyer, M., De Graef, P., Wagemans, J. & Verfaillie, K. 2010 Parametric integration of visual form across saccades. Vis. Res. 50, 1225-1234. (doi:10.1016/j. visres.2010.04.008)
37. Melcher, D. 2005 Spatiotopic transfer of visual-form adaptation across saccadic eye movements. Curr. Biol. 15, 1745-1748. (doi:10.1016/j.cub.2005.08. 044) (Pubitemid 41415631)
38. Godijn, R. & Pratt, J. 2002 Endogenous saccades are preceded by shifts of visual attention: evidence from cross-saccadic priming effects. Acta Psychol. 110, 83-102. (doi:10.1016/S0001-6918 (01) 00071-3)
39. Deubel, H., Irwin, D. E. & Schneider, W. X. 1999 The subjective direction of gaze shifts long before the saccade. In Current oculomotor research: physiological and psychological aspects (eds W. Becker, H. Deubel & T. Mergner), pp. 65-70. New York, NY: Plenum Press.
40. Hunt, A. R. & Cavanagh, P. 2009 Looking ahead: the perceived direction of gaze shifts before the eyes move. J. Vis. 9, 1-7. (doi:10.1167/9.9.1)
41. Currie, C. B., McConkie, G. W., Carlson-Radvansky, L. A. & Irwin, D. E. 2000 The role of the saccade target object in the perception of a visually stable world. Percept. Psychophys. 62, 673-683.
42. Deubel, H., Bridgeman, B. & Schneider, W. X. 1998 Immediate post-saccadic information mediates space constancy. Vis. Res. 38, 3147-3159. (doi:10.1016/S0042-6989 (98) 00048-0) (Pubitemid 28408308)
43. Deubel, H. & Schneider, W. X. 1994 Perceptual stability and postsaccadic visual information: can man bridge a gap? Behav. Brain Sci. 17, 259-259. (doi:10. 1017/S0140525X00034397)
44. McConkie, G. W. & Currie, C. B. 1996 Visual stability across saccades while viewing complex pictures. J. Exp. Psychol. Hum. 22, 563-581. (doi:10.1037/0096-1523. 22.3.563) (Pubitemid 126418411)
45. Holt, E. B. 1903 Eye-movement and central anaesthesia. Psychol. Monogr. 4, 1-45.
46. Ross, J., Morrone, M. C., Goldberg, M. E. & Burr, D. C. 2001 Changes in visual perception at the time of saccades. Trends Neurosci. 24, 113-121. (doi:10. 1016/S0166-2236 (00) 01685-4) (Pubitemid 32115442)
47. Bridgeman, B., Hendry, D. & Stark, L. 1975 Failure to detect displacement of the visual world during saccadic eye movements. Vis. Res. 15, 719-722. (doi:10.1016/0042-6989 (75) 90290-4)
48. Gysen, V., De Graef, P. & Verfaillie, K. 2002 Detection of intrasaccadic displacements and depth rotations of moving objects. Vis. Res. 42, 379-391. (doi:10.1016/S0042-6989 (01) 00296-6) (Pubitemid 34102364)
49. Deubel, H., Schneider, W. X. & Bridgeman, B. 1996 Postsaccadic target blanking prevents saccadic suppression of image displacement. Vis. Res. 36, 985-996. (doi:10.1016/0042-6989 (95) 00203-0) (Pubitemid 26093417)
50. Heywood, S. & Churcher, J. 1981 Direction-specific and position-specific effects upon detection of displacements during saccadic eye movements. Vis. Res. 21, 255-261. (doi:10.1016/0042-6989 (81) 90119-X) (Pubitemid 11137201)
51. Deubel, H., Koch, C. & Bridgeman, B. 2010 Landmarks facilitate visual space constancy across saccades and during fixation. Vis. Res. 50, 249-259. (doi:10. 1016/j.visres.2009.09.020)
52. Hollingworth, A., Richard, A. M. & Luck, S. J. 2008 Understanding the function of visual short-term memory: transsaccadic memory, object correspondence, and gaze correction. J. Exp. Psychol. Gen. 137, 163-181. (doi:10.1037/0096-3445.137.1.163)
53. Shebilske, W. L. 1976 Extraretinal information in corrective saccades and inflow vs outflow theories of visual direction constancy. Vis. Res. 16, 621-628. (doi:10.1016/0042-6989 (76) 90009-2)
54. Talbot, S. A. & Marshall, W. H. 1941 Physiological studies on neural mechanisms of visual localization and discrimination. Am. J. Ophthalmol. 24, 1255-1263.
55. Tolias, A. S., Moore, T., Smirnakis, S. M., Tehovnik, E. J., Siapas, A. G. & Schiller, P. H. 2001 Eye movements modulate visual receptive fields of V4 neurons. Neuron 29, 757-767. (doi:10.1016/S0896-6273 (01) 00250-1) (Pubitemid 32323948)
56. D'Avossa, G., Tosetti, M., Crespi, S., Biagi, L., Burr, D. C. & Morrone, M. C. 2007 Spatiotopic selectivity of BOLD responses to visual motion in human area MT. Nat. Neurosci. 10, 249-255. (doi:10.1038/nn1824) (Pubitemid 46174850)
57. Duhamel, J. R., Bremmer, F., Benhamed, S. & Graf, W. 1997 Spatial invariance of visual receptive fields in parietal cortex neurons. Nature 389, 845-848. (doi:10.1038/39865) (Pubitemid 27462977)
58. Galletti, C., Battaglini, P. P. & Fattori, P. 1995 Eye position influence on the parieto-occipital area PO (V6) of the macaque monkey. Eur. J. Neurosci. 7, 2486-2501. (doi:10.1111/j.1460-9568.1995.tb01047.x)
59. Gardner, J. L., Merriam, E. P., Movshon, J. A. & Heeger, D. J. 2008 Maps of visual space in human occipital cortex are retinotopic, not spatiotopic. J. Neurosci. 28, 3988-3999. (doi:10.1523/JNEUR-OSCI.5476-07.2008)
60. Fadiga, L., Fogassi, L., Gallese, V. & Rizzolatti, G. 2000 Visuomotor neurons: ambiguity of the discharge or 'motor' perception? Int. J. Psychophysiol. 35, 165-177. (doi:10.1016/S0167-8760 (99) 00051-3) (Pubitemid 30085588)
61. Wurtz, R. H. 2008 Neuronal mechanisms of visual stability. Vis. Res. 48, 2070-2089. (doi:10.1016/j. visres.2008.03.021)
62. Sommer, M. A. & Wurtz, R. H. 2008 Brain circuits for the internal monitoring of movements. Annu. Rev. Neurosci. 31, 317-338. (doi:10.1146/annurev. neuro. 31.060407.125627)
63. Merriam, E. P., Genovese, C. R. & Colby, C. L. 2003 Spatial updating in human parietal cortex. Neuron 39, 361-373. (doi:10.1016/S0896-6273 (03) 00393-3) (Pubitemid 36897556)
64. Colby, C. L., Duhamel, J. R. & Goldberg, M. E. 1996 Visual, presaccadic, and cognitive activation of single neurons in monkey lateral intraparietal area. J. Neurophysiol. 76, 2841-2852. (Pubitemid 26378066)
65. Duhamel, J. R., Colby, C. L. & Goldberg, M. E. 1992 The updating of the representation of visual space in parietal cortex by intended eye movements. Science 255, 90-92. (doi:10.1126/science.1553535)
66. Goldberg, M. E. & Bruce, C. J. 1990 Primate frontal eye fields. III. Maintenance of a spatially accurate saccade signal. J. Neurophysiol. 64, 489-508. (Pubitemid 20264057)
67. Barash, S., Bracewell, R. M., Fogassi, L., Gnadt, J. W. & Andersen, R. A. 1991 Saccade-related activity in the lateral intraparietal area. II. Spatial properties. J. Neurophysiol. 66, 1109-1124.
68. Nakamura, K. & Colby, C. L. 2002 Updating of the visual representation in monkey striate and extrastriate cortex during saccades. Proc. Natl Acad. Sci. USA 99, 4026-4031. (doi:10.1073/pnas.052379899) (Pubitemid 34252223)
69. Sommer, M. A. & Wurtz, R. H. 2006 Influence of the thalamus on spatial visual processing in frontal cortex. Nature 444, 374-377. (doi:10.1038/nature05279) (Pubitemid 44764113)
70. Walker, M. F., Fitzgibbon, E. J. & Goldberg, M. E. 1995 Neurons in the monkey superior colliculus predict the visual result of impending saccadic eye movements. J. Neurophysiol. 73, 1988-2003.
71. Khayat, P. S., Spekreijse, H. & Roelfsema, P. R. 2004 Correlates of transsaccadic integration in the primary visual cortex of the monkey. Proc. Natl Acad. Sci. USA 101, 12712-12717. (doi:10.1073/pnas.0301935101) (Pubitemid 39122088)
72. Merriam, E. P., Genovese, C. R. & Colby, C. L. 2007 Remapping in human visual cortex. J. Neurophysiol. 97, 1738-1755. (doi:10.1152/jn. 00189.2006) (Pubitemid 46239542)
73. Sommer, M. A. & Wurtz, R. H. 2004 What the brain stem tells the frontal cortex. I. Oculomotor signals sent from superior colliculus to frontal eye field via mediodorsal thalamus. J. Neurophysiol. 91, 1381-1402. (doi:10.1152/jn. 00738.2003) (Pubitemid 38250418)
74. Sommer, M. A. & Wurtz, R. H. 2003 The frontal eye field sends predictively remapped visual signals to the superior colliculus. J. Vis. 3, 146. (doi:10.1167/3.9.146) (Pubitemid 39111126)
75. Craighero, L. & Rizzolatti, G. 2005 The premotor theory of attention. In Neurobiology of attention (eds L. Itti, G. Rees & J. K. Tsotsos), pp. 181-186. San Diego, CA: Elsevier.
76. Colby, C. L. 1996 A neurophysiological distinction between attention and intention. In Attention and Performance XVI: information integration in perception and communication (eds T. Inui & J. L. McClelland), pp. 157-177. Cambridge, MA: MIT Press.
77. Gottlieb, J. P., Kusunoki, M. & Goldberg, M. E. 1998 The representation of visual salience in monkey parietal cortex. Nature 391, 481-484. (doi:10.1038/35135) (Pubitemid 28086547)
78. Bisley, J. W. & Goldberg, M. E. 2010 Attention, intention, and priority in the parietal lobe. Annu. Rev. Neurosci. 33, 1-21.
79. Donk, M. & van Zoest, W. 2008 Effects of salience are short-lived. Psychol. Sci. 19, 733-739. (doi:10.1111/j. 1467-9280.2008.02149.x)
80. Irwin, D. E. & Gordon, R. D. 1998 Eye movements, attention and trans-saccadic memory. Vis. Cogn. 5, 127-155. (Pubitemid 128537536)
81. Melcher, D. 2007 Predictive remapping of visual features precedes saccadic eye movements. Nat. Neurosci. 10, 903-907. (doi:10.1038/nn1917) (Pubitemid 47013433)
82. Knapen, T., Rolfs, M., Wexler, M. & Cavanagh, P. 2010 The reference frame of the tilt aftereffect. J. Vis. 10, 1-13. (doi:10.1167/10.1.8)
83. Cha, O. & Chong, S. C. 2010 Background is remapped across saccades. J. Vis. 10, 516. (doi:10.1167/10.7.516)
84. Posner, M. I. & Cohen, Y. 1984 Components of visual orienting. In Attention and performance X: control of language processes (eds H. Bouma & D. G. Bouwhuis), pp. 531-556. Hillsdale, NY: Erlbaum.
85. Maylor, E. A. & Hockey, R. 1985 Inhibitory component of externally controlled covert orienting in visual space. J. Exp. Psychol. Hum. 11, 777-787. (doi:10.1037/0096-1523.11.6.777)
86. Abrams, R. A. & Pratt, J. 2000 Oculocentric coding of inhibited eye movements to recently attended locations. J. Exp. Psychol. Hum. 26, 776-788. (doi:10.1037/0096-1523.26.2.776)
87. Golomb, J. D., Chun, M. M. & Mazer, J. A. 2008 The native coordinate system of spatial attention is retinotopic. J. Neurosci. 28, 10654-10662. (doi:10. 1523/JNEUROSCI.2525-08.2008)
88. Awh, E., Jonides, J. & Reuter-Lorenz, P. A. 1998 Rehearsal in spatial working memory. J. Exp. Psychol. Hum. 24, 780-790. (doi:10.1037/0096-1523.24.3. 780) (Pubitemid 128457477)
89. Mathôt, S. & Theeuwes, J. 2010 Evidence for the predictive remapping of visual attention. Exp. Brain. Res. 200, 117-122. (doi:10.1007/s00221-009-2055-3)
90. Yantis, S. & Jonides, J. 1984 Abrupt visual onsets and selective attention: evidence from visual search. J. Exp. Psychol. Hum. 10, 601-621. (doi:10.1037/0096-1523.10.5.601)
91. Mathôt, S. & Theeuwes, J. In press. Gradual remapping results in early retinotopic and late spatiotopic inhibition of return. Psychol. Sci. (doi:10.1177/0956797 610388813)
92. van Koningsbruggen, M. G., Gabay, S., Sapir, A., Henik, A. & Rafal, R. D. 2009 Hemispheric asymmetry in the remapping and maintenance of visual saliency maps: a TMS study. J. Cogn. Neurosci. 22, 1730-1738. (doi:10.1162/jocn. 2009.21356)
93. Marino, A., Golomb, J. D., Chun, M. M. & Mazer, J. A. 2009 Spatiotemporal dynamics of attentional updating across saccades. J. Vis. 9, 238a. (doi:10.1167/9.8.238)
94. Hamker, F. H., Zirnsak, M., Calow, D. & Lappe, M. 2008 The peri-saccadic perception of objects and space. PLoS Comp. Biol. 4, e31. (doi:10.1371/journal.pcbi.0040031) (Pubitemid 351328507)
95. Zirnsak, M., Lappe, M. & Hamker, F. H. 2010 The spatial distribution of receptive field changes in a model of peri-saccadic perception: predictive remapping and shifts towards the saccade target. Vis. Res. 50, 1328-1337. (doi:10.1016/j.visres.2010.02.002)
96. Cavanagh, P., Hunt, A. R., Afraz, A. & Rolfs, M. 2010 Visual stability based on remapping of attention pointers. Trends Cogn. Sci. 14, 147-153. (doi:10.1016/j. tics.2010.01.007)
97. Afraz, A. & Cavanagh, P. 2009 The gender-specific face aftereffect is based in retinotopic not spatiotopic coordinates. J. Vis. 9, 1-17. (doi:10.1167/9.10.10)
98. Knapen, T., Rolfs, M. & Cavanagh, P. 2009 The reference frame of the motion aftereffect is retinotopic. J. Vis. 9, 1-7. (doi:10.1167/9.5.16)
99. Wenderoth, P. & Wiese, M. 2008 Retinotopic encoding of the direction aftereffect. Vis. Res. 48, 1949-1954. (doi:10.1016/j.visres.2008.06.013)
100. Ezzati, A., Golzar, A. & Afraz, A. 2008 Topography of the motion aftereffect with and without eye movements. J. Vis. 8, 1-16. (doi:10.1167/8.14.23)
101. Wittenberg, M., Bremmer, F. & Wachtler, T. 2008 Perceptual evidence for saccadic updating of color stimuli. J. Vis. 8, 1-9. (doi:10.1167/8.14.9)
102. Bays, P. M. & Husain, M. 2007 Spatial remapping of the visual world across saccades. Neuroreport 18, 1207-1213. (doi:10.1097/WNR.0b013e328244e6c3) (Pubitemid 47075583)