Predicting object features across saccades: Evidence from object recognition and visual search

Journal of Experimental Psychology: General

Volumn 143, Issue 5, 2014, Pages 1903-1922

  Herwig, Arvid ^a   Schneider, Werner X ^a  

^a BIELEFELD UNIVERSITY   (Germany)

Author keywords

Anticipation; Eye movements; Ideomotor theory; Peripheral vision; Prediction

Indexed keywords

ADULT; FEMALE; HUMAN; MALE; PATTERN RECOGNITION; PHOTOSTIMULATION; PHYSIOLOGY; REACTION TIME; SACCADIC EYE MOVEMENT; VISION; YOUNG ADULT;

ADULT; FEMALE; HUMANS; MALE; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; REACTION TIME; SACCADES; VISUAL PERCEPTION; YOUNG ADULT;

EID: 84925348181     PISSN: 00963445     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0036781     Document Type: Article

References (90)

1. Abrams, J., Barbot, A., & Carrasco, M. (2010). Voluntary attention increases perceived spatial frequency. Attention, Perception & Psychophysics, 72, 1510-1521. doi:10.3758/APP.72.6.1510
2. Anton-Erxleben, K., & Carrasco, M. (2013). Attentional enhancement of spatial resolution: Linking behavioural and neurophysiological evidence. Nature Reviews Neuroscience, 14, 188-200. doi:10.1038/nrn3443
3. Bar, M. (2009). The proactive brain: Memory for predictions. Philosophical Transactions of the Royal Society B, 364, 1235-1243. doi:10.1098/ rstb.2008.0310
4. Bar, M. (Ed.). (2011). Predictions in the brain: Using our past to generate a future. New York, NY: Oxford University Press. doi:10.1093/acprof: oso/9780195395518.001.0001
5. Block, N. (2012). The grain of vision and the grain of attention. Thought: A Journal of Philosophy, 1, 170-184.
6. Bubic, A., von Cramon, D. Y., & Schubotz, R. I. (2010). Prediction, cognition and the brain. Frontiers in Human Neuroscience, 4, 1-15. doi:10.3389/fnhum.2010.00025
7. Bundesen, C. (1990). A theory of visual attention. Psychological Review, 97, 523-547. doi:10.1037/0033-295X.97.4.523
8. Cavanagh, P., Hunt, A. R., Afraz, A., & Rolfs, M. (2010). Visual stability based on remapping of attention pointers. Trends in Cognitive Sciences, 14, 147-153. doi:10.1016/j.tics.2010.01.007
9. Chelazzi, L., Duncan, J., Miller, E. K., & Desimone, R. (1998). Responses of neurons in inferior temporal cortex during memory-guided visual search. Journal of Neurophysiology, 80, 2918-2940.
10. Chelazzi, L., Miller, E. K., Duncan, J., & Desimone, R. (1993). A neural basis for visual search in inferior temporal cortex. Nature, 363, 345-347. doi:10.1038/363345a0
11. Chun, M. M., & Turk-Browne, N. B. (2008). Associative learning mechanisms in vision. In S. J. Luck & A. R. Hollingworth (Eds.), Visual memory (pp. 209-245). Oxford, England: Oxford University Press. doi:10.1093/acprof:oso/9780195305487.003.0007
12. Clark, A. (2013). Whatever next? Predictive brains, situated agents, and the future of cognitive science. Behavioral and Brain Sciences, 36, 181-253. doi:10.1017/S0140525X12000477
13. Cox, D., Meier, P., Oertelt, N., & DiCarlo, J. (2005). Breaking positioninvariant object recognition. Nature Neuroscience, 8, 1145-1147. doi: 10.1038/nn1519
14. Demeyer, M., De Graef, P., Wagemans, J., & Verfaillie, K. (2009). Transsaccadic identification of highly similar artificial shapes. Journal of Vision, 9, 1-14.
15. Dennett, D. C. (1991). Consciousness explained. Boston, MA: Little, Brown.
16. Dennett, D. C. (2001). Surprise, surprise. Behavioral and Brain Sciences, 24, 982-982. doi:10.1017/S0140525X01320113
17. Deubel, H., Irwin, D. E., & Schneider, W. X. (1999). The subjective direction of gaze shifts long before the saccade. In W. Becker, H. Deubel, & T. Mergner (Eds.), Current oculomotor research: Physiological and psychological aspects (pp. 65-70). New York, NY: Plenum Press. doi:10.1007/978-1-4757-3054-8_8
18. Deubel, H., Schneider, W. X., & Bridgeman, B. (1996). Postsaccadic target blanking prevents saccadic suppression of image displacement. Vision Research, 36, 985-996. doi:10.1016/0042-6989(95)00203-0
19. Deubel, H., Schneider, W. X., & Bridgeman, B. (2002). Transsaccadic memory of position and form. Progress in Brain Research, 140, 165-180. doi:10.1016/S0079-6123(02)40049-0
20. DiCarlo, J. J., Zoccolan, D., & Rust, N. C. (2012). How does the brain solve visual object recognition? Neuron, 73, 415-434. doi:10.1016/j .neuron.2012.01.010
21. Duhamel, J. R., Colby, C. L., & Goldberg, M. E. (1992). The updating of the representation of visual space in parietal cortex by intended eye movements. Science, 255, 90-92. doi:10.1126/science.1553535
22. Elsner, B., & Hommel, B. (2001). Effect anticipation and action control. Journal of Experimental Psychology: Human Perception and Performance, 27, 229-240. doi:10.1037/0096-1523.27.1.229
23. Fahle, M. (2009). Perceptual learning and sensory plasticity. In L. Squire (Ed.), Encyclopedia of neuroscience (pp. 523-533). Amsterdam, the Netherlands: Academic Press. doi:10.1016/B978-008045046-9.00230-8
24. Findlay, J. M. (1997). Saccade target selection during visual search. Vision Research, 37, 617-631. doi:10.1016/S0042-6989(96)00218-0
25. Freeman, J., & Simoncelli, E. P. (2011). Metamers of the ventral stream. Nature Neuroscience, 14, 1195-1201. doi:10.1038/nn.2889
26. Friston, K. (2005). A theory of cortical responses. Philosophical Transactions of the Royal Society of London B, 360, 815-836. doi:10.1098/rstb .2005.1622
27. Geisler, W. S., & Chou, K. (1995). Separation of low-level and high-level factors in complex tasks: Visual search. Psychological Review, 102, 356-378. doi:10.1037/0033-295X.102.2.356
28. Gobell, J., & Carrasco, M. (2005). Attention alters the appearance of spatial frequency and gap size. Psychological Science, 16, 644-651. doi:10.1111/j.1467-9280.2005.01588.x
29. Grimes, J. (1996). On the failure to detect changes in scenes across saccades. In K. A. Akins (Ed.), Perception. Vancouver studies in cognitive science, Vol. 5 (pp. 89-110). New York, NY: Oxford University Press.
30. Henderson, J. M. (1994). Two representational systems in dynamic visual identification. Journal of Experimental Psychology: General, 123, 410-426. doi:10.1037/0096-3445.123.4.410
31. Henderson, J. M. (2008). Eye movements and scene memory. In S. J. Luck & A. Hollingworth (Eds.), Visual memory (pp. 87-121). Oxford, England: Oxford University Press. doi:10.1093/acprof:oso/9780195305487 .003.0004
32. Herwig, A., Beisert, M., & Prinz, W. (2013). Action science emerging: Introduction and leitmotifs. In W. Prinz, M. Beisert, & A. Herwig (Eds.), Action science: Foundations of an emerging discipline (pp. 1-33). Cambridge, MA: MIT Press. doi:10.7551/mitpress/9780262018555.003 .0001
33. Herwig, A., & Horstmann, G. (2011). Action-effect associations revealed by eye movements. Psychonomic Bulletin & Review, 18, 531-537. doi:10.3758/s13423-011-0063-3
34. Herwig, A., Prinz, W., & Waszak, F. (2007). Two modes of sensorimotor integration in intention-based and stimulus-based actions. Quarterly Journal of Experimental Psychology, 60, 1540-1554. doi:10.1080/ 17470210601119134
35. Herwig, A., & Waszak, F. (2009). Intention and attention in ideomotor learning. Quarterly Journal of Experimental Psychology, 62, 219-227. doi:10.1080/17470210802373290
36. Herwig, A., & Waszak, F. (2012). Action-effect bindings and ideomotor learning in intention- and stimulus-based actions. Frontiers in Psychology, 3, 1-18. doi:10.3389/fpsyg.2012.00444
37. Hommel, B. (2009). Action control according to TEC (theory of event coding). Psychological Research, 73, 512-526. doi:10.1007/s00426-009-0234-2
38. Hommel, B., Müsseler, J., Aschersleben, G., & Prinz, W. (2001). The theory of event coding (TEC): A framework for perception and action planning. Behavioral and Brain Sciences, 24, 849-878. doi:10.1017/ S0140525X01000103
39. Huestegge, L., & Koch, I. (2010). Fixation disengagement enhances peripheral perceptual processing: Evidence for a perceptual gap effect. Experimental Brain Research, 201, 631-640. doi:10.1007/s00221-009-2080-2
40. Huestegge, L., & Kreutzfeldt, M. (2012). Action effects in saccade control. Psychonomic Bulletin & Review, 19, 198-203. doi:10.3758/s13423-011-0215-5
41. Hughes, G., Desantis, A., & Waszak, F. (2013). Mechanisms of intentional binding and sensory attenuation: The role of temporal prediction, temporal control, identity prediction, and motor prediction. Psychological Bulletin, 139, 133-151. doi:10.1037/a0028566
42. Hunt, A. R., & Cavanagh, P. (2009). Looking ahead: The perceived direction of gaze shifts before the eyes move. Journal of Vision, 9, 1-7.
43. Irwin, D. E. (1992). Memory for position and identity across eye movements. Journal of Experimental Psychology: Learning, Memory, and Cognition, 18, 307-317. doi:10.1037/0278-7393.18.2.307
44. James, W. (1890). The principles of psychology. New York, NY: Dover. doi:10.1037/11059-000
45. Kotowicz, A., Rutishauser, U., & Koch, C. (2010). Time course of target recognition in visual search. Frontiers in Human Neuroscience, 4, 1-11.
46. Krauzlis, R. J., & Nummela, S. U. (2011). Attention points to the future. Nature Neuroscience, 14, 130-131. doi:10.1038/nn0211-130
47. Kravitz, D. J., Saleem, K. S., Baker, C. I., Ungerleider, L. G., & Mishkin, M. (2013). The ventral visual pathway: An expanded neural framework for the processing of object quality. Trends in Cognitive Sciences, 17, 26-49. doi:10.1016/j.tics.2012.10.011
48. Kunde, W. (2001). Response-effect compatibility in manual choice reaction tasks. Journal of Experimental Psychology: Human Perception and Performance, 27, 387-394. doi:10.1037/0096-1523.27.2.387
49. Land, M. F., & Tatler, B. W. (2009). Looking and acting: Vision and action in natural behaviour. Oxford, England: Oxford University Press.
50. Li, N., & DiCarlo, J. J. (2008). Unsupervised natural experience rapidly alters invariant object representation in visual cortex. Science, 321, 1502-1507. doi:10.1126/science.1160028
51. Liu, N., Kriegeskorte, N., Mur, M., Hadj-Bouziane, F., Luh, W.-M., Tootell, R. B. H., & Ungerleider, L. G. (2013). Intrinsic structure of visual exemplar and category representations in macaque brain. Journal of Neuroscience, 33, 11346-11360. doi:10.1523/JNEUROSCI.4180-12 .2013
52. Loftus, G. R., & Masson, M. E. J. (1994). Using confidence intervals in within-subject designs. Psychonomic Bulletin & Review, 1, 476-490. doi:10.3758/BF03210951
53. Lotze, R. H. (1852). Medizinische Psychologie oder Physiologie der Seele [Medical psychology or physiology of the soul]. Leipzig, Germany: Weidmannsche Buchhandlung.
54. McConkie, G. W., & Currie, C. B. (1996). Visual stability across saccades while viewing complex pictures. Journal of Experimental Psychology: Human Perception and Performance, 22, 563-581. doi:10.1037/0096-1523.22.3.563
55. Meinecke, C. (1989). Retinal eccentricity and the detection of targets. Psychological Research, 51, 107-116. doi:10.1007/BF00309305
56. Melcher, D. (2007). Predictive remapping of visual features precedes saccadic eye movements. Nature Neuroscience, 10, 903-907. doi: 10.1038/nn1917
57. Melcher, D., & Colby, C. L. (2008). Trans-saccadic perception. Trends in Cognitive Sciences, 12, 466-473. doi:10.1016/j.tics.2008.09.003
58. Nakamura, K., & Colby, C. L. (2002). Updating of the visual representation in monkey striate and extrastriate cortex during saccades. Proceedings of the National Academy of Sciences, 99, 4026-4031. doi:10.1073/ pnas.052379899
59. Nattkemper, D., Ziessler, M., & Frensch, P. A. (2010). Binding in voluntary action control. Neuroscience and Biobehavioral Reviews, 34, 1092-1101. doi:10.1016/j.neubiorev.2009.12.013
60. Noë, A. (2001). Experience and the active mind. Synthese, 129, 41-60. doi:10.1023/A:1012695023768
61. Nuthmann, A. (2014). How do the regions of the visual field contribute to object search in real-world scenes? Evidence from eye movements. Journal of Experimental Psychology: Human Perception and Performance, 40, 342-360. doi:10.1037/a0033854
62. Oliva, A., & Torralba, A. (2006). Building the gist of a scene: The role of global image features in recognition. Progress in Brain Research, 155, 23-36. doi:10.1016/S0079-6123(06)55002-2
63. O'Regan, J. K. (1992). Solving the "real" mysteries of visual perception: The world as an outside memory. Canadian Journal of Psychology, 46, 461-488. doi:10.1037/h0084327
64. O'Regan, J. K., & Noë, A. (2001). A sensorimotor account of vision and visual consciousness. Behavioral and Brain Sciences, 24, 939-973. doi:10.1017/S0140525X01000115
65. Palmeri, T. J., & Tarr, M. J. (2008). Visual object perception and long-term memory. In S. J. Luck & A. Hollingworth (Eds.), Visual memory (pp. 163-207). Oxford, England: Oxford University Press. doi:10.1093/ acprof:oso/9780195305487.003.0006
66. Potter, M. C. (1976). Short-term conceptual memory for pictures. Journal of Experimental Psychology: Human Learning and Memory, 2, 509-522. doi:10.1037/0278-7393.2.5.509
67. Prinz, W. (1990). A common coding approach to perception and action. In O. Neumann & W. Prinz (Eds.), Relationships between perception and action: Current approaches (pp. 167-201). Berlin, Germany: Springer-Verlag. doi:10.1007/978-3-642-75348-0_7
68. Rayner, K., McConkie, G. W., & Zola, D. (1980). Integrating information across eye movements. Cognitive Psychology, 12, 206 -226. doi: 10.1016/0010-0285(80)90009-2
69. Rolfs, M., Jonikaitis, D., Deubel, H., & Cavanagh, P. (2011). Predictive remapping of attention across eye movements. Nature Neuroscience, 14, 252-256. doi:10.1038/nn.2711
70. Rousselet, G. A., Thorpe, S. J., & Fabre-Thorpe, M. (2004). How parallel is visual processing in the ventral pathway? Trends in Cognitive Sciences, 8, 363-370. doi:10.1016/j.tics.2004.06.003
71. Schneider, W. X. (2013). Selective visual processing across competition episodes: A theory of task-driven visual attention and working memory. Philosophical Transactions of the Royal Society of London B, 368, 1-13. doi:10.1098/rstb.2013.0060
72. Schneider, W. X., Einhäuser, W., & Horstmann, G. (2013). Attentional selection in visual perception, memory and action: A quest for crossdomain integration. Philosophical Transactions of the Royal Society B, 368, 1-7. doi:10.1098/rstb.2013.0053
73. Shin, Y. K., Proctor, R. W., & Capaldi, E. J. (2010). A review of contemporary ideomotor theory. Psychological Bulletin, 136, 943-974. doi:10.1037/a0020541
74. Sommer, M. A., & Wurtz, R. H. (2006). Influence of the thalamus on spatial visual processing in frontal cortex. Nature, 444, 374-377. doi: 10.1038/nature05279
75. Thorpe, S., Fize, D., & Marlot, C. (1996). Speed of processing in the human visual system. Nature, 381, 520-522. doi:10.1038/381520a0
76. Treisman, A. M., & Gelade, G. (1980). A feature-integration theory of attention. Cognitive Psychology, 12, 97-136. doi:10.1016/0010-0285(80)90005-5
77. Umeno, M. M., & Goldberg, M. E. (1997). Spatial processing in the monkey frontal eye field. I. Predictive visual responses. Journal of Neurophysiology, 78, 1373-1383.
78. Walker, M. F., Fitzgibbon, E. J., & Goldberg, M. E. (1995). Neurons in the monkey superior colliculus predict the visual result of impending saccadic eye movements. Journal of Neurophysiology, 73, 1988-2003.
79. Waszak, F., & Herwig, A. (2007). Effect anticipation modulates deviance processing in the brain. Brain Research, 1183, 74-82. doi:10.1016/j .brainres.2007.08.082
80. Webster, M. J., Bachevalier, J., & Ungerleider, L. G. (1994). Connections of inferior temporal areas TEO and TE with parietal and frontal cortex in macaque monkeys. Cerebral Cortex, 4, 470-483. doi:10.1093/cercor/ 4.5.470
81. Wischnewski, M., Belardinelli, A., Schneider, W. X., & Steil, J. J. (2010). Where to look next? Combining static and dynamic proto-objects in a TVA-based model of visual attention. Cognitive Computation, 2, 326-343. doi:10.1007/s12559-010-9080-1
82. Wolfe, J. M. (1994). Guided search 2.0: A revised model of visual search. Psychonomic Bulletin & Review, 1, 202-238. doi:10.3758/BF03200774
83. Wolfe, J. M., & Horowitz, T. S. (2004). What attributes guide the deployment of visual attention and how do they do it? Nature Reviews Neuroscience, 5, 495-501. doi:10.1038/nrn1411
84. Wolfe, J. M., O'Neill, P., & Bennett, S. C. (1998). Why are there eccentricity effects in visual search? Visual and attentional hypotheses. Perception & Psychophysics, 60, 140-156. doi:10.3758/BF03211924
85. Wolff, P. (1984). Saccadic eye movements and visual stability: Preliminary considerations towards a cognitive approach. In W. Prinz & A. F. Sanders (Eds.), Cognition and motor processes (pp. 121-137). Berlin, Germany: Springer. doi:10.1007/978-3-642-69382-3_8
86. Wurtz, R. H., Joiner, W. M., & Berman, R. A. (2011). Neuronal mechanisms for visual stability: Progress and problems. Philosophical Transactions of the Royal Society of London Series B, 366, 492-503. doi: 10.1098/rstb.2010.0186
87. Zelinsky, G. J. (1996). Using eye saccades to assess the selectivity of search movements. Vision Research, 36, 2177-2187. doi:10.1016/0042-6989(95)00300-2
88. Zelinsky, G. J. (2008). A theory of eye movements during target acquisition. Psychological Review, 115, 787-835. doi:10.1037/a0013118
89. Zelinsky, G. J., Adeli, H., Peng, Y., & Samaras, D. (2013). Modelling eye movements in a categorical search task. Philosophical Transactions of the Royal Society B, 368, 1-12. doi:10.1098/rstb.2013.0058
90. Zelinsky, G. J., & Sheinberg, D. (1997). Eye movements during parallel-serial visual search. Journal of Experimental Psychology: Human Perception and Performance, 23, 244-262. doi:10.1037/0096-1523.23.1 .244