Selective visual processing across competition episodes: A theory of task-driven visual attention and working memory

Philosophical Transactions of the Royal Society B: Biological Sciences

Volumn 368, Issue 1628, 2013, Pages

  Schneider, Werner X ^a  

^a BIELEFELD UNIVERSITY   (Germany)

Author keywords

Attentional blink; Biased competition; Eye movements; Short term consolidation; Visual attention; Visual working memory

Indexed keywords

CONSOLIDATION; ENCAPSULATION; EYE; MEMORY; MOVEMENT; VISUAL CUE; VISUALIZATION;

ATTENTION; ATTENTIONAL BLINK; BIASED COMPETITION; EYE MOVEMENT; HUMAN; PHYSIOLOGY; PSYCHOLOGICAL MODEL; REVIEW; SHORT TERM MEMORY; SHORT-TERM CONSOLIDATION; VISION; VISUAL ATTENTION; VISUAL WORKING MEMORY;

ATTENTIONAL BLINK; BIASED COMPETITION; EYE MOVEMENTS; SHORT-TERM CONSOLIDATION; VISUAL ATTENTION; VISUAL WORKING MEMORY;

ATTENTION; ATTENTIONAL BLINK; EYE MOVEMENTS; HUMANS; MEMORY, SHORT-TERM; MODELS, PSYCHOLOGICAL; VISUAL PERCEPTION;

EID: 84896590346     PISSN: 09628436     EISSN: 14712970     Source Type: Journal    
DOI: 10.1098/rstb.2013.0060     Document Type: Review

References (90)

1. Land MF, Tatler BW. 2009 Looking and acting. Oxford, UK: Oxford University Press.
2. Desimone R, Duncan J. 1995 Neural mechanisms of selective visual attention. Annu. Rev. Neurosci. 18, 193-222. (doi:10.1146/annurev.ne.18.030195.001205)
3. Bundesen C, Habekost T, Kyllingsbæk S. 2005 A neural theory of visual attention: bridging cognition and neurophysiology. Psychol. Rev. 112, 291-328. (doi:10.1037/0033-295X.112.2.291)
4. Deco G, Rolls ET. 2005 Attention, short-term memory, and action selection: a unifying theory. Prog. Neurobiol. 76, 236-256. (doi:10.1016/j. pneurobio.2005.08.004)
5. Hopf J-M, Schoenfeld MA, Heinze H-J. 2005 The temporal flexibility of attentional selection in the visual cortex. Curr. Opin. Neurobiol. 15, 183-187. (doi:10.1016/j.conb.2005.03.008)
6. Duncan J. 2006 Brain mechanisms of attention. Q. J. Exp. Psychol. 59, 2-27. (doi:10.1080/ 17470210500260674)
7. Fecteau JH, Munoz DP. 2006 Salience, relevance, and firing: a priority map for target selection. Trends Cogn. Sci. 10, 382-390. (doi:10.1016/j.tics. 2006.06.011)
8. Bisley JW, Goldberg ME. 2010 Attention, intention, and priority in the parietal lobe. Annu. Rev. Neurosci. 33, 1-21. (doi:10.1146/annurev-neuro-060909-152823)
9. Duncan J, Humphreys G, Ward R. 1997 Competitive brain activity in visual attention. Curr. Opin. Neurobiol. 7, 255-261. (doi:10.1016/S0959-4388(97)80014-1)
10. Koch C, Ullman S. 1985 Shifts in selective visual attention: towards the underlying neural circuitry. Hum. Neurobiol. 4, 219-227.
11. Wolfe JM. 1994 Guided Search 2.0. A revised model of visual search. Psychon. Bull. Rev. 1, 202-238. (doi:10.3758/BF03200774)
12. Schall JD. 2009 Frontal eye fields. In Encyclopedia of neuroscience (eds MD Binder, N Hirokawa, U Windhorst), pp. 1635-1638. Berlin, Germany: Springer.
13. Krauzlis RJ, Liston D, Carello CD. 2004 Target selection and the superior colliculus: goals, choices and hypotheses. Vision Res. 44, 1445-1451. (doi:10.1016/j.visres.2004.01.005)
14. Kastner S, Pinsk MA. 2004 Visual attention as a multilevel selection process. Cogn. Affect. Behav. Neurosci. 4, 483-500. (doi:10.3758/CABN.4.4.483)
15. Neumann O. 1987 Beyond capacity: a functional view of attention. In Perspectives on perception and action (eds H Heuer, AF Sanders), pp. 361-394. Hillsdale, NJ: Lawrence Erlbaum Associates.
16. Bundesen C, Habekost T. 2008 Principles of visual attention: linking mind and brain. Oxford, UK: Oxford University Press.
17. Itti L, Koch C, Niebur E. 1998 A model of saliencybased visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. 20, 1254-1259. (doi:10.1109/34.730558)
18. Posner MI. 1980 Orienting of attention. Q. J. Exp. Psychol. 32, 3-25. (doi:10.1080/00335558008248231)
19. Bundesen C. 1990 A theory of visual attention. Psychol. Rev. 97, 523-547. (doi:10.1037/0033- 295X.97.4.523)
20. Duncan J, Humphreys GW. 1989 Visual search and stimulus similarity. Psychol. Rev. 96, 433-458. (doi:10.1037/0033-295X.96.3.433)
21. Bundesen C, Habekost T, Kyllingsbæk S. 2011 A neural theory of visual attention and short-term memory (NTVA). Neuropsychologia 49, 1446-1457. (doi:10.1016/j.neuropsychologia.2010.12.006)
22. Vangkilde S, Petersen A, Bundesen C. 2013 Temporal expectancy in the context of a theory of visual attention. Phil. Trans. R. Soc. B 368, 20130054. (doi:10.1098/rstb.2013.0054)
23. Finkel LH, Sajda P. 1992 Object discrimination based on depth-from-occlusion. Neural Comput. 4, 901-921. (doi:10.1162/neco.1992.4.6.901)
24. Rensink RA. 2000 Seeing, sensing, and scrutinizing. Vision Res. 40, 1469-1487. (doi:10.1016/S0042- 6989(00)00003-1)
25. Wischnewski M, Steil JJ, Kehrer L, Schneider WX. 2009 Integrating inhomogeneous processing and proto-object formation in a computational model of visual attention. In Proceedings of Human Centered Robotic Systems (HCRS), pp. 93-102. Berlin, Germany: Springer.
26. Wischnewski M, Belardinelli A, Schneider WX, Steil JJ. 2010 Where to look next? Combining static and dynamic proto-objects in a TVA-based model of visual attention. Cogn. Comput. 2, 326-343. (doi:10.1007/s12559-010-9080-1)
27. Schneider WX. 1995 VAM: a neuro-cognitive model for visual attention control of segmentation, object recognition, and space-based motor action. Vis. Cogn. 2, 331-376. (doi:10.1080/135062895 08401737)
28. Kahneman D, Treisman A, Gibbs BJ. 1992 The reviewing of object files: object-specific integration of information. Cogn. Psychol. 24, 175-219. (doi:10.1016/0010-0285(92)90007-O)
29. Irwin DE. 1992 Memory for position and identity across eye movements. J. Exp. Psychol. Learn. Mem. Cogn. 18, 307-317. (doi:10.1037/0278-7393.18.2.307)
30. Cowan N. 2001 The magical number 4 in short-term memory: a reconsideration of mental storage capacity. Behav. Brain Sci. 24, 87-114. (doi:10. 1017/S0140525X01003922)
31. Luck SJ, Vogel EK. 2013 Visual working memory capacity: from psychophysics and neurobiology to individual differences. Trends Cogn. Sci. 17, 391-400. (doi:10.1016/j.tics.2013.06.006)
32. Singer W, Gray CM. 1995 Visual feature integration and the temporal correlation hypothesis. Annu. Rev. Neurosci. 18, 555-586. (doi:10.1146/annurev.ne. 18.030195.003011)
33. Raffone A, Wolters G. 2001 A cortical mechanism for binding in visual working memory. J. Cogn. Neurosci. 13, 766-785. (doi:10.1162/ 08989290152541430)
34. Treisman AM, Gelade G. 1980 A feature-integration theory of attention. Cogn. Psychol. 12, 97-136. (doi:10.1016/0010-0285(80)90005-5)
35. Awh E, Vogel E, Oh S-H. 2006 Interactions between attention and working memory. Neuroscience 139, 201-208. (doi:10.1016/j.neuroscience.2005.08.023)
36. Gazzaley A, Nobre AC. 2012 Top-down modulation: bridging selective attention and working memory. Trends Cogn. Sci. 16, 129-135. (doi:10.1016/j.tics. 2011.11.014)
37. Tatler BW, Hayhoe MM, Land MF, Ballard DH. 2011 Eye guidance in natural vision: reinterpreting salience. J. Vision 11, 5. (doi:10.1167/11.5.5)
38. Zelinsky GJ. 2008 A theory of eye movements during target acquisition. Psychol. Rev. 115, 787-835. (doi:10.1037/a0013118)
39. Zelinsky GJ, Adeli H, Peng Y, Samaras D. 2013 Modelling eye movements in a categorical search task. Phil. Trans. R. Soc. B 368, 20130058. (doi:10. 1098/rstb.2013.0058)
40. Deubel H, Schneider WX. 1996 Saccade target selection and object recognition: evidence for a common attentional mechanism. Vision Res. 36, 1827-1837. (doi:10.1016/0042-6989(95)00294-4)
41. Deubel H, Schneider WX. 2003 Delayed saccades, but not delayed manual aiming movements, require visual attention shifts. Ann. NY Acad. Sci. 1004, 289-296. (doi:10.1196/annals.1303.026)
42. Schneider WX, Deubel H. 1995 Visual attention and saccadic eye movements: evidence for obligatory and selective spatial coupling. In Eye movement research (eds JM Findlay, R Walker, W Kentridge), pp. 317-324. Amsterdam, The Netherlands: Elsevier.
43. Schneider WX, Deubel H. 2002 Selection-forperception and selection-for-spatial-motor-action are coupled by visual attention: a review of recent findings and new evidence from stimulus-driven saccade control. In Common mechanisms in perception and action: attention and performance XIX (eds W Prinz, B Hommel), pp. 609-627. Oxford, UK: Oxford University Press.
44. Kowler E, Anderson E, Dosher B, Blaser E. 1995 The role of attention in the programming of saccades. Vision Res. 35, 1897-1916. (doi:10.1016/0042- 6989(94)00279-U)
45. Hoffman JE, Subramaniam B. 1995 The role of visual attention in saccadic eye movements. Percept. Psychophys. 57, 787-795. (doi:10.3758/ BF03206794)
46. Collins T, Heed T, Röder B. 2010 Visual target selection and motor planning define attentional enhancement at perceptual processing phases. Front. Hum. Neurosci. 4, 1-33. (doi:10.3389/neuro. 09.014.2010)
47. Baldauf D, Deubel H. 2010 Attentional landscapes in reaching and grasping. Vision Res. 50, 999-1013. (doi:10.1016/j.visres.2010.02.008)
48. Allport DA. 1987 Selection for action: some behavioral and neurophysiological considerations of attention and action. In Perspectives on perception and action (eds H Heuer, AF Sanders), pp. 395-419. Hillsdale, NJ: Lawrence Erlbaum Associates.
49. Carbone E, Schneider WX. 2010 The control of stimulus-driven saccades is subject not to central, but to visual attention limitations. Atten. Percept. Psychophys. 72, 2168-2175.
50. Prinz W. 1983 Wahrnehmung und Tätigkeitssteuerung. Heidelberg, Germany: Springer.
51. Tsubomi H, Fukuda K, Watanabe K, Vogel EK. 2013 Neural limits to representing objects still within view. J. Neurosci. 33, 8257-8263. (doi:10.1523/ JNEUROSCI.5348-12.2013)
52. Vogel EK, Machizawa MG. 2004 Neural activity predicts individual differences in visual working memory capacity. Nature 428, 748-751. (doi:10. 1038/nature02447)
53. Baddeley A, Hitch GJ. 1974 Working memory. In The psychology of learning and motivation: advances in research and theory (ed. GH Bower), pp. 47-89. New York, NY: Academic Press.
54. Treisman A. 1988 Features and objects: the fourteenth Bartlett memorial lecture. Q. J. Exp. Psychol. A 40, 201-237. (doi:10.1080/0272498 8843000104)
55. Prinz W. 1990 A common coding approach to perception and action. In Relationships between perception and action (eds O Neumann, W Prinz), pp. 167-201. Berlin, Germany: Springer.
56. Petersen A, Kyllingsbæk S, Bundesen C. 2012 Measuring and modeling attentional dwell time. Psychon. Bull. Rev. 19, 1029-1046. (doi:10.3758/ s13423-012-0286-y)
57. Findlay JM, Walker R. 1999 A model of saccade generation based on parallel processing and competitive inhibition. Behav. Brain Sci. 22, 661-674. (doi:10.1017/S0140525X99002150)
58. Henderson J. 2008 Eye movements and scene memory. In Visual memory (eds S Luck, A Hollingworth), pp. 89-121. Oxford, UK: Oxford University Press.
59. Hollingworth A. 2004 Constructing visual representations of natural scenes: the roles of short- and long-term visual memory. J. Exp. Psychol. Hum. Percept. Perform. 30, 519-537. (doi:10.1037/0096-1523.30.3.519)
60. Maxcey-Richard AM, Hollingworth A. 2013 The strategic retention of task-relevant objects in visual working memory. J. Exp. Psychol. Learn. Mem. Cogn. 39, 760-772. (doi:10.1037/a0029496)
61. Droll JA, Hayhoe MM. 2007 Trade-offs between gaze and working memory use. J. Exp. Psychol. Hum. Percept. Perform. 33, 1352-1365. (doi:10.1037/ 0096-1523.33.6.1352)
62. Foerster RM, Carbone E, Koesling H, Schneider WX. 2011 Saccadic eye movements in a high-speed bimanual stacking task: changes of attentional control during learning and automatization. J. Vision 11, 9. (doi:10.1167/11.7.9)
63. Hayhoe M, Ballard D. 2005 Eye movements in natural behavior. Trends Cogn. Sci. 9, 188-194. (doi:10.1016/j.tics.2005.02.009)
64. Mongillo G, Barak O, Tsodyks M. 2008 Synaptic theory of working memory. Science 319, 1543-1546. (doi:10.1126/science.1150769)
65. Olivers CNL, Peters J, Houtkamp R, Roelfsema PR. 2011 Different states in visual working memory: when it guides attention and when it does not? Trends Cogn. Sci. 15, 327-334.
66. Stokes MG, Kusunoki M, Sigala N, Nili H, Gaffan D, Duncan J. 2013 Dynamic coding for cognitive control in prefrontal cortex. Neuron 78, 364-375. (doi:10.1016/j.neuron.2013.01.039)
67. Hebb DO. 1949 Organization of behavior. New York, NY: John Wiley & Sons, Inc.
68. Zucker RS, Regehr WG. 2002 Short-term synaptic plasticity. Annu. Rev. Physiol. 64, 355-405. (doi:10. 1146/annurev.physiol.64.092501.114547)
69. Jolicoeur P, Dell'Acqua R. 1998 The demonstration of short-term consolidation. Cogn. Psychol. 36, 138-202. (doi:10.1006/cogp.1998.0684)
70. Flanagan JR, Rotman G, Reichelt AF, Johansson RS. 2013 The role of observers' gaze behaviour when watching object manipulation tasks: predicting and evaluating the consequences of action. Phil. Trans. R. Soc. B 368, 20130063. (doi:10.1098/rstb. 2013.0063)
71. Cowan N. 2011 The focus of attention as observed in visual working memory tasks: making sense of competing claims. Neuropsychologia 49, 1401-1406. (doi:10.1016/j.neuropsychologia.2011.01.035)
72. Oberauer K, Lewandowsky S, Farrell S, Jarrold C, Greaves M. 2012 Modeling working memory: an interference model of complex span. Psychon. Bull. Rev. 19, 779-819. (doi:10.3758/s13423-012- 0272-4)
73. Enns JT, Di Lollo V. 2000 What's new in visual masking? Trends Cogn. Sci. 4, 345-352. (doi:10. 1016/S1364-6613(00)01520-5)
74. Scheerer E. 1973 Integration, interruption and processing rate in visual backward masking. Psychol. Forsch. 36, 71-93. (doi:10.1007/BF00424655)
75. Raymond JE, Shapiro KL, Arnell KM. 1992 Temporary suppression of visual processing in an RSVP task: an attentional blink? J. Exp. Psychol. Hum. Percept. Perform. 18, 849-860. (doi:10.1037/ 0096-1523.18.3.849)
76. Chun MM, Potter MC. 1995 A two-phase model for multiple target detection in rapid serial visual presentation. J. Exp. Psychol. Hum. Percept. Perform 21, 109-127. (doi:10.1037/0096-1523.21.1.109)
77. Shapiro K, Raymond J, Arnell K. 1997 The attentional blink. Trends Cogn. Sci. 1, 291-296. (doi:10.1016/S1364-6613(97)01094-2)
78. Flombaum JI, Santos LR. 2009 Spatiotemporal priority as a fundamental principle of object persistence. In The origins of object knowledge (eds B Hood, LR Santos), pp. 135-164. Oxford, UK: Oxford University Press.
79. Duncan J, Ward R, Shapiro K. 1994 Direct measurement of attentional dwell time in human vision. Nature 369, 313-315. (doi:10.1038/ 369313a0)
80. Potter MC. 1975 Meaning in visual search. Science 187, 965-966. (doi:10.1126/science.1145183)
81. Broadbent DE, Broadbent MHP. 1987 From detection to identification: response to multiple targets in rapid serial visual presentation. Percept. Psychophys. 42, 105-113. (doi:10.3758/ BF03210498)
82. Olivers CNL, Meeter M. 2008 A boost and bounce theory of temporal attention. Psychol. Rev. 115, 836-863. (doi:10.1037/a0013395)
83. Nieuwenstein MR, Potter MC, Theeuwes J. 2009 Unmasking the attentional blink. J. Exp. Psychol. Hum. Percept. Perform. 35, 159-169. (doi:10.1037/ 0096-1523.35.1.159)
84. Di Lollo V, Kawahara JI, Ghorashi SMS, Enns JT. 2005 The attentional blink: resource depletion or temporary loss of control? Psychol. Res. 69, 191-200. (doi:10.1007/s00426-004-0173-x)
85. Olivers CNL, van der Stigchel S, Hulleman J. 2007 Spreading the sparing: against a limited-capacity account of the attentional blink. Psychol. Res. 71, 126-139. (doi:10.1007/s00426-005-0029-z)
86. Wyble B, Bowman H, Nieuwenstein M. 2009 The attentional blink provides episodic distinctiveness: sparing at a cost. J. Exp. Psychol. Hum. Percept. Perform. 35, 787-807. (doi:10.1037/a0013902)
87. Woodman GF, Chun MM. 2006 The role of working memory and long-term memory in visual search. Vis. Cogn. 14, 808-830. (doi:10.1080/13506280 500197397)
88. Chelazzi L, Duncan J, Miller EK, Desimone R. 1998 Responses of neurons in inferior temporal cortex during memory-guided visual search. J. Neurophysiol. 80, 2918-2940.
89. Olivers CN, Meijer F, Theeuwes J. 2006 Featurebased memory-driven attentional capture: visual working memory content affects visual attention. J. Exp. Psychol. Hum. Percept. Perform. 32, 1243. (doi:10.1037/0096-1523.32.5.1243)
90. Downing P, Dodds C. 2004 Competition in visual working memory for control of search. Vis. Cogn. 11, 689-703. (doi:10.1080/1350628 0344000446)