Rewards teach visual selective attention

Vision Research

Volumn 85, Issue , 2013, Pages 58-72

  Chelazzi, Leonardo ^a,b   Perlato, Andrea ^a,b   Santandrea, Elisa ^a,b   Della Libera, Chiara ^a,b  

^a UNIVERSITY OF VERONA   (Italy)

^b National Institute of Neuroscience   (Italy)

Author keywords

Attentional learning; Motivation; Reward; Visual processing; Visual selective attention

Indexed keywords

ARTICLE; ATTENTION; BEHAVIOR; BRAIN FUNCTION; ENVIRONMENT; HUMAN; LEARNING; NONHUMAN; PERCEPTION; PRIORITY JOURNAL; RETINA; REWARD; STIMULUS RESPONSE; TASK PERFORMANCE; VISUAL SELECTIVE ATTENTION; VISUAL STIMULATION;

EID: 84886290448     PISSN: 00426989     EISSN: 18785646     Source Type: Journal    
DOI: 10.1016/j.visres.2012.12.005     Document Type: Article

References (141)

1. Aarts H., Custers R., Marien H. Preparing and motivating behavior outside of awareness. Science 2008, 319(5870):1639.
2. Anderson B.A., Laurent P.A., Yantis S. Value-driven attentional capture. Proceedings of the National Academy of Sciences of the United States of America 2011, 108:10367-10371.
3. Anderson B.A., Laurent P.A., Yantis S. Learned value magnifies salience-based attentional capture. PLoS ONE 2011, 6:e27926.
4. Awh E., Belopolsky A.V., Theeuwes J. Top-down versus bottom-up attentional control: A failed theoretical dichotomy. Trends in Cognitive Sciences 2012, 16:437-443.
5. Baldassi S., Simoncini C. Reward sharpens orientation coding independently of attention. Frontiers in Neuroscience 2011, 5:13.
6. Bar-Haim Y., Lamy D., Pergamin L., Bakermans-Kranenburg M.J., van IJzendoorn M.H. Threat-related attentional bias in anxious and nonanxious individuals: A meta-analytic study. Psychological Bulletin 2007, 133:1-24.
7. Baum W.M. On two types of deviation from the matching law: Bias and undermatching. Journal of the Experimental Analysis of Behavior 1974, 22:231-242.
8. Baum W.M. Matching, undermatching, and overmatching in studies of choice. Journal of the Experimental Analysis of Behavior 1979, 32:269-281.
9. Becker M.W., Rasmussen I.P. Guidance of attention to objects and locations by long-term memory of natural scenes. Journal of Experimental Psychology: Learning, Memory and Cognition 2008, 34:1325-1338.
10. Belke E., Humphreys G.W., Watson D.G., Meyer A.S., Telling A.L. Top-down effects of semantic knowledge in visual search are modulated by cognitive but not perceptual load. Perception & Psychophysics 2008, 70:1444-1458.
11. Bichot N.P., Schall J.D. Effects of similarity and history on neural mechanisms of visual selection. Nature Neuroscience 1999, 2:549-554.
12. Bichot N.P., Schall J.D., Thompson K.G. Visual feature selectivity in frontal eye fields induced by experience in mature macaques. Nature 1996, 381:697-699.
13. Bjork J.M., Hommer D.W. Anticipating instrumentally obtained and passively-received rewards: A factorial fMRI investigation. Behavioral Brain Research 2007, 177:165-170.
14. Brockmole J.R., Henderson J.M. Recognition and attention guidance during contextual cueing in real-world scenes: Evidence from eye movements. Quarterly Journal of Experimental Psychology (Hove) 2006, 59:1177-1187.
15. Chelazzi L. Serial attention mechanisms in visual search: A critical look at the evidence. Psychological Research 1999, 62:195-219.
16. Chelazzi L., Della Libera C., Sani I., Santandrea E. Neural basis of visual selective attention. Wiley Interdisciplinary Reviews: Cognitive Science 2011, 2:392-407.
17. Chun M.M. Contextual cueing of visual attention. Trends in Cognitive Sciences 2000, 4:170-177.
18. Chun M.M., Golomb J.D., Turk-Browne N.B. A taxonomy of external and internal attention. Annual Review of Psychology 2011, 62:73-101.
19. Chun M.M., Jiang Y. Contextual cueing: Implicit learning and memory of visual context guides spatial attention. Cognitive Psychology 1998, 36:28-71.
20. Chun M.M., Jiang Y. Top-down attentional guidance based on implicit learning of visual covariation. Psychological Science 1999, 10:360-365.
21. Ciaramitaro V.M., Cameron E.L., Glimcher P.W. Stimulus probability directs spatial attention: An enhancement of sensitivity in humans and monkeys. Vision Research 2001, 41:57-75.
22. Conci M., Müller H.J. Contextual learning of multiple target locations in visual search. Visual Cognition 2012, 20:746-770.
23. Davis C. Attention-deficit/hyperactivity disorder: Associations with overeating and obesity. Current Psychiatry Reports 2010, 12:389-395.
24. De Houwer J., Baeyens F., Field A.P. Associative learning of likes and dislikes: Some current controversies and possible ways forward. Cognition & Emotion 2005, 19:162-174.
25. De Houwer J., Thomas S., Baeyens F. Associative learning of likes and dislikes: A review of 25 years of research on human evaluative conditioning. Psychological Bulletin 2001, 127:853-869.
26. Della Libera C., Chelazzi L. Visual selective attention and the effects of monetary rewards. Psychological Science 2006, 17:222-227.
27. Della Libera C., Chelazzi L. Learning to attend and to ignore is a matter of gains and losses. Psychological Science 2009, 20:778-784.
28. Della Libera C., Perlato A., Chelazzi L. Dissociable effects of reward on attentional learning: From passive associations to active monitoring. PLoS ONE 2011, 6:e19460.
29. Desimone R. Neural mechanisms for visual memory and their role in attention. Proceedings of the National Academy of Sciences of the United States of America 1996, 93:13494-13499.
30. Desimone R., Duncan J. Neural mechanisms of selective visual attention. Annual Review of Neuroscience 1995, 18:193-222.
31. Dickinson A., Shanks D.R., Evenden J.L. Judgment of act-outcome contingency: The role of selective attribution. The Quarterly Journal of Experimental Psychology A: Human Experimental Psychology 1984, 36:29-50.
32. Dixon M.L., Ruppel J., Pratt J., De Rosa E. Learning to ignore: Acquisition of sustained attentional suppression. Psychonomic Bulletin and Review 2009, 16:418-423.
33. Dobson K.S., Dozois D.J. Attentional biases in eating disorders: A meta-analytic review of Stroop performance. Clinical Psychology Review 2004, 23:1001-1022.
34. Dux P.E., Marois R. The attentional blink: A review of data and theory. Attention, Perception & Psychophysics 2009, 71:1683-1700.
35. Egeth H.E., Yantis S. Visual attention: Control, representation and time course. Annual Review of Psychology 1997, 48:269-297.
36. Engelmann J.B., Damaraju E., Padmala S., Pessoa L. Combined effects of attention and motivation on visual task performance: Transient and sustained motivational effects. Frontiers in Human Neurosciences 2009, 3:4.
37. Engelmann J.B., Pessoa L. Motivation sharpens exogenous spatial attention. Emotion 2007, 7:668-674.
38. Feltenstein M.W., See R.E. The neurocircuitry of addiction: An overview. British Journal of Pharmacology 2008, 154:261-274.
39. Field M., Cox W.M. Attentional bias in addictive behaviors: A review of its development, causes, and consequences. Drug and Alcohol Dependence 2008, 97:1-20.
40. Frankó E., Seitz A.R., Vogels R. Dissociable neural effects of long term stimulus-reward pairing in macaque visual cortex. Journal of Cognitive Neuroscience 2010, 22:1425-1439.
41. Gál V., Kozák L.R., Kóbor I., Bankó E.M., Serences J.T., Vidnyánszky Z. Learning to filter out visual distracters. European Journal of Neuroscience 2009, 29:1723-1731.
42. Gehring W.J., Willoughby A.R. The medial frontal cortex and the rapid processing of monetary gains and losses. Science 2002, 295:2279-2282.
43. Geng J.J., Behrmann M. Probability cuing of target location facilitates visual search implicitly in normal participants and patients with hemispatial neglect. Psychological Science 2002, 13:520-525.
44. Godijn R., Theeuwes J. The relationship between inhibition of return and saccade trajectory deviations. Journal of Experimental Psychology: Human Perception and Performance 2004, 30:538-554.
45. Gottlieb J. Attention, learning, and the value of information. Neuron 2012, 76:281-295.
46. Hakyemez H.S., Dagher A., Smith S.D., Zald D.H. Striatal dopamine transmission in healthy humans during a passive monetary reward task. Neuroimage 2008, 39:2058-2065.
47. Hall, G. (1994). Pavlovian conditioning. Laws of association. In N. J. Mackintosh (Ed.), Animal learning and cognition (pp. 15-44). San Diego: Academic Press.
48. Herrnstein R.J. Relative and absolute strength of responses as a function of frequency of reinforcement. Journal of Experimental Analysis of Behavior 1961, 4:267-272.
49. Hickey C., Chelazzi L., Theeuwes J. Reward changes salience in human vision via the anterior cingulate. Journal of Neuroscience 2010, 30:11096-11103.
50. Hickey C., Chelazzi L., Theeuwes J. Reward guides vision when it's your thing: Trait reward seeking in reward-mediated visual priming. PLoS ONE 2010, 5:e14087.
51. Hickey C., Chelazzi L., Theeuwes J. Reward has a residual impact on target selection in visual search but not on the suppression of distractors. Visual Cognition 2011, 19:117-128.
52. Hickey C., Olivers C., Meeter M., Theeuwes J. Feature priming and the capture of visual attention: Linking two ambiguity resolution hypotheses. Brain Research 2011, 1370:175-184.
53. Hickey C., van Zoest W. Reward creates oculomotor salience. Current Biology 2012, 22:R219-R220.
54. Hoffman J., Kunde W. Location-specific target expectancies in visual search. Journal of Experimental Psychology: Human Perception and Performance 1999, 25:1127-1141.
55. Holroyd C.B., Coles M.G.H. The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychological Review 2002, 109:679-709.
56. Jagadeesh B., Chelazzi L., Mishkin M., Desimone R. Learning increases stimulus salience in anterior inferior temporal cortex of the macaque. Journal of Neurophysiology 2001, 86:290-303.
57. Jiang Y., Chun M.M. Selective attention modulates implicit learning. The Quarterly Journal of Experimental Psychology. A, Human Experimental Psychology 2001, 54:1105-1124.
58. Kamin L.J. Selective association and conditioning. Fundamental issues in instrumental learning 1969, 42-64. Dalhousie University Press, Halifax. N.J. Mackintosh, W.K. Honig (Eds.).
59. Kelley T.A., Yantis S. Learning to attend: Effects of practice on information selection. Journal of Vision 2009, 9:16.
60. Kiss M., Driver J., Eimer M. Reward priority of visual target singletons modulates event-related potential signatures of attentional selection. Psychological Science 2009, 20:245-251.
61. Klein R.M. Inhibition of return. Trends in Cognitive Sciences 2000, 4:138-147.
62. Krebs R.M., Boehler C.N., Egner T., Woldorff M.G. The neural underpinnings of how reward associations can both guide and misguide attention. Journal of Neuroscience 2011, 31:9752-9759.
63. Krebs R.M., Boehler C.N., Woldorff M.G. The influence of reward associations on conflict processing in the Stroop task. Cognition 2010, 117:341-347.
64. Kristjánsson Á. Rapid learning in attention shifts. Visual Cognition 2006, 13:324-362.
65. Kristjánsson Á., Campana G. Where perception meets memory: A review of repetition priming in visual search tasks. Attention Perception & Psychophysics 2010, 72:5-18.
66. Kristjánsson Á., Mackeben M., Nakayama K. Rapid, object-based learning in the deployment of transient attention. Perception 2001, 30:1375-1387.
67. Kristjánsson Á., Nakayama K. A primitive memory system for the deployment of transient attention. Perception & Psychophysics 2003, 65:711-724.
68. Kristjánsson Á., Sigurjónsdóttir Ó., Driver J. Fortune and reversals of fortune in visual search: Reward contingencies for pop-out targets affect search efficiency and target repetition effects. Attention, Perception & Psychophysics 2010, 72:1229-1236.
69. Kruschke J.K., Blair N.J. Blocking and backward blocking involve learned inattention. Psychonomic Bulletin and Review 2000, 7:636-645.
70. Kyllingsbæk S., Schneider W.X., Bundesen C. Automatic attraction of attention to former targets in visual displays of letters. Perception & Psychophysics 2001, 63:85-98.
71. Logan G.D. An instance theory of attention and memory. Psychological Review 2002, 109:376-400.
72. Lovibond P.F. Facilitation of instrumental behavior by a Pavlovian appetitive conditioned stimulus. Journal of Experimental Psychology: Animal Behavior Processes 1983, 9:225-247.
73. Maljkovic V., Nakayama K. Priming of pop-out: I. Role of features. Memory & Cognition 1994, 22:657-672.
74. Maljkovic V., Nakayama K. Priming of pop-out: II. The role of position. Perception & Psychophysics 1996, 58:977-991.
75. Maljkovic V., Nakayama K. Priming of pop-out: III. A short-term implicit memory system beneficial for rapid target selection. Visual Cognition 2000, 7:571-595.
76. Maunsell J.H. Neuronal representations of cognitive state: Reward or attention?. Trends in Cognitive Sciences 2004, 8:261-265.
77. May C.P., Kane M.J., Hasher L. Determinants of negative priming. Psychological Bulletin 1995, 118:35-54.
78. Miller J. Components of the location probability effect in visual search tasks. Journal of Experimental Psychology: Human Perception and Performance 1988, 14:453-471.
79. Miltner W.H.R., Braun C.H., Coles M.G.H. Event-related brain potentials following incorrect feedback in a time-estimation task: Evidence for a "generic" neural system for error detection. Journal of Cognitive Neuroscience 1997, 9:788-798.
80. Mogami T., Tanaka K. Reward association affects neuronal responses to visual stimuli in macaque TE and perirhinal cortices. The Journal of Neuroscience 2006, 26:6761-6770.
81. Mogg K., Bradley B.P. Time course of attentional bias for fear-relevant pictures in spider-fearful individuals. Behavioral Research and Therapy 2006, 44:1241-1250.
82. Mohanty A., Gitelman D.R., Small D.M., Mesulam M.M. The spatial attention network interacts with limbic and monoaminergic systems to modulate motivation-induced attention shifts. Cerebral Cortex 2008, 18:2604-2613.
83. Moores E., Laiti L., Chelazzi L. Associative knowledge controls deployment of visual selective attention. Nature Neuroscience 2003, 6:182-189.
84. Navalpakkam V., Koch C., Perona P. Homo economicus in visual search. Journal of Vision 2009, 9:1-16.
85. Navalpakkam V., Koch C., Rangel A., Perona P. Optimal reward harvesting in complex perceptual environments. Proceedings of the National Academy of Sciences of the United States of America 2010, 107:5232-5237.
86. Neill W.T., Valdes L.A. Persistence of negative priming: Steady state or decay?. Journal of Experimental Psychology: Learning, Memory, and Cognition 1992, 18:565-576.
87. Neill W.T., Valdes L.A., Terry K.M., Gorfein D.S. Persistence of negative priming: II. Evidence for episodic trace retrieval. Journal of Experimental Psychology: Learning, Memory, and Cognition 1992, 18:993-1000.
88. O'Doherty J.P. Reward representations and reward-related learning in the human brain: Insights from neuroimaging. Current Opinion in Neurobiology 2004, 14:769-776.
89. Olivers C.N., Meeter M. A boost and bounce theory of temporal attention. Psychological Review 2008, 115:836-863.
90. Pashler H. The psychology of attention 1998, MIT Press, Cambridge, MA.
91. Peck C.J., Jangraw D.C., Suzuki M., Efem R., Gottlieb J. Reward modulates attention independently of action value in posterior parietal cortex. The Journal of Neuroscience 2009, 29:11182-11191.
92. Pessiglione M., Petrovic P., Daunizeau J., Palminteri S., Dolan R.J., Frith C.D. Subliminal instrumental conditioning demonstrated in the human brain. Neuron 2008, 59:561-567.
93. Pessoa L. How do emotion and motivation direct executive control?. Trends in Cognitive Sciences 2009, 13:160-166.
94. Pessoa L., Engelmann J.B. Embedding reward signals into perception and cognition. Frontiers in Neuroscience 2010, 4:17.
95. Posner M.I. Orienting of attention. Quarterly Journal of Experimental Psychology 1980, 32:3-25.
96. Rabbitt P.M.A., Vyas S. What is repeated in the repetition effect?. Attention and performance IV 1973, 327-342. Academic Press, New York. S. Kornblum (Ed.).
97. Raymond J.E., O'Brien J.L. Selective visual attention and motivation: The consequences of value learning in an attentional blink task. Psychological Science 2009, 20:981-988.
98. Raymond J.E., Shapiro K.L., Arnell K.M. Temporary suppression of visual processing in an RSVP task: An attentional blink?. Journal of Experimental Psychology: Human Perception and Performance 1992, 18:849-860.
99. Reynolds J.H., Chelazzi L. Attentional modulation of visual processing. Annual Review of Neuroscience 2004, 27:611-647.
100. Robinson T.E., Berridge K.C. The neural basis of drug craving: An incentive-sensitization theory of addiction. Brain Research Reviews 1993, 18:247-291.
101. Robinson T.E., Berridge K.C. The psychology and neurobiology of addiction: An incentive-sensitization view. Addiction 2000, 95:S91-S117.
102. Robinson T.E., Berridge K.C. The incentive sensitization theory of addiction: Some current issues. Philosophical Transactions of the Royal Society B: Biological Sciences 2008, 363:3137-3146.
103. Rosenfarb I.S., Newland M.C., Brannon S.E., Howey D.S. Effects of self-generated rules on the development of schedule-controlled behavior. Journal of the Experimental Analysis of Behavior 1992, 58:107-121.
104. Rutherford H.J., O'Brien J.L., Raymond J.E. Value associations of irrelevant stimuli modify rapid visual orienting. Psychonomic Bulletin & Review 2010, 17:536-542.
105. Sarter M., Gehring W.J., Kozak R. More attention must be paid: The neurobiology of attentional effort. Brain Research Reviews 2006, 51:145-160.
106. Schacter D.L., Buckner R.L. Priming and the brain. Neuron 1998, 20:185-195.
107. Schultz W. Behavioral theories and the neurophysiology of reward. Annual Review of Psychology 2006, 57:87-115.
108. Schultz W. Multiple dopamine functions at different time courses. Annual Review of Neuroscience 2007, 30:259-288.
109. Schultz W. Behavioral dopamine signals. Trends in Neurosciences 2007, 30:203-210.
110. Seitz A.R., Kim D., Watanabe T. Rewards evoke learning of unconsciously processed visual stimuli in adult humans. Neuron 2009, 61:700-707.
111. Serences J. Value-based modulations in human visual cortex. Neuron 2008, 60:1169-1181.
112. Serences J., Saproo S. Population response profiles in early visual cortex are biased in favor of more valuable stimuli. Journal of Neurophysiology 2010, 104:76-87.
113. Shahan T.A., Podlesnik C.A. Divided attention performance and the matching law. Learning & Behavior 2006, 34:255-261.
114. Shahan T.A., Podlesnik C.A. Divided attention and the matching law: Sample duration affects sensitivity to reinforcement allocation. Learning & Behavior 2007, 35:141-148.
115. Shen Y.J., Chun M.M. Increases in rewards promote flexible behavior. Attention, Perception & Psychophysics 2011, 73:938-952.
116. Shiffrin R.M., Schneider W. Controlled and automatic human information processing: II. Perceptual learning, automatic attending, and a general theory. Psychological Review 1977, 84:127-190.
117. Shuler M.G., Bear M.F. Reward timing in the primary visual cortex. Science 2006, 311:1606-1609.
118. Sireteanu R., Rettenbach R. Perceptual learning in visual search generalizes over tasks, locations, and eyes. Vision Research 2000, 40:2925-2949.
119. Skinner B.F. The behavior of organisms 1938, Appleton-Century-Crofts, New York.
120. Skinner B.F. Science and human behavior 1953, Macmillian Free Press, New York.
121. Skinner B.F. Selection by consequences. Science 1981, 213:501-504.
122. Small D.M., Gitelman D., Simmons K., Bloise S.M., Parrish T., Mesulam M.M. Monetary incentives enhance processing in brain regions mediating top-down control of attention. Cerebral Cortex 2005, 15:1855-1865.
123. Stokes M.G., Atherton K., Patai E.Z., Nobre A.C. Long-term memory prepares neural activity for perception. Proceedings of the National Academy of Sciences 2012, 109:E360-E367.
124. Sugrue L.P., Corrado G.S., Newsome W.T. Matching behavior and the representation of value in the parietal cortex. Science 2004, 304:1782-1787.
125. Sugrue L.P., Corrado G.S., Newsome W.T. Choosing the greater of two goods: Neural currencies for valuation and decision making. Nature Reviews Neuroscience 2005, 6:363-375.
126. Summerfield J.J., Lepsien J., Gitelman D.R., Mesulam M.M., Nobre A.C. Orienting attention based on long-term memory experience. Neuron 2006, 49:905-916.
127. Telling A.L., Kumar S., Meyer A.S., Humphreys G.W. Electrophysiological evidence of semantic interference in visual search. Journal of Cognitive Neuroscience 2010, 22:2212-2225.
128. Theeuwes J. Perceptual selectivity for color and form. Perception and Psychophysics 1992, 51:599-606.
129. Thorndike E.L. Animal intelligence 1911, Macmillian, New York.
130. Tipper S.P. The negative priming effect: Inhibitory priming by ignored objects. The Quarterly Journal of Experimental Psychology A: Human Experimental Psychology 1985, 37:571-590.
131. Tipper S.P. Does negative priming reflect inhibitory mechanisms? A review and integration of conflicting views. The Quarterly Journal of Experimental Psychology A: Human Experimental Psychology 2001, 54:321-343.
132. Tipper S.P., Milliken B. Distinguishing between inhibition and episodic retrieval based accounts of negative priming. Converging operations in the study of visual selective attention 1996, 337-363. American Psychological Association, Washington, DC. A.F. Kramer, M.G.H. Coles, G.D. Logan (Eds.).
133. Torralba A., Oliva A., Castelhano M.S., Henderson J.M. Contextual guidance of eye movements and attention in real-world scenes: The role of global features in object search. Psychological Review 2006, 113:766-786.
134. Tricomi E.M., Delgado M.R., Fiez J.A. Modulation of caudate activity by action contingency. Neuron 2004, 41:281-292.
135. Tseng C.-H., Gobell J.L., Sperling G. Long-lasting sensitization to a given colour after visual search. Nature 2004, 428:657-660.
136. Vidnyánszky Z., Sohn W. Learning to suppress task-irrelevant visual stimuli with attention. Vision Research 2005, 45:677-685.
137. Watanabe M. Role of anticipated reward in cognitive behavioral control. Current Opinion in Neurobiology 2007, 17:213-219.
138. Weil R.S., Furl N., Ruff C.C., Symmonds M., Flanding G., Dolan R.J., et al. Rewarding feedback after correct visual discriminations has both general and specific influences on visual cortex. Journal of Neurophysiology 2010, 104:1746-1757.
139. Wise R.A. Action of drugs of abuse on brain reward systems. Pharmacology, Biochemistry and Behavior 1980, 13:213-223.
140. Wolfe J.M. Visual search in continuous, naturalistic stimuli. Vision Research 1994, 34:1187-1195.
141. Yantis S., Jonides J. Abrupt visual onsets and selective attention: Evidence from visual search. Journal of Experimental Psychology: Human Perception and Performance 1984, 10:601-621.