Reward uncertainty enhances incentive salience attribution as sign-tracking

Behavioural Brain Research

Volumn 238, Issue 1, 2013, Pages 53-61

  Anselme, Patrick ^a   Robinson, Mike J F ^a   Berridge, Kent C ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Autoshaping; Incentive motivation; Reinforcement; Reward uncertainty; Sign tracking

Indexed keywords

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARTICLE; ASSOCIATION; BEHAVIOR CHANGE; BEHAVIORAL STRESS; CONDITIONING; FEMALE; LATENT PERIOD; MOTIVATION; NEUROPHYSIOLOGY; NONHUMAN; PREDICTION; PRIORITY JOURNAL; RAT; REINFORCEMENT; REWARD; TASK PERFORMANCE;

ANIMALS; ATTENTION; BEHAVIOR, ANIMAL; CONDITIONING, CLASSICAL; FEMALE; MOTIVATION; RATS; RATS, SPRAGUE-DAWLEY; REWARD; UNCERTAINTY;

EID: 84868595763     PISSN: 01664328     EISSN: 18727549     Source Type: Journal    
DOI: 10.1016/j.bbr.2012.10.006     Document Type: Article

References (59)

1. Anselme P. The uncertainty processing theory of motivation. Behavioural Brain Research 2010, 208:291-310.
2. Anselme P, Robinson MJF, DiFeliceantonio AG, Berridge KC. Replacement of goal-tracking by sign-tracking under reward uncertainty, and impairment by dopamine antagonism in the rat. Abstract. Washington, DC: Society for Neuroscience; 2011.
3. Bean D., Mason G.J., Bateson M. Contrafreeloading in starlings: testing the information hypothesis. Behaviour 1999, 136:1267-1282.
4. Beckmann J.S., Bardo M.T. Environmental enrichment reduces attribution of incentive salience to a food-associated stimulus. Behavioural Brain Research 2012, 226:331-334.
5. Belzung C. Biologie des émotions 2007, De Boeck, Bruxelles.
6. Berridge K.C. The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology 2007, 19:391-431.
7. Berridge K.C. From prediction error to incentive salience: mesolimbic computation of reward motivation. European Journal of Neuroscience 2012, 35:1124-1143.
8. Berridge K.C., Robinson T.E. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?. Brain Research Reviews 1998, 28:309-369.
9. Boakes R.A. Performance on learning to associate a stimulus with positive reinforcement. Operant-Pavlovian interactions 1977, 67-97. Lawrence Erlbaum Associates, New Jersey. H. Davis, H.M.B. Hurwitz (Eds.).
10. Caraco T., Blanckenhorn W.U., Gregory G.M., Newman J.A., Recer G.M., Zwicker S.M. Risk-sensitivity: ambient temperature affects foraging choice. Animal Behaviour 1990, 39:338-345.
11. Cardinal R.N., Howes N.J. Effects of lesions of the nucleus accumbens core on choice between small certain rewards and large uncertain rewards in rats. BMC Neuroscience 2005, 6:37.
12. Collins L., Young D.B., Davies K., Pearce J.M. The influence of partial reinforcement on serial autoshaping with pigeons. Quarterly Journal of Experimental Psychology 1983, 35B:275-290.
13. Davey G.C.L., Cleland G.G., Oakley D.A. Applying Konorski's model of classical conditioning to signal-centered behavior in the rat: some functional similarities between hunger CRs and sign-tracking. Animal Learning and Behavior 1982, 10:257-262.
14. DiFeliceantonio A.G., Berridge K.C. Which cue to 'want'? Opioid stimulation of central amygdala makes goal-trackers show stronger goal-tracking, just as sign-trackers show stronger sign-tracking. Behavioural Brain Research 2012, 230:399-408.
15. Doya K. Modulators of decision making. Nature Review Neuroscience 2008, 11:410-416.
16. Falk J.L. Production of polydipsia in normal rats by an intermittent food schedule. Science 1961, 133:195-196.
17. Fiorillo C.D. Transient activation of midbrain dopamine neurons by reward risk. Neuroscience 2011, 197:162-171.
18. Fiorillo C.D., Tobler P.N., Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 2003, 299:1898-1902.
19. Flagel S.B., Akil H., Robinson T.E. Individual differences in the attribution of incentive salience to reward-related cues: implications for addiction. Neuropharmacology 2009, 56:139-148.
20. Flagel S.B., Watson S.J., Robinson T.E., Akil H. Individual differences in the propensity to approach signals vs. goals promote different adaptations in the dopamine system of rats. Psychopharmacology 2007, 191:599-607.
21. Flagel S.B., Clark J.J., Robinson T.E., Mayo L., Czuj A., Willuhn I., Akers C.A., Clinton S.M., Phillips P.E.M., Akil H. A selective role for dopamine in stimulus-reward learning. Nature 2011, 469:53-57.
22. Forkman B. The effect of uncertainty on the food intake of the Mongolian gerbil. Behaviour 1993, 124:197-206.
23. Forkman B. The foraging behaviour of Mongolian gerbils: a behavioural need or a need to know?. Behaviour 1996, 133:129-143.
24. Funamizu A., Ito M., Doya K., Kanzaki R., Takahashi H. Uncertainty in action-value estimation affects both action choice and learning rate of the choice behaviors of rats. European Journal of Neuroscience 2012, 35:1180-1189.
25. Gallistel C.R. Conditioning from an information processing perspective. Behavioural Processes 2003, 62:89-101.
26. Gibbon J., Farrell L., Locurto C.M., Duncan H.J., Terrace H.S. Partial reinforcement in autoshaping with pigeons. Animal Learning and Behavior 1980, 8:45-59.
27. Glimcher P.W., Camerer C.F., Fehr E., Poldrack R.A. Neuroeconomics. Decision making and the brain 2009, Academic Press, New York.
28. Hurly T.A., Oseen M.D. Context-dependent, risk-sensitive foraging preference in wild rufous hummingbirds. Animal Behaviour 1999, 58:59-66.
29. Ikemoto S., Panksepp J. The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking. Brain Research Reviews 1999, 31:6-41.
30. Inglis I.R., Forkman B., Lazarus J. Free food or earned food? A review and fuzzy model of contrafreeloading. Animal Behaviour 1997, 53:1171-1191.
31. Kacelnik A., Bateson M. Risky theories: the effects of variance on foraging decisions. American Zoologist 1996, 36:402-434.
32. Katz R.J., Roth K. Tail pinch induced stress-arousal facilitates brain stimulation reward. Physiology and Behavior 1979, 22:193-194.
33. Leussis M.P., Bolivar V.J. Habituation in rodents: a review of behavior, neurobiology, and genetics. Neuroscience and Biobehavioral Reviews 2006, 30:1045-1064.
34. Linnet J, Mouridsen K, Peterson E, Moller A, Doudet DJ, Gjedde A. Striatal dopamine release codes uncertainty in pathological gambling. Psychiatry Research-Neuroimaging; in press, doi:10.1016/j.pscychresns.2012.04.012.
35. Lomanowska A.M., Lovic V., Rankine M.J., Mooney S.J., Robinson T.E., Kraemer G.W. Inadequate early social experience increases the incentive salience of reward-related cues in adulthood. Behavioural Brain Research 2011, 220:91-99.
36. Mackintosh N.J. A theory of attention: variations in the associability of stimuli with reinforcement. Psychological Review 1975, 82:276-298.
37. Mahler S.V., Berridge K.C. Which cue to 'want'? Central amygdala opioid activation enhances and focuses incentive salience on a prepotent reward cue. Journal of Neuroscience 2009, 29:6500-6513.
38. Montague P.R., Dayan P., Sejnowski T.J. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. Journal of Neuroscience 1996, 16:1936-1947.
39. Nader K., Bechara A., van der Kooy D. Neurobiological constraints on behavioral models of motivation. Annual Review of Psychology 1997, 48:85-114.
40. Ono K. Free-choice preference under uncertainty. Behavioural Processes 2000, 49:11-19.
41. Oswald L.M., Wong D.F., McCaul M., Zhou Y., Kuwabara H., Choi L., Brasic J., Wand G.S. Relationships among ventral striatal dopamine release, cortisol secretion, and subjective responses to amphetamine. Neuropsychopharmacology 2005, 30:821-832.
42. Pearce J.M., Hall G. A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychological Review 1980, 87:532-552.
43. Peciña S., Schulkin J., Berridge K.C. Nucleus accumbens corticotropin-releasing factor increases cue-triggered motivation for sucrose reward: paradoxical positive incentive effects in stress?. BMC Biology 2006, 4:8.
44. Preuschoff K., Bossaerts P., Quartz S.R. Neural differentiation of expected reward and risk in human subcortical structures. Neuron 2006, 51:381-390.
45. Rescorla R.A. Pavlovian conditioning and its proper control procedures. Psychological Review 1967, 74:71-80.
46. Rescorla R.A., Wagner A.R. A theory of pavlovian conditioning: variations in the effectiveness of reinforcement and nonreniforcement. Classical conditioning II: current theory and research 1972, 64-99. Appleton-Century-Crofts, New York. A.H. Black, W.F. Prokasy (Eds.).
47. Robinson T.E., Berridge K.C. The psychology and neurobiology of addiction: an incentive-sensitization view. Addiction 2000, 95(Suppl.):S91-S117.
48. Robinson T.E., Flagel S.B. Dissociating the predictive and incentive motivational properties of reward-related cues through the study of individual differences. Biological Psychiatry 2009, 65:869-873.
49. Robinson MJF, Berridge KC. Instant incentive salience: dynamic transformation of an aversive salt cue into a 'wanted' motivational magnet. Abstract. San Diego, CA: Society for Neuroscience; 2010.
50. Schultz W. Predictive reward signal of dopamine neurons. Journal of Neurophysiology 1998, 80:1-27.
51. Schultz W., Apicella P., Ljungberg T. Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. Journal of Neuroscience 1993, 13:900-913.
52. Shurtleff D., Delamater A.R., Riley A.L. A reevaluation of the CS - hypothesis for schedule-induced polydipsia under intermittent schedules of pellet delivery. Animal Learning and Behavior 1983, 11:247-254.
53. Singer B.F., Scott-Railton J., Vezina P. Unpredictable saccharin reinforcement enhances locomotor responding to amphetamine. Behavioural Brain Research 2012, 226:340-344.
54. Stephens DW, Krebs JR. Foraging theory. Princeton, NJ: Princeton University Press.
55. Tindell A.J., Smith K.S., Berridge K.C., Aldridge J.W. Dynamic computation of incentive salience: 'wanting' what was never 'liked'. Journal of Neuroscience 2009, 29:12220-12228.
56. Tindell A.J., Berridge K.C., Zhang J., Peciña S., Aldridge J.W. Ventral pallidal neurons code incentive motivation: amplification by mesolimbic sensitization and amphetamine. European Journal of Neuroscience 2005, 22:2617-2634.
57. Tomie A., Aguado A.S., Pohorecky L.A., Benjamin D. Individual differences in Pavlovian autoshaping of lever-pressing in rats predict stress-induced corticosterone release and mesolimbic levels of monoamines. Pharmacology Biochemistry and Behavior 2000, 65:509-517.
58. Tomie A., Tirado A.D., Yu L., Pohorecky L.A. Pavlovian autoshaping procedures increase plasma corticosterone and levels of norepinephrine and serotonin in prefrontal cortex in rats. Behavioural Brain Research 2004, 153:97-105.
59. Zhang J., Berridge K.C., Tindell A.J., Smith K.S., Aldridge J.W. A neural computational model of incentive salience. PLoS Computational Biology 2009, 5:e1000437.