From prediction error to incentive salience: Mesolimbic computation of reward motivation

European Journal of Neuroscience

Volumn 35, Issue 7, 2012, Pages 1124-1143

  Berridge, Kent C ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Dopamine; Incentive salience; Learning; Mesolimbic; Nucleus accumbens; Prediction error

Indexed keywords

AMPHETAMINE; COCAINE; DOPAMINE; LEVODOPA;

APPETITE; ARTICLE; ASSOCIATION; COCAINE DEPENDENCE; COGNITION; CONDITIONING; DOPAMINERGIC SYSTEM; DRUG DEPENDENCE; ERROR; HUMAN; INCENTIVE SALIENCE; LEARNING; LIMBIC SYSTEM; MATHEMATICAL MODEL; MEMORY; MOTIVATION; NEUROMODULATION; NONHUMAN; PARKINSON DISEASE; PARKINSONISM; PLEASURE; PREDICTION; PRIORITY JOURNAL; REWARD; SATIETY; STIMULUS RESPONSE;

ANIMALS; COMPUTER SIMULATION; FORECASTING; HUMANS; LEARNING; LIMBIC SYSTEM; MODELS, NEUROLOGICAL; MOTIVATION; REWARD;

EID: 84859343970     PISSN: 0953816X     EISSN: 14609568     Source Type: Journal    
DOI: 10.1111/j.1460-9568.2012.07990.x     Document Type: Article

References (178)

1. Aarts, E., van Holstein, M. & Cools, R. (2011) Striatal dopamine and the interface between motivation and cognition. Front. Psychol., 2, 163, doi: 10.3389/fpsyg.2011.00163 [Epub ahead of print].
2. Allan, R.W. & Zeigler, H.P. (1994) Autoshaping the pigeon's gape response: acquisition and topography as a function of reinforcer type and magnitude. J. Exp. Anal. Behav., 62, 201-223.
3. Anderson, B.A., Laurent, P.A. & Yantis, S. (2011) Value-driven attentional capture. Proc. Nat. Acad. Sci., 108, 10367-10371.
4. Aragona, B.J., Day, J.J., Roitman, M.F., Cleaveland, N.A., Wightman, R.M. & Carelli, R.M. (2009) Regional specificity in the real-time development of phasic dopamine transmission patterns during acquisition of a cue-cocaine association in rats. Eur. J. Neurosci., 30, 1889-1899.
5. Attneave, F. (1959) Applications of information theory to psychology. Chicago, USA: Holt, Rinehart, and Winston.
6. Balleine, B.W. & O'Doherty, J.P. (2010) Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology, 35, 48-69.
7. Balsam, P.D. & Gallistel, C.R. (2009) Temporal maps and informativeness in associative learning. Trends Neurosci., 32, 73-78.
8. Barbano, M.F. & Cador, M. (2007) Opioids for hedonic experience and dopamine to get ready for it. Psychopharmacology (Berl.), 191, 497-506.
9. Barch, D.M. & Dowd, E.C. (2010) Goal representations and motivational drive in schizophrenia: the role of prefrontal-striatal interactions. Schizophr. Bull., 36, 919-934.
10. Beaver, J., Lawrence, A., van Ditzhuijzen, J., Davis, M., Woods, A. & Calder, A. (2006) Individual differences in reward drive predict neural responses to images of food. J. Neurosci., 26, 5160-5166.
11. Benotsch, E.G., Kalichman, S.C. & Kelly, J.A. (1999) Sexual compulsivity and substance use in HIV-seropositive men who have sex with men: prevalence and predictors of high-risk behaviors. Addict. Behav., 24, 857-868.
12. Berridge, K.C. (1996) Food reward: brain substrates of wanting and liking. Neurosci. Biobehav. Rev., 20, 1-25.
13. Berridge, K.C. (2001) Reward learning: reinforcement, incentives, and expectations. In Medin, D.L. (ed.), The Psychology of Learning and Motivation. Academic Press, New York, NY, pp. 223-278.
14. Berridge, K.C. (2004) Motivation concepts in behavioral neuroscience. Physiol. Behav., 81, 179-209.
15. Berridge, K.C. (2007) The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology, 191, 391-431.
16. Berridge, K.C. & Aldridge, J.W. (2008) Decision utility, the brain and pursuit of hedonic goals. Soc. Cogn., 26, 621-646.
17. Berridge, K.C. & Robinson, T.E. (1998) What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res. Rev., 28, 309-369.
18. Berridge, K.C. & Schulkin, J. (1989) Palatability shift of a salt-associated incentive during sodium depletion. Q. J. Exp. Psychol., 41, 121-138.
19. Berridge, K.C. & Valenstein, E.S. (1991) What psychological process mediates feeding evoked by electrical stimulation of the lateral hypothalamus? Behav. Neurosci., 105, 3-14.
20. Berridge, K.C. & Winkielman, P. (2003) What is an unconscious emotion? (The case for unconscious 'liking') Cogn. Emot., 17, 181-211.
21. Berridge, K.C., Flynn, F.W., Schulkin, J. & Grill, H.J. (1984) Sodium depletion enhances salt palatability in rats. Behav. Neurosci., 98, 652-660.
22. Berridge, K.C., Venier, I.L. & Robinson, T.E. (1989) Taste reactivity analysis of 6-hydroxydopamine-induced aphagia: implications for arousal and anhedonia hypotheses of dopamine function. Behav. Neurosci., 103, 36-45.
23. Berridge, K.C., Ho, C.Y., Richard, J.M. & DiFeliceantonio, A.G. (2010) The tempted brain eats: pleasure and desire circuits in obesity and eating disorders. Brain Res., 1350, 43-64.
24. Bindra, D. (1978) How adaptive behavior is produced: a perceptual-motivation alternative to response reinforcement. Behav. Brain. Sci., 1, 41-91.
25. Boakes, R.A. (1977) Performance on learning to associate a stimulus with positive reinforcement. In Davis, H. & Hurwitz, H.M.B. (Eds), Operant - Pavlovian Interactions. Lawrence Erlbaum Associates, Hillsdale, NJ, pp. 67-101.
26. Boureau, Y.L. & Dayan, P. (2011) Opponency revisited: competition and cooperation between dopamine and serotonin. Neuropsychopharmacology, 36, 74-97.
27. Brauer, L.H. & de Wit, H. (1996) Subjective responses to d-amphetamine alone and after pimozide pretreatment in normal, healthy volunteers. Biol. Psychiatry, 39, 26-32.
28. Brauer, L.H. & De Wit, H. (1997) High dose pimozide does not block amphetamine-induced euphoria in normal volunteers. Pharmacol. Biochem. Behav., 56, 265-272.
29. Briers, B., Pandelaere, M., Dewitte, S. & Warlop, L. (2006) Hungry for money: the desire for caloric resources increases the desire for financial resources and vice versa. Psychol. Sci., 17, 939-943.
30. Buckholtz, J.W., Treadway, M.T., Cowan, R.L., Woodward, N.D., Li, R., Ansari, M.S., Baldwin, R.M., Schwartzman, A.N., Shelby, E.S., Smith, C.E., Kessler, R.M. & Zald, D.H. (2010) Dopaminergic network differences in human impulsivity. Science, 329, 532.
31. Caggiula, A.R., Donny, E.C., White, A.R., Chaudhri, N., Booth, S., Gharib, M.A., Hoffman, A., Perkins, K.A. & Sved, A.F. (2002) Environmental stimuli promote the acquisition of nicotine self-administration in rats. Psychopharmacology, 163, 230-237.
32. Cannon, C.M. & Palmiter, R.D. (2003) Reward without dopamine. J. Neurosci., 23, 10827-10831.
33. Carr, K.D. (2011) Food scarcity, neuroadaptations, and the pathogenic potential of dieting in an unnatural ecology: binge eating and drug abuse. Physiol. Behav., 104, 162-167.
34. Cetinkaya, H. & Domjan, M. (2006) Sexual fetishism in a quail (Coturnix japonica) model system: test of reproductive success. J. Comp. Psychol., 120, 427-432.
35. Claassen, D.O., van den Wildenberg, W.P., Ridderinkhof, K.R., Jessup, C.K., Harrison, M.B., Wooten, G.F. & Wylie, S.A. (2011) The risky business of dopamine agonists in Parkinson disease and impulse control disorders. Behav. Neurosci., 125, 492-500.
36. Corbit, L.H. & Balleine, B.W. (2011) The general and outcome-specific forms of Pavlovian-instrumental transfer are differentially mediated by the nucleus accumbens core and shell. J. Neurosci., 31, 11786-11794.
37. Cornell, C.E., Rodin, J. & Weingarten, H. (1989) Stimulus-induced eating when satiated. Physiol. Behav., 45, 695-704.
38. Dallman, M.F. (2010) Stress-induced obesity and the emotional nervous system. Trends Endocrinol. Metab., 21, 159-165.
39. Darvas, M. & Palmiter, R.D. (2010) Restricting dopaminergic signaling to either dorsolateral or medial striatum facilitates cognition. J. Neurosci., 30, 1158-1165.
40. Darvas, M., Fadok, J.P. & Palmiter, R.D. (2011) Requirement of dopamine signaling in the amygdala and striatum for learning and maintenance of a conditioned avoidance response. Learn. Mem., 18, 136-143.
41. Daw, N.D. (2007) Dopamine: at the intersection of reward and action. Nat. Neurosci., 10, 1505-1507.
42. Daw, N.D., Niv, Y. & Dayan, P. (2005) Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci., 8, 1704-1711.
43. Dayan, P. & Balleine, B.W. (2002) Reward, motivation, and reinforcement learning. Neuron, 36, 285-298.
44. Dayan, P. & Niv, Y. (2008) Reinforcement learning: the good, the bad and the ugly. Curr. Opin. Neurobiol., 18, 185-196.
45. Dickinson, A. & Balleine, B. (2002) The role of learning in the operation of motivational systems. In Gallistel, C.R. (Ed.), Stevens' Handbook of Experimental Psychology: Learning, Motivation, and Emotion. Wiley and Sons, New York, NY, pp. 497-534.
46. Dickinson, A. & Balleine, B. (2010) Hedonics: the cognitive-motivational interface. In Kringelbach, M.L. & Berridge, K.C. (Eds), Pleasures of the Brain. Oxford University Press, Oxford, pp. 74-84.
47. Dickinson, A., Smith, J. & Mirenowicz, J. (2000) Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists. Behav. Neurosci., 114, 468-483.
48. DiFeliceantonio, A.G. & Berridge, K.C. (2010) Neostriatal Sites of Mu Opioid Stimulation Enhance CS Motivational Magnets. Abstract. Society for Neuroscience, San Diego, CA.
49. Domjan, M. (2005) Pavlovian conditioning: a functional perspective. Annu. Rev. Psychol., 56, 179-206.
50. Dowd, E.C. & Barch, D.M. (2010) Anhedonia and emotional experience in schizophrenia: neural and behavioral indicators. Biol. Psychiatry, 67, 902-911.
51. Ettenberg, A. (1989) Dopamine, neuroleptics and reinforced behavior. Neurosci. Biobehav. Rev., 13, 105-111.
52. Evans, A.H. & Lees, A.J. (2004) Dopamine dysregulation syndrome in Parkinson's disease. Curr. Opin. Neurol., 17, 393-398.
53. Evans, A.H., Pavese, N., Lawrence, A.D., Tai, Y.F., Appel, S., Doder, M., Brooks, D.J., Lees, A.J. & Piccini, P. (2006) Compulsive drug use linked to sensitized ventral striatal dopamine transmission. Ann. Neurol., 59, 852-858.
54. Everitt, B.J., Dickinson, A. & Robbins, T.W. (2001) The neuropsychological basis of addictive behaviour. Brain Res. Rev., 36, 129-138.
55. Fadok, J.P., Dickerson, T.M.K. & Palmiter, R.D. (2009) Dopamine is necessary for cue-dependent fear conditioning. J. Neurosci., 29, 11089-11097.
56. Farooqi, I.S. & O'Rahilly, S. (2009) Leptin: a pivotal regulator of human energy homeostasis. Am. J. Clin. Nutr., 89, 980S-984S.
57. Farooqi, I.S., Bullmore, E., Keogh, J., Gillard, J., O'Rahilly, S. & Fletcher, P.C. (2007) Leptin regulates striatal regions and human eating behavior. Science, 317, 1355.
58. Faure, A., Reynolds, S.M., Richard, J.M. & Berridge, K.C. (2008) Mesolimbic dopamine in desire and dread: enabling motivation to be generated by localized glutamate disruptions in nucleus accumbens. J. Neurosci., 28, 7184-7192.
59. Flagel, S.B., Akil, H. & Robinson, T.E. (2009) Individual differences in the attribution of incentive salience to reward-related cues: implications for addiction. Neuropharmacology, 56, 1390148.
60. Flagel, S.B., Clark, J.J., Robinson, T.E., Mayo, L., Czuj, A., Willuhn, I., Akers, C.A., Clinton, S.M., Phillips, P.E. & Akil, H. (2011) A selective role for dopamine in stimulus-reward learning. Nature, 469, 53-57.
61. Flanagan, O. (2011) What is it like to be an addict? In Poland, J. & Graham, G. (Eds), Addiction and Responsibility. MIT Press, Cambridge, MA, pp. 269-292.
62. Fluharty, S.J. & Epstein, A.N. (1983) Sodium appetite elicited by intracerebroventricular infusion of angiotensin II in the rat: II. Synergistic interaction with systemic mineralocorticoids. Behav. Neurosci., 97, 746-758.
63. Flynn, F.W., Grill, H.J., Schulkin, J. & Norgren, R. (1991) Central gustatory lesions: II. Effects on sodium appetite, taste aversion learning, and feeding behaviors. Behav. Neurosci., 105, 944-954.
64. Fudim, O.K. (1978) Sensory preconditioning of flavors with a formalin-produced sodium need. J. Exp. Psychol. Anim. Behav. Process., 4, 276-285.
65. Gearhardt, A.N., Corbin, W.R. & Brownell, K.D. (2009) Preliminary validation of the Yale Food Addiction Scale. Appetite, 52, 430-436.
66. Glimcher, P.W. (2011) Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis. Proc. Nat. Acad. Sci. USA, 108, 15647-15654.
67. Heath, R.G. 1996. Exploring the Mind-Brain Relationship. Moran Printing Inc., Baton Rouge, LA.
68. Heimer, L., Van Hoesen, G.W., Trimble, M. & Zahm, D.S. 2008. Anatomy of Neuropsychiatry: The New Anatomy of the Basal Forebrain and its Implications for Neuropsychiatric Illness. Elsevier: Academic Press, Amsterdam.
69. Herzog, J., Reiff, J., Krack, P., Witt, K., Schrader, B., Muller, D. & Deuschl, G. (2003) Manic episode with psychotic symptoms induced by subthalamic nucleus stimulation in a patient with Parkinson's disease. Mov. Disord., 18, 1382-1384.
70. Hickey, C., Chelazzi, L. & Theeuwes, J. (2010a) Reward changes salience in human vision via the anterior cingulate. J. Neurosci., 30, 11096-11103.
71. Hickey, C., Chelazzi, L. & Theeuwes, J. (2010b) Reward guides vision when it's your thing: trait reward-seeking in reward-mediated visual priming. PLoS ONE, 5, e14087.
72. Hnasko, T.S., Sotak, B.N. & Palmiter, R.D. (2005) Morphine reward in dopamine-deficient mice. Nature, 438, 854-857.
73. Hnasko, T., Sotak, B. & Palmiter, R. (2007) Cocaine-conditioned place preference by dopamine-deficient mice is mediated by serotonin. J. Neurosci., 27, 12484-12488.
74. Holland, P.C. (2004) Relations between Pavlovian-instrumental transfer and reinforcer devaluation. J. Exp. Psychol. Anim. Behav. Process., 30, 104-117.
75. Holland, P.C. & Petrovich, G.D. (2005) A neural systems analysis of the potentiation of feeding by conditioned stimuli. Physiol. Behav., 86, 747-761.
76. Hyman, S.E., Malenka, R.C. & Nestler, E.J. (2006) Neural mechanisms of addiction: the role of reward-related learning and memory. Annu. Rev. Neurosci., 29, 565-598.
77. Jaffe, J.H., Cascella, N.G., Kumor, K.M. & Sherer, M.A. (1989) Cocaine-induced cocaine craving. Psychopharmacology (Berl.), 97, 59-64.
78. Jenkins, H.M. & Moore, B.R. (1973) The form of the auto-shaped response with food or water reinforcers. J. Exp. Anal. Behav., 20, 163-181.
79. Kahneman, D., Wakker, P.P. & Sarin, R. (1997) Back to Bentham? Explorations of experienced utility Q. J. Econ., 112, 375-405.
80. Kapur, S. (2003) Psychosis as a state of aberrant salience: a framework linking biology, phenomenology, and pharmacology in schizophrenia. Am. J. Psychiatry, 160, 13-23.
81. Knutson, B., Wimmer, G., Kuhnen, C. & Winkielman, P. (2008) Nucleus accumbens activation mediates the influence of reward cues on financial risk taking. Neuroreport, 19, 509-513.
82. Koob, G.F. & Le Moal, M. (1997) Drug abuse: hedonic homeostatic dysregulation. Science, 278, 52-58.
83. Koob, G.F. & Volkow, N.D. (2010) Neurocircuitry of addiction. Neuropsychopharmacology, 35, 217-238.
84. Krieckhaus, E.E. & Wolf, G. (1968) Acquisition of sodium by rats: interaction of innate mechanisms and latent learning. J. Comp. Physiol. Psychol., 65, 197-201.
85. Kringelbach, M.L. (2010) The hedonic brain: a functional neuroanatomy of human pleasure. In Kringelbach, M.L. & Berridge, K.C. (Eds), Pleasures of the Brain. Oxford University Press, Oxford, pp. 202-221.
86. Kringelbach, M.L., Green, A.L., Owen, S.L., Schweder, P.M. & Aziz, T.Z. (2010) Sing the mind electric - principles of deep brain stimulation. Eur. J. Neurosci., 32, 1070-1079.
87. Leeman, R.F. & Potenza, M.N. (2012) Similarities and differences between pathological gambling and substance use disorders: a focus on impulsivity and compulsivity. Psychopharmacology, 219, 469-490.
88. Leyton, M. (2010) The neurobiology of desire: dopamine and the regulation of mood and motivational states in humans. In Kringelbach, M.L. & Berridge, K.C. (Eds), Pleasures of the Brain. Oxford University Press, Oxford, pp. 222-243.
89. Leyton, M., Boileau, I., Benkelfat, C., Diksic, M., Baker, G. & Dagher, A. (2002) Amphetamine-Induced Increases in extracellular dopamine, drug wanting, and novelty seeking: a PET/[11C]raclopride study in healthy men. Neuropsychopharmacology, 27, 1027-1035.
90. Leyton, M., Casey, K., Delaney, J., Kolivakis, T. & Benkelfat, C. (2005) Cocaine craving, euphoria, and self-administration: a preliminary study of the effect of catecholamine precursor depletion. Behav. Neurosci., 119, 1619-1627.
91. Leyton, M., aan het Rot, M., Booij, L., Baker, G., Young, S. & Benkelfat, C. (2007) Mood-elevating effects of d-amphetamine and incentive salience: the effect of acute dopamine precursor depletion. J. Psychiatry Neurosci., 32, 129-136.
92. Liedtke, W.B., McKinley, M.J., Walker, L.L., Zhang, H., Pfenning, A.R., Drago, J., Hochendoner, S.J., Hilton, D.L., Lawrence, A.J. & Denton, D.A. (2011) Relation of addiction genes to hypothalamic gene changes subserving genesis and gratification of a classic instinct, sodium appetite. Proc. Nat. Acad. Sci., 108, 12509-12514.
93. Liljeholm, M., Tricomi, E., O'Doherty, J.P. & Balleine, B.W. (2011) Neural correlates of instrumental contingency learning: differential effects of action-reward conjunction and disjunction. J. Neurosci., 31, 2474-2480.
94. Lovic, V., Saunders, B.T., Yager, L.M. & Robinson, T.E. (2011) Rats prone to attribute incentive salience to reward cues are also prone to impulsive action. Behav. Brain Res., 223, 255-261.
95. Lucas, L.R., Grillo, C.A. & McEwen, B.S. (2003) Involvement of mesolimbic structures in short-term sodium depletion: in situ hybridization and ligand-binding analyses. Neuroendocrinology, 77, 406-415.
96. Mahler, S.V. & Berridge, K.C. (2009) Which cue to 'want?' Central amygdala opioid activation enhances and focuses incentive salience on a prepotent reward cue. J. Neurosci., 29, 6500-6513.
97. Mahler, S.V. & Berridge, K.C. (2011) What and when to 'want'? amygdala-based focusing of incentive salience upon sugar and sex. Psychopharmacology, doi: 10.1007/s00213-011-2588-6 [Epub ahead of print].
98. Mahler, S.V. & de Wit, H. (2010) Cue-reactors: individual differences in cue-induced craving after food or smoking abstinence. PLoS ONE, 5, e15475.
99. McClure, S.M., Berns, G.S. & Montague, P.R. (2003a) Temporal prediction errors in a passive learning task activate human striatum. Neuron, 38, 339-346.
100. McClure, S.M., Daw, N.D. & Read Montague, P. (2003b) A computational substrate for incentive salience. Trends Neurosci., 26, 423-428.
101. Meyer, P.J., Ma, S.T. & Robinson, T.E. (2012) A cocaine cue is more preferred and evokes more frequency-modulated 50-kHz ultrasonic vocalizations in rats prone to attribute incentive salience to a food cue. Psychopharmacology, 219, 999-1009.
102. Mirenowicz, J. & Schultz, W. (1994) Importance of unpredictability for reward responses in primate dopamine neurons. J. Neurophysiol., 72, 1024-1027.
103. Moustafa, A.A., Cohen, M.X., Sherman, S.J. & Frank, M.J. (2008) A role for dopamine in temporal decision making and reward maximization in parkinsonism. J. Neurosci., 28, 12294-12304.
104. Nagy, H., Levy-Gigi, E., Somlai, Z., Takats, A., Bereczki, D. & Keri, S. (2011) The effect of dopamine agonists on adaptive and aberrant salience in Parkinson's disease. Neuropsychopharmacology, doi: 10.1038/npp.2011.278 [Epub ahead of print].
105. Nicola, S.M. (2007) The nucleus accumbens as part of a basal ganglia action selection circuit. Psychopharmacology, 191, 521-550.
106. Niv, Y. & Schoenbaum, G. (2008) Dialogues on prediction errors. Trends Cogn Sci., 12, 265-272.
107. Niv, Y., Joel, D. & Dayan, P. (2006) A normative perspective on motivation. Trends Cogn. Sci., 10, 375-381.
108. Niv, Y., Daw, N.D., Joel, D. & Dayan, P. (2007) Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology, 191, 507-520.
109. Nocjar, C. & Panksepp, J. (2002) Chronic intermittent amphetamine pretreatment enhances future appetitive behavior for drug- and natural-reward: interaction with environmental variables. Behav. Brain Res., 128, 189-203.
110. O'Doherty, J.P., Dayan, P., Friston, K., Critchley, H. & Dolan, R.J. (2003) Temporal difference models and reward-related learning in the human brain. Neuron, 38, 329-337.
111. van Os, J. & Kapur, S. (2009) Schizophrenia. Lancet, 374, 635-645.
112. Ostlund, S.B. & Maidment, N.T. (2012) Dopamine receptor blockade attenuates the general incentive motivational effects of noncontingently delivered rewards and reward-paired cues without affecting their ability to bias action selection. Neuropsychopharmacology, 37, 508-519.
113. O'Sullivan, S.S., Wu, K., Politis, M., Lawrence, A.D., Evans, A.H., Bose, S.K., Djamshidian, A., Lees, A.J. & Piccini, P. (2011) Cue-induced striatal dopamine release in Parkinson's disease-associated impulsive-compulsive behaviours. Brain, 134, 969-978.
114. Pecina, S., Cagniard, B., Berridge, K.C., Aldridge, J.W. & Zhuang, X. (2003) Hyperdopaminergic mutant mice have higher 'wanting' but not 'liking' for sweet rewards. J. Neurosci., 23, 9395-9402.
115. Pecina, S., Schulkin, J. & Berridge, K.C. (2006a) Nucleus accumbens corticotropin-releasing factor increases cue-triggered motivation for sucrose reward: paradoxical positive incentive effects in stress? BMC Biol, 4, 8.
116. Pecina, S., Smith, K.S. & Berridge, K.C. (2006b) Hedonic hot spots in the brain. Neuroscientist, 12, 500-511.
117. Pelchat, M.L. (2009) Food addiction in humans. J. Nutr., 139, 620-622.
118. Pessiglione, M., Seymour, B., Flandin, G., Dolan, R.J. & Frith, C.D. (2006) Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature, 442, 1042-1045.
119. Petrovich, G.D. (2011) Learning and the motivation to eat: forebrain circuitry. Physiol. Behav., 104, 582-589.
120. Piech, R.M., Pastorino, M.T. & Zald, D.H. (2010) All I saw was the cake. Hunger effects on attentional capture by visual food cues. Appetite, 54, 579-582.
121. Redish, A.D., Jensen, S. & Johnson, A. (2008a) Addiction as vulnerabilities in the decision process. Behav. Brain Sci., 31, 461-487.
122. Redish, A.D., Jensen, S. & Johnson, A. (2008b) A unified framework for addiction: vulnerabilities in the decision process. Behav. Brain Sci., 31, 415-437; discussion 437-487.
123. Reynolds, S.M. & Berridge, K.C. (2008) Emotional environments retune the valence of appetitive versus fearful functions in nucleus accumbens. Nat. Neurosci., 11, 423-425.
124. Richard, J.M. & Berridge, K.C. (2011) Nucleus accumbens dopamine/glutamate interaction switches modes to generate desire versus dread: D1 alone for appetitive eating but D1 and D2 together for fear. J. Neurosci., 31, 12866-12879.
125. Robinson, T.E. & Berridge, K.C. (1993) The neural basis of drug craving: an incentive-sensitization theory of addiction. Brain Res. Rev., 18, 247-291.
126. Robinson, M.J.F. & Berridge, K.C. (2010) Instant Incentive Salience: dynamic Transformation of An Aversive Salt Cue Into a 'Wanted' Motivational Magnet. Abstract. Society for Neuroscience, San Diego, CA.
127. Robinson, S., Sandstrom, S.M., Denenberg, V.H. & Palmiter, R.D. (2005) Distinguishing whether dopamine regulates liking, wanting, and/or learning about rewards. Behav. Neurosci., 119, 5-15.
128. Roitman, M.F., Stuber, G.D., Phillips, P.E.M., Wightman, R.M. & Carelli, R.M. (2004) Dopamine operates as a subsecond modulator of food seeking. J. Neurosci., 24, 1265-1271.
129. Rose, J.E., Salley, A., Behm, F.M., Bates, J.E. & Westman, E.C. (2010) Reinforcing effects of nicotine and non-nicotine components of cigarette smoke. Psychopharmacology, 210, 1-12.
130. Rosse, R.B., Fay-McCarthy, M., Collins, J. Jr, Risher-Flowers, D., Alim, T.N. & Deutsch, S.I. (1993) Transient compulsive foraging behavior associated with crack cocaine use. Am. J. Psychiatry, 150, 155-156.
131. Rosse, R.B., Fay-McCarthy, M., Collins, J.P. Jr, Alim, T.N. & Deutsch, S.I. (1994) The relationship between cocaine-induced paranoia and compulsive foraging: a preliminary report. Addiction, 89, 1097-1104.
132. Salamone, J.D., Cousins, M.S. & Snyder, B.J. (1997) Behavioral functions of nucleus accumbens dopamine: empirical and conceptual problems with the anhedonia hypothesis. Neurosci. Biobehav. Rev., 21, 341-359.
133. Salamone, J.D., Correa, M., Farrar, A. & Mingote, S.M. (2007) Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology, 191, 461-482.
134. Samson, R.D., Frank, M.J. & Fellous, J.M. (2010) Computational models of reinforcement learning: the role of dopamine as a reward signal. Cogn. Neurodyn., 4, 91-105.
135. Saunders, B.T. & Robinson, T.E. (2010) A cocaine cue acts as an incentive stimulus in some but not others: implications for addiction. Biol. Psychiatry, 67, 730-736.
136. Saunders, B.T. & Robinson, T.E. (2011) Individual variation in the motivational properties of cocaine. Neuropsychopharmacology, 36, 1668-1676.
137. Schonberg, T., Daw, N.D., Joel, D. & O'Doherty, J.P. (2007) Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making. J. Neurosci., 27, 12860-12867.
138. Schulkin, J. 1991. Sodium Hunger: The Search for a Salty Taste. Cambridge University Press, New York, NY.
139. Schultz, W. (1998) Predictive reward signal of dopamine neurons. J. Neurophysiol., 80, 1-27.
140. Schultz, W. (2006) Behavioral theories and the neurophysiology of reward. Annu. Rev. Psychol., 57, 87-115.
141. Schultz, W. & Dickinson, A. (2000) Neuronal coding of prediction errors. Annu. Rev. Neurosci., 23, 473-500.
142. Schultz, W., Apicella, P., Scarnati, E. & Ljungberg, T. (1992) Neuronal activity in monkey ventral striatum related to the expectation of reward. J. Neurosci., 12, 4595-4610.
143. Schultz, W., Apicella, P. & Ljungberg, T. (1993) Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. J. Neurosci., 13, 900-913.
144. Schultz, W., Dayan, P. & Montague, P.R. (1997) A neural substrate of prediction and reward. Science, 275, 1593-1599.
145. Sharot, T., Shiner, T., Brown, A.C., Fan, J. & Dolan, R.J. (2009) Dopamine enhances expectation of pleasure in humans. Curr. Biol., 19, 2077-2080.
146. Sienkiewicz-Jarosz, H., Scinska, A., Kuran, W., Ryglewicz, D., Rogowski, A., Wrobel, E., Korkosz, A., Kukwa, A., Kostowski, W. & Bienkowski, P. (2005) Taste responses in patients with Parkinson's disease. J. Neurol. Neurosurg. Psychiatry, 76, 40-46.
147. Smith, K.S., Berridge, K.C. & Aldridge, J.W. (2011) Disentangling pleasure from incentive salience and learning signals in brain reward circuitry. Proc. Natl Acad. Sci. USA, 108, E255-E264.
148. Stouffer, E.M. & White, N.M. (2005) A latent cue preference based on sodium depletion in rats. Learn. Mem., 12, 549-552.
149. Sutton, R.S. & Barto, A.G. (1981) Toward a modern theory of adaptive networks: expectation and prediction. Psychol. Rev., 88, 135-170.
150. Swanson, L.W. (2005) Anatomy of the soul as reflected in the cerebral hemispheres: neural circuits underlying voluntary control of basic motivated behaviors. J. Comp. Neurol., 493, 122-131.
151. Talmi, D., Seymour, B., Dayan, P. & Dolan, R. (2008) Human pavlovian-instrumental transfer. J. Neurosci., 28, 360-368.
152. Tapper, K., Pothos, E.M. & Lawrence, A.D. (2010) Feast your eyes: hunger and trait reward drive predict attentional bias for food cues. Emotion, 10, 949-954.
153. Thompson, R.H. & Swanson, L.W. (2010) Hypothesis-driven structural connectivity analysis supports network over hierarchical model of brain architecture. Proc. Natl Acad. Sci. USA, 107, 15235-15239.
154. Tindell, A.J., Berridge, K.C., Zhang, J., Pecina, S. & Aldridge, J.W. (2005) Ventral pallidal neurons code incentive motivation: amplification by mesolimbic sensitization and amphetamine. Eur. J. Neurosci., 22, 2617-2634.
155. Tindell, A.J., Smith, K.S., Pecina, S., Berridge, K.C. & Aldridge, J.W. (2006) Ventral pallidum firing codes hedonic reward: when a bad taste turns good. J. Neurophysiol., 96, 2399-2409.
156. Tindell, A.J., Smith, K.S., Berridge, K.C. & Aldridge, J.W. (2009) Dynamic computation of incentive salience: 'wanting' what was never 'liked'. J. Neurosci., 29, 12220-12228.
157. Toates, F. 1986. Motivational Systems. Cambridge University Press, Cambridge.
158. Treadway, M.T. & Zald, D.H. (2011) Reconsidering anhedonia in depression: lessons from translational neuroscience. Neurosci. Biobehav. Rev., 35, 537-555.
159. Uslaner, J., Acerbo, M., Jones, S. & Robinson, T. (2006) The attribution of incentive salience to a stimulus that signals an intravenous injection of cocaine. Behav. Brain Res., 169, 320-324.
160. Valenstein, E.S. (1971) Channeling of responses elicited by hypothalamic stimulation. J. Psychiatr. Res., 8, 335-344.
161. Volkow, N.D., Wang, G.J., Fowler, J.S., Logan, J., Jayne, M., Franceschi, D., Wong, C., Gatley, S.J., Gifford, A.N., Ding, Y.S. & Pappas, N. (2002) 'Nonhedonic' food motivation in humans involves dopamine in the dorsal striatum and methylphenidate amplifies this effect. Synapse, 44, 175-180.
162. Wang, G.J., Geliebter, A., Volkow, N.D., Telang, F.W., Logan, J., Jayne, M.C., Galanti, K., Selig, P.A., Han, H., Zhu, W., Wong, C.T. & Fowler, J.S. (2011) Enhanced striatal dopamine release during food stimulation in binge eating disorder. Obesity, 19, 1601-1608.
163. Washton, A.M. & Stone-Washton, N. (1993) Outpatient treatment of cocaine and crack addiction: a clinical perspective. NIDA Res. Monogr., 135, 15-30.
164. Wassum, K.M., Ostlund, S.B., Balleine, B.W. & Maidment, N.T. (2011) Differential dependence of Pavlovian incentive motivation and instrumental incentive learning processes on dopamine signaling. Learn. Mem., 18, 475-483.
165. Weingarten, H.P. (1983) Conditioned cues elicit feeding in sated rats: a role for learning in meal initiation. Science, 220, 431-433.
166. Wickelgren, I. (1997) Neuroscience: getting the brain's attention. Science, 278, 35-37.
167. Wiers, R.W. & Stacy, A.W. (Eds) (2006) Handbook of Implicit Cognition and Addiction. Sage Publications, Inc., Thousand Oaks, CA.
168. Wilson, C.L., Sherman, J.E. & Holman, E.W. (1981) Aversion to the reinforcer differentially affects conditioned reinforcement and instrumental responding. J. Exp. Psychol. Anim. Behav. Process., 7, 165-174.
169. Winkielman, P., Berridge, K.C. & Wilbarger, J.L. (2005) Unconscious affective reactions to masked happy versus angry faces influence consumption behavior and judgments of value. Personal. Soc. Psychol. Bull., 31, 121-135.
170. Wise, R.A. (1982) Neuroleptics and operant behavior: the anhedonia hypothesis. Behav. Brain Sci., 5, 39-87.
171. Wise, R.A. (1985) The anhedonia hypothesis: Mark III. Behav. Brain Sci., 8, 178-186.
172. Wise, R.A. (2006) Role of brain dopamine in food reward and reinforcement. Philos. Trans. R. Soc. Lond. B Biol. Sci., 361, 1149-1158.
173. Wise, R.A., Spindler, J., deWit, H. & Gerberg, G.J. (1978) Neuroleptic-induced 'anhedonia' in rats: pimozide blocks reward quality of food. Science, 201, 262-264.
174. de Wit, H. & Chutuape, M.A. (1993) Increased ethanol choice in social drinkers following ethanol preload. Behav. Pharmacol., 4, 29-36.
175. Wyvell, C.L. & Berridge, K.C. (2000) Intra-accumbens amphetamine increases the conditioned incentive salience of sucrose reward: enhancement of reward 'wanting' without enhanced 'liking' or response reinforcement. J. Neurosci., 20, 8122-8130.
176. Wyvell, C.L. & Berridge, K.C. (2001) Incentive-sensitization by previous amphetamine exposure: increased cue-triggered 'wanting' for sucrose reward. J. Neurosci., 21, 7831-7840.
177. Yager, L.M. & Robinson, T.E. (2010) Cue-induced reinstatement of food seeking in rats that differ in their propensity to attribute incentive salience to food cues. Behav. Brain Res., 214, 30-34.
178. Zhang, J., Berridge, K.C., Tindell, A.J., Smith, K.S. & Aldridge, J.W. (2009) A neural computational model of incentive salience. PLoS Comput. Biol., 5, e1000437.