The Mysterious Motivational Functions of Mesolimbic Dopamine

Neuron

Volumn 76, Issue 3, 2012, Pages 470-485

  Salamone, John D ^a   Correa, Mercè ^a,b  

^a UNIVERSITY OF CONNECTICUT   (United States)

^b UNIVERSITAT JAUME I   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

DOPAMINE RECEPTOR;

BRAIN ELECTROPHYSIOLOGY; DECISION MAKING; DOPAMINE METABOLISM; DOPAMINERGIC NERVE CELL; DOPAMINERGIC TRANSMISSION; DRUG SEEKING BEHAVIOR; FOOD DEPRIVATION; FOOD INTAKE; LOCOMOTION; MAZE TEST; MESOLIMBIC DOPAMINERGIC SYSTEM; MOTIVATION; MOTOR CONTROL; NERVOUS SYSTEM FUNCTION; NONHUMAN; NUCLEUS ACCUMBENS; PRIORITY JOURNAL; REFERENCE MEMORY; REINFORCEMENT; REVIEW; TASK PERFORMANCE; WORKING MEMORY;

ANIMALS; APPETITIVE BEHAVIOR; DOPAMINE; HUMANS; LIMBIC SYSTEM; MOTIVATION; NUCLEUS ACCUMBENS;

EID: 84868631248     PISSN: 08966273     EISSN: 10974199     Source Type: Journal    
DOI: 10.1016/j.neuron.2012.10.021     Document Type: Review

References (196)

1. Aberman J.E., Salamone J.D. Nucleus accumbens dopamine depletions make rats more sensitive to high ratio requirements but do not impair primary food reinforcement. Neuroscience 1999, 92:545-552.
2. Acquas E., Di Chiara G. D1 receptor blockade stereospecifically impairs the acquisition of drug-conditioned place preference and place aversion. Behav. Pharmacol. 1994, 5:555-569.
3. Adamantidis A.R., Tsai H.C., Boutrel B., Zhang F., Stuber G.D., Budygin E.A., Touriño C., Bonci A., Deisseroth K., de Lecea L. Optogenetic interrogation of dopaminergic modulation of the multiple phases of reward-seeking behavior. J. Neurosci. 2011, 31:10829-10835.
4. Anstrom K.K., Woodward D.J. Restraint increases dopaminergic burst firing in awake rats. Neuropsychopharmacology 2005, 30:1832-1840.
5. Anstrom K.K., Miczek K.A., Budygin E.A. Increased phasic dopamine signaling in the mesolimbic pathway during social defeat in rats. Neuroscience 2009, 161:3-12.
6. Baldo B.A., Kelley A.E. Discrete neurochemical coding of distinguishable motivational processes: insights from nucleus accumbens control of feeding. Psychopharmacology (Berl.) 2007, 191:439-459.
7. Baldo B.A., Sadeghian K., Basso A.M., Kelley A.E. Effects of selective dopamine D1 or D2 receptor blockade within nucleus accumbens subregions on ingestive behavior and associated motor activity. Behav. Brain Res. 2002, 137:165-177.
8. Baliki M.N., Geha P.Y., Fields H.L., Apkarian A.V. Predicting value of pain and analgesia: nucleus accumbens response to noxious stimuli changes in the presence of chronic pain. Neuron 2010, 66:149-160.
9. Barbano M.F., Le Saux M., Cador M. Involvement of dopamine and opioids in the motivation to eat: influence of palatability, homeostatic state, and behavioral paradigms. Psychopharmacology (Berl.) 2009, 203:475-487.
10. Bardgett M.E., Depenbrock M., Downs N., Points M., Green L. Dopamine modulates effort-based decision making in rats. Behav. Neurosci. 2009, 123:242-251.
11. Bassareo V., De Luca M.A., Di Chiara G. Differential expression of motivational stimulus properties by dopamine in nucleus accumbens shell versus core and prefrontal cortex. J. Neurosci. 2002, 22:4709-4719.
12. Bayer H.M., Glimcher P.W. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 2005, 47:129-141.
13. Beeler J.A., Daw N., Frazier C.R., Zhuang X. Tonic dopamine modulates exploitation of reward learning. Front. Behav. Neurosci. 2010, 4:170.
14. Beeler J., Frazier C.R.M., Zhuang X. Putting desire on a budget: dopamine and energy expenditure, reconciling reward and resources. Front. Integr. Neurosci. 2012, 6:49.
15. Belin D., Jonkman S., Dickinson A., Robbins T.W., Everitt B.J. Parallel and interactive learning processes within the basal ganglia: relevance for the understanding of addiction. Behav. Brain Res. 2009, 199:89-102.
16. Berridge K.C. Food reward: brain substrates of wanting and liking. Neurosci. Biobehav. Rev. 1996, 20:1-25.
17. Berridge K.C. The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology (Berl.) 2007, 191:391-431.
18. Berridge K.C., Kringelbach M.L. Affective neuroscience of pleasure: reward in humans and animals. Psychopharmacology (Berl.) 2008, 199:457-480.
19. Berridge K.C., Robinson T.E. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?. Brain Res. Brain Res. Rev. 1998, 28:309-369.
20. Berridge K.C., Robinson T.E. Parsing reward. Trends Neurosci. 2003, 26:507-513.
21. Blackburn J.R., Phillips A.G., Fibiger H.C. Dopamine and preparatory behavior: III. Effects of metoclopramide and thioridazine. Behav. Neurosci. 1989, 103:903-906.
22. Botvinick M.M., Huffstetler S., McGuire J.T. Effort discounting in human nucleus accumbens. Cogn. Affect. Behav. Neurosci. 2009, 9:16-27.
23. Brauer L.H., De Wit H. High dose pimozide does not block amphetamine-induced euphoria in normal volunteers. Pharmacol. Biochem. Behav. 1997, 56:265-272.
24. Brischoux F., Chakraborty S., Brierley D.I., Ungless M.A. Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli. Proc. Natl. Acad. Sci. USA 2009, 106:4894-4899.
25. Bromberg-Martin E.S., Matsumoto M., Hikosaka O. Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 2010, 68:815-834.
26. Brown H.D., McCutcheon J.E., Cone J.J., Ragozzino M.E., Roitman M.F. Primary food reward and reward-predictive stimuli evoke different patterns of phasic dopamine signaling throughout the striatum. Eur. J. Neurosci. 2011, 34:1997-2006.
27. Cabib S., Puglisi-Allegra S. The mesoaccumbens dopamine in coping with stress. Neurosci. Biobehav. Rev. 2012, 36:79-89.
28. Cacciapaglia F., Wightman R.M., Carelli R.M. Rapid dopamine signaling differentially modulates distinct microcircuits within the nucleus accumbens during sucrose-directed behavior. J. Neurosci. 2011, 31:13860-13869.
29. Cagniard B., Balsam P.D., Brunner D., Zhuang X. Mice with chronically elevated dopamine exhibit enhanced motivation, but not learning, for a food reward. Neuropsychopharmacology 2006, 31:1362-1370.
30. Calaminus C., Hauber W. Intact discrimination reversal learning but slowed responding to reward-predictive cues after dopamine D1 and D2 receptor blockade in the nucleus accumbens of rats. Psychopharmacology (Berl.) 2007, 191:551-566.
31. Cannon C.M., Bseikri M.R. Is dopamine required for natural reward?. Physiol. Behav. 2004, 81:741-748.
32. Carelli R.M., Wondolowski J. Selective encoding of cocaine versus natural rewards by nucleus accumbens neurons is not related to chronic drug exposure. J. Neurosci. 2003, 23:11214-11223.
33. Cofer C.N., Appley M.H. Motivation: Theory and Research 1964, John Wiley and Sons, New York.
34. Collins-Praino L.E., Paul N.E., Rychalsky K.L., Hinman J.R., Chrobak J.J., Senatus P.B., Salamone J.D. Pharmacological and physiological characterization of the tremulous jaw movement model of parkinsonian tremor: potential insights into the pathophysiology of tremor. Front. Syst. Neurosci. 2011, 5:49.
35. Colwill R.M., Rescorla R.A. Associations between the discrimintaive stimulus and the reinforcer in instrumental learning. J. Exp. Psychol. Anim. Behav. Process. 1988, 14:155-164.
36. Corbit L.H., Muir J.L., Balleine B.W. The role of the nucleus accumbens in instrumental conditioning: Evidence of a functional dissociation between accumbens core and shell. J. Neurosci 2001, 21:3251-3260.
37. Correa M., Carlson B.B., Wisniecki A., Salamone J.D. Nucleus accumbens dopamine and work requirements on interval schedules. Behav. Brain Res. 2002, 137:179-187.
38. Craig W. Appetites and aversions as constituents of instincts. Biol. Bull. 1918, 34:91-107.
39. Croxson P.L., Walton M.E., O'Reilly J.X., Behrens T.E., Rushworth M.F. Effort-based cost-benefit valuation and the human brain. J. Neurosci. 2009, 29:4531-4541.
40. Cousins M.S., Sokolowski J.D., Salamone J.D. Different effects of nucleus accumbens and ventrolateral striatal dopamine depletions on instrumental response selection in the rat. Pharmacol. Biochem. Behav. 1993, 46:943-951.
41. Czachowski C.L., Santini L.A., Legg B.H., Samson H.H. Separate measures of ethanol seeking and drinking in the rat: effects of remoxipride. Alcohol 2002, 28:39-46.
42. Dalley J.W., Lääne K., Theobald D.E., Armstrong H.C., Corlett P.R., Chudasama Y., Robbins T.W. Time-limited modulation of appetitive Pavlovian memory by D1 and NMDA receptors in the nucleus accumbens. Proc. Natl. Acad. Sci. USA 2005, 102:6189-6194.
43. Dantzer R., O'Connor J.C., Freund G.G., Johnson R.W., Kelley K.W. From inflammation to sickness and depression: when the immune system subjugates the brain. Nat. Rev. Neurosci. 2008, 9:46-56.
44. Delgado M.R., Jou R.L., Phelps E.A. Neural systems underlying aversive conditioning in humans with primary and secondary reinforcers. Front. Neurosci. 2011, 5:71.
45. Demyttenaere K., De Fruyt J., Stahl S.M. The many faces of fatigue in major depressive disorder. Int. J. Neuropsychopharmacol. 2005, 8:93-105.
46. Denk F., Walton M.E., Jennings K.A., Sharp T., Rushworth M.F., Bannerman D.M. Differential involvement of serotonin and dopamine systems in cost-benefit decisions about delay or effort. Psychopharmacology (Berl.) 2005, 179:587-596.
47. Dickinson A., Balleine B. Motivational control of goal-directed action. Anim. Learn. Behav. 1994, 22:1-18.
48. Dunnett S.B., Iversen S.D. Regulatory impairments following selective 6-OHDA lesions of the neostriatum. Behav. Brain Res. 1982, 4:195-202.
49. Everitt B.J., Robbins T.W. Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nat. Neurosci. 2005, 8:1481-1489.
50. A agonist muscimol into ventral pallidum alter response allocation in food-seeking behavior. Neuroscience 2008, 152:321-330.
51. Farrar A.M., Segovia K.N., Randall P.A., Nunes E.J., Collins L.E., Stopper C.M., Port R.G., Hockemeyer J., Müller C.E., Correa M., Salamone J.D. Nucleus accumbens and effort-related functions: behavioral and neural markers of the interactions between adenosine A2A and dopamine D2 receptors. Neuroscience 2010, 166:1056-1067.
52. Faure A., Haberland U., Condé F., El Massioui N. Lesion to the nigrostriatal dopamine system disrupts stimulus-response habit formation. J. Neurosci. 2005, 25:2771-2780.
53. Faure A., Reynolds S.M., Richard J.M., Berridge K.C. Mesolimbic dopamine in desire and dread: enabling motivation to be generated by localized glutamate disruptions in nucleus accumbens. J. Neurosci. 2008, 28:7184-7192.
54. Fenu S., Bassareo V., Di Chiara G. A role for dopamine D1 receptors of the nucleus accumbens shell in conditioned taste aversion learning. J. Neurosci. 2001, 21:6897-6904.
55. Fields H.L., Hjelmstad G.O., Margolis E.B., Nicola S.M. Ventral tegmental area neurons in learned appetitive behavior and positive reinforcement. Annu. Rev. Neurosci. 2007, 30:289-316.
56. Flagel S.B., Watson S.J., Robinson T.E., Akil H. Individual differences in the propensity to approach signals vs goals promote different adaptations in the dopamine system of rats. Psychopharmacology (Berl.) 2007, 191:599-607.
57. Floresco S.B., Ghods-Sharifi S. Amygdala-prefrontal cortical circuitry regulates effort-based decision making. Cereb. Cortex 2007, 17:251-260.
58. Floresco S.B., West A.R., Ash B., Moore H., Grace A.A. Afferent modulation of dopamine neuron firing differentially regulates tonic and phasic dopamine transmission. Nat. Neurosci. 2003, 6:968-973.
59. Floresco S.B., Tse M.T., Ghods-Sharifi S. Dopaminergic and glutamatergic regulation of effort- and delay-based decision making. Neuropsychopharmacology 2008, 33:1966-1979.
60. Foltin R.W. Effects of amphetamine, dexfenfluramine, diazepam, and other pharmacological and dietary manipulations on food "seeking" and "taking" behavior in non-human primates. Psychopharmacology (Berl.) 2001, 158:28-38.
61. Friedman J.H., Brown R.G., Comella C., Garber C.E., Krupp L.B., Lou J.S., Marsh L., Nail L., Shulman L., Taylor C.B. Fatigue in Parkinson's disease: a review. Mov. Disord. 2007, 22:297-308. Working Group on Fatigue in Parkinson's Disease.
62. Gan J.O., Walton M.E., Phillips P.E. Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine. Nat. Neurosci. 2010, 13:25-27.
63. Gawin F.H. Neuroleptic reduction of cocaine-induced paranoia but not euphoria?. Psychopharmacology 1986, 90:142-143.
64. Goto Y., Grace A.A. Dopaminergic modulation of limbic and cortical drive of nucleus accumbens in goal-directed behavior. Nat. Neurosci. 2005, 8:805-812.
65. Grace A.A. The tonic/phasic model of dopamine system regulation and its implications for understanding alcohol and psychostimulant craving. Addiction 2000, 95(Suppl 2):S119-S128.
66. Graybiel A.M. The basal ganglia and chunking of action repertoires. Neurobiol. Learn. Mem. 1998, 70:119-136.
67. Grieder T.E., George O., Tan H., George S.R., Le Foll B., Laviolette S.R., van der Kooy D. Phasic D1 and tonic D2 dopamine receptor signaling double dissociate the motivational effects of acute nicotine and chronic nicotine withdrawal. Proc. Natl. Acad. Sci. USA 2012, 109:3101-3106.
68. Guitart-Masip M., Huys Q.J., Fuentemilla L., Dayan P., Duzel E., Dolan R.J. Go and no-go learning in reward and punishment: interactions between affect and effect. Neuroimage 2012, 62:154-166.
69. Haney M., Ward A.S., Foltin R.W., Fischman M.W. Effects of ecopipam, a selective dopamine D1 antagonist, on smoked cocaine self-administration by humans. Psychopharmacology (Berl.) 2001, 155:330-337.
70. Hauber W. Dopamine release in the prefrontal cortex and striatum: temporal and behavioural aspects. Pharmacopsychiatry 2010, 43(Suppl 1):S32-S41.
71. Hauber W., Sommer S. Prefrontostriatal circuitry regulates effort-related decision making. Cereb. Cortex 2009, 19:2240-2247.
72. Hernandez P.J., Sadeghian K., Kelley A.E. Early consolidation of instrumental learning requires protein synthesis in the nucleus accumbens. Nat. Neurosci. 2002, 5:1327-1331.
73. Hernandez G., Breton Y.A., Conover K., Shizgal P. At what stage of neural processing does cocaine act to boost pursuit of rewards?. PLoS ONE 2010, 5:e15081.
74. Hursh S.R., Raslear T.G., Shurtleff D., Bauman R., Simmons L. A cost-benefit analysis of demand for food. J. Exp. Anal. Behav. 1988, 50:419-440.
75. Hursh S.R. Behavioral economics of drug self-administration: an introduction. Drug Alcohol Depend. 1993, 33:165-172.
76. Ikemoto S., Panksepp J. Dissociations between appetitive and consummatory responses by pharmacological manipulations of reward-relevant brain regions. Behav. Neurosci. 1996, 110:331-345.
77. Inoue T., Izumi T., Maki Y., Muraki I., Koyama T. Effect of the dopamine D(1/5) antagonist SCH 23390 on the acquisition of conditioned fear. Pharmacol. Biochem. Behav. 2000, 66:573-578.
78. Jensen J., Smith A.J., Willeit M., Crawley A.P., Mikulis D.J., Vitcu I., Kapur S. Separate brain regions code for salience vs. valence during reward prediction in humans. Hum. Brain Mapp. 2007, 28:294-302.
79. Jicha G.A., Salamone J.D. Vacuous jaw movements and feeding deficits in rats with ventrolateral striatal dopamine depletion: possible relation to parkinsonian symptoms. J. Neurosci 1991, 11:3822-3829.
80. Kalivas P.W. Addiction as a pathology in prefrontal cortical regulation of corticostriatal habit circuitry. Neurotox. Res. 2008, 14:185-189.
81. Kelley A.E., Baldo B.A., Pratt W.E., Will M.J. Corticostriatal-hypothalamic circuitry and food motivation: integration of energy, action and reward. Physiol. Behav. 2005, 86:773-795.
82. Knutson B., Fong G.W., Adams C.M., Varner J.L., Hommer D. Dissociation of reward anticipation and outcome with event-related fMRI. Neuroreport 2001, 12:3683-3687.
83. 2 receptors in instrumental and Pavlovian paradigms of conditioned reward. Psychopharmacology (Berl.) 2000, 152:67-73.
84. Koffarnus M.N., Newman A.H., Grundt P., Rice K.C., Woods J.H. Effects of selective dopaminergic compounds on a delay-discounting task. Behav. Pharmacol. 2011, 22:300-311.
85. Koob G.F., Riley S.J., Smith S.C., Robbins T.W. Effects of 6-hydroxydopamine lesions of the nucleus accumbens septi and olfactory tubercle on feeding, locomotor activity, and amphetamine anorexia in the rat. J. Comp. Physiol. Psychol. 1978, 92:917-927.
86. Kosobud A.E., Harris G.C., Chapin J.K. Behavioral associations of neuronal activity in the ventral tegmental area of the rat. J. Neurosci. 1994, 14:7117-7129.
87. Kurniawan I.T., Guitart-Masip M., Dolan R.J. Dopamine and effort-based decision making. Front. Neurosci. 2011, 5:81.
88. Lammel S., Ion D.I., Roeper J., Malenka R.C. Projection-specific modulation of dopamine neuron synapses by aversive and rewarding stimuli. Neuron 2011, 70:855-862.
89. Lapierre Y., Hum S. Treating fatigue. Int. MS J. 2007, 14:64-71.
90. Levita L., Hare T.A., Voss H.U., Glover G., Ballon D.J., Casey B.J. The bivalent side of the nucleus accumbens. Neuroimage 2009, 44:1178-1187.
91. Lewin K. A Dynamic Theory of Personality 1935, McGraw-Hill, New York.
92. Lex A., Hauber W. Dopamine D1 and D2 receptors in the nucleus accumbens core and shell mediate Pavlovian-instrumental transfer. Learn. Mem. 2008, 15:483-491.
93. Lex B., Hauber W. The role of nucleus accumbens dopamine in outcome encoding in instrumental and Pavlovian conditioning. Neurobiol. Learn. Mem. 2010, 93:283-290.
94. Leyton M., Casey K.F., Delaney J.S., Kolivakis T., Benkelfat C. Cocaine craving, euphoria, and self-administration: a preliminary study of the effect of catecholamine precursor depletion. Behav. Neurosci. 2005, 119:1619-1627.
95. Liberman N., Forster J. Expectancy, value and psychological distance: a new look at goal gradients. Soc. Cogn. 2008, 26:515-533.
96. Liberzon I., Taylor S.F., Amdur R., Jung T.D., Chamberlain K.R., Minoshima S., Koeppe R.A., Fig L.M. Brain activation in PTSD in response to trauma-related stimuli. Biol. Psychiatry 1999, 45:817-826.
97. Mai B., Sommer S., Hauber W. Motivational states influence effort-based decision making in rats: the role of dopamine in the nucleus accumbens. Cogn. Affect. Behav. Neurosci. 2012, 12:74-84.
98. Marin R.S., Firinciogullari S., Biedrzycki R.C. The sources of convergence between measures of apathy and depression. J. Affect. Disord. 1993, 28:117-124.
99. Matsumoto M., Hikosaka O. Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 2009, 459:837-841.
100. Matsumoto N., Hanakawa T., Maki S., Graybiel A.M., Kimura M. Role of nigrostriatal dopamine system in learning to perform sequential motor tasks in a predictive manner. J. Neurophysiol. 1999, 82:978-998.
101. McCullough L.D., Salamone J.D. Involvement of nucleus accumbens dopamine in the motor activity induced by periodic food presentation: a microdialysis and behavioral study. Brain Res. 1992, 592:29-36.
102. McCullough L.D., Sokolowski J.D., Salamone J.D. A neurochemical and behavioral investigation of the involvement of nucleus accumbens dopamine in instrumental avoidance. Neuroscience 1993, 52:919-925.
103. Menon M., Jensen J., Vitcu I., Graff-Guerrero A., Crawley A., Smith M.A., Kapur S. Temporal difference modeling of the blood-oxygen level dependent response during aversive conditioning in humans: effects of dopaminergic modulation. Biol. Psychiatry 2007, 62:765-772.
104. Miller A.H. Norman Cousins lecture. Mechanisms of cytokine-induced behavioral changes: psychoneuroimmunology at the translational interface. Brain Behav. Immun. 2009, 23:149-158.
105. Mingote S., Weber S.M., Ishiwari K., Correa M., Salamone J.D. Ratio and time requirements on operant schedules: effort-related effects of nucleus accumbens dopamine depletions. Eur. J. Neurosci. 2005, 21:1749-1757.
106. Mingote S., Font L., Farrar A.M., Vontell R., Worden L.T., Stopper C.M., Port R.G., Sink K.S., Bunce J.G., Chrobak J.J., Salamone J.D. Nucleus accumbens adenosine A2A receptors regulate exertion of effort by acting on the ventral striatopallidal pathway. J. Neurosci. 2008, 28:9037-9046.
107. Mogenson G.J., Jones D.L., Yim C.Y. From motivation to action: functional interface between the limbic system and the motor system. Prog. Neurobiol. 1980, 14:69-97.
108. Morris S.E., Cuthbert B.N. Research domain criteria: cognitive systems, neural circuits, and dimensions of behavior. Dialogues Clin. Neurosci. 2012, 14:29-37.
109. Morrow J.D., Maren S., Robinson T.E. Individual variation in the propensity to attribute incentive salience to an appetitive cue predicts the propensity to attribute motivational salience to an aversive cue. Behav. Brain Res. 2011, 220:238-243.
110. Nann-Vernotica E., Donny E.C., Bigelow G.E., Walsh S.L. Repeated administration of the D1/5 antagonist ecopipam fails to attenuate the subjective effects of cocaine. Psychopharmacology 2001, 155:338-347.
111. Nicola S.M. The flexible approach hypothesis: unification of effort and cue-responding hypotheses for the role of nucleus accumbens dopamine in the activation of reward-seeking behavior. J. Neurosci. 2010, 30:16585-16600.
112. Nishino H., Ono T., Muramoto K., Fukuda M., Sasaki K. Neuronal activity in the ventral tegmental area (VTA) during motivated bar press feeding in the monkey. Brain Res. 1987, 413:302-313.
113. Niv Y. Reinforcement learning in the brain. J. Math. Psychol. 2009, 53:139-154.
114. 2 antagonism in nucleus accumbens core or dorsomedial shell suppresses lever pressing for food but leads to compensatory increases in chow consumption. Pharmacol. Biochem. Behav. 2001, 69:373-382.
115. Nunes E.J., Randall P.A., Santerre J.L., Given A.B., Sager T.N., Correa M., Salamone J.D. Differential effects of selective adenosine antagonists on the effort-related impairments induced by dopamine D1 and D2 antagonism. Neuroscience 2010, 170:268-280.
116. O'Doherty J.P., Deichmann R., Critchley H.D., Dolan R.J. Neural responses during anticipation of a primary taste reward. Neuron 2002, 33:815-826.
117. O'Donnell P. Dopamine gating of forebrain neural ensembles. Eur. J. Neurosci. 2003, 17:429-435.
118. Ostlund S.B., Wassum K.M., Murphy N.P., Balleine B.W., Maidment N.T. Extracellular dopamine levels in striatal subregions track shifts in motivation and response cost during instrumental conditioning. J. Neurosci. 2011, 31:200-207.
119. Panksepp J. Cross-species affective neuroscience decoding of the primal affective experiences of humans and related animals. PLoS ONE 2011, 6:e21236.
120. 2A receptor antagonism and genetic deletion attenuate the effects of dopamine D2 antagonism on effort-based decision making in mice. Neuropharmacology 2012, 62:2068-2077.
121. Parker J.G., Zweifel L.S., Clark J.J., Evans S.B., Phillips P.E.M., Palmiter R.D. Absence of NMDA receptors in dopamine neurons attenuates dopamine release but not conditioned approach during Pavlovian conditioning. Proc. Natl. Acad. Sci. USA 2010, 107:13491-13496.
122. Parkinson J.A., Dalley J.W., Cardinal R.N., Bamford A., Fehnert B., Lachenal G., Rudarakanchana N., Halkerston K.M., Robbins T.W., Everitt B.J. Nucleus accumbens dopamine depletion impairs both acquisition and performance of appetitive Pavlovian approach behaviour: implications for mesoaccumbens dopamine function. Behav. Brain Res. 2002, 137:149-163.
123. Pavic L., Gregurek R., Petrović R., Petrović D., Varda R., Vukusić H., Crnković-Marković S. Alterations in brain activation in posttraumatic stress disorder patients with severe hyperarousal symptoms and impulsive aggressiveness. Eur. Arch. Psychiatry Clin. Neurosci. 2003, 253:80-83.
124. Peciña S., Cagniard B., Berridge K.C., Aldridge J.W., Zhuang X. Hyperdopaminergic mutant mice have higher "wanting" but not "liking" for sweet rewards. J. Neurosci. 2003, 23:9395-9402.
125. Pezze M.A., Feldon J. Mesolimbic dopaminergic pathways in fear conditioning. Prog. Neurobiol. 2004, 74:301-320.
126. Phan K.L., Taylor S.F., Welsh R.C., Ho S.H., Britton J.C., Liberzon I. Neural correlates of individual ratings of emotional salience: a trial-related fMRI study. Neuroimage 2004, 21:768-780.
127. Phillips P.E., Walton M.E., Jhou T.C. Calculating utility: preclinical evidence for cost-benefit analysis by mesolimbic dopamine. Psychopharmacology (Berl.) 2007, 191:483-495.
128. Pruessner J.C., Champagne F., Meaney M.J., Dagher A. Dopamine release in response to a psychological stress in humans and its relationship to early life maternal care: a positron emission tomography study using [11C]raclopride. J. Neurosci. 2004, 24:2825-2831.
129. Rescorla R.A., Wagner A.R. A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. Classical Conditioning II: Current Research and Theory 1972, 64-99. Appleton Century Crofts, New York. A.H. Black, W.F. Prokasy (Eds.).
130. Rice M.E., Patel J.C., Cragg S.J. Dopamine release in the basal ganglia. Neuroscience 2011, 198:112-137.
131. Robbins T.W., Everitt B.J. A role for mesencephalic dopamine in activation: commentary on Berridge (2006). Psychopharmacology 2007, 191:433-437.
132. Robbins T.W., Koob G.F. Selective disruption of displacement behaviour by lesions of the mesolimbic dopamine system. Nature 1980, 285:409-412.
133. Roesch M.R., Singh T., Brown P.L., Mullins S.E., Schoenbaum G. Ventral striatal neurons encode the value of the chosen action in rats deciding between differently delayed or sized rewards. J. Neurosci. 2009, 29:13365-13376.
134. Roitman M.F., Stuber G.D., Phillips P.E., Wightman R.M., Carelli R.M. Dopamine operates as a subsecond modulator of food seeking. J. Neurosci. 2004, 24:1265-1271.
135. Roitman M.F., Wheeler R.A., Wightman R.M., Carelli R.M. Real-time chemical responses in the nucleus accumbens differentiate rewarding and aversive stimuli. Nat. Neurosci. 2008, 11:1376-1377.
136. Salamone J.D. The actions of neuroleptic drugs on appetitive instrumental behaviors. Handbook of Psychopharmacology 1987, 575-608. Plenum, New York. L.L. Iversen, S.D. Iversen, S.H. Snyder (Eds.).
137. Salamone J.D. Dopaminergic involvement in activational aspects of motivation: effects of haloperidol on schedule induced activity, feeding and foraging in rats. Psychobiology 1988, 16:196-206.
138. Salamone J.D. Complex motor and sensorimotor functions of striatal and accumbens dopamine: involvement in instrumental behavior processes. Psychopharmacology (Berl.) 1992, 107:160-174.
139. Salamone J.D. Will the last person who uses the term 'reward' please turn out the lights? Comments on processes related to reinforcement, learning, motivation and effort. Addict. Biol. 2006, 11:43-44.
140. Salamone J.D. Motor function and motivation. Encyclopedia of Behavioral Neuroscience 2010, Volume 3:267-276. Academic Press, Oxford.
141. Salamone J.D., Correa M. Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine. Behav. Brain Res. 2002, 137:3-25.
142. Salamone J.D., Steinpreis R.E., McCullough L.D., Smith P., Grebel D., Mahan K. Haloperidol and nucleus accumbens dopamine depletion suppress lever pressing for food but increase free food consumption in a novel food choice procedure. Psychopharmacology (Berl.) 1991, 104:515-521.
143. Salamone J.D., Mahan K., Rogers S. Ventrolateral striatal dopamine depletions impair feeding and food handling in rats. Pharmacol. Biochem. Behav. 1993, 44:605-610.
144. Salamone J.D., Cousins M.S., Bucher S. Anhedonia or anergia? Effects of haloperidol and nucleus accumbens dopamine depletion on instrumental response selection in a T-maze cost/benefit procedure. Behav. Brain Res. 1994, 65:221-229.
145. Salamone J.D., Wisniecki A., Carlson B.B., Correa M. Nucleus accumbens dopamine depletions make animals highly sensitive to high fixed ratio requirements but do not impair primary food reinforcement. Neuroscience 2001, 105:863-870.
146. Salamone J.D., Arizzi M., Sandoval M.D., Cervone K.M., Aberman J.E. Dopamine antagonsts alter response allocation but do not suppress appetite for food in rats: Contrast between the effects of SKF83566, raclopride and fenfluramine on a concurrent choice task. Psychopharmacology 2002, 160:371-380.
147. Salamone J.D., Correa M., Mingote S.M., Weber S.M. Beyond the reward hypothesis: alternative functions of nucleus accumbens dopamine. Curr. Opin. Pharmacol. 2005, 5:34-41.
148. Salamone J.D., Correa M., Mingote S.M., Weber S.M., Farrar A.M. Nucleus accumbens dopamine and the forebrain circuitry involved in behavioral activation and effort-related decision making: implications for understanding anergia and psychomotor slowing in depression. Curr. Psychiatry Rev. 2006, 2:267-280.
149. Salamone J.D., Correa M., Farrar A., Mingote S.M. Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology (Berl.) 2007, 191:461-482.
150. Salamone J.D., Correa M., Farrar A.M., Nunes E.J., Pardo M. Dopamine, behavioral economics, and effort. Front. Behav. Neurosci. 2009, 3:13.
151. Salamone J.D., Correa M., Nunes E.J., Randall P.A., Pardo M. The behavioral pharmacology of effort-related choice behavior: dopamine, adenosine and beyond. J. Exp. Anal. Behav. 2012, 97:125-146.
152. Schmidt K., Nolte-Zenker B., Patzer J., Bauer M., Schmidt L.G., Heinz A. Psychopathological correlates of reduced dopamine receptor sensitivity in depression, schizophrenia, and opiate and alcohol dependence. Pharmacopsychiatry 2001, 34:66-72.
153. Schopenhauer, W. (1999). Prize Essay on the Freedom of the Will. Cambridge Texts in the History of Philosophy, G. Zoller, ed. Payne, E.F.J. (trans.) (Cambridge: Cambridge University Press).
154. Schultz W. Dopamine signals for reward value and risk: basic and recent data. Behav. Brain Funct. 2010, 6:24.
155. Schultz W., Apicella P., Ljungberg T. Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. J. Neurosci. 1993, 13:900-913.
156. Schultz W., Dayan P., Montague P.R. A neural substrate of prediction and reward. Science 1997, 275:1593-1599.
157. Sederholm F., Johnson A.E., Brodin U., Södersten P. Dopamine D(2) receptors and ingestive behavior: brainstem mediates inhibition of intraoral intake and accumbens mediates aversive taste behavior in male rats. Psychopharmacology (Berl.) 2002, 160:161-169.
158. Segovia K.N., Correa M., Salamone J.D. Slow phasic changes in nucleus accumbens dopamine release during fixed ratio acquisition: a microdialysis study. Neuroscience 2011, 196:178-188.
159. Segovia K.N., Correa M., Lennington J.B., Conover J.C., Salamone J.D. Changes in nucleus accumbens and neostriatal c-Fos and DARPP-32 immunoreactivity during different stages of food-reinforced instrumental training. Eur. J. Neurosci. 2012, 35:1354-1367.
160. Shepard R.N. Stimulus and response generalization: a stochastic model relating generalization to distance in psychological space. Psychometrika 1957, 22:325-345.
161. Shore D.M., Rafal R., Parkinson J.A. Appetitive motivational deficits in individuals with Parkinson's disease. Mov. Disord. 2011, 26:1887-1892.
162. Sink K.S., Vemuri V.K., Olszewska T., Makriyannis A., Salamone J.D. Cannabinoid CB1 antagonists and dopamine antagonists produce different effects on a task involving response allocation and effort-related choice in food-seeking behavior. Psychopharmacology (Berl.) 2008, 196:565-574.
163. Smith K.S., Berridge K.C., Aldridge J.W. Disentangling pleasure from incentive salience and learning signals in brain reward circuitry. Proc. Natl. Acad. Sci. USA 2011, 108:E255-E264.
164. Smith-Roe S.L., Kelley A.E. Coincident activation of NMDA and dopamine D1 receptors within the nucleus accumbens core is required for appetitive instrumental learning. J. Neurosci. 2000, 20:7737-7742.
165. Sokolowski J.D., Salamone J.D. The role of accumbens dopamine in lever pressing and response allocation: effects of 6-OHDA injected into core and dorsomedial shell. Pharmacol. Biochem. Behav. 1998, 59:557-566.
166. Sombers L.A., Beyene M., Carelli R.M., Wightman R.M. Synaptic overflow of dopamine in the nucleus accumbens arises from neuronal activity in the ventral tegmental area. J. Neurosci. 2009, 29:1735-1742.
167. Stahl S.M. The psychopharmacology of energy and fatigue. J. Clin. Psychiatry 2002, 63:7-8.
168. Surmeier D.J., Graybiel A.M. A feud that wasn't: acetylcholine evokes dopamine release in the striatum. Neuron 2012, 75:1-3.
169. Tan K.R., Yvon C., Turiault M., Mirzabekov J.J., Doehner J., Labouèbe G., Deisseroth K., Tye K.M., Lüscher C. GABA neurons of the VTA drive conditioned place aversion. Neuron 2012, 73:1173-1183.
170. Threlfell S., Lalic T., Platt N.J., Jennings K.A., Deisseroth K., Cragg S.J. Striatal dopamine release is triggered by synchronized activity in cholinergic interneurons. Neuron 2012, 75:58-64.
171. Tidey J.W., Miczek K.A. Social defeat stress selectively alters mesocorticolimbic dopamine release: an in vivo microdialysis study. Brain Res. 1996, 721:140-149.
172. Treadway M.T., Zald D.H. Reconsidering anhedonia in depression: lessons from translational neuroscience. Neurosci. Biobehav. Rev. 2011, 35:537-555.
173. Treadway M.T., Buckholtz J.W., Cowan R.L., Woodward N.D., Li R., Ansari M.S., Baldwin R.M., Schwartzman A.N., Kessler R.M., Zald D.H. Dopaminergic mechanisms of individual differences in human effort-based decision-making. J. Neurosci. 2012, 32:6170-6176.
174. Ungerstedt U. Adipsia and aphagia after 6-hydroxydopamine induced degeneration of the nigro-striatal dopamine system. Acta Physiol. Scand. 1971, 367:95-122.
175. van Zessen R., Phillips J.L., Budygin E.A., Stuber G.D. Activation of VTA GABA neurons disrupts reward consumption. Neuron 2012, 73:1184-1194.
176. Venugopalan V.V., Casey K.F., O'Hara C., O'Loughlin J., Benkelfat C., Fellows L.K., Leyton M. Acute phenylalanine/tyrosine depletion reduces motivation to smoke cigarettes across stages of addiction. Neuropsychopharmacology 2011, 36:2469-2476.
177. Volkow N.D., Chang L., Wang G.J., Fowler J.S., Leonido-Yee M., Franceschi D., Sedler M.J., Gatley S.J., Hitzemann R., Ding Y.S., et al. Association of dopamine transporter reduction with psychomotor impairment in methamphetamine abusers. Am. J. Psychiatry 2001, 158:377-382.
178. Wachtel S.R., Ortengren A., de Wit H. The effects of acute haloperidol or risperidone on subjective responses to methamphetamine in healthy volunteers. Drug Alcohol Depend. 2002, 68:23-33.
179. Wade T.R., de Wit H., Richards J.B. Effects of dopaminergic drugs on delayed reward as a measure of impulsive behavior in rats. Psychopharmacology (Berl.) 2000, 150:90-101.
180. Wakabayashi K.T., Fields H.L., Nicola S.M. Dissociation of the role of nucleus accumbens dopamine in responding to reward-predictive cues and waiting for reward. Behav. Brain Res. 2004, 154:19-30.
181. Wall V.Z., Parker J.G., Fadok J.P., Darvas M., Zweifel L., Palmiter R.D. A behavioral genetics approach to understanding D1 receptor involvement in phasic dopamine signaling. Mol. Cell. Neurosci. 2011, 46:21-31.
182. Walton M.E., Bannerman D.M., Alterescu K., Rushworth M.F.S. Functional specialization within medial frontal cortex of the anterior cingulate for evaluating effort-related decisions. J. Neurosci. 2003, 23:6475-6479.
183. Wanat M.J., Kuhnen C.M., Phillips P.E. Delays conferred by escalating costs modulate dopamine release to rewards but not their predictors. J. Neurosci. 2010, 30:12020-12027.
184. Wardle M.C., Treadway M.T., Mayo L.M., Zald D.H., de Wit H. Amping up effort: effects of d-amphetamine on human effort-based decision-making. J. Neurosci. 2011, 31:16597-16602.
185. Wassum K.M., Ostlund S.B., Balleine B.W., Maidment N.T. Differential dependence of Pavlovian incentive motivation and instrumental incentive learning processes on dopamine signaling. Learn. Mem. 2011, 18:475-483.
186. Winstanley C.A., Theobald D.E.H., Dalley J.W., Robbins T.W. Interactions between serotonin and dopamine in the control of impulsive choice in rats: therapeutic implications for impulse control disorders. Neuropsychopharmacology 2005, 30:669-682.
187. Wise R.A. Dopamine, learning and motivation. Nat. Rev. Neurosci. 2004, 5:483-494.
188. Wise R.A. Dopamine and reward: the anhedonia hypothesis 30 years on. Neurotox. Res. 2008, 14:169-183.
189. Wyvell C.L., Berridge K.C. Intra-accumbens amphetamine increases the conditioned incentive salience of sucrose reward: enhancement of reward "wanting" without enhanced "liking" or response reinforcement. J. Neurosci. 2000, 20:8122-8130.
190. Yin H.H., Knowlton B.J., Balleine B.W. Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. Eur. J. Neurosci. 2004, 19:181-189.
191. Yin H.H., Knowlton B.J., Balleine B.W. Blockade of NMDA receptors in the dorsomedial striatum prevents action-outcome learning in instrumental conditioning. Eur. J. Neurosci. 2005, 22:505-512.
192. Yin H.H., Ostlund S.B., Balleine B.W. Reward-guided learning beyond dopamine in the nucleus accumbens: the integrative functions of cortico-basal ganglia networks. Eur. J. Neurosci. 2008, 28:1437-1448.
193. Young P.T. Motivation and Emotion 1961, John Wiley and Sons, New York.
194. Young A.M. Increased extracellular dopamine in nucleus accumbens in response to unconditioned and conditioned aversive stimuli: studies using 1 min microdialysis in rats. J. Neurosci. Methods 2004, 138:57-63.
195. Zweifel L.S., Parker J.G., Lobb C.J., Rainwater A., Wall V.Z., Fadok J.P., Darvas M., Kim M.J., Mizumori S.J., Paladini C.A., et al. Disruption of NMDAR-dependent burst firing by dopamine neurons provides selective assessment of phasic dopamine-dependent behavior. Proc. Natl. Acad. Sci. USA 2009, 106:7281-7288.
196. Zweifel L.S., Fadok J.P., Argilli E., Garelick M.G., Jones G.L., Dickerson T.M., Allen J.M., Mizumori S.J., Bonci A., Palmiter R.D. Activation of dopamine neurons is critical for aversive conditioning and prevention of generalized anxiety. Nat. Neurosci. 2011, 14:620-626.