Dopamine modulates reward-related vigor

Neuropsychopharmacology

Volumn 38, Issue 8, 2013, Pages 1495-1503

  Beierholm, Ulrik ^a   Guitart Masip, Marc ^b   Economides, Marcos ^b   Chowdhury, Rumana ^b,c   Düzel, Emrah ^c   Dolan, Ray ^b   Dayan, Peter ^d  

^a UNIVERSITY OF BIRMINGHAM   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c UNIVERSITY COLLEGE LONDON   (United Kingdom)

^d UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Cognition; dopamine; psychopharmacology; reinforcement learning; reward learning; vigor

Indexed keywords

CITALOPRAM; DOPAMINE; LEVODOPA; PLACEBO; SEROTONIN;

ADOLESCENT; ADULT; ARTICLE; CONTROLLED STUDY; DOPAMINE BRAIN LEVEL; DOUBLE BLIND PROCEDURE; FEMALE; HUMAN; LEARNING; MALE; NEUROMODULATION; NORMAL HUMAN; POSTSYNAPTIC POTENTIAL; PRIORITY JOURNAL; RANDOMIZED CONTROLLED TRIAL; RESPONSE TIME; REWARD; SIGNAL TRANSDUCTION;

ADOLESCENT; ADULT; CITALOPRAM; DOPAMINE; DOUBLE-BLIND METHOD; FEMALE; HUMANS; LEVODOPA; MALE; MOTIVATION; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; REACTION TIME; REWARD; YOUNG ADULT;

EID: 84879422305     PISSN: 0893133X     EISSN: 1740634X     Source Type: Journal    
DOI: 10.1038/npp.2013.48     Document Type: Article

References (54)

1. Aberman JE, Salamone JD (1999). Nucleus accumbens dopamine depletions make rats more sensitive to high ratio requirements but do not impair primary food reinforcement. Neuroscience 92: 545-552. (Pubitemid 29268042)
2. Artigas F, Romero L, de Montigny C, Blier P (1996). Acceleration of the effect of selected antidepressant drugs in major depression by 5-HT1A antagonists. Trends Neurosci 19: 378-383. (Pubitemid 26270513)
3. Balleine B (2005). Neural bases of food-seeking: Affect arousal and reward in corticostriatolimbic circuits. Physiol Behav 86: 717-730. (Pubitemid 41741866)
4. Bari A, Theobald DE, Caprioli D, Mar AC, Aidoo-Micah A, Dalley JW et al (2010). Serotonin modulates sensitivity to reward and negative feedback in a probabilistic reversal learning task in rats. Neuropsychopharmacology 35: 1290-1301.
5. Boureau Y-L, Dayan P (2011). Opponency revisited: competition and cooperation between dopamine and serotonin. Neuropsy-chopharmacology 36: 74-97.
6. Breland K, Breland M (1961). The misbehavior of organisms. Am Psychol 16: 681-684.
7. Cools R (2006). Dopaminergic modulation of cognitive function- implications for L-DOPA treatment in Parkinson's disease. Neurosci Biobehav Rev 30: 1-23. (Pubitemid 41779404)
8. Cools R, Blackwell A, Clark L, Menzies L, Cox S, Robbins TW (2005). Tryptophan depletion disrupts the motivational guidance of goal-directed behavior as a function of trait impulsivity. Neuropsychopharmacology 30: 1362-1373. (Pubitemid 40848090)
9. Cools R, Nakamura K, Daw ND (2011). Serotonin and dopamine: unifying affective, activational, and decision functions. Neurop-sychopharmacology 36: 98-113.
10. Correa M, Carlson BB, Wisniecki A, Salamone JD (2002). Nucleus accumbens dopamine and work requirements on interval schedules. Behavl Brain Res 137: 179-187. (Pubitemid 35346436)
11. Crockett MJ, Clark L, Apergis-Schoute AM, Morein-Zamir S, Robbins TW (2012). Serotonin modulates the effects of Pavlovian aversive predictions on response vigor. Neuropsycho-pharmacology 37: 2244-2252.
12. Crockett MJ, Clark L, Robbins TW (2009). Reconciling the role of serotonin in behavioral inhibition and aversion: acute trypto-phan depletion abolishes punishment-induced inhibition in humans. J Neurosci 29: 11993-11999.
13. Czoty PW, Riddick NV, Gage HD, Sandridge M, Nader SH, Garg S et al (2009). Effect of menstrual cycle phase on dopamine D2 receptor availability in female cynomolgus monkeys. Neuropsy-chopharmacology 34: 548-554.
14. Daw ND, Kakade S, Dayan P (2002). Opponent interactions between serotonin and dopamine. Neural Netw 15: 603-616. (Pubitemid 34951146)
15. Dayan P (2012). Instrumental vigour in punishment and reward. Eur J Neurosci 35: 1152-1168.
16. Deakin JF, Graeff FG (1991). 5-HT and mechanisms of defence. J Psychopharmacol 5: 305-315.
17. Evenden JL, Robbins TW (1983). Dissociable effects of d-amphe-tamine, chlordiazepoxide and alpha-flupenthixol on choice and rate measures of reinforcement in the rat. Psychopharmacology 79: 180-186. (Pubitemid 13192078)
18. Floresco SB, West AR, Ash B, Moore H, Grace AA (2003). Afferent modulation of dopamine neuron firing differentially regulates tonic and phasic dopamine transmission. Nat Neurosci 6: 968-973. (Pubitemid 37064759)
19. Gan JO, Walton ME, Phillips PEM (2010). Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine. Nature Neurosci 13: 25-27.
20. Grace AA (1991). Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: a hypothesis for the etiology of schizophrenia. Neuroscience 41: 1-24.
21. Guitart-Masip M, Beierholm U, Dolan R, Duzel E, Dayan P (2011). Vigor in the face of fluctuating rates of reward: an experimental examination. J Cogn Neurosci 23: 1-6.
22. Guitart-Masip M, Chowdhury R, Sharot T, Dayan P, Duzel E, Dolan RJ (2012a). Action controls dopaminergic enhancement of reward representations. Proc Natl Acad Sci USA 109: 7511-7516.
23. Guitart-Masip M, Huys QJM, Fuentemilla L, Dayan P, Duzel E, Dolan RJ (2012b). Go and no-go learning in reward and punishment: interactions between affect and effect. NeuroImage 62: 154-166.
24. Hajós M, Gartside SE, Sharp T (1995). Inhibition of median and dorsal raphe neurones following administration of the selective serotonin reuptake inhibitor paroxetine. Naunyn Schmiedebergs Arch Pharmacol 351: 624-629.
25. Huys QJM, Dayan P (2009). A Bayesian formulation of behavioral control. Cognition 113: 314-328.
26. Jacobs E, D'Esposito M (2011). Estrogen shapes dopamine-dependent cognitive processes: implications for women's health. J Neurosci 31: 5286-5293.
27. Knutson B, Adams CM, Fong GW, Hommer D (2001). Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J Neurosci 21: RC159.
28. Knutson B, Westdorp A, Kaiser E, Hommer D (2000). FMRI visualization of brain activity during a monetary incentive delay task. Neuroimage 12: 20-27. (Pubitemid 30602060)
29. Lex A, Hauber W (2008). Dopamine D1 and D2 receptors in the nucleus accumbens core and shell mediate Pavlovian-instru-mental transfer. Learn Mem 15: 483-491. (Pubitemid 352008670)
30. Mazzoni P, Hristova A, Krakauer JW (2007). Why don't we move faster? Parkinson's disease, movement vigor, and implicit motivation. J Neurosci 27: 7105-7116. (Pubitemid 47037561)
31. McCleary RA (1961). Response specificity in the behavioral effects of limbic system lesions in the cat. J Comp Physiol Psychol 54: 605-613.
32. Mingote S, Weber SM, Ishiwari K, Correa M, Salamone JD (2005). Ratio and time requirements on operant schedules: effort-related effects of nucleus accumbens dopamine depletions. Eur J Neurosci 21: 1749-1757. (Pubitemid 40646620)
33. Miyazaki K, Miyazaki KW, Doya K (2012). The role of serotonin in the regulation of patience and impulsivity. Mol Neurobiol 45: 213-224.
34. Niv Y, Daw ND, Joel D, Dayan P (2007). Tonic dopamine: opportunity costs and the control of response vigor. Psycho-pharmacology 191: 507-520. (Pubitemid 46355878)
35. Ossewaarde L, Wingen GA, van, Kooijman SC, Bäckström T, Fernández G, Hermans EJ (2011). Changes in functioning of mesolimbic incentive processing circuits during the premenstrual phase. Soc Cogn Affect Neurosci 6: 612-620.
36. Ostlund SB, Wassum KM, Murphy NP, Balleine BW, Maidment NT (2011). Extracellular dopamine levels in striatal subregions track shifts in motivation and response cost during instrumental conditioning. J Neurosci 31: 200-207.
37. Parkinson JA, Dalley JW, Cardinal RN, Bamford A, Fehnert B, Lachenal G et al (2002). Nucleus accumbens dopamine depletion impairs both acquisition and performance of appetitive Pavlo-vian approach behaviour: implications for mesoaccumbens dopamine function. Behav Brain Res 137: 149-163. (Pubitemid 35346434)
38. Salamone JD, Correa M (2002). Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine. Behav Brain Res 137: 3-25. (Pubitemid 35346426)
39. Salamone JD, Correa M (2012). The Mysterious Motivational Functions of Mesolimbic Dopamine. Neuron 76: 470-485.
40. Salamone JD, Steinpreis RE, McCullough LD, Smith P, Grebel D, Mahan K (1991). Haloperidol and nucleus accumbens dopamine depletion suppress lever pressing for food but increase free food consumption in a novel food choice procedure. Psychopharma-cology 104: 515-521.
41. Salamone JD, Wisniecki A, Carlson BB, Correa M (2001). Nucleus accumbens dopamine depletions make animals highly sensitive to high fixed ratio requirements but do not impair primary food reinforcement. Neuroscience 105: 863-870. (Pubitemid 32786799)
42. Satoh T, Nakai S, Sato T (2003). Correlated coding of motivation and outcome of decision by dopamine neurons. J Neurosci 23: 9913-9923. (Pubitemid 37371606)
43. Schultz W, Dayan P, Montague PR (1997). A neural substrate of prediction and reward. Science 275: 1593.
44. Segovia KN, Correa M, Salamone JD (2011). Slow phasic changes in nucleus accumbens dopamine release during fixed ratio acquisition: a microdialysis study. Neuroscience 196: 178-188.
45. Selvaraj S, Turkheimer F, Rosso L, Faulkner P, Mouchlianitis E, Roiser JP et al (2012). Measuring endogenous changes in serotonergic neurotransmission in humans: a [(11)C]CUMI-101 PET challenge study. Mol Psychiatry 17: 1254-1260.
46. Sokolowski JD, Conlan AN, Salamone JD (1998). A microdialysis study of nucleus accumbens core and shell dopamine during operant responding in the rat. Neuroscience 86: 1001-1009. (Pubitemid 28298754)
47. Sokolowski JD, Salamone JD (1994). Effects of dopamine depletions in the medial prefrontal cortex on DRL performance and motor activity in the rat. Brain Res 642: 20-28. (Pubitemid 24105685)
48. Soubrié P (1986). Reconciling the role of central serotonin neurons in human and animal behavior. Behav Brain Sci 9: 319-364.
49. Talmi D, Seymour B, Dayan P, Dolan RJ (2008). Human pavlovian- instrumental transfer. J Neurosci 28: 360-368.
50. Taylor JR, Robbins TW (1986). 6-Hydroxydopamine lesions of the nucleus accumbens, but not of the caudate nucleus, attenuate enhanced responding with reward-related stimuli produced by intra-accumbens d-amphetamine. Psychopharmacology 90: 390-397. (Pubitemid 16022477)
51. Ungerstedt U (1971). Adipsia and aphagia after 6-hydroxydopa-mine induced degeneration of the nigro-striatal dopamine system. Acta physiol Scand Suppl 367: 95-122.
52. Westerink B, Kwint H, deVries J (1996). The pharmacology of mesolimbic dopamine neurons: a dual-probe microdialysis study in the ventral tegmental area and nucleus accumbens of the rat brain. J Neurosci 16: 2605-2611. (Pubitemid 26124349)
53. Winkel J, van Maanen L, Ratcliff R, van der Schaaf ME, van Schouwenburg MR, Cools R et al (2012). Bromocriptine does not alter speed-accuracy tradeoff. Front Neurosci 6: 126.
54. Wittmann BC, Schott BH, Guderian S, Frey JU, Heinze H-J, Düzel E (2005). Reward-related FMRI activation of dopaminergic mid-brain is associated with enhanced hippocampus-dependent long-term memory formation. Neuron 45: 459-467. (Pubitemid 40188212)