Serotonin and dopamine: Unifying affective, activational, and decision functions

Neuropsychopharmacology

Volumn 36, Issue 1, 2011, Pages 98-113

  Cools, Roshan ^a   Nakamura, Kae ^b,c   Daw, Nathaniel D ^d  

^a RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

^b KANSAI MEDICAL UNIVERSITY   (Japan)

^c JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

^d NEW YORK UNIVERSITY   (United States)

Author keywords

activation; aversion; impulsivity; inhibition; punishment; reward

Indexed keywords

DOPAMINE; SEROTONIN;

AFFECTIVE; AVERSION; BEHAVIOR; BEHAVIORAL ACTIVATION; CONTROLLED STUDY; DECISION MAKING; DOPAMINERGIC ACTIVITY; EMOTION; HUMAN; NERVOUS SYSTEM FUNCTION; NONHUMAN; PRIORITY JOURNAL; REINFORCEMENT; REVIEW; RISK ASSESSMENT; SEROTONINERGIC SYSTEM; TEMPORAL LOBE;

AFFECT; ANIMALS; AVOIDANCE LEARNING; BRAIN; BRAIN CHEMISTRY; DECISION MAKING; DOPAMINE; HUMANS; MODELS, NEUROLOGICAL; MOTIVATION; REWARD; SEROTONIN;

EID: 78649650717     PISSN: 0893133X     EISSN: None     Source Type: Journal    
DOI: 10.1038/npp.2010.121     Document Type: Review

References (177)

1. Aarts E, Roelofs A, Franke B, Rijpkema M, Fernandez G, Helmich RC et al (2010). Striatal dopamine mediates the interface between motivational and cognitive control in humans: evidence from genetic imaging. Neuropsychopharmacology 35: 1943-1951.
2. Alex KD, Pehek EA (2007). Pharmacologic mechanisms of serotonergic regulation of dopamine neurotransmission. Pharmacol Ther 113: 296-320.
3. Amat J, Baratta MV, Paul E, Bland ST, Watkins LR, Maier SF (2005). Medial prefrontal cortex determines how stressor controllability affects behavior and dorsal raphe nucleus. Nat Neurosci 8: 365-371.
4. Arbuthnott G, Wickens J (2007). Space, time and dopamine. Trends Neurosci 30: 62-69.
5. Artigas F (1993). 5-HT and antidepressants: new views from microdialysis studies. Trends Pharmacol Sci 14: 262.
6. Balleine B, Daw N, O'Doherty J (2008). Multiple forms of value learning and the function of dopamine. In: Glimcher P, Fehr E, Camerer C, Poldrack R (eds) Neuroeconomics: Decision-Making and the Brain. pp 367-385.
7. Balleine BW, O'Doherty JP (2010). Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsycho-pharmacology 35: 48-69.
8. Bari A, Eagle DM, Mar AC, Robinson ES, Robbins TW (2009). Dissociable effects of noradrenaline, dopamine, and serotonin uptake blockade on stop task performance in rats. Psychopharmacology (Berl) 205: 273-283.
9. Barton DA, Esler MD, Dawood T, Lambert EA, Haikerwal D, Brenchley C et al (2008). Elevated brain serotonin turnover in patients with depression: effect of genotype and therapy. Arch Gen Psychiatry 65: 38-46.
10. Bayer HM, Glimcher PW (2005). Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47: 129-141.
11. Berridge KC (2007). The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology (Berl) 191: 391-431.
12. Berridge KC, Robinson TE (1998). What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res Brain Res Rev 28: 309-369.
13. Bizot J, Le Bihan C, Puech AJ, Hamon M, Thiebot M (1999). Serotonin and tolerance to delay of reward in rats. Psychopharmacology (Berl) 146: 400-412.
14. Blier P, de Montigny C (1999). Serotonin and drug-induced therapeutic responses in major depression, obsessive-compulsive and panic disorders. Neuropsycho-pharmacology 21: 91S-98S.
15. Booij L, Van der Does AJ, Riedel WJ (2003). Monoamine depletion in psychiatric and healthy populations: review. Mol Psychiatry 8: 951-973.
16. Boulougouris V, Robbins T (2010). Enhancement of spatial reversal learning by 5-HT2c receptor antagonism is neuroanatomically specific. J Neurosci 30: 930-938.
17. Boureau Y-L, Dayan P (2010). Opponency revisited: competition and cooperation between dopamine and serotonin. Neuropsychopharmacology.
18. Brischoux F, Chakraborty S, Brierley DI, Ungless MA (2009). Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli. Proc Natl Acad Sci USA 106: 4894-4899.
19. Bromberg-Martin E, Hikosaka O, Nakamura K (2010). Coding of task reward value in the dorsal raphe nucleus. J Neurosci 30: 6262-6272.
20. Cardinal R, Winstanley C, Robbins T, Everitt B (2004). Limbic corticostriatal systems and delayed reinforcement. Ann NY Acad Sci 1021: 33-50.
21. Cardinal RN (2006). Neural systems implicated in delayed and probabilistic reinforcement. Neural Netw 19: 1277-1301.
22. Cardinal RN, Robbins TW, Everitt BJ (2000). The effects of d-amphetamine, chlordiazepoxide, alpha-flupenthixol and behavioural manipulations on choice of signalled and unsignalled delayed reinforcement in rats. Psychopharmacology (Berl) 152: 362-375.
23. Chamberlain SR, Muller U, Blackwell AD, Clark L, Robbins TW, Sahakian BJ (2006). Neurochemical modulation of response inhibition and probabilistic learning in humans. Science 311: 861-863.
24. Charrier D, Thiebot MH (1996). Effects of psychotropic drugs on rat responding in an operant paradigm involving choice between delayed reinforcers. Pharmacol Biochem Behav 54: 149-157.
25. Clark L, Chamberlain SR, Sahakian BJ (2009). Neurocognitive mechanisms in depression: implications for treatment. Annu Rev Neurosci 32: 57-74.
26. Clark L, Roiser JP, Cools R, Rubinsztein DC, Sahakian BJ, Robbins TW (2005). Stop signal response inhibition is not modulated by tryptophan depletion or the serotonin transporter polymorphism in healthy volunteers: implications for the 5-HT theory of impulsivity. Psychopharmacology (Berl) 182: 570-578.
27. Clarke H, Robbins T, Roberts AC (2008). Lesions of the medial striatum in monkeys produce perseverative impairments during reversal learning similar to those produced by lesions of the orbitofrontal cortex. J Neurosci 28: 10972-10982.
28. Clarke H, Dalley J, Crofts H, Robbins T, Roberts A (2004). Cognitive inflexibility after prefrontal serotonin depletion. Science 304: 878-880.
29. Clarke HF, Walker SC, Dalley JW, Robbins TW, Roberts AC (2007). Cognitive inflexibility after prefrontal serotonin depletion is behaviorally and neurochemically specific. Cereb Cortex 17: 18-27.
30. Clarke HF, Walker SC, Crofts HS, Dalley JW, Robbins TW, Roberts AC (2005). Prefrontal serotonin depletion affects reversal learning but not attentional set shifting. J Neurosci 25: 532-538.
31. Clatworthy PL, Lewis SJ, Brichard L, Hong YT, Izquierdo D, Clark L et al (2009). Dopamine release in dissociable striatal subregions predicts the different effects of oral methylphenidate on reversal learning and spatial working memory. J Neurosci 29: 4690-4696.
32. Cole BJ, Robbins TW (1987). Amphetamine impairs the discriminative performance of rats with dorsal noradrenergic bundle lesions on a 5-choice serial reaction time task: new evidence for central dopaminergic-noradrenergic interactions. Psychopharmacology (Berl) 91: 458-466.
33. Cools R (2006). Dopaminergic modulation of cognitive function- implications for L-DOPA treatment in Parkinson's disease. Neurosci Biobehav Rev 30: 1-23.
34. Cools R, Altamirano L, D'Esposito M (2006). Reversal learning in Parkinson's disease depends on medication status and outcome valence. Neuropsychologia 44: 1663-1673.
35. Cools R, Robinson O, Sahakian BJ (2008a). Acute tryptophan depletion in healthy volunteers enhances punishment prediction but does not affect reward prediction. Neuropsychopharmacology 33: 2291-2299.
36. Cools R, Roberts AC, Robbins TW (2008b). Serotoninergic regulation of emotional and behavioural control processes. Trends Cogn Sci 12: 31-40.
37. Cools R, Barker RA, Sahakian BJ, Robbins TW (2001). Enhanced or impaired cognitive function in Parkinson's disease as a function of dopaminergic medication and task demands. Cereb Cortex 11: 1136-1143.
38. Cools R, Blackwell A, Clark L, Menzies L, Cox S, Robbins TW (2005). Tryptophan depletion disrupts the motivational guidance of goal-directed behavior as a function of trait impulsivity. Neuropsychopharmacology 30: 1362-1373.
39. Cools R, Frank M, Gibbs S, Miyakawa A, Jagust W, D'Esposito M (2009). Striatal dopamine synthesis capacity predicts dopaminergic drug effects on flexible outcome learning. J Neurosci 29: 1538-1543.
40. Cowen PJ, Parry-Billings M, Newsholme EA (1989). Decreased plasma tryptophan levels in major depression. J Affect Disord 16: 27-31.
41. Cragg S, Rice M (2004). DAncing past the DAT at a DA synapse. Trends Neurosci 27: 270-277.
42. Crean J, Richards J, de Wit H (2002). Effect of tryptophan depletion on impulsive behavior in men with or without a family history of alcoholism. Behav Brain Res 136: 349-357.
43. Crockett MJ, Clark L, Robbins TW (2009). Reconciling the role of serotonin in behavioral inhibition and aversion: acute tryptophan depletion abolishes punishment-induced inhibition in humans. J Neurosci 29: 11993-11999.
44. D'Ardenne K, McClure SM, Nystrom LE, Cohen JD (2008). BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science 319: 1264-1267.
45. Dalley JW, Mar AC, Economidou D, Robbins TW (2008). Neurobehavioral mechanisms of impulsivity: fronto-striatal systems and functional neurochemistry. Pharmacol Biochem Behav 90: 250-260.
46. Dalley JW, Theobald DE, Eagle DM, Passetti F, Robbins TW (2002). Deficits in impulse control associated with tonically-elevated serotonergic function in rat prefrontal cortex. Neuropsychopharmacology 26: 716-728.
47. Daw N, Kakade S, Dayan P (2002). Opponent interactions between serotonin and dopamine. Neural Netw 15: 603-616.
48. Daw ND, Touretzky DS (2002). Long-term reward prediction in TD models of the dopamine system. Neural Comput 14: 2567-2583.
49. Day JJ, Roitman MF, Wightman RM, Carelli RM (2007). Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens. Nat Neurosci 10: 1020-1028.
50. Dayan P, Huys QJ (2008). Serotonin, inhibition, and negative mood. PLoS Comput Biol 4: e4.
51. De Wit H, Enggasser JL, Richards JB (2002). Acute administration of d-amphetamine decreases impulsivity in healthy volunteers. Neuropsychophar- macology 27: 813-825.
52. Deakin J (1983). Roles of serotonergic systems in escape, avoidance and other behaviours. In: Cooper S (ed). Theory in Psychopharmacology. Academic Press: London and New York.
53. Deakin J (1998). The role of serotonin in panic, anxiety and depression. Int Clin Psychopharmacol 13: S1-S5.
54. Deakin J, Graeff F (1991). 5-HT and mechanisms of defence. J Psychopharmacol 5: 305-315.
55. Delgado PL, Charney DS, Price LH, Aghajanian GK, Landis H, Heninger GR (1990). Serotonin function and the mechanism of antidepressant action. Reversal of antidepressant-induced remission by rapid depletion of plasma tryptophan. Arch Gen Psychiatry 47: 411-418.
56. Den Ouden H, Elshout J, Rijpkema M, Franke B, nandë z G, Cools R (2010). Dissociable effects of serotonin and dopamine transporter polymorphisms on probabilistic reversal learning. 7th Forum of European Neuroscience, 3-7 July 2010, Amsterdam.
57. Denk F, Walton ME, Jennings KA, Sharp T, Rushworth MF, Bannerman DM (2005). Differential involvement of serotonin and dopamine systems in cost-benefit decisions about delay or effort. Psychopharmacology (Berl) 179: 587-596.
58. Dodd ML, Klos KJ, Bower JH, Geda YE, Josephs KA, Ahlskog JE (2005). Pathological gambling caused by drugs used to treat Parkinson disease. Arch Neurol 62: 1377-1381.
59. Doya K (2002). Metalearning and neuromodulation. Neural Netw 15: 495-506.
60. Dray A, Gonye TJ, Oakley NR, Tanner Ti (1976). Evidence for the existence of a raphe projection to the substantia nigra in rat. Brain Res 113: 45-57.
61. Drevets W, Frank E, Price J, Kupfer D, Holt D, Greer P et al (1999). PET imaging of serotonin 1A receptor binding in depression. Biol Psychiatr 46: 1375-1387.
62. Eagle DM, Lehmann O, Theobald DE, Pena Y, Zakaria R, Ghosh R et al (2009). Serotonin depletion impairs waiting but not stop-signal reaction time in rats: implications for theories of the role of 5-HT in behavioral inhibition. Neuropsy-chopharmacology 34: 1311-1321.
63. Esher N, Roiser J (2010). Reward and punishment processing in depression. Biol Psychiatr 68: 118-124.
64. Evenden J (1999). Varieties of impulsivity. Psychopharmacology 146: 348-361.
65. Evenden JL, Robbins TW (1984). Effects of unilateral 6-hydroxydopamine lesions of the caudate-putamen on skilled forepaw use in the rat. Behav Brain Res 14: 61-68.
66. Evenden JL, Ryan CN (1999). The pharmacology of impulsive behaviour in rats VI: the effects of ethanol and selective serotonergic drugs on response choice with varying delays of reinforcement. Psychopharmacology (Berl) 146: 413-421.
67. Evers EA, Van der Veen FM, Van Deursen JA, Schmitt JA, Deutz NE, Jolles J (2006). The effect of acute tryptophan depletion on the BOLD response during performance monitoring and response inhibition in healthy male volunteers. Psychopharmacology (Berl) 187: 200-208.
68. Evers EA, Cools R, Clark L, Van der Veen FM, Jolles J, Sahakian BJ et al (2005). Serotonergic modulation of prefrontal cortex during negative feedback in probabilistic reversal learning. Neuropsychopharmacology 30: 1138-1147.
69. Fields HL, Hjelmstad GO, Margolis EB, Nicola SM (2007). Ventral tegmental area neurons in learned appetitive behavior and positive reinforcement. Annu Rev Neurosci 30: 289-316.
70. Floresco SB, West AR, Ash B, Moore H, Grace AA (2003). Afferent modulation of dopamine neuron firing differentially regulates tonic and phasic dopamine transmission. Nat Neurosci 6: 968-973.
71. Frank MJ (2005). Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and nonmedi-cated Parkinsonism. J Cogn Neurosci 17: 51-72.
72. Frank MJ, Seeberger LC, O'Reilly RC (2004). By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 306: 1940-1943.
73. Gallistel CR, Stellar JR, Bubis E (1974). Parametric analysis of brain stimulation reward in the rat: I. The transient process and the memory-containing process. J Comp Physiol Psychol 87: 848-859.
74. Garris P, Christensen J, Rebec G, Wightman R (1997). Real-time measurement of electrically evoked extracellular dopamine in the striatum of freely moving rats. J Neurochem 68: 152-161.
75. Geisler S, Wise RA (2008). Functional implications of glutamatergic projections to the ventral tegmental area. Rev Neurosci 19: 227-244.
76. Geisler S, Derst C, Veh RW, Zahm DS (2007). Glutamatergic afferents of the ventral tegmental area in the rat. J Neurosci 27: 5730-5743.
77. Gervais J, Rouillard C (2000). Dorsal raphe stimulation differentially modulates dopaminergic neurons in the ventral tegmental area and substantia nigra. Synapse 35: 281-291.
78. Grace AA (1991). Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: a hypothesis for the ethiology of schizophrenia. Neuroscience 41: 1-24.
79. Haber SN, Fudge JL, McFarland NR (2000). Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. J Neurosci 20: 2369-2382.
80. Harrison A, Everitt BL, Robbins TW (1997a). Central 5-HT depletion enhances impulsive responding without affecting the accuracy of attentional performance: interactions with dopaminergic mechanisms. Psychopharmacology 133: 329-342.
81. Harrison A, Everitt BL, Robbins TW (1997b). Double dissociable effects of median-and dorsal-raphe lesions on the performance of the five-choice serial reaction time test of attention in rats. Behav Brain Res 89: 135-149.
82. Harrison AA, Everitt BJ, Robbins TW (1999). Central serotonin depletion impairs both the acquisition and performance of a symmetrically reinforced go/no-go conditional visual discrimination. Behav Brain Res 100: 99-112.
83. Hashemi P, Dankoski E, Petrovic J, Keithley R, Wightmann R (2009). Voltammetric detection of 5-hydroxytryptamine release in the rat brain. Anal Chem 81: 9462-9471.
84. Hikosaka O (2010). The habenula: from stress evasion to value-based decision-making. Nat Rev Neurosci 11: 503-513.
85. Hikosaka O, Sesack SR, Lecourtier L, PD S (2008). Habenula: crossroad between the basal ganglia and the limbic system. J Neurosci 28: 11825-11829.
86. Hill R (1970). Facilitation of conditioned reinforcement as a mechanism of psychomotor stimulation. In: Costa E, Garratini S (eds). Amphetamines and Related Compounds. Raven Press: New York. pp 781-795.
87. Hollander E, Rosen J (2000). Impulsivity. J Psychopharmacol 14: S39-S44.
88. Hollerman JR, Schultz W (1998). Dopamine neurons report an error in the temporal prediction of reward during learning. Nat Neurosci 1: 304-309.
89. Homberg JR, Pattij T, Janssen MC, Ronken E, De Boer SF, Schoffelmeer AN et al (2007). Serotonin transporter deficiency in rats improves inhibitory control but not behavioural flexibility. Eur J Neurosci 26: 2066-2073.
90. Houk J, Adams J, Barto A (1995). A model of how the basal ganglia generate and predict reinforcement. In: Houk J, Davis J, Beiser D (eds). Models Processing in the Basal Ganglia. MIT Press: Cambridge, MA. pp 249-270.
91. Ikemoto S, Panksepp J (1999). The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking. Brain Res Brain Res Rev 31: 6-41.
92. Jacobs BL, Fornal CA (1993). 5-HT and motor control: a hypothesis. Trends Neurosci 16: 346-352.
93. Kahneman D, Tversky A (1979). Prospect theory: an analysis of decision under risk. Econometrica 47: 263-292.
94. Kehagia AA, Murray GK, Robbins TW (2010). Learning and cognitive flexibility: frontostriatal function and monoaminergic modulation. Curr Opin Neurobiol 20: 199-204.
95. Kranz GS, Kasper S, Lanzenberger R (2010). Reward and the serotonergic system. Neuroscience 166: 1023-1035.
96. Kuczenski R, Segal DS, Leith NJ, Applegate CD (1987). Effects of amphetamine, methylphenidate, and apomorphine on regional brain serotonin and 5-hydro-xyindole acetic acid. Psychopharmacology (Berl) 93: 329-335.
97. Kuhnen C, Chiao J (2009). Genetic determinants of financial risk taking. PLoS One 4: e4362.
98. Lattal K (1987). Considerations in the experimental analysis of reinforcement delay. In: Commons M (ed). Quantitative Analyses of Behavior. V. The Effect of Delay and of Intervening Events on Reinforcement Value. Lawrence Erlbaum: Hillsdale, NJ. pp 107-123.
99. LeMarquand D, Benkelfat C, Pihl R, Palmour R, Young S (1999). Behavioral disinhibition induced by tryptophan depletion in nonalcoholic young men with multigenerational family histories of paternal alcoholism. Am J Psychiatr 156: 1771-1779.
100. Leyton M, Okazawa H, Diksic M, Paris J, Rosa P, Mzengeza S et al (2001). Brain Regional alpha-[11C]methyl-L-tryptophan trapping in impulsive subjects with borderline personality disorder. Am J Psychiatry 158: 775-782.
101. Linnoila M, Virkkunen M, Scheinin M, Nuutila A, Rimon R, Goodwin F (1983). Low cerebrospinal fluid 5-hydroxyindoleacetic acid concentration differentiates impulsive from nonimpulsive violent behavior. Life Sci 33: 2609-2614.
102. Linnoila V, Virkkunen M (1992). Aggression, suicidality, and serotonin. J Clin Psychiatry 53: 46-51.
103. Ljungberg T, Apicella P, Schultz W (1991). Responses of monkey midbrain dopamine neurons during delayed alternation performance. Brain Res 567: 337-341.
104. Logue AW, Tobin H, Chelonis JJ, Wang RY, Geary N, Schachter S (1992). Cocaine decreases self-control in rats: a preliminary report. Psychopharmacology (Berl) 109: 245-247.
105. Long AB, Kuhn CM, Platt ML (2009). Serotonin shapes risky decision making in monkeys. Soc Cogn Affect Neurosci 4: 346-356.
106. Lorens SA (1978). Some behavioral effects of serotonin depletion depend on method: a comparison of 5,7-dihydroxytryptamine, p-chlorophenylalanine, p-choloroamphetamine, and electrolytic raphe lesions. Ann NY Acad Sci 305: 532-555.
107. Lyon M, Robbins TW (1975). The action of central nervous system stimulant drugs: a general theory concerning amphetamine effects. In: Essman W (ed). Current Developments in Psychopharmacology. Spectrum: New York. pp 79-163.
108. Maia TV (2010). Two-factor theory, the actor-critic model, and conditioned avoidance. Learn Behav 38: 50-67.
109. Matsumoto M, Hikosaka O (2009). Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459: 837-841.
110. McClure S, Berns G, Montague P (2003). Temporal prediction errors in a passive learning task activate human striatum. Neuron 38: 339-346.
111. Milner P (1977). Theories of drive, reinforcement and motivation. In: Iversen L, Iversen S, Snyder S (eds). Handbook of Psychopharmacology. Plenum Press: New York, pp 181-200.
112. Mink JW (1996). The basal ganglia: focused selection and inhibition of competing motor programs. Prog Neurobiol 50: 381-425.
113. Mobini S, Chiang T-J, Ho M-Y, Bradshaw CM, Szabadi E (2000). Effects of central 5-hydroxytrytamine depletion on sensitivity to delayed and probabilistic reinforcement. Psychopharmacology 152: 390-397.
114. Mogenson GJ, Jones DL, Yim CY (1980). From motivation to action: functional interface between the limbic system and the motor system. Prog Neurobiol 14: 69-97.
115. Montague P, Dayan P, Sejnowski T (1996). A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16: 1936-1947.
116. Montague PR, Hyman SE, Cohen JD (2004). Computational roles for dopamine in behavioural control. Nature 431: 760-767.
117. Morris G, Nevet A, Arkadir D, Vaadia E, Bergman H (2006). Midbrain dopamine neurons encode decisions for future action. Nat Neurosci 9: 1057-1063.
118. Murphy FC, Smith K, Cowen P, Robbins TW, Sahakian BJ (2002). The effects of tryptophan depletion on cognitive and affective processing in healthy volunteers. Psychopharmacology 163: 42-53.
119. Murphy SE, Longhitano C, Ayres RE, Cowen PJ, Harmer CJ, Rogers RD (2009). The role of serotonin in nonnormative risky choice: the effects of tryptophan supplements on the 'reflection effect' in healthy adult volunteers. J Cogn Neurosci 21: 1709-1719.
120. Nakamura K, Matsumoto M, Hikosaka O (2008). Reward-dependent modulation of neuronal activity in the primate dorsal raphe nucleus. J Neurosci 28: 5331-5343.
121. Nauta HJ (1979). A proposed conceptual reorganization of the basal ganglia and telencephalon. Neuroscience 4: 1875-1881.
122. Nauta WJ (1982). Limbic innervation of the striatum. Adv Neurol 35: 41-47.
123. Niv Y, Daw ND, Joel D, Dayan P (2007). Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology (Berl) 191: 507-520.
124. O'Doherty J, Dayan P, Friston K, Critchley H, Dolan R (2003). Temporal difference models and reward-related learning in the human brain. Neuron 38: 329-337.
125. O'Reilly RC, Frank MJ (2006). Making working memory work: a computational model of learning in the prefrontal cortex and basal ganglia. Neural Comput 18: 283-328.
126. Pattij T, Vanderschuren LJ (2008). The neuropharmacology of impulsive behaviour. Trends Pharmacol Sci 29: 192-199.
127. Pessiglione M, Seymour B, Flandin G, Dolan RJ, Frith CD (2006). Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature 442: 1042-1045.
128. Phillips P, Stuber G, Heien M, Wightman R, Carelli R (2003). Subsecond dopamine release promotes cocaine seeking. Nature 422: 614-618.
129. Post T, Van den Assem M, Baltussen G, Thaler R (2008). Deal or no deal? Decision making under risk in a large-payoff game show. Am Econ Rev 98: 38-71.
130. Poulos CX, Parker JL, Le AD (1996). Dexfenfluramine and 8-OH-DPAT modulate impulsivity in a delay-of-reward paradigm: implications for a correspondence with alcohol consumption. Behav Pharmacol 7: 395-399.
131. Puumala T, Sirvio J (1998). Changes in activities of dopamine and serotonin systems in the frontal cortex underlie poor choice accuracy and impulsivity of rats in an attention task. Neuroscience 83: 489-499.
132. Ranade SP, Mainen ZF (2009). Transient firing of dorsal raphe neurons encodes diverse and specific sensory, motor, and reward events. J Neurophysiol 102: 3026-3037.
133. Robbins T (1976). Relationship between reward-enhancing and stereotypical effects of psychomotor stimulant drugs. Nature 264: 57-59.
134. Robbins TW (2007). Shifting and stopping: fronto-striatal substrates, neurochemical modulation and clinical implications. Philos Trans R Soc Lond B Biol Sci 362: 917-932.
135. Robbins TW, Sahakian BJ (1979). Paradoxical effects of psychomotor stimulant drugs in hyperactive children from the standpoint fo behavioural pharmacology. Neuropharmacology 18: 931-950.
136. Robbins TW, Everitt BJ (1982). Functional studies of the central catecholamines. Int Rev Neurobiol 23: 303-365.
137. Robbins TW, Everitt BJ (1992). Functions of dopamine in the dorsal and ventral striatum. Semin Neurosci 4: 119-127.
138. Robbins TW, Everitt BJ (2007). A role for mesencephalic dopamine in activation: commentary on Berridge (2006). Psychopharmacology (Berl) 191: 433-437.
139. Robinson OJ, Sahakian BJ (2008). Recurrence in major depressive disorder: a neurocognitive perspective. Psychol Med 38: 315-318.
140. Robinson OJ, Sahakian BJ (2009). A double dissociation in the roles of serotonin and mood in healthy subjects. Biol Psychiatry 65: 89-92.
141. Rogers RD, Blackshaw AJ, Middleton HC, Matthews K, Hawtin K, Crowley C et al (1999). Tryptophan depletion impairs stimulus-reward learning while methylphe-nidate disrupts attentional control in healthy young adults: implications for the monoaminergic basis of impulsive behaviour. Psychopharmacology 146: 482-491.
142. Roitman MF, Wheeler RA, Wightman RM, Carelli RM (2008). Real-time chemical responses in the nucleus accumbens differentiate rewarding and aversive stimuli. Nat Neurosci 11: 1376-1377.
143. Rubia K, Lee F, Cleare AJ, Tunstall N, Fu CH, Brammer M et al (2005). Tryptophan depletion reduces right inferior prefrontal activation during response inhibition in fast, event-related fMRI. Psychopharmacology (Berl) 179: 791-803.
144. Ruhe HG, Mason NS, Schene AH (2007). Mood is indirectly related to serotonin, norepinephrine and dopamine levels in humans: a meta-analysis of monoamine depletion studies. Mol Psychiatry 12: 331-359.
145. Salamone JD, Correa M, Farrar A, Mingote SM (2007). Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychophar-macology (Berl) 191: 461-482.
146. Samejima K, Ueda Y, Doya K, Kimura M (2005). Representation of action-specific reward values in the striatum. Science 310: 1337-1340.
147. Schultz W (2007). Multiple dopamine functions at different time courses. Annu Rev Neurosci 30: 259-288.
148. Schultz W, Dayan P, Montague PR (1997). A neural substrate of prediction and reward. Science 275: 1593-1599.
149. Schweighofer N, Bertin M, Shishida K, Okamoto Y, Tanaka SC, Yamawaki S et al (2008). Low-serotonin levels increase delayed reward discounting in humans. J Neurosci 28: 4528-4532.
150. Smith KA, Fairburn CG, Cowen PJ (1997). Relapse of depression after rapid depletion of tryptophan. Lancet 349: 915-919.
151. Sombers LA, Beyene M, Carelli RM, Wightman RM (2009). Synaptic overflow of dopamine in the nucleus accumbens arises from neuronal activity in the ventral tegmental area. J Neurosci 29: 1735-1742.
152. Soubrié P (1986). Reconciling the role of central serotonin neurons in human and animal behavior. Behav Brain Sci 9: 319-362.
153. Staley JK, Malison RT, Innis RB (1998). Imaging of the serotonergic system: interactions of neuroanatomical and functional abnormalities of depression. Biol Psychiatry 44: 534-549.
154. Sutton R, Barto A (1990). Time-derivative models of Pavlovian reinforcement. In: Gabriel M, More J (eds). Learning and Computational Neuroscience: Foundations of Adaptive Networks. MIT Press: Cambridge, MA, pp 497-537.
155. Sutton R, Barto A (1998). Reinforcement learning. MIT Press: Cambridge, MA.
156. Takase LF, Nogueira MI, Baratta M, Bland ST, Watkins LR, Maier SF et al (2004). Inescapable shock activates serotonergic neurons in all raphe nuclei of rat. Behav Brain Res 153: 233-239.
157. Tanaka S, Schweighofer N, Asahi S, Shishida K, Okamoto Y, Yarnawaki S et al (2007). Serotonin differentially regulates short- and long-term prediction of rewards in the ventral and dorsal striatum. PLoS One 2: e1333.
158. Tanaka SC, Shishida K, Schweighofer N, Okamoto Y, Yamawaki S, Doya K (2009). Serotonin affects association of aversive outcomes to past actions. J Neurosci 29: 15669-15674.
159. Todd M, Niv Y, Cohen J (2008). Learning to use working memory in partially observable environments through dopaminergic reinforcement. In: Daphne K, Yoshua B, Dale S, Leon Bottou, Aron C (eds) Twenty-First Annual Conference on Neural Information Processing Systems (NIPS) 2008. Vancouver: Canada.
160. Tops M, Russo S, Boksem MA, Tucker DM (2009). Serotonin: modulator of a drive to withdraw. Brain Cogn 71: 427-436.
161. Trent F, Tepper JM (1991). Dorsal raphe stimulation modifies striatal-evoked antidromic invasion of nigral dopaminergic neurons in vivo. Exp Brain Res 84: 620-630.
162. Tsai CT (1989). Involvement of serotonin in mediation of inhibition of substantia nigra neurons by noxious stimuli. Brain Res Bull 23: 121-127.
163. Tsai HC, Z hang F, Adamantidis A, Stuber GD, Bonci A, de Lecea L et al (2009). Phasic firing in dopaminergic neurons is sufficient for behavioral conditioning. Science 324: 1080-1084.
164. Ungerstedt U (1971). Stereotaxic mapping of the monoamine pathways in the rat brain. Acta Physiol Scand (Suppl) 367: 1-48.
165. Ungless M, Magill P, Bolam J (2004). Uniform inhibition of dopamine neurons in the ventral tegmental area by aversive stimuli. Science 303: 2040-2042.
166. Van Gaalen M, Van Koten R, Schoffelmeer A, Vanderschuren L (2006). Critical involvement of dopaminergic neurotransmission in impulsive decision making. Biol Psychiatr 60: 66-73.
167. Wade TR, de Wit H, Richards JB (2000). Effects of dopaminergic drugs on delayed reward as a measure of impulsive behavior in rats. Psychopharmacology (Berl) 150: 90-101.
168. Waelti P, Dickinson A, Schultz W (2001). Dopamine responses comply with basic assumptions of formal learning theory. Nature 412: 43-48.
169. Walker SC, Robbins TW, Roberts AC (2009). Response disengagement on a spatial self-ordered sequencing task: effects of regionally selective excitotoxic lesions and serotonin depletion within the prefrontal cortex. J Neurosci 29: 6033-6041.
170. Walker SC, Mikheenko Y, Argyle L, Robbins T, Roberts A (2006). Selective prefrontal serotonin depletion impairs acquisition of a detour-reaching task. Eur J Neurosci 23: 3119-3123.
171. Ward BO, Wilkinson LS, Robbins TW, Everitt BJ (1999). Forebrain serotonin depletion facilitates the acquisition and performance of a conditional visual discrimination task in rats. Behav Brain Res 100: 51-65.
172. Winstanley C, Dalley J, Theobald D, Robbins T (2003). Global 5-HT depletion attenuates the ability of amphetamine to decrease impulsive choice on a delay-discounting task in rats. Psychopharmacology 170: 320-331.
173. Winstanley CA, Eagle DM, Robbins TW (2006a). Behavioral models of impulsivity in relation to ADHD: translation between clinical and preclinical studies. Clin Psychol Rev 26: 379-395.
174. Winstanley CA, Theobald DE, Dalley JW, Cardinal RN, Robbins TW (2006b). Double dissociation between serotonergic and dopaminergic modulation of medial prefrontal and orbitofrontal cortex during a test of impulsive choice. Cereb Cortex 16: 106-114.
175. Wise RA (2004). Dopamine, learning and motivation. Nat Rev Neurosci 5: 483-494.
176. Wogar M, Bradshaw C, Szabadi E (1993). Does the effect of central 5-hydroxytryptamine depletion on timing depend on motivational change? Psychopharmacology 112: 86-92.
177. Zaghloul KA, Blanco JA, Weidemann CT, McGill K, Jaggi JL, Baltuch GH et al (2009). Human substantia nigra neurons encode unexpected financial rewards. Science 323: 1496-1499.