The roles of dopamine and serotonin in decision making: Evidence from pharmacological experiments in humans

Neuropsychopharmacology

Volumn 36, Issue 1, 2011, Pages 114-132

  Rogers, Robert D ^a,b  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

choice; dopamine; psychiatry and behavioral sciences; serotonin; social; value

Indexed keywords

4 AMINOBUTYRIC ACID; AMPHETAMINE; CABERGOLINE; CANNABINOID; DOPAMINE; DOPAMINE 2 RECEPTOR; DOPAMINE 3 RECEPTOR; DOPAMINE RECEPTOR; DOPAMINE TRANSPORTER; HALOPERIDOL; METHYLPHENIDATE; PLACEBO; PRAMIPEXOLE; SEROTONIN; SEROTONIN UPTAKE INHIBITOR; TRYPTOPHAN;

ADDICTION; ATTENTION DEFICIT DISORDER; COGNITION; CORPUS STRIATUM; DECISION MAKING; DRUG RECEPTOR BINDING; FUNCTIONAL MAGNETIC RESONANCE IMAGING; GENOTYPE; HUMAN; LEARNING; NEUROPHYSIOLOGY; NONHUMAN; PARKINSON DISEASE; POSTSYNAPTIC POTENTIAL; PREFRONTAL CORTEX; PRESYNAPTIC POTENTIAL; PRIORITY JOURNAL; PROTEIN EXPRESSION; REINFORCEMENT; REVIEW; TASK PERFORMANCE;

AVOIDANCE LEARNING; BRAIN; BRAIN CHEMISTRY; COGNITION; DECISION MAKING; DOPAMINE; DOPAMINE AGENTS; HUMANS; NEUROPHARMACOLOGY; REINFORCEMENT (PSYCHOLOGY); SEROTONIN; SEROTONIN AGENTS;

EID: 78649667885     PISSN: 0893133X     EISSN: None     Source Type: Journal    
DOI: 10.1038/npp.2010.165     Document Type: Review

References (206)

1. Adinoff B, Rilling LM, Williams MJ, Schreffler E, Schepis TS, Rosvall T et al (2007). Impulsivity, neural deficits, and the addictions: the 'oops' factor in relapse. J Addict Dis 26(Suppl 1): 25-39.
2. Aronson SC, Black JE, McDougle CJ, Scanley BE, Jatlow P, Kosten TR et al (1995). Serotonergic mechanisms of cocaine effects in humans. Psychopharmacology (Berl) 119: 179-185.
3. Aston-Jones G, Cohen JD (2005). Adaptive gain and the role of the locus coeruleus- norepinephrine system in optimal performance. J Comp Neurol 493: 99-110.
4. Axelrod R, Hamilton WD (1981). The evolution of cooperation. Science 211: 1390-1396.
5. Balleine BW, O'Doherty JP (2010). Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsycho-pharmacology 35: 48-69.
6. Baumgartner T, Heinrichs M, Vonlanthen A, Fischbacher U, Fehr E (2008). Oxytocin shapes the neural circuitry of trust and trust adaptation in humans. Neuron 58: 639-650.
7. Bazanis E, Rogers RD, Dowson JH, Taylor P, Meux C, Staley C et al (2002). Neurocognitive deficits in decision-making and planning of patients with DSM-III-R borderline personality disorder. Psychol Med 32: 1395-1405.
8. Bechara A, Dolan S, Denburg N, Hindes A, Anderson SW, Nathan PE (2001). Decision-making deficits, linked to a dysfunctional ventromedial prefrontal cortex, revealed in alcohol and stimulant abusers. Neuropsychologia 39: 376-389.
9. Bechara A, Tranel D, Damasio H, Damasio AR (1996). Failure to respond autonomically to anticipated future outcomes following damage to prefrontal cortex. Cereb Cortex 6: 215-225.
10. Behrens TE, Hunt LT, Rushworth MF (2009). The computation of social behavior. Science 324: 1160-1164.
11. Berthet A, Porras G, Doudnikoff E, Stark H, Cador M, Bezard E et al (2009). Pharmacological analysis demonstrates dramatic alteration of D1 dopamine receptor neuronal distribution in the rat analog of L-DOPA-induced dyskinesia. J Neurosci 29: 4829-4835.
12. Besson M, Belin D, McNamara R, Theobald DE, Castel A, Beckett VL et al (2010). Dissociable control of impulsivity in rats by dopamine d2/3 receptors in the core and shell subregions of the nucleus accumbens. Neuropsychopharmacology 35: 560-569.
13. Blair KS, Finger E, Marsh AA, Morton J, Mondillo K, Buzas B et al (2008). The role of 5-HTTLPR in choosing the lesser of two evils, the better of two goods: examining the impact of 5-HTTLPR genotype and tryptophan depletion in object choice. Psychopharmacology (Berl) 196: 29-38.
14. Bolla KI, Eldreth DA, Matochik JA, Cadet JL (2004). Sex-related differences in a gambling task and its neurological correlates. Cereb Cortex 14: 1226-1232.
15. Booij L, Tremblay RE, Leyton M, Seguin JR, Vitaro F, Gravel P et al (2010). Brain serotonin synthesis in adult males characterized by physical aggression during childhood: a 21-year longitudinal study. PLoS One 5: e11255.
16. Brown GL, Goodwin FK, Ballenger JC, Goyer PF, Major LF (1979). Aggression in humans correlates with cerebrospinal fluid amine metabolites. Psychiatry Res 1: 131-139.
17. Camara E, Kramer UM, Cunillera T, Marco-Pallares J, Cucurell D, Nager W et al (2010). The effects of COMT (Va1108/158Met) and DRD4 (SNP -521) dopamine genotypes on brain activatlons related to valence and magnitude of rewards. Cereb Cortex 20: 1985-1996.
18. Campbell-Meiklejohn D, Wakeley J, Herber TV, Cook J, Scollo P, Kar Ray M et al Serotonin and dopamine play complementary roles in gambling to recover losses: Implications for pathological gambling. Neuropsychopharrnacology (in press).
19. Chamberlain SR, Muller U, Blackwell AD, Clark L, Robbins TW, Sahakian BJ (2006). Neurochemical modulation of response inhibition and probabilistic learning in humans. Science 311: 861-863.
20. Chandler RA, Wakeley J, Goodwin GM, Rogers RD (2009). Altered risk-aversion and risk-seeking behavior in bipolar disorder. Biol Psychiatry 66: 840-846.
21. Coccaro EF, Lee R, Kavoussi RJ (2010). Aggression, suicidality, and intermittent explosive disorder: serotonergic correlates in personality disorder and healthy control subjects. Neuropsychopharmacology 35: 435-444.
22. Cohen MX, Young J, Baek JM, Kessler C, Ranganath C (2005). Individual differences in extraversion and dopamine genetics predict neural reward responses. Brain Res Cogn Brain Res 25: 851-861.
23. Comings DE, Gonzalez N, Wu S, Gade R, Muhleman D, Saucier G et al (1999). Studies of the 48 bp repeat polymorphism of the DRD4 gene in impulsive, compulsive, addictive behaviors: Tourette syndrome, ADHD, pathological gambling, and substance abuse. Am J Med Genet 88: 358-368.
24. Cools R, Barker RA, Sahakian BJ, Robbins TW (2001). Enhanced or impaired cognitive function in Parkinson's disease as a function of dopaminergic medication and task demands. Cereb Cortex 11: 1136-1143.
25. Cools R, Barker RA, Sahakian BJ, Robbins TW (2003). -Dopa medication remediates cognitive inflexibility, but increases impulsivity in patients with Parkinson's disease. Neuropsychologia 41: 1431-1441.
26. Cools R, Frank MJ, Gibbs SE, Miyakawa A, Jagust W, D'Esposito M (2009). Striatal dopamine predicts outcome-specific reversal learning and its sensitivity to dopaminergic drug administration. J Neurosci 29: 1538-1543.
27. Cools R, Lewis SJ, Clark L, Barker RA, Robbins TW (2007). -DOPA disrupts activity in the nucleus accumbens during reversal learning in Parkinson's disease. Neuropsychopharmacology 32: 180-189.
28. Cools R, Nakamura K, Daw ND (2010). Serotonin and Dopamine: Unifying Affective, Activational, and Decision Functions. Neuropsychopharmacology.
29. Cools R, Roberts AC, Robbins TW (2008a). Serotoninergic regulation of emotional and behavioural control processes. Trends Cogn Sci 12: 31-40.
30. Cools R, Robinson OJ, Sahakian B (2008b). Acute tryptophan depletion in healthy volunteers enhances punishment prediction but does not affect reward prediction. Neuropsychopharmacology 33: 2291-2299.
31. Crockett MJ, Clark L, Lieberman MD, Tabibnla G, Robbins TWR (in press). Impulsive choice and altruistic punishment are correlated and increase in tandem with serotonin depletion. Emofion: Washington DC.
32. Crockett MJ, Clark L, Tabibnia G, Lieberman MD, Robbins TW (2008). Serotonin modulates behavioral reactions to unfairness. Science 320: 1739.
33. Cunningham K, Callahan P (1991). Monoamine reuptake inhibitors enhance the discriminative state induced by cocaine in the rat. Psychopharmacology (Berl) 104: 177-180.
34. D'Ardenne K, McClure SM, Nystrom LE, Cohen JD (2008). BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science 319: 1264-1267.
35. Da Rocha FF, Malloy-Diniz L, Lage NV, Romano-Silva MA, de Marco LA, Correa H (2008). Decision-making impairment is related to serotonin transporter promoter polymorphism in a sample of patients with obsessive-compulsive disorder. Behav Brain Res 195: 159-163.
36. Dagher A, Robbins TW (2009). Personality, addiction, dopamine: insights from Parkinson's disease. Neuron 61: 502-510.
37. Dalley JW, Fryer TD, Brichard L, Robinson ES, Theobald DE, Laane K et al (2007). Nucleus accumbens D2/3 receptors predict trait impulsivity and cocaine reinforcement. Science 315: 1267-1270.
38. Dalley JW, Theobald DE, Pereira EA, Li PM, Robbins TW (2002). Specific abnormalities in serotonin release in the prefrontal cortex of isolation-reared rats measured during behavioural performance of a task assessing visuospatial attention and impulsivity. Psychopharmacology (Berl) 164: 329-340.
39. Damasio AR (1994). Descarte's Error: Emotion, Reason and the Human Brain. Grosset/Putnam: New York.
40. David SP, Murthy NV, Rabiner EA, Munafo MR, Johnstone EC, Jacob R et al (2005). A functional genetic variation of the serotonin (5-HT) transporter affects 5-HT1A receptor binding in humans. J Neurosci 25: 2586-2590.
41. Daw ND, Kakade S, Dayan P (2002). Opponent interactions between serotonin and dopamine. Neural Netw 15: 603-616.
42. Dayan P, Huys QJ (2008). Serotonin, inhibition, and negative mood. PLoS Comput Biol 4: e4.
43. Dayan P, Yu AJ (2006). Phasic norepinephrine: a neural interrupt signal for unexpected events. Network 17: 335-350.
44. Deakin JF (1998). The role of serotonin in panic, anxiety and depression. Int Clin Psychopharmacol 13(Suppl 4): S1-S5.
45. Deakin JFW, Graeff FG (1991). 5-HT and mechanisms of defence. J Psychophar-macol 5: 305-315.
46. Denk F, Walton ME, Jennings KA, Sharp T, Rushworth MF, Bannerman DM (2005). Differential involvement of serotonin and dopamine systems in cost-benefit decisions about delay or effort. Psychopharmacology (Berl) 179: 587-596.
47. DeVito EE, Blackwell AD, Kent L, Ersche KD, Clark L, Salmond CH et al (2008). The effects of methylphenidate on decision making in attention-deficit/hyperactivity disorder. Biol Psychiatry 64: 636-639.
48. Dodd ML, Klos KJ, Bower JH, Geda YE, Josephs KA, Ahlskog JE (2005). Pathological gambling caused by drugs used to treat Parkinson disease. Arch Neurol 62: 1377-1381.
49. Dombrovski AY, Clark L, Siegle GJ, Butters MA, Ichikawa N, Sahakian BJ et al (2010). Reward/punishment reversal learning in older suicide attempters. Am J Psychiatry 167: 699-707.
50. Doya K (2008). Modulators of decision making. Nat Neurosci 11: 410-416.
51. Dreher JC, Kohn P, Kolachana B, Weinberger DR, Berman KF (2009). Variation in dopamine genes influences responsivity of the human reward system. Proc Natl Acad Sci USA 106: 617-622.
52. Duan J, Wainwright MS, Comeron JM, Saitou N, Sanders AR, Gelernter J et al (2003). Synonymous mutations in the human dopamine receptor D2 (DRD2) affect mRNA stability and synthesis of the receptor. Hum Mol Genet 12: 205-216.
53. Eisenegger C, Knoch D, Ebstein RP, Gianotti LR, Sandor PS, Fehr E (2010). Dopamine receptor D4 polymorphism predicts the effect of L-DOPA on gambling behavior. Biol Psychiatry 67: 702-706.
54. Emanuele E, Brondino N, Bertona M, Re S, Geroldi D (2008). Relationship between platelet serotonin content and rejections of unfair offers in the ultimatum game. Neurosci Lett 437: 158-161.
55. Ersche KD, Roiser JP, Robbins TW, Sahakian BJ (2008). Chronic cocaine but not chronic amphetamine use is associated with perseverative responding in humans. Psychopharmacology (Berl) 197: 421-431.
56. Everitt B, Robbins T (2005). Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nat Neurosci 8: 1481-1489.
57. Evers EA, Cools R, Clark L, Van der Veen FM, Jolles J, Sahakian BJ et al (2005). Serotonergic modulation of prefrontal cortex during negative feedback in probabilistic reversal learning. Neuropsychopharmacology 30: 1138-1147.
58. Fehr E (2009). Social preferences and the brain. In: Glimcher PW, Camerer C, Poldrack RA, Fehr E (eds). Neuroeconomics: Decision Making and the Brain. Elsevier Academic Press: New York.
59. Finger EC, Marsh AA, Buzas B, Kamel N, Rhodes R, Vythilingham M et al (2007). The impact of tryptophan depletion and 5-HTTLPR genotype on passive avoidance and response reversal instrumental learning tasks. Neuropsycho-pharmacology 32: 206-215.
60. Fletcher PJ, Korth KM, Chambers JW (1999). Selective destruction of brain serotonin neurons by 5,7-dihydroxytryptamine increases responding for a conditioned reward. Psychopharmacology (Berl) 147: 291-299.
61. Fletcher PJ, Ming ZH, Higgins GA (1993). Conditioned place preference induced by microinjection of 8-OH-DPAT into the dorsal or median raphe nucleus. Psychopharmacology (Berl) 113: 31-36.
62. Fletcher PJ, Tampakeras M, Yeomans JS (1995). Median raphe injections of 8-OH-DPAT lower frequency thresholds for lateral hypothalamic self-stimulation. Pharmacol Biochem Behav 52: 65-71.
63. Floresco SB, Tse MT, Ghods-Sharifi S (2008). Dopaminergic and glutamatergic regulation of effort- and delay-based decision making. Neuropsychopharmacol-ogy 33: 1966-1979.
64. Forbes EE, Brown SM, Kimak M, Ferrell RE, Manuck SB, Hariri AR (2009). Genetic variation in components of dopamine neurotransmission impacts ventral striatal reactivity associated with impulsivity. Mol Psychiatry 14: 60-70.
65. Frank MJ, Doll BB, Oas-Terpstra J, Moreno F (2009). Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation. Nat Neurosci 12: 1062-1068.
66. Frank MJ, Hutchison K (2009). Genetic contributions to avoidance-based decisions: striatal D2 receptor polymorphisms. Neuroscience 164: 131-140.
67. Frank MJ, Moustafa AA, Haughey HM, Curran T, Hutchison KE (2007a). Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning. Proc Natl Acad Sci USA 104: 16311-16316.
68. Frank MJ, O'Reilly RC (2006). A mechanistic account of striatal dopamine function in human cognition: psychopharmacological studies with cabergoline and haloperidol. Behav Neurosci 120: 497-517.
69. Frank MJ, Scheres A, Sherman SJ (2007b). Understanding decision-making deficits in neurological conditions: insights from models of natural action selection. Philos Trans R Soc Lond Ser B 362: 1641-1654.
70. Frank MJ, Seeberger LC, O'Reilly R C (2004). By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 306: 1940-1943.
71. Frith CD (2007). The social brain? Philos Trans R Soc Lond Ser B 362: 671-678.
72. Frith CD, Singer T (2008). The role of social cognition in decision making. Philos Trans R Soc Lond Ser B 363: 3875-3886.
73. Gan JO, Walton ME, Phillips PE (2010). Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine. Nat Neurosci 13: 25-27.
74. Glimcher PW, Camerer C, Poldrack RA, Fehr E (2008). Neuroeconomics: Decision Making and the Brain. Academic Press: New York.
75. Grace AA (1995). The tonic/phasic model of dopamine system regulation: its releVance for understanding how stimulant abuse can alter basal ganglia function. Drug Alcohol Depend 37: 111-129.
76. Guth W, Schmittberger R, Schwarze B (1982). An experimental-analysis of ultimatum bargaining. J Econ Behav Organ 3: 367-388.
77. Hamidovic A, Kang UJ, de Wit H (2008). Effects of low to moderate acute doses of pramipexole on impulsivity and cognition in healthy volunteers. J Clin Psychopharmacol 28: 45-51.
78. Hare TA, Camerer CF, Knoepfle DT, Rangel A (2010). Value computations in ventral medial prefrontal cortex during charitable decision making incorporate input from regions involved in social cognition. J Neurosci 30: 583-590.
79. Hare TA, O'Doherty J, Camerer CF, Schultz W, Rangel A (2008). Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J Neurosci 28: 5623-5630.
80. Hariri AR, Drabant EM, Munoz KE, Kolachana BS, Mattay VS, Egan MF et al (2005). A susceptibility gene for affective disorders and the response of the human amygdala. Arch Gen Psychiatry 62: 146-152.
81. Harmer CJ (2008). Serotonin and emotional processing: does it help explain antidepressant drug action? Neuropharmacology 55: 1023-1028.
82. Harmer CJ, Rogers RD, Tunbridge E, Cowen PJ, Goodwin GM (2003). Tryptophan depletion decreases the recognition of fear in female volunteers. Psychophar-macology (Berl) 167: 411-417.
83. Harmer CJ, Shelley NC, Cowen PJ, Goodwin GM (2004). Increased positive vs negative affective perception and memory in healthy volunteers following selective serotonin and norepinephrine reuptake inhibition. Am J Psychiatry 161: 1256-1263.
84. Harrison AA, Markou A (2001). Serotonergic manipulations both potentiate and reduce brain stimulation reward in rats: involvement of serotonin-1A receptors. J Pharmacol Exp Ther 297: 316-325.
85. Hauber W, Sommer S (2009). Prefrontostriatal circuitry regulates effort-related decision making. Cereb Cortex 19: 2240-2247.
86. Hollerman JR, Schultz W (1998). Dopamine neurons report an error in the temporal prediction of reward during learning. Nat Neurosci 1: 304-309.
87. Homberg JR, Van den Bos R, den Heijer E, Suer R, Cuppen E (2008). Serotonin transporter dosage modulates long-term decision-making in rat and human. Neuropharmacology 55: 80-84.
88. Jentsch JD, Olausson P, De La Garza II R, Taylor JR (2002). Impairments of reversal learning and response perseveration after repeated, intermittent cocaine administrations to monkeys. Neuropsychopharmacology 26: 183-190.
89. Jentsch JD, Taylor JR (1999). lmpulsivily resulting from frontmtrlatal dysfunction In drug abuse: implications for the control of behavior by reward-related stlmull. Psychopharmacology (Ber1) 146: 373-390.
90. Jocham G, Klein TA, Neumann J, von Cramon DY, Reuter M, Ullsperger M (2009). Dopamine DRD2 polymorphism alters reversal learning and associated neural activity. J Neurosci 29: 3695-3704.
91. Jollant F, Bellivier F, Leboyer M, Astruc B, Torres S, Verdier R et al (2005). Impaired decision making in suicide attempters. Am J Psychiatry 162: 304-310.
92. Juhasz G, Downey D, Hinvest N, Thomas E, Chase D, Toth ZG et al (2010). Risk-taking behavior in a gambling task associated with variations in the tryptophan hydroxylase 2 gene: releVance to psychiatric disorders. Neuropsychopharmacol-ogy 35: 1109-1119.
93. Kapur S, Remington G (1996). Serotonin-dopamine interaction and its releVance to schizophrenia. Am J Psychiatry 153: 466-476.
94. Kirkpatrick T, Joyce E, Milton J, Duggan C, Tyrer P, Rogers RD (2007). Altered emotional decision-making in prisoners with borderline personality disorder. J Person Disord 21: 243-261.
95. Kishida KT, King-Cosas B, Montague PR (2010). Neuroeconomic approaches to mental disorders. Neuron 67: 543-554.
96. Klein TA, Neumann J, Reuter M, Hennig J, von Cramon DY, Ullsperger M (2007). Genetically determined differences in learning from errors. Science 318: 1642-1645.
97. Kleven M, Koek W (1998). Discriminative stimulus properties of cocaine: enhancement by monoamine reuptake blockers. J Pharmacol Exp Ther 284: 1015-1025.
98. Knoch D, Pascual-Leone A, Meyer K, Treyer V, Fehr E (2006). Diminishing reciprocal fairness by disrupting the right prefrontal cortex. Science 314: 829-832.
99. Knutson B, Wimmer GE (2007). Splitting the difference: how does the brain code reward episodes? Ann N Y Acad Sci 1104: 54-69.
100. Knutson B, Wolkowitz OM, Cole SW, Chan T, Moore EA, Johnson RC et al (1998). Selective alteration of personality and social behavior by serotonergic intervention. Am J Psychiatry 155: 373-379.
101. Koenigs M, Tranel D (2007). Irrational economic decision-making after ventromedial prefrontal damage: evidence from the Ultimatum Game. J Neurosci 27: 951-956.
102. Krugel LK, Biele G, Mohr PN, Li SC, Heekeren HR (2009). Genetic variation in dopaminergic neuromodulation influences the ability to rapidly and flexibly adapt decisions. Proc Natl Acad Sci USA 106: 17951-17956.
103. Kuhnen CM, Chiao JY (2009). Genetic determinants of financial risk taking. PLoS One 4: e4362.
104. Lane SD, Cherek DR, Nouvion SO (2008). Modulation of human risky decision making by flunitrazepam. Psychopharmacology (Berl) 196: 177-188.
105. Lejuez CW, Read JP, Kahler CW, Richards JB, Ramsey SE, Stuart GL et al (2002). Evaluation of a behavioral measure of risk taking: the Balloon Analogue Risk Task (BART). J Exp Psychol Appl 8: 75-84.
106. Long AB, Kuhn CM, Platt ML (2009). Serotonin shapes risky decision making in monkeys. Soc Cogn Affect Neurosci 4: 346-356.
107. Lucki I, Harvey JA (1979). Increased sensitivity to D- and Lamphetamine action after midbrain raphe lesions as measured by locomotor activity. Neuropharmacology 18: 243-249.
108. Menon M, Jensen J, Vitcu I, Graff-Guerrero A, Crawley A, Smith MA et al (2007). Temporal difference modeling of the blood-oxygen level dependent response during aversive conditioning in humans: effects of dopaminergic modulation. Biol Psychiatry 62: 765-772.
109. Mitsis GD, Iannetti GD, Smart TS, Tracey I, Wise RG (2008). Regions of interest analysis in pharmacological fMRI: how do the definition criteria influence the inferred result? NeuroImage 40: 121-132.
110. Mobini S, Chiang TJ, Al-Ruwaitea AS, Ho MY, Bradshaw CM, Szabadi E (2000a). Effect of central 5-hydroxytryptamine depletion on inter-temporal choice: a quantitative analysis. Psychopharmacology (Berl) 149: 313-318.
111. Mobini S, Chiang TJ, Ho MY, Bradshaw CM, Szabadi E (2000b). Effects of central 5-hydroxytryptamine depletion on sensitivity to delayed and probabilistic reinforcement. Psychopharmacology (Berl) 152: 390-397.
112. Murphy FC, Rubinsztein JS, Michael A, Rogers RD, Robbins TW, Paykel ES et al (2001). Decision-making cognition in mania and depression. Psychol Med 31: 679-693.
113. Murphy SE, Longhitano C, Ayres RE, Cowen PJ, Harmer CJ, Rogers RD (2009). The role of serotonin in nonnormative risky choice: the effects of tryptophan supplements on the 'reflection effect' in healthy adult volunteers. J Cogn Neurosci 21: 1709-1719.
114. Nakamura K, Matsumoto M, Hikosaka O (2008). Reward-dependent modulation of neuronal activity in the primate dorsal raphe nucleus. J Neurosci 28: 5331-5343.
115. Newman JP, Widom CS, Nathan S (1985). Passive avoidance in syndromes of disinhibition: psychopathy and extraversion. J Person Soc Psychol 48: 1316-1327.
116. Nishizawa S, Benkelfat C, Young SN, Leyton M, Mzengeza S, de Montigny C et al (1997). Differences between males and females in rates of serotonin synthesis in human brain. Proc Natl Acad Sci USA 94: 5308-5313.
117. O'Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ (2004). Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304: 452-454.
118. O'Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ (2003). Temporal difference models and reward-related learning in the human brain. Neuron 38: 329-337.
119. O'Doherty JP, Hampton A, Kim H (2007). Model-based fMRI and its application to reward learning and decision making. Ann N Y Acad Sci 1104: 35-53.
120. Parrott AC (2004). MDMA (3,4-methylenedioxymethamphetamine) or ecstasy: the neuropsychobiological implications of taking it at dances and raves. Neuropsy-chobiology 50: 329-335.
121. Paulus MP, Hozack N, Frank L, Brown GG, Schuckit MA (2003). Decision making by methamphetamine-dependent subjects is associated with error-rate-independent decrease in prefrontal and parietal activation. Biol Psychiatry 53: 65-74.
122. Perretta JG, Pari G, Beninger RJ (2005). Effects of Parkinson disease on two putative nondeclarative learning tasks: probabilistic classification and gambling. Cogn Behav Neurol 18: 185-192.
123. Pessiglione M, Seymour B, Flandin G, Dolan RJ, Frith CD (2006). Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature 442: 1042-1045.
124. Phillips PE, Walton ME, Jhou TC (2007). Calculating utility: preclinical evidence for cost-benefit analysis by mesolimbic dopamine. Psychopharmacology (Berl) 191: 483-495.
125. Pizzagalli DA, Evins AE, Schetter EC, Frank MJ, Pajtas PE, Santesso DL et al (2008). Single dose of a dopamine agonist impairs reinforcement learning in humans: behavioral evidence from a laboratory-based measure of reward responsiveness. Psychopharmacology (Berl) 196: 221-232.
126. Rahman S, Robbins TW, Hodges JR, Mehta MA, Nestor PJ, Clark L et al (2006). Methylphenidate ('Ritalin') can ameliorate abnormal risk-taking behavior in the frontal variant of frontotemporal dementia. Neuropsychopharmacology 31: 651-658.
127. Rahman S, Sahakian BJ, Hodges JR, Rogers RD, Robbins TW (1999). Specific cognitive deficits in mild frontal variant frontotemporal dementia. Brain 122 (Part 8): 1469-1493.
128. Raleigh MJ, Brammer GL, Yuwiler A, Flannery JW, McGuire MT, Geller E (1980). Serotonergic influences on the social behavior of vervet monkeys (Cercopithecus aethiops sabaeus). Exp Neurol 68: 322-334.
129. Reist C, Mazzanti C, Vu R, Tran D, Goldman D (2001). Serotonin transporter promoter polymorphism is associated with attenuated prolactin response to fenfluramine. Am J Med Genet 105: 363-368.
130. Riba J, Kramer UM, Heldmann M, Richter S, Munte TF (2008). Dopamine agonist increases risk taking but blunts reward-related brain activity. PLoS One 3: e2479.
131. Richards JB, Zhang L, Mitchell SH, de Wit H (1999). Delay or probability discounting in a model of impulsive behavior: effect of alcohol. J Exp Anal Behav 71: 121-143.
132. Ritchie T, Noble EP (2003). Association of seven polymorphisms of the D2 dopamine receptor gene with brain receptor-binding characteristics. Neurochem Res 28: 73-82.
133. Robbins TW, Arnsten AF (2009). The neuropsychopharmacology of fronto-executive function: monoaminergic modulation. Annu Rev Neurosci 32: 267-287.
134. Roberts AC, De Salvia MA, Wilkinson LS, Collins P, Muir JL, Everitt BJ et al (1994). 6-Hydroxydopamine lesions of the prefrontal cortex in monkeys enhance performance on an analog of the Wisconsin Card Sort Test: possible interactions with subcortical dopamine. J Neurosci 14: 2531-2544.
135. Rogers R, Wakeley J, Robson P, Bhagwagar Z, Makela P (2007). The effects of low doses of delta-9 tetrahydrocannabinol on reinforcement processing in the risky decision-making of young healthy adults. Neuropsychopharmacology 32: 417-428.
136. Rogers RD, Blackshaw AJ, Middleton HC, Matthews K, Hawtin K, Crowley C et al (1999a). Tryptophan depletion impairs stimulus-reward learning while methyl-phenidate disrupts attentional control in healthy young adults: implications for the monoaminergic basis of impulsive behaviour. Psychopharmacology (Berl) 146: 482-491.
137. Rogers RD, Everitt BJ, Baldacchino A, Blackshaw AJ, Swainson R, Wynne K et al (1999b). Dissociable deficits in the decision-making cognition of chronic amphetamine abusers, opiate abusers, patients with focal damage to prefrontal cortex, and tryptophan-depleted normal volunteers: evidence for monoaminergic mechanisms. Neuropsychopharmacology 20: 322-339.
138. Rogers RD, Robbins TW (2001). Investigating the neurocognitive deficits associated with chronic drug misuse. Curr Opin Neurobiol 11: 250-257.
139. Rogers RD, Tunbridge EM, Bhagwagar Z, Drevets WC, Sahakian BJ, Carter CS (2003). Tryptophan depletion alters the decision-making of healthy volunteers through altered processing of reward cues. Neuropsychopharmacology 28: 153-162.
140. Roiser JP, de Martino B, Tan GC, Kumaran D, Seymour B, Wood NW et al (2009). A genetically mediated bias in decision making driven by failure of amygdala control. J Neurosci 29: 5985-5991.
141. Roiser JP, Rogers RD, Cook LJ, Sahakian BJ (2006). The effect of polymorphism at the serotonin transporter gene on decision-making, memory and executive function in ecstasy users and controls. Psychopharmacology (Berl) 188: 213-227.
142. Rowe JB, Hughes L, Ghosh BC, Eckstein D, Williams-Gray CH, Fallon S et al (2008). Parkinson's disease and dopaminergic therapyFdifferential effects on movement, reward and cognition. Brain 131: 2094-2105.
143. Rutledge RB, Lazzaro SC, Lau B, Myers CE, Gluck MA, Glimcher PW (2009). Dopaminergic drugs modulate learning rates and perseveration in Parkinson's patients in a dynamic foraging task. J Neurosci 29: 15104-15114.
144. Salamone J, Cousins M, Bucher S (1994). Anhedonia or anergia? Effects of haloperidol and nucleus accumbens dopamine depletion on instrumental response selection in a T-maze cost/benefit procedure. Behav Brain Res 65: 221-229.
145. Samuels ER, Hou RH, Langley RW, Szabadi E, Bradshaw CM (2006). Comparison of pramipexole and amisulpride on alertness, autonomic and endocrine functions in healthy volunteers. Psychopharmacology (Berl) 187: 498-510.
146. Sanfey AG, Rilling JK, Aronson JA, Nystrom LE, Cohen JD (2003). The neural basis of economic decision-making in the Ultimatum Game. Science 300: 1755-1758.
147. Santesso DL, Evins AE, Frank MJ, Schetter EC, Bogdan R, Pizzagalli DA (2009). Single dose of a dopamine agonist impairs reinforcement learning in humans: evidence from event-related potentials and computational modeling of striatal-cortical function. Hum Brain Mapp 30: 1963-1976.
148. Sasaki-Adams DM, Kelley AE (2001). Serotonin-dopamine interactions in the control of conditioned reinforcement and motor behavior. Neuropsychopharma- cology 25: 440-452.
149. Scarná A, McTavish S, Cowen P, Goodwin G, Rogers R (2005). The effects of a branched chain amino acid mixture supplemented with tryptophan on biochemical indices of neurotransmitter function and decision-making. Psychopharmacology (Berl) 179: 761-768.
150. Schlosser RG, Nenadic I, Wagner G, Zysset S, Koch K, Sauer H (2009). Dopaminergic modulation of brain systems subserving decision making under uncertainty: a study with fMRI and methylphenidate challenge. Synapse 63: 429-442.
151. Schultz W (2004). Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioural ecology. Curr Opin Neurobiol 14: 139-147.
152. Schultz W (2006). Behavioral theories and the neurophysiology of reward. Annu Rev Psychol 57: 87-115.
153. Schultz W (2007). Behavioral dopamine signals. Trends Neurosci 30: 203-210.
154. Schultz W, Preuschoff K, Camerer C, Hsu M, Fiorillo CD, Tobler PN et al (2008). Explicit neural signals reflecting reward uncertainty. Philos Trans R Soc Lond Ser B 363: 3801-3811.
155. Schweighofer N, Bertin M, Shishida K, Okamoto Y, Tanaka SC, Yamawaki S et al (2008). Low-serotonin levels increase delayed reward discounting in humans. J Neurosci 28: 4528-4532.
156. Schweighofer N, Tanaka SC, Doya K (2007). Serotonin and the evaluation of future rewards: theory, experiments, and possible neural mechanisms. Ann N Y Acad Sci 1104: 289-300.
157. Schweimer J, Hauber W (2006). Dopamine D1 receptors in the anterior cingulate cortex regulate effort-based decision making. Learn Mem (Cold Spring Harbor, NY) 13: 777-782.
158. Segal M (1976). 5-HT antagonists in rat hippocampus. Brain Res 103: 161-166.
159. Sevy S, Hassoun Y, Bechara A, Yechiam E, Napolitano B, Burdick K et al (2006). Emotion-based decision-making in healthy subjects: short-term effects of reducing dopamine levels. Psychopharmacology (Berl) 188: 228-235.
160. Shiels K, Hawk Jr LW, Reynolds B, Mazzullo RJ, Rhodes JD, Pelham Jr WE et al (2009). Effects of methylphenidate on discounting of delayed rewards in attention deficit/hyperactivity disorder. Exp Clin Psychopharmacol 17: 291-301.
161. Siegel RA (1978). Probability of punishment and suppression of behavior in psychopathic and nonpsychopathic offenders. J Abnorm Psychol 87: 514-522.
162. Singer T, Lamm C (2009). The social neuroscience of empathy. Ann N Y Acad Sci 1156: 81-96.
163. Skuse DH, Gallagher L (2009). Dopaminergic-neuropeptide interactions in the social brain. Trends Cogn Sci 13: 27-35.
164. Smith DV, Hayden BY, Truong TK, Song AW, Platt ML, Huettel SA (2010). Distinct value signals in anterior and posterior ventromedial prefrontal cortex. J Neurosci 30: 2490-2495.
165. Smith GS, Lotrich FE, Malhotra AK, Lee AT, Ma Y, Kramer E et al (2004). Effects of serotonin transporter promoter polymorphisms on serotonin function. Neuropsychopharmacology 29: 2226-2234.
166. Smith KA, Fairburn CG, Cowen PJ (1997). Relapse of depression after rapid depletion of tryptophan. Lancet 349: 915-919.
167. Soubrie P (1986). Serotonergic neurons and behavior. J Pharmacol 17: 107-112.
168. 11C] raclopride PET study. Brain 132: 1376-1385.
169. Stoltenberg SF, Vandever JM (2010). Gender moderates the association between 5-HTTLPR and decision-making under ambiguity but not under risk. Neuropharmacology 58: 423-428.
170. Sutton R, Barto A (1998). Reinforcement Learing: An Introduction. MIT Press: Cambridge, MA.
171. Swainson R, Rogers RD, Sahakian BJ, Summers BA, Polkey CE, Robbins TW (2000). Probabilistic learning and reversal deficits in patients with Parkinson's disease or frontal or temporal lobe lesions: possible adverse effects of dopaminergic medication. Neuropsychologia 38: 596-612.
172. Talbot PS, Watson DR, Barrett SL, Cooper SJ (2006). Rapid tryptophan depletion improves decision-making cognition in healthy humans without affecting reversal learning or set shifting. Neuropsychopharmacology 31: 1519-1525.
173. Tanaka SC, Doya K, Okada G, Ueda K, Okamoto Y, Yamawaki S (2004). Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops. Nat Neurosci 7: 887-893.
174. Tanaka SC, Schweighofer N, Asahi S, Shishida K, Okamoto Y, Yamawaki S et al (2007). Serotonin differentially regulates short- and long-term prediction of rewards in the ventral and dorsal striatum. PLoS One 2: e1333
175. Tanaka SC, Shishida K, Schweighofer N, Okamoto Y, Yamawaki S, Doya K (2009). Serotonin affects association of aversive outcomes to past actions. J Neurosci 29: 15669-15674.
176. Tobler PN, Christopoulos GI, O'Doherty JP, Dolan RJ, Schultz W (2008). Neuronal distortions of reward probability without choice. J Neurosci 28: 11703-11711.
177. Tobler PN, O'Doherty JP, Dolan RJ, Schultz W (2007). Reward value coding distinct from risk attitude-related uncertainty coding in human reward systems. J Neurophysiol 97: 1621-1632.
178. Tranel D, Damasio H, Denburg NL, Bechara A (2005). Does gender play a role in functional asymmetry of ventromedial prefrontal cortex? Brain 128: 2872-2881.
179. Tse WS, Bond AJ (2002a). Difference in serotonergic and noradrenergic regulation of human social behaviours. Psychopharmacology (Berl) 159: 216-221.
180. Tse WS, Bond AJ (2002b). Serotonergic intervention affects both social dominance and affiliative behaviour. Psychopharmacology (Berl) 161: 324-330.
181. Tversky A, Kahneman D (1981). The framing of decisions and the psychology of choice. Science 211: 453-458.
182. Ullsperger M (2010). Genetic association studies of performance monitoring and learning from feedback: the role of dopamine and serotonin. Neurosci Biobehav Rev 34: 649-659.
183. Van Eimeren T, Ballanger B, Pellecchia G, Miyasaki JM, Lang AE, Strafella AP (2009). Dopamine agonists diminish value sensitivity of the orbitofrontal cortex: a trigger for pathological gambling in Parkinson's disease? Neuropsychopharma-cology 34: 2758-2766.
184. Voon V, Hassan K, Zurowski M, de Souza M, Thomsen T, Fox S et al (2006a). Prevalence of repetitive and reward-seeking behaviors in Parkinson disease. Neurology 67: 1254-1257.
185. Voon V, Hassan K, Zurowski M, Duff-Canning S, de Souza M, Fox S et al (2006b). Prospective prevalence of pathologic gambling and medication association in Parkinson disease. Neurology 66: 1750-1752.
186. Voon V, Pessiglione M, Brezing C, Gallea C, Fernandez HH, Dolan RJ et al (2010). Mechanisms underlying dopamine-mediated reward bias in compulsive behaviors. Neuron 65: 135-142.
187. Voon V, Reynolds B, Brezing C, Gallea C, Skaljic M, Ekanayake V et al (2009). Impulsive choice and response in dopamine agonist-related impulse control behaviors. Psychopharmacology (Berl) 207: 645-59.
188. Voon V, Thomsen T, Miyasaki JM, de Souza M, Shafro A, Fox SH et al (2007). Factors associated with dopaminergic drug-related pathological gambling in Parkinson disease. Arch Neurol 64: 212-216.
189. Watson KK, Ghodasra JH, Platt ML (2009). Serotonin transporter genotype modulates social reward and punishment in rhesus macaques. PLoS One 4: e4156.
190. Weintraub D, Siderowf AD, Potenza MN, Goveas J, Morales KH, Duda JE et al (2006). Association of dopamine agonist use with impulse control disorders in Parkinson disease. Arch Neurol 63: 969-973.
191. Wilkinson LS, Humby T, Killcross S, Robbins TW, Everitt BJ (1996). Dissociations in hippocampal 5-hydroxytryptamine release in the rat following Pavlovian aversive conditioning to discrete and contextual stimuli. Eur J Neurosci 8: 1479-1487.
192. Williams RB, Marchuk DA, Gadde KM, Barefoot JC, Grichnik K, Helms MJ et al (2003). Serotonin-related gene polymorphisms and central nervous system serotonin function. Neuropsychopharmacology 28: 533-541.
193. Winstanley CA, Dalley JW, Theobald DE, Robbins TW (2004a). Fractionating impulsivity: contrasting effects of central 5-HT depletion on different measures of impulsive behavior. Neuropsychopharmacology 29: 1331-1343.
194. Winstanley CA, Theobald DE, Dalley JW, Glennon JC, Robbins TW (2004b). 5-HT2A and 5-HT2C receptor antagonists have opposing effects on a measure of impulsivity: interactions with global 5-HT depletion. Psychopharmacology (Berl) 176: 376-385.
195. Winstanley CA, Theobald DE, Dalley JW, Robbins TW (2005). Interactions between serotonin and dopamine in the control of impulsive choice in rats: therapeutic implications for impulse control disorders. Neuropsychopharmacology 30: 669-682.
196. Wogar MA, Bradshaw CM, Szabadi E (1993). Effect of lesions of the ascending 5-hydroxytryptaminergic pathways on choice between delayed reinforcers. Psychopharmacology (Berl) 111: 239-243.
197. Wood RM, Rilling JK, Sanfey AG, Bhagwagar Z, Rogers RD (2006). Effects of tryptophan depletion on the performance of an iterated Prisoner's Dilemma game in healthy adults. Neuropsychopharmacology 31: 1075-1084.
198. Yacubian J, Sommer T, Schroeder K, Glascher J, Kalisch R, Leuenberger B et al (2007). Gene-gene interaction associated with neural reward sensitivity. Proc Natl Acad Sci USA 104: 8125-8130.
199. Yoshida W, Dolan RJ, Friston KJ (2008). Game theory of mind. PLoS Comput Biol 4: e1000254.
200. Young SN, Leyton M (2002). The role of serotonin in human mood and social interaction. Insight from altered tryptophan levels. Pharmacol Biochem Behav 71: 857-865.
201. Yu AJ, Dayan P (2005). Uncertainty, neuromodulation, and attention. Neuron 46: 681-692.
202. Zack M, Poulos CX (2004). Amphetamine primes motivation to gamble and gambling-related semantic networks in problem gamblers. Neuropsychophar-macology 29: 195-207.
203. Zack M, Poulos CX (2007). A D2 antagonist enhances the rewarding and priming effects of gambling episode in pathological gamblers. Neuropsychopharmaco-logy 32: 1678-1686.
204. Zack M, Poulos CX (2009). Effects of the atypical stimulant modafinil on a brief gambling episode in pathological gamblers with high vs low impulsivity. J Psychopharmacol 23: 660-671.
205. Zeeb FD, Robbins TW, Winstanley CA (2009). Serotonergic and dopaminergic modulation of gambling behavior as assessed using a novel rat gambling task. Neuropsychopharmacology 34: 2329-2343.
206. Zhong S, Israel S, Xue H, Sham PC, Ebstein RP, Chew SH (2009). A neurochemical approach to valuation sensitivity over gains and losses. Proc Biol Sci 276: 4181-4188.