Dopamine modulates neural networks involved in effort-based decision-making

Neuroscience and Biobehavioral Reviews

Volumn 33, Issue 3, 2009, Pages 383-393

  Assadi, Seyed M ^a,b   Yücel, Murat ^a   Pantelis, Christos ^a  

^a UNIVERSITY OF MELBOURNE   (Australia)

^b TEHRAN UNIVERSITY OF MEDICAL SCIENCES   (Iran)

Author keywords

Basal ganglia; D1 receptor; D2 receptor; Decision making; Dopamine; Dorsal anterior cingulate cortex

Indexed keywords

DOPAMINE; DOPAMINE 1 RECEPTOR; DOPAMINE 2 RECEPTOR;

BASAL GANGLION; CINGULATE GYRUS; DECISION MAKING; DOPAMINERGIC SYSTEM; DOPAMINERGIC TRANSMISSION; HUMAN; MAZE TEST; NERVE CELL NETWORK; NONHUMAN; NUCLEUS ACCUMBENS; PRIORITY JOURNAL; REVIEW; REWARD; THALAMUS;

ANIMALS; COGNITION; DECISION MAKING; DOPAMINE; FRONTAL LOBE; HUMANS; MAZE LEARNING; MOTIVATION; NERVE NET; NEURAL PATHWAYS; NEURONS; NUCLEUS ACCUMBENS; RECEPTORS, DOPAMINE D1; RECEPTORS, DOPAMINE D2; REWARD; SYNAPTIC TRANSMISSION;

EID: 59249107185     PISSN: 01497634     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neubiorev.2008.10.010     Document Type: Review

References (169)

1. Adell A., and Artigas F. The somatodendritic release of dopamine in the ventral tegmental area and its regulation by afferent transmitter systems. Neuroscience and Biobehavioral Reviews 28 (2004) 415-431
2. Alexander G.E., DeLong M.R., and Strick P.L. Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annual Review of Neuroscience 9 (1986) 357-381
3. Amiez C., Joseph J.P., and Procyk E. Anterior cingulate error-related activity is modulated by predicted reward. European Journal of Neuroscience 21 (2005) 3447-3452
4. An X., Bandler R., Ongur D., and Price J.L. Prefrontal cortical projections to longitudinal columns in the midbrain periaqueductal gray in macaque monkeys. Journal of Comparative Neurology 401 (1998) 455-479
5. Baleydier C., and Mauguiere F. The duality of the cingulate gyrus in monkey. Neuroanatomical study and functional hypothesis. Brain 103 (1980) 525-554
6. Bar-Gad I., Morris G., and Bergman H. Information processing, dimensionality reduction and reinforcement learning in the basal ganglia. Progress in Neurobiology 71 (2003) 439-473
7. Barnes T.D., Kubota Y., Hu D., Jin D.Z., and Graybiel A.M. Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories. Nature 437 (2005) 1158-1161
8. Bechara A., Damasio H., Damasio A.R., and Lee G.P. Different contributions of the human amygdala and ventromedial prefrontal cortex to decision-making. Journal of Neuroscience 19 (1999) 5473-5481
9. Bechara A., Tranel D., and Damasio H. Characterization of the decision-making deficit of patients with ventromedial prefrontal cortex lesions. Brain 123 (2000) 2189-2202
10. Bergman H., Feingold A., Nini A., Raz A., Slovin H., Abeles M., and Vaadia E. Physiological aspects of information processing in the basal ganglia of normal and Parkinsonian primates. Trends in Neurosciences 21 (1998) 32-38
11. Berns G.S., and Sejnowski T.J. A computational model of how the basal ganglia produce sequences. Journal of Cognitive Neuroscience 10 (1998) 108-121
12. Berridge K.C., and Robinson T.E. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?. Brain Research Brain Research Reviews 28 (1998) 309-369
13. Beurze S.M., de Lange F.P., Toni I., and Medendorp W.P. Integration of target and effector information in the human brain during reach planning. Journal of Neurophysiology 97 (2007) 188-199
14. Bezzina G., Cheung T.H., Asgari K., Hampson C.L., Body S., Bradshaw C.M., Szabadi E., Deakin J.F., and Anderson I.M. Effects of quinolinic acid-induced lesions of the nucleus accumbens core on inter-temporal choice: a quantitative analysis. Psychopharmacology 193 (2007) 423-436
15. Blair K., Marsh A.A., Morton J., Vythilingam M., Jones M., Mondillo K., Pine D.C., Drevets W.C., and Blair J.R. Choosing the lesser of two evils, the better of two goods: specifying the roles of ventromedial prefrontal cortex and dorsal anterior cingulate in object choice. Journal of Neuroscience 26 (2006) 11379-11386
16. Bilder R.M., Volavka J., Lachman H.M., and Grace A.A. The catechol-O-methyltransferase polymorphism: relations to the tonic-phasic dopamine hypothesis and neuropsychiatric phenotypes. Neuropsychopharmacology 29 (2004) 1943-1961
17. Both S., Everaerd W., Laan E., and Gooren L. Effect of a single dose of levodopa on sexual response in men and women. Neuropsychopharmacology 30 (2005) 173-183
18. Botvinick M., Nystrom L.E., Fissell K., Carter C.S., and Cohen J.D. Conflict monitoring versus selection-for-action in anterior cingulate cortex. Nature 402 (1999) 179-181
19. Botvinick M.M., Cohen J.D., and Carter C.S. Conflict monitoring and anterior cingulate cortex: an update. Trends in Cognitive Sciences 8 (2004) 539-546
20. Brown J.W., and Braver T.S. Learned predictions of error likelihood in the anterior cingulate cortex. Science 307 (2005) 1118-1121
21. Bush G., Luu P., and Posner M.I. Cognitive and emotional influences in anterior cingulate cortex. Trends in Cognitive Sciences 4 (2000) 215-222
22. Bush G., Vogt B.A., Holmes J., Dale A.M., Greve D., Jenike M.A., and Rosen B.R. Dorsal anterior cingulate cortex: a role in reward-based decision making. Proceedings of the National Academy of Sciences of the United States of America 99 (2002) 523-528
23. Calabresi P., Picconi B., Tozzi A., and Di Filippo M. Dopamine-mediated regulation of corticostriatal synaptic plasticity. Trends in Neurosciences 30 (2007) 211-219
24. Cannon C.M., and Bseikri M.R. Is dopamine required for natural reward?. Physiology and Behavior 81 (2004) 741-748
25. Cardinal R.N., Pennicott D.R., Sugathapala C.L., Robbins T.W., and Everitt B.J. Impulsive choice induced in rats by lesions of the nucleus accumbens core. Science 292 (2001) 2499-2501
26. Carter C.S., Braver T.S., Barch D.M., Botvinick M.M., Noll D., and Cohen J.D. Anterior cingulate cortex, error detection, and the online monitoring of performance. Science 280 (1998) 747-749
27. Cheung T.H., Bezzina G., Hampson C.L., Body S., Fone K.C., Bradshaw C.M., and Szabadi E. Evidence for the sensitivity of operant timing behaviour to stimulation of D(1) dopamine receptors. Psychopharmacology 195 (2007) 213-222
28. Cohen M.X., Young J., Baek J.M., Kessler C., and Ranganath C. Individual differences in extraversion and dopamine genetics predict neural reward responses. Brain Research Cognitive Brain Research 25 (2005) 851-861
29. Comoli E., Ribeiro-Barbosa E.R., and Canteras N.S. Predatory hunting and exposure to a live predator induce opposite patterns of Fos immunoreactivity in the PAG. Behavioural Brain Research 138 (2003) 17-28
30. Constantinidis C., Williams G.V., and Goldman-Rakic P.S. A role for inhibition in shaping the temporal flow of information in prefrontal cortex. Nature Neuroscience 5 (2002) 175-180
31. Cousins M.S., Atherton A., Turner L., and Salamone J.D. Nucleus accumbens dopamine depletions alter relative response allocation in a T-maze cost/benefit task. Behavioural Brain Research 74 (1996) 189-197
32. Cousins M.S., Wei W., and Salamone J.D. Pharmacological characterization of performance on a concurrent lever pressing/feeding choice procedure: effects of dopamine antagonist, cholinomimetic, sedative and stimulant drugs. Psychopharmacology 116 (1994) 529-537
33. Critchley H.D. Neural mechanisms of autonomic, affective, and cognitive integration. Journal of Comparative Neurology 493 (2005) 154-166
34. Critchley H.D., Mathias C.J., Josephs O., O'Doherty J., Zanini S., Dewar B.K., Cipolotti L., Shallice T., and Dolan R.J. Human cingulate cortex and autonomic control: converging neuroimaging and clinical evidence. Brain 126 (2003) 2139-2152
35. Critchley H.D., Tang J., Glaser D., Butterworth B., and Dolan R.J. Anterior cingulate activity during error and autonomic response. Neuroimage 27 (2005) 885-895
36. Cromwell H.C., Berridge K.C., Drago J., and Levine M.S. Action sequencing is impaired in D1 A-deficient mutant mice. European Journal of Neuroscience 10 (1998) 2426-2432
37. Daberkow D.P., Kesner R.P., and Keefe K.A. Relation between methamphetamine-induced monoamine depletions in the striatum and sequential motor learning. Pharmacology, Biochemistry and Behavior 81 (2005) 198-204
38. Daw N.D., O'Doherty J.P., Dayan P., Seymour B., and Dolan R.J. Cortical substrates for exploratory decisions in humans. Nature 441 (2006) 876-879
39. de Bruijn E.R., Sabbe B.G., Hulstijn W., Ruigt G.S., and Verkes R.J. Effects of antipsychotic and antidepressant drugs on action monitoring in healthy volunteers. Brain Research 1105 (2006) 122-129
40. Dehaene S., Artiges E., Naccache L., Martelli C., Viard A., Schurhoff F., Recasens C., Martinot M.L., Leboyer M., and Martinot J.L. Conscious and subliminal conflicts in normal subjects and patients with schizophrenia: the role of the anterior cingulate. Proceedings of the National Academy of Sciences of the United States of America 100 (2003) 13722-13727
41. DeLong M.R. Primate models of movement disorders of basal ganglia origin. Trends in Neurosciences 13 (1990) 281-285
42. Devinsky O., Morrell M.J., and Vogt B.A. Contributions of anterior cingulate cortex to behaviour. Brain 118 (1995) 279-306
43. Dosenbach N.U., Visscher K.M., Palmer E.D., Miezin F.M., Wenger K.K., Kang H.C., Burgund E.D., Grimes A.L., Schlaggar B.L., and Petersen S.E. A core system for the implementation of task sets. Neuron 50 (2006) 799-812
44. Ernst M., Nelson E.E., McClure E.B., Monk C.S., Munson S., Eshel N., Zarahn E., Leibenluft E., Zametkin A., Towbin K., Blair J., Charney D., and Pine D.S. Choice selection and reward anticipation: an fMRI study. Neuropsychologia 42 (2004) 1585-1597
45. Eshel N., Nelson E.E., Blair R.J., Pine D.S., and Ernst M. Neural substrates of choice selection in adults and adolescents: development of the ventrolateral prefrontal and anterior cingulate cortices. Neuropsychologia 45 (2007) 1270-1279
46. Ferry A.T., Ongur D., An X., and Price J.L. Prefrontal cortical projections to the striatum in macaque monkeys: evidence for an organization related to prefrontal networks. Journal of Comparative Neurology 425 (2000) 447-470
47. Fiorillo C.D., Tobler P.N., and Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299 (2003) 1898-1902
48. Floresco S.B., Blaha C.D., Yang C.R., and Phillips A.G. Modulation of hippocampal and amygdalar-evoked activity of nucleus accumbens neurons by dopamine: cellular mechanisms of input selection. Journal of Neuroscience 21 (2001) 2851-2860
49. Floresco S.B., and Ghods-Sharifi S. Amygdala-prefrontal cortical circuitry regulates effort-based decision making. Cerebral Cortex 17 (2007) 251-260
50. Floresco S.B., Tse M.T., and Ghods-Sharifi S. Dopaminergic and glutamatergic regulation of effort- and delay-based decision making. Neuropsychopharmacology 33 (2008) 1966-1979
51. Floresco S.B., West A.R., Ash B., Moore H., and Grace A.A. Afferent modulation of dopamine neuron firing differentially regulates tonic and phasic dopamine transmission. Nature Neuroscience 6 (2003) 968-973
52. Gerfen C.R., Engber T.M., Mahan L.C., Susel Z., Chase T.N., Monsma Jr. F.J., and Sibley D.R. D1 and D2 dopamine receptor-regulated gene expression of striatonigral and striatopallidal neurons. Science 250 (1990) 1429-1432
53. Gibson R.M., and Langen T.A. How do animals choose their mates?. Trends in Ecology & Evolution 11 (1996) 468-470
54. Goldman-Rakic P.S., Muly III E.C., and Williams G.V. D(1) receptors in prefrontal cells and circuits. Brain Research. Brain Research Reviews 31 (2000) 295-301
55. Goto Y., and Grace A.A. Dopaminergic modulation of limbic and cortical drive of nucleus accumbens in goal-directed behavior. Nature Neuroscience 8 (2005) 805-812
56. Grace A.A. Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: a hypothesis for the etiology of schizophrenia. Neuroscience 41 (1991) 1-24
57. Grace A.A., Floresco S.B., Goto Y., and Lodge D.J. Regulation of firing of dopaminergic neurons and control of goal-directed behaviors. Trends in Neurosciences 30 (2007) 220-227
58. Graybiel A.M. The basal ganglia: learning new tricks and loving it. Current Opinion in Neurobiology 15 (2005) 638-644
59. Green L., and Myerson J. A discounting framework for choice with delayed and probabilistic rewards. Psychological Bulletin 130 (2004) 769-792
60. Greengard P. The neurobiology of dopamine signaling. Bioscience Reports 21 (2001) 247-269
61. Hampton A.N., Bossaerts P., and O'Doherty J.P. The role of the ventromedial prefrontal cortex in abstract state-based inference during decision making in humans. Journal of Neuroscience 26 (2006) 8360-8367
62. Hampton A.N., and O'Doherty J.P. Decoding the neural substrates of reward-related decision making with functional MRI. Proceedings of the National Academy of Sciences of the United States of America 104 (2007) 1377-1382
63. Hauber W., and Sommer S. Direct interactions between anterior cingulate cortex and nucleus accumbens mediate effort-based decision making in rats. Society of Neuroscience Abstract (2007) 741.27
64. Hogan A.M., Vargha-Khadem F., Saunders D.E., Kirkham F.J., and Baldeweg T. Impact of frontal white matter lesions on performance monitoring: ERP evidence for cortical disconnection. Brain 129 (2006) 2177-2188
65. Hoshi E., Sawamura H., and Tanji J. Neurons in the rostral cingulate motor area monitor multiple phases of visuomotor behavior with modest parametric selectivity. Journal of Neurophysiology 94 (2005) 640-656
66. Hurd Y.L., Suzuki M., and Sedvall G.C. D1 and D2 dopamine receptor mRNA expression in whole hemisphere sections of the human brain. Journal of Chemical Neuroanatomy 22 (2001) 127-137
67. Ito S., Stuphorn V., Brown J.W., and Schall J.D. Performance monitoring by the anterior cingulate cortex during saccade countermanding. Science 302 (2003) 120-122
68. Kacelnik A., and Bateson M. Risk-sensitivity: crossroads for theories of decision making. Trends in Cognitive Sciences 1 (1997) 304-309
69. Keay K.A., and Bandler R. Parallel circuits mediating distinct emotional coping reactions to different types of stress. Neuroscience and Biobehavioral Reviews 25 (2001) 669-678
70. Kennerley S.W., Walton M.E., Behrens T.E., Buckley M.J., and Rushworth M.F. Optimal decision making and the anterior cingulate cortex. Nature Neuroscience 9 (2006) 940-947
71. Kheramin S., Body S., Ho M., Velazquez-Martinez D.N., Bradshaw C.M., Szabadi E., Deakin J.F., and Anderson I.M. Role of the orbital prefrontal cortex in choice between delayed and uncertain reinforcers: a quantitative analysis. Behavioural Processes 64 (2003) 239-250
72. Kheramin S., Body S., Ho M.Y., Velazquez-Martinez D.N., Bradshaw C.M., Szabadi E., Deakin J.F., and Anderson I.M. Effects of orbital prefrontal cortex dopamine depletion on inter-temporal choice: a quantitative analysis. Psychopharmacology 175 (2004) 206-214
73. Kiehl K.A., Liddle P.F., and Hopfinger J.B. Error processing and the rostral anterior cingulate: an event-related fMRI study. Psychophysiology 37 (2000) 216-223
74. Klein T.A., Neumann J., Reuter M., Hennig J., von Cramon D.Y., and Ullsperger M. Genetically determined differences in learning from errors. Science 318 (2007) 1642-1645
75. Knutson B., Bjork J.M., Fong G.W., Hommer D., Mattay V.S., and Weinberger D.R. Amphetamine modulates human incentive processing. Neuron 43 (2004) 261-269
76. Knutson B., Westdorp A., Kaiser E., and Hommer D. FMRI visualization of brain activity during a monetary incentive delay task. Neuroimage 12 (2000) 20-27
77. Koski L., and Paus T. Functional connectivity of the anterior cingulate cortex within the human frontal lobe: a brain-mapping meta-analysis. Experimental Brain Research 133 (2000) 55-65
78. Krebs R.E. Optimal foraging: decision rules for predators. In: Krebs J.R., and Davies N.B. (Eds). Behavioral Ecology: An Evolutionary Approach (1978), Blackwell Scientific Publications, London 23-63
79. Kunishio K., and Haber S.N. Primate cingulostriatal projection: limbic striatal versus sensorimotor striatal input. Journal of Comparative Neurology 350 (1994) 337-356
80. Lapish C.C., Kroener S., Durstewitz D., Lavin A., and Seamans J.K. The ability of the mesocortical dopamine system to operate in distinct temporal modes. Psychopharmacology 191 (2007) 609-625
81. Lonstein J.S., and Stern J.M. Site and behavioral specificity of periaqueductal gray lesions on postpartum sexual, maternal, and aggressive behaviors in rats. Brain Research 804 (1998) 21-35
82. Marsh A.A., Blair K.S., Vythilingam M., Busis S., and Blair R.J. Response options and expectations of reward in decision-making: the differential roles of dorsal and rostral anterior cingulate cortex. Neuroimage 35 (2007) 979-988
83. Matsumoto K., Suzuki W., and Tanaka K. Neuronal correlates of goal-based motor selection in the prefrontal cortex. Science 301 (2003) 229-232
84. Maynard Smith J. Evolution and the Theory of Games (1982), Cambridge University Press, London
85. McClure S.M., Laibson D.I., Loewenstein G., and Cohen J.D. Separate neural systems value immediate and delayed monetary rewards. Science 306 (2004) 503-507
86. McLean A., Rubinsztein J.S., Robbins T.W., and Sahakian B.J. The effects of tyrosine depletion in normal healthy volunteers: implications for unipolar depression. Psychopharmacology 171 (2004) 286-297
87. Mesulam M.M. Large-scale neurocognitive networks and distributed processing for attention, language, and memory. Annals of Neurology 28 (1990) 597-613
88. Mink J.W. The basal ganglia: focused selection and inhibition of competing motor programs. Progress in Neurobiology 50 (1996) 381-425
89. Mobini S., Body S., Ho M.Y., Bradshaw C.M., Szabadi E., Deakin J.F., and Anderson I.M. Effects of lesions of the orbitofrontal cortex on sensitivity to delayed and probabilistic reinforcement. Psychopharmacology 160 (2002) 290-298
90. Mobini S., Chiang T.J., Ho M.Y., Bradshaw C.M., and Szabadi E. Effects of central 5-hydroxytryptamine depletion on sensitivity to delayed and probabilistic reinforcement. Psychopharmacology 152 (2000) 390-397
91. Morecraft R.J., McNeal D.W., Stilwell-Morecraft K.S., Gedney M., Ge J., Schroeder C.M., and van Hoesen G.W. Amygdala interconnections with the cingulate motor cortex in the rhesus monkey. Journal of Comparative Neurology 500 (2007) 134-165
92. Morecraft R.J., and Van Hoesen G.W. Convergence of limbic input to the cingulate motor cortex in the rhesus monkey. Brain Research Bulletin 45 (1998) 209-232
93. Morris G., Nevet A., Arkadir D., Vaadia E., and Bergman H. Midbrain dopamine neurons encode decisions for future action. Nature Neuroscience 9 (2006) 1057-1063
94. Mulder M.B. Kipsigis women's preferences for wealthy men: evidence for female choice in mammals?. Behavioral Ecology and Sociobiology 27 (1990) 255-264
95. Nishida T. Sexual behavior of adult male chimpanzees of the Mahale Mountains National Park, Tanzania. Primates 38 (1997) 379-398
96. Nowend K.L., Arizzi M., Carlson B.B., and Salamone J.D. D1 or D2 antagonism in nucleus accumbens core or dorsomedial shell suppresses lever pressing for food but leads to compensatory increases in chow consumption. Pharmacology, Biochemistry and Behavior 69 (2001) 373-382
97. O'Donnell P., and Grace A.A. Synaptic interactions among excitatory afferents to nucleus accumbens neurons: hippocampal gating of prefrontal cortical input. Journal of Neuroscience 15 (1995) 3622-3639
98. Ongur D., An X., and Price J.L. Prefrontal cortical projections to the hypothalamus in macaque monkeys. Journal of Comparative Neurology 401 (1998) 480-505
99. Ongur D., and Price J.L. The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. Cerebral Cortex 10 (2000) 206-219
100. Paus T., Koski L., Caramanos Z., and Westbury C. Regional differences in the effects of task difficulty and motor output on blood flow response in the human anterior cingulate cortex: a review of 107 PET activation studies. Neuroreport 9 (1998) R37-47
101. Percheron G., Yelnik J., and Francois C. A golgi analysis of the primate globus pallidus. III. Spatial organization of the striato-pallidal complex. Journal of Comparative Neurology 227 (1984) 214-227
102. Pessiglione M., Czernecki V., Pillon B., Dubois B., Schupbach M., Agid Y., and Tremblay L. An effect of dopamine depletion on decision-making: the temporal coupling of deliberation and execution. Journal of Cognitive Neuroscience 17 (2005) 1886-1896
103. Phillips P.E., Walton M.E., and Jhou T.C. Calculating utility: preclinical evidence for cost-benefit analysis by mesolimbic dopamine. Psychopharmacology (Berlin) 191 (2007) 483-495
104. Picard N., and Strick P.L. Motor areas of the medial wall: a review of their location and functional activation. Cerebral Cortex 6 (1996) 342-353
105. Plenz D. When inhibition goes incognito: feedback interaction between spiny projection neurons in striatal function. Trends in Neurosciences 26 (2003) 436-443
106. Posner M.I., Petersen S.E., Fox P.T., and Raichle M.E. Localization of cognitive operations in the human brain. Science 240 (1988) 1627-1631
107. Rahm B., Opwis K., Kaller C.P., Spreer J., Schwarzwald R., Seifritz E., Halsband U., and Unterrainer J.M. Tracking the subprocesses of decision-based action in the human frontal lobes. Neuroimage 30 (2006) 656-667
108. Raichle M.E., MacLeod A.M., Snyder A.Z., Powers W.J., Gusnard D.A., and Shulman G.L. A default mode of brain function. Proceedings of the National Academy of Sciences of the United States of America 98 (2001) 676-682
109. Ray J.P., and Price J.L. The organization of projections from the mediodorsal nucleus of the thalamus to orbital and medial prefrontal cortex in macaque monkeys. Journal of Comparative Neurology 337 (1993) 1-31
110. Reynolds J.N., and Wickens J.R. Dopamine-dependent plasticity of corticostriatal synapses. Neural Networks 15 (2002) 507-521
111. Richmond B.J., Liu Z., and Shidara M. Neuroscience. Predicting future rewards. Science 301 (2003) 179-180
112. Ridderinkhof K.R., Ullsperger M., Crone E.A., and Nieuwenhuis S. The role of the medial frontal cortex in cognitive control. Science 306 (2004) 443-447
113. Roesch M.R., Calu D.J., Burke K.A., and Schoenbaum G. Should I stay or should I go? Transformation of time-discounted rewards in orbitofrontal cortex and associated brain circuits. Annals of the New York Academy of Sciences 1104 (2007) 21-34
114. Rolls E.T., McCabe C., and Redoute J. Expected value, reward outcome, and temporal difference error representations in a probabilistic decision task. Cerebral Cortex 18 (2008) 652-663
115. Rudebeck P.H., Buckley M.J., Walton M.E., and Rushworth M.F. A role for the macaque anterior cingulate gyrus in social valuation. Science 313 (2006) 1310-1312
116. Rudebeck P.H., Walton M.E., Smyth A.N., Bannerman D.M., and Rushworth M.F. Separate neural pathways process different decision costs. Nature Neuroscience 9 (2006) 1161-1168
117. Rushworth M.F., Hadland K.A., Paus T., and Sipila P.K. Role of the human medial frontal cortex in task switching: a combined fMRI and TMS study. Journal of Neurophysiology 87 (2002) 2577-2592
118. Rushworth M.F., Walton M.E., Kennerley S.W., and Bannerman D.M. Action sets and decisions in the medial frontal cortex. Trends in Cognitive Sciences 8 (2004) 410-417
119. Salamone J.D. The behavioral neurochemistry of motivation: methodological and conceptual issues in studies of the dynamic activity of nucleus accumbens dopamine. Journal of Neuroscience Methods 64 (1996) 137-149
120. Salamone J.D., Correa M., Farrar A., and Mingote S.M. Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology 191 (2007) 461-482
121. Salamone J.D., Correa M., Mingote S., and Weber S.M. Nucleus accumbens dopamine and the regulation of effort in food-seeking behavior: implications for studies of natural motivation, psychiatry, and drug abuse. Journal of Pharmacology and Experimental Therapeutics 305 (2003) 1-8
122. Salamone J.D., Cousins M.S., and Bucher S. Anhedonia or anergia? Effects of haloperidol and nucleus accumbens dopamine depletion on instrumental response selection in a T-maze cost/benefit procedure. Behavioural Brain Research 65 (1994) 221-229
123. Satoh T., Nakai S., Sato T., and Kimura M. Correlated coding of motivation and outcome of decision by dopamine neurons. Journal of Neuroscience 23 (2003) 9913-9923
124. Satterthwaite T.D., Green L., Myerson J., Parker J., Ramaratnam M., and Buckner R.L. Dissociable but inter-related systems of cognitive control and reward during decision making: evidence from pupillometry and event-related fMRI. Neuroimage 37 (2007) 1017-1031
125. Schultz W. Behavioral dopamine signals. Trends in Neurosciences 30 (2007) 203-210
126. Schultz W. Multiple dopamine functions at different time courses. Annual Review of Neuroscience 30 (2007) 259-288
127. Schultz W., Dayan P., and Montague P.R. A neural substrate of prediction and reward. Science 275 (1997) 1593-1599
128. Schultz W., and Dickinson A. Neuronal coding of prediction errors. Annual Review of Neuroscience 23 (2000) 473-500
129. Schweimer J., and Hauber W. Involvement of the rat anterior cingulate cortex in control of instrumental responses guided by reward expectancy. Learning and Memory 12 (2005) 334-342
130. Schweimer J., and Hauber W. Dopamine D1 receptors in the anterior cingulate cortex regulate effort-based decision making. Learning and Memory 13 (2006) 777-782
131. Schweimer J., Saft S., and Hauber W. Involvement of catecholamine neurotransmission in the rat anterior cingulate in effort-related decision making. Behavioral Neuroscience 119 (2005) 1687-1692
132. Seamans J.K., Gorelova N., Durstewitz D., and Yang C.R. Bidirectional dopamine modulation of GABAergic inhibition in prefrontal cortical pyramidal neurons. Journal of Neuroscience 21 (2001) 3628-3638
133. Seamans J.K., and Yang C.R. The principal features and mechanisms of dopamine modulation in the prefrontal cortex. Progress in Neurobiology 74 (2004) 1-58
134. Seo H., and Lee D. Temporal filtering of reward signals in the dorsal anterior cingulate cortex during a mixed-strategy game. Journal of Neuroscience 27 (2007) 8366-8377
135. Shidara M., Mizuhiki T., and Richmond B.J. Neuronal firing in anterior cingulate neurons changes modes across trials in single states of multitrial reward schedules. Experimental Brain Research 163 (2005) 242-245
136. Shidara M., and Richmond B.J. Anterior cingulate: single neuronal signals related to degree of reward expectancy. Science 296 (2002) 1709-1711
137. Shima K., and Tanji J. Role for cingulate motor area cells in voluntary movement selection based on reward. Science 282 (1998) 1335-1338
138. Somerville L.H., Heatherton T.F., and Kelley W.M. Anterior cingulate cortex responds differentially to expectancy violation and social rejection. Nature Neuroscience 9 (2006) 1007-1008
139. Stevens J.R., Rosati A.G., Ross K.R., and Hauser M.D. Will travel for food: spatial discounting in two new world monkeys. Current Biology 15 (2005) 1855-1860
140. Sukikara M.H., Mota-Ortiz S.R., Baldo M.V., Felicio L.F., and Canteras N.S. A role for the periaqueductal gray in switching adaptive behavioral responses. Journal of Neuroscience 26 (2006) 2583-2589
141. Suri R.E., and Schultz W. Learning of sequential movements by neural network model with dopamine-like reinforcement signal. Experimental Brain Research 121 (1998) 350-354
142. Toda M., and Abi-Dargham A. Dopamine hypothesis of schizophrenia: making sense of it all. Current Psychiatry Reports 9 (2007) 329-336
143. Trantham-Davidson H., Neely L.C., Lavin A., and Seamans J.K. Mechanisms underlying differential D1 versus D2 dopamine receptor regulation of inhibition in prefrontal cortex. Journal of Neuroscience 24 (2004) 10652-10659
144. Ullsperger M., and von Cramon D.Y. The role of intact frontostriatal circuits in error processing. Journal of Cognitive Neuroscience 18 (2006) 651-664
145. Volkow N.D., Fowler J.S., Wang G.J., Swanson J.M., and Telang F. Dopamine in drug abuse and addiction: results of imaging studies and treatment implications. Archives of Neurology 64 (2007) 1575-1579
146. Voorn P., Vanderschuren L.J., Groenewegen H.J., Robbins T.W., and Pennartz C.M. Putting a spin on the dorsal-ventral divide of the striatum. Trends in Neurosciences 27 (2004) 468-474
147. Vrshek-Schallhorn S., Wahlstrom D., Benolkin K., White T., and Luciana M. Affective bias and response modulation following tyrosine depletion in healthy adults. Neuropsychopharmacology 31 (2006) 2523-2536
148. Wade T.R., de Wit H., and Richards J.B. Effects of dopaminergic drugs on delayed reward as a measure of impulsive behavior in rats. Psychopharmacology 150 (2000) 90-101
149. Wakabayashi K.T., Fields H.L., and Nicola S.M. Dissociation of the role of nucleus accumbens dopamine in responding to reward-predictive cues and waiting for reward. Behavioural Brain Research 154 (2004) 19-30
150. Wallis J.D. Orbitofrontal cortex and its contribution to decision-making. Annual Review of Neuroscience 30 (2007) 31-56
151. Walton M.E., Bannerman D.M., Alterescu K., and Rushworth M.F. Functional specialization within medial frontal cortex of the anterior cingulate for evaluating effort-related decisions. Journal of Neuroscience 23 (2003) 6475-6479
152. Walton M.E., Croxson P.L., Rushworth M.F., and Bannerman D.M. The mesocortical dopamine projection to anterior cingulate cortex plays no role in guiding effort-related decisions. Behavioral Neuroscience 119 (2005) 323-328
153. Walton M.E., Devlin J.T., and Rushworth M.F. Interactions between decision making and performance monitoring within prefrontal cortex. Nature Neuroscience 7 (2004) 1259-1265
154. Walton M.E., Rudebeck P.H., Bannerman D.M., and Rushworth M.F. Calculating the cost of acting in frontal cortex. Annals of the New York Academy of Sciences 1104 (2007) 340-356
155. Whalen P.J., Bush G., McNally R.J., Wilhelm S., McInerney S.C., Jenike M.A., and Rauch S.L. The emotional counting Stroop paradigm: a functional magnetic resonance imaging probe of the anterior cingulate affective division. Biological Psychiatry 44 (1998) 1219-1228
156. Wichmann T., and DeLong M.R. Functional and pathophysiological models of the basal ganglia. Current Opinion in Neurobiology 6 (1996) 751-758
157. Wickens J. Basal ganglia: structure and computations. Network: Computation in Neural Systems 8 (1997) R77-R109
158. Winstanley C.A., Theobald D.E., Dalley J.W., and Robbins T.W. Interactions between serotonin and dopamine in the control of impulsive choice in rats: therapeutic implications for impulse control disorders. Neuropsychopharmacology 30 (2005) 669-682
159. Wittmann M., Leland D.S., and Paulus M.P. Time and decision making: differential contribution of the posterior insular cortex and the striatum during a delay discounting task. Experimental Brain Research 179 (2007) 643-653
160. Xiaob D., and Barbas H. Circuits through prefrontal cortex, basal ganglia, and ventral anterior nucleus map pathways beyond motor control. Thalamus & Related Systems 2 (2004) 325-343
161. Yang C.R., Seamans J.K., and Gorelova N. Developing a neuronal model for the pathophysiology of schizophrenia based on the nature of electrophysiological actions of dopamine in the prefrontal cortex. Neuropsychopharmacology 21 (1999) 161-194
162. Yeterian E.H., and Pandya D.N. Corticothalamic connections of paralimbic regions in the rhesus monkey. Journal of Comparative Neurology 269 (1988) 130-146
163. Yücel M., Brewer W.J., Harrison B.J., Fornito A., O'Keefe G.J., Olver J., Scott A.M., Egan G.F., Velakoulis D., McGorry P.D., and Pantelis C. Anterior cingulate activation in antipsychotic-naive first-episode schizophrenia. Acta Psychiatrica Scandinavica 115 (2007) 155-158
164. Yücel M., Harrison B.J., Wood S.J., Fornito A., Clarke K., Wellard R.M., Cotton S., and Pantelis C. State, trait and biochemical influences on human anterior cingulate function. Neuroimage 34 (2007) 1766-1773
165. Yücel M., Harrison B.J., Wood S.J., Fornito A., Wellard R.M., Pujol J., Clarke K., Phillips M.L., Kyrios M., Velakoulis D., and Pantelis C. Functional and biochemical alterations of the medial frontal cortex in obsessive-compulsive disorder. Archives of General Psychiatry 64 (2007) 946-955
166. Yücel M., Lubman D.I., Harrison B.J., Fornito A., Allen N.B., Wellard R.M., Roffel K., Clarke K., Wood S.J., Forman S.D., and Pantelis C. A combined spectroscopic and functional MRI investigation of the dorsal anterior cingulate region in opiate addiction. Molecular Psychiatry 12 611 (2007) 691-702
167. Yücel M., Pantelis C., Stuart G.W., Wood S.J., Maruff P., Velakoulis D., Pipingas A., Crowe S.F., Tochon-Danguy H.J., and Egan G.F. Anterior cingulate activation during Stroop task performance: a PET to MRI coregistration study of individual patients with schizophrenia. American Journal of Psychiatry 159 (2002) 251-254
168. Yücel M., Wood S.J., Fornito A., Riffkin J., Velakoulis D., and Pantelis C. Anterior cingulate dysfunction: implications for psychiatric disorders?. Journal of Psychiatry and Neuroscience 28 (2003) 350-354
169. Zikopoulos B., and Barbas H. Parallel driving and modulatory pathways link the prefrontal cortex and thalamus. PLoS ONE 2 (2007) e848