Distinct roles of three frontal cortical areas in reward-guided behavior

Journal of Neuroscience

Volumn 31, Issue 40, 2011, Pages 14399-14412

  Noonan, M P ^a,b   Mars, R B ^a,b   Rushworth, M F S ^a,b  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; AMYGDALOID NUCLEUS; ARTICLE; ASSOCIATION; BRAIN FUNCTION; BRAIN REGION; CORPUS STRIATUM; EXPECTATION; FEMALE; FRONTAL CORTEX; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HABENULA; HUMAN; HUMAN EXPERIMENT; LATERAL ORBITAL CORTEX; LEARNING; MALE; MEDIAL ORBITAL CORTEX; MOTIVATION; NORMAL HUMAN; PERIRHINAL CORTEX; PRIORITY JOURNAL; PROBABILITY; PSYCHOPHYSIOLOGY; REWARD; STIMULUS RESPONSE; TASK PERFORMANCE; THALAMUS DORSOMEDIAL NUCLEUS; VENTROMEDIAL FRONTAL CORTEX;

ADULT; BRAIN MAPPING; FEMALE; FRONTAL LOBE; HUMANS; LEARNING; MALE; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; REWARD; YOUNG ADULT;

EID: 80053620706     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.6456-10.2011     Document Type: Article

References (97)

1. Aggleton JP, Albasser MM, Aggleton DJ, Poirier GL, Pearce JM (2010) Lesions of the rat perirhinal cortex spare the acquisition of a complex con-figural visual discrimination yet impair object recognition. Behav Neurosci 124:55-68.
2. Amiez C, Joseph JP, Procyk E (2006) Reward encoding in the monkey anterior cingulate cortex. Cereb Cortex 16:1040-1055.
3. Baxter MG, Murray EA (2002) The amygdala and reward. Nat Rev Neurosci 3:563-573.
4. Baxter MG, Parker A, Lindner CC, Izquierdo AD, Murray EA (2000) Control of response selection by reinforcer value requires interaction of amygdala and orbital prefrontal cortex. J Neurosci 20:4311-4319.
5. Beckmann M, Johansen-Berg H, Rushworth MF (2009) Connectivity-based parcellation of human cingulate cortex and its relation to functional specialization. J Neurosci 29:1175-1190.
6. Behrens TE, Woolrich MW, Walton ME, Rushworth MF (2007) Learning the value of information in an uncertain world. Nat Neurosci 10:1214 -1221.
7. Behrens TE, Hunt LT, Woolrich MW, Rushworth MF (2008) Associative learning of social value. Nature 456:245-249.
8. Boorman ED, Behrens TE, Woolrich MW, Rushworth MF (2009) How greenisthe grassonthe other side? Frontopolar cortex and the evidence in favor of alternative courses of action. Neuron 62:733-743.
9. Bouret S, Richmond BJ (2010) Ventromedial and orbital prefrontal neurons differentially encode internally and externally driven motivational values in monkeys. J Neurosci 30:8591-8601.
10. Brett M (1999) The MNI brain and the Talairach atlas. Available at http://imaging.mrc-cbu.cam.ac.uk/imaging/MniTalairach.
11. Bromberg-Martin ES, Matsumoto M, Hong S, Hikosaka O (2010) A pallidus-habenula-dopamine pathway signals inferred stimulus values. J Neurophysiol 104:1068-1076.
12. Buckley MJ, Gaffan D (1997) Impairment of visual object-discrimination learning after perirhinal cortex ablation. Behav Neurosci 111:467-475.
13. Buckley MJ, Gaffan D (1998) Perirhinal cortex ablation impairs visual object identification. J Neurosci 18:2268-2275.
14. Buckley MJ, Gaffan D (2006) Perirhinal cortical contributions to object perception. Trends Cogn Sci 10:100-107.
15. Bunge S, Wallis JD, eds (2008) Neuroscience of rule-guided behavior. New York: Oxford UP.
16. Carmichael ST, Price JL (1995) Limbic connections of the orbital and medial prefrontal cortexin macaque monkeys. JComp Neurol 363:615-641.
17. Croxson PL, Walton ME, O'Reilly JX, Behrens TE, Rushworth MF (2009) Effort-based cost-benefit valuation and the human brain. J Neurosci 29:4531-4541.
18. Daw ND, Niv Y, Dayan P (2005) Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat Neurosci 8:1704-1711.
19. Deichmann R, Gottfried JA, Hutton C, Turner R (2003) Optimized EPI for fMRI studies of the orbitofrontal cortex. Neuroimage 19:430-441.
20. De Martino B, Kumaran D, Seymour B, Dolan RJ (2006) Frames, biases, and rational decision-making in the human brain. Science 313:684-687.
21. de Wit S, Corlett PR, Aitken MR, Dickinson A, Fletcher PC (2009) Differential engagement of the ventromedial prefrontal cortex by goal-directed and habitual behavior toward food pictures in humans. J Neurosci 29:11330-11338.
22. Easton A (2004) Differential reward outcome learning in adult humans. Behav Brain Res 154:165-169.
23. Easton A, Gaffan D (2002) Insights into the nature of fronto-temporal interactions from a biconditional discrimination task in the monkey. Behav Brain Res 136:217-226.
24. Estevez AF, Vivas AB, Alonso D, Mari-Beffa P, Fuentes LJ, Overmier JB (2007) Enhancing challenged students' recognition of mathematical relations through differential outcomes training. Q J Exp Psychol (Colchester) 60:571-580.
25. Ferry AT, Ongur D, An X, Price JL (2000) Prefrontal cortical projections to the striatum in macaque monkeys: evidence foran organization related to prefrontal networks. J Comp Neurol 425:447-470.
26. FitzGerald TH, Seymour B, Dolan RJ (2009) The role of human orbitofron-tal cortex in value comparison for incommensurable objects. J Neurosci 29:8388-8395.
27. Friston KJ, Buechel C, Fink GR, Morris J, Rolls E, Dolan RJ (1997) Psycho-physiological and modulatory interactionsinneuroimaging. Neuroimage 6:218-229.
28. Gaffan D, Murray EA (1990) Amygdalar interaction with the mediodorsal nucleus of the thalamus and the ventromedial prefrontal cortex in stimulus-reward associative learning in the monkey. J Neurosci 10:3479-3493.
29. Gaffan EA, Eacott MJ, Simpson EL (2000) Perirhinal cortex ablation in rats selectively impairs object identification in a simultaneous visual comparison task. Behav Neurosci 114:18-31.
30. Grill-Spector K (2003) The neural basis of object perception. Curr Opin Neurobiol 13:159-166.
31. Hampton AN, Adolphs R, Tyszka MJ, O'Doherty JP (2007) Contributions of the amygdala to reward expectancy and choice signals in human pre-frontal cortex. Neuron 55:545-555.
32. Hare TA, O'Doherty J, Camerer CF, Schultz W, Rangel A (2008) Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J Neurosci 28:5623-5630.
33. Hayden BY, Platt ML (2010) Neuronsinanterior cingulate cortex multiplex information about reward and action. J Neurosci 30:3339-3346.
34. Hikosaka O, Sesack SR, Lecourtier L, Shepard PD (2008) Habenula: crossroad between the basal ganglia and the limbic system. J Neurosci 28:11825-11829.
35. Izquierdo A, Murray EA (2007) Selective bilateral amygdala lesions in rhesus monkeys fail to disrupt object reversal learning. J Neurosci 27: 1054-1062.
36. Izquierdo A, Murray EA (2010) Functional interactionofmedial mediodor-sal thalamic nucleus but not nucleus accumbens with amygdala and orbital prefrontal cortex is essential for adaptive response selection after reinforcer devaluation. J Neurosci 30:661-669.
37. Jenkinson M, Smith S (2001) A global optimisation method for robust af-fine registration of brain images. Med Image Anal 5:143-156.
38. Jones M, White KG (1994) An investigation of the differential-outcomes effect within sessions. J Exp Anal Behav 61:389-406.
39. Kennerley SW, Walton ME, Behrens TE, Buckley MJ, Rushworth MF (2006) Optimal decision making and the anterior cingulate cortex. Nature Neu-rosci 9:940-947.
40. Kennerley SW, Dahmubed AF, Lara AH, Wallis JD (2009) Neurons in the frontal lobe encode the value of multiple decision variables. J Cogn Neu-rosci 21:1162-1178.
41. Klein JC, Rushworth MF, Behrens TE, Mackay CE, de Crespigny AJ, D'Arceuil H, Johansen-Berg H (2010) Topography of connections between human prefrontal cortex and mediodorsal thalamus studied with diffusion tractography. Neuroimage 51:555-564.
42. Klein TA, Neumann J, Reuter M, Hennig J, von Cramon DY, Ullsperger M (2007) Genetically determined differences in learning from errors. Science 318:1642-1645.
43. Kondo H, Saleem KS, Price JL (2005) Differential connections of the perirhinal and parahippocampal cortex with the orbital and medial pre-frontal networks in macaque monkeys. J Comp Neurol 493:479-509.
44. Kringelbach ML, Rolls ET (2004) The functional neuroanatomy of the human orbitofrontal cortex: evidence from neuroimaging and neuropsy-chology. Prog Neurobiol 72:341-372.
45. Lebreton M, Jorge S, Michel V, Thirion B, Pessiglione M (2009) An automatic valuation system in the human brain: evidence from functional neuroimaging. Neuron 64:431-439.
46. Lee AC, Bandelow S, Schwarzbauer C, Henson RN, Graham KS (2006) Perirhinal cortex activity during visual object discrimination: an event-related fMRI study. Neuroimage 33:362-373.
47. Luk CH, Wallis JD (2009) Dynamic encoding of responses and outcomes by neurons in medial prefrontal cortex. J Neurosci 29:7526-7539.
48. Malkova L, Gaffan D, Murray EA (1997) Excitotoxic lesionsofthe amygdala fail to produce impairment in visual learning for auditory secondary reinforcement but interfere with reinforcer devaluation effects in rhesus monkeys. J Neurosci 17:6011-6020.
49. Mars RB, Coles MG, Grol MJ, Holroyd CB, Nieuwenhuis S, Hulstijn W, Toni I (2005) Neural dynamics of error processing in medial frontal cortex. Neuroimage 28:1007-1013.
50. Matsumoto K, Suzuki W, Tanaka K (2003) Neuronal correlates of goal-based motor selection in the prefrontal cortex. Science 301:229-232.
51. Matsumoto M, Hikosaka O (2007) Lateral habenula as a source of negative reward signals in dopamine neurons. Nature 447:1111-1115.
52. Matsumoto M, Matsumoto K, Abe H, Tanaka K (2007) Medial prefrontal cell activity signaling prediction errors of action values. Nat Neurosci 10:647-656.
53. Murayama K, Matsumoto M, Izuma K, Matsumoto K (2010) Neural basis of the undermining effect of monetary reward on intrinsic motivation. Proc Natl Acad Sci U S A 107:20911-20916.
54. Murray EA, Richmond BJ (2001) Role of perirhinal cortex in object perception, memory, and associations. Curr Opin Neurobiol 11:188-193.
55. Murray EA, Bussey TJ, Saksida LM (2007) Visual perception and memory: a new viewofmedial temporal lobe functioninprimates and rodents. Annu Rev Neurosci 30:99-122.
56. Noonan MP, Walton ME, Behrens TE, Sallet J, Buckley MJ, Rushworth MF (2010) Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex. Proc Natl Acad Sci U S A 107:20547-20552.
57. O'Doherty JP, Deichmann R, Critchley HD, Dolan RJ (2002) Neural responses during anticipation of a primary taste reward. Neuron 33:815- 826.
58. O'Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ (2004) Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304:452-454.
59. Ongur D, An X, Price JL (1998) Orbital and medial prefrontal cortical projections to the hypothalamus in macaque monkeys. J Comp Neurol 401:480-505.
60. Ongur D, Ferry AT, Price JL (2003) Architectonic subdivision of the human orbital and medial prefrontal cortex. J Comp Neurol 460:425-449.
61. Ostlund S, Balleine BW (2007) The contribution of orbitofrontal cortex to action selection. Ann N Y Acad Sci 1121:174-192.
62. Passingham RE, Toni I, Rushworth MFS (2000) Specialisation within the prefrontal cortex: the ventral prefrontal cortex and associative learning. Exp Brain Res 133:103-113.
63. Petrides M (2005) Lateral prefrontal cortex: architectonic and functional organization. Philos Trans R Soc Lond B Biol Sci 360:781-795.
64. Picard N, Strick PL (2001) Imaging the premotor areas. Curr Opin Neuro-biol 11:663-672.
65. Plassmann H, O'Doherty J, Rangel A (2007) Orbitofrontal cortex encodes willingness to pay in everyday economic transactions. J Neurosci 27:9984-9988.
66. Plaza V, Estévez AF, López-Crespo G, Fuentes LJ (2011) Enhancing recognition memory in adults through differential outcomes. Acta Psychol (Amst) 136:129-136.
67. Prevost C, Pessiglione M, Metereau E, Clery-Melin ML, Dreher JC (2010) Separate valuation subsystems for delay and effort decision costs. J Neu-rosci 30:14080-14090.
68. Quilodran R, Rothe M, Procyk E (2008) Behavioral shifts and action valuation in the anterior cingulate cortex. Neuron 57:314-325.
69. Rangel A, Hare T (2010) Neural computations associated with goal-directed choice. Curr Opin Neurobiol 20:262-270.
70. Rangel A, Camerer C, Montague PR (2008) A framework for studying the neurobiology of value-based decision making. Nat Rev Neurosci 9:545-556.
71. Ray JP, Price JL (1993) The organization of projections from the mediodor-sal nucleus of the thalamus to orbital and medial prefrontal cortex in macaque monkeys. J Comp Neurol 337:1-31.
72. Rempel-Clower NI, Barbas H (1998) Topographic organization of connections between the hypothalamus and prefrontal cortexin the rhesus monkey. J Comp Neurol 398:393-419.
73. Rudebeck PH, Murray EA (2011) Dissociable effects of subtotal lesions within the macaque orbital prefrontal cortex on reward-guided behavior. J Neurosci 31:10569-10578.
74. Rudebeck PH, Behrens TE, Kennerley SW, Baxter MG, Buckley MJ, Walton ME, Rushworth MF (2008) Frontal cortex subregions play distinct roles in choices between actions and stimuli. J Neurosci 28:13775-13785.
75. Rushworth MF, Behrens TE (2008) Choice, uncertainty and value in pre-frontal and cingulate cortex. Nat Neurosci 11:389-397.
76. Rushworth MF, Behrens TE, Rudebeck PH, Walton ME (2007) Contrasting roles for cingulate and orbitofrontal cortex in decisions and social behaviour. Trends Cogn Sci 11:168-176.
77. Rushworth MF, Noonan MP, Boorman ED, Walton ME, Behrens TE (2011) Frontal cortex and reward-guided learning and decision-making. Neuron 70:1054-1069.
78. Saksida LM, Bussey TJ, Buckmaster CA, Murray EA (2007) Impairment and facilitation of transverse patterning after lesions of the perirhinal cortex and hippocampus, respectively. Cereb Cortex 17:108-115.
79. Saleem KS, Kondo H, Price JL (2008) Complementary circuits connecting the orbital and medial prefrontal networks with the temporal, insular, and opercular cortex in the macaque monkey. J Comp Neurol 506:659-693.
80. Sallet J, Quilodran R, Rothe M, Vezoli J, Joseph JP, Procyk E (2007) Expectations, gains, and losses in the anterior cingulate cortex. Cogn Affect Behav Neurosci 7:327-336.
81. Savage LM (2001) In search of the neurobiological underpinnings of the differential outcomes effect. Integr Physiol Behav Sci 36:182-195.
82. Schoenbaum G, Roesch M (2005) Orbitofrontal cortex, associative learning, and expectancies. Neuron 47:633-636.
83. Sescousse G, Redoute J, Dreher JC (2010) The architecture of reward value coding in the human orbitofrontal cortex. J Neurosci 30:13095-13104.
84. Smith DV, Hayden BY, Truong TK, Song AW, Platt ML, Huettel SA (2010) Distinct value signals in anterior and posterior ventromedial prefrontal cortex. J Neurosci 30:2490-2495.
85. Smith SM (2002) Fast robust automated brain extraction. Hum Brain Mapp 17:143-155.
86. Tanaka SC, Doya K, Okada G, Ueda K, Okamoto Y, Yamawaki S (2004) Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops. Nat Neurosci 7:887-893.
87. Tobler PN, Fletcher PC, Bullmore ET, Schultz W (2007) Learning-related human brain activations reflecting individual finances. Neuron 54:167-175.
88. Tobler PN, Christopoulos GI, O'Doherty JP, Dolan RJ, Schultz W (2009) Risk-dependent reward value signal in human prefrontal cortex. Proc Natl Acad Sci U S A 106:7185-7190.
89. Tsujimoto S, Genovesio A, Wise SP (2009) Monkey orbitofrontal cortex encodes response choices near feedback time. J Neurosci 29:2569-2574.
90. Ullsperger M, von Cramon DY (2003) Error monitoring using external feedback: specific roles of the habenular complex, the reward system, and the cingulate motor area revealed by functional magnetic resonance imaging. J Neurosci 23:4308-4314.
91. Valentin VV, Dickinson A, O'Doherty JP (2007) Determining the neural substrates of goal-directed learning in the human brain. J Neurosci 27:4019-4026.
92. Vogt B (2008) Architecture, cytology and comparative organization of primate cingulate cortex. In: Cingulate neurobiology and disease (Vogt B, ed). Oxford, UK: Oxford UP.
93. Walton ME, Devlin JT, Rushworth MFS (2004) Interactions between decision making and performance monitoring within prefrontal cortex. Nat Neurosci 7:1259-1265.
94. Walton ME, Behrens TE, Buckley MJ, Rudebeck PH, Rushworth MF (2010) Separable learning systems in the macaque brain and the role of orbito-frontal cortex in contingent learning. Neuron 65:927-939.
95. Wise SP, Murray EA (2000) Arbitrary associations between antecedents and actions. Trends Neurosci 23:271-276.
96. Woolrich MW, Ripley BD, Brady M, Smith SM (2001) Temporal autocorrelation in univariate linear modeling of FMRI data. Neuroimage 14:1370-1386.
97. Wunderlich K, Rangel A, O'Doherty J (2011) Economic choices can be made using only stimulus values. Proc Natl Acad Sci U S A 107:15005- 15010.