Connectivity reveals relationship of brain areas for reward-guided learning and decision making in human and monkey frontal cortex

Proceedings of the National Academy of Sciences of the United States of America

Volumn 112, Issue 20, 2015, Pages E2695-E2704

  Neubert, Franz Xaver ^a   Mars, Rogier B ^a,b,c   Sallet, Jérôme ^a   Rushworth, Matthew F S ^a,b  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b JOHN RADCLIFFE HOSPITAL   (United Kingdom)

^c RADBOUD UNIVERSITY   (Netherlands)

Author keywords

Anterior cingulate cortex; Comparative anatomy; Decision making; Orbitofrontal cortex; Resting state functional connectivity

Indexed keywords

ADULT; AMYGDALOID NUCLEUS; ANIMAL EXPERIMENT; ANTERIOR CINGULATE; ARTICLE; BRAIN REGION; COMPARATIVE ANATOMY; CONTROLLED STUDY; DECISION MAKING; DIFFUSION WEIGHTED IMAGING; EXECUTIVE FUNCTION; FEMALE; FRONTAL CORTEX; FUNCTIONAL ANATOMY; FUNCTIONAL MAGNETIC RESONANCE IMAGING; GLOBUS PALLIDUS; HUMAN; HUMAN EXPERIMENT; HUMAN VERSUS ANIMAL COMPARISON; HYPOTHALAMUS; INSULA; LATERAL ORBITOFRONTAL CORTEX; LEARNING; MACACA; MALE; MEDIAL FRONTAL CORTEX; NONHUMAN; NORMAL HUMAN; ORBITAL CORTEX; PARIETAL OPERCULUM; POSTERIOR CINGULATE; PRIORITY JOURNAL; REWARD; STIMULUS RESPONSE; SUPPLEMENTARY MOTOR AREA; TEMPORAL CORTEX; TRACTOGRAPHY; VENTRAL STRIATUM; VENTROMEDIAL PREFRONTAL CORTEX; ANIMAL; BIOLOGICAL MODEL; COMPARATIVE STUDY; CONNECTOME; FRONTAL LOBE; NUCLEAR MAGNETIC RESONANCE IMAGING; PHYSIOLOGY; PROCEDURES; SPECIES DIFFERENCE;

ANIMALS; CONNECTOME; DECISION MAKING; FRONTAL LOBE; HUMANS; LEARNING; MACACA; MAGNETIC RESONANCE IMAGING; MODELS, NEUROLOGICAL; REWARD; SPECIES SPECIFICITY;

EID: 84929430289     PISSN: 00278424     EISSN: 10916490     Source Type: Journal    
DOI: 10.1073/pnas.1410767112     Document Type: Article

References (90)

1. Wallis JD (2012) Cross-species studies of orbitofrontal cortex and value-based decision-making. Nat Neurosci 15(1):13-19.
2. Rangel A, Hare T (2010) Neural computations associated with goal-directed choice. Curr Opin Neurobiol 20(2):262-270.
3. O'Doherty JP (2011) Contributions of the ventromedial prefrontal cortex to goaldirected action selection. Ann N Y Acad Sci 1239:118-129.
4. Bouret S, Richmond BJ (2010) Ventromedial and orbital prefrontal neurons differentially encode internally and externally driven motivational values in monkeys. J Neurosci 30(25):8591-8601.
5. Monosov IE, Hikosaka O (2012) Regionally distinct processing of rewards and punishments by the primate ventromedial prefrontal cortex. J Neurosci 32(30):10318-10330.
6. Padoa-Schioppa C, Cai X (2011) The orbitofrontal cortex and the computation of subjective value: Consolidated concepts and new perspectives. Ann N Y Acad Sci 1239: 130-137.
7. Cole MW, Yeung N, Freiwald WA, Botvinick M (2009) Cingulate cortex: Diverging data from humans and monkeys. Trends Neurosci 32(11):566-574.
8. Rushworth MF, Noonan MP, Boorman ED, Walton ME, Behrens TE (2011) Frontal cortex and reward-guided learning and decision-making. Neuron 70(6):1054-1069.
9. Hare TA, Schultz W, Camerer CF, O'Doherty JP, Rangel A (2011) Transformation of stimulus value signals into motor commands during simple choice. Proc Natl Acad Sci USA 108(44):18120-18125.
10. Kolling N, Behrens TE, Mars RB, Rushworth MF (2012) Neural mechanisms of foraging. Science 336(6077):95-98.
11. Amemori K, Graybiel AM (2012) Localized microstimulation of primate pregenual cingulate cortex induces negative decision-making. Nat Neurosci 15(5):776-785.
12. Cai X, Padoa-Schioppa C (2012) Neuronal encoding of subjective value in dorsal and ventral anterior cingulate cortex. J Neurosci 32(11):3791-3808.
13. Dosenbach NU, et al. (2006) A core system for the implementation of task sets. Neuron 50(5):799-812.
14. Ridderinkhof KR, Ullsperger M, Crone EA, Nieuwenhuis S (2004) The role of the medial frontal cortex in cognitive control. Science 306(5695):443-447.
15. O'Reilly JX, et al. (2013) Causal effect of disconnection lesions on interhemispheric functional connectivity in rhesus monkeys. Proc Natl Acad Sci USA 110(34):13982-13987.
16. Passingham RE, Stephan KE, Kötter R (2002) The anatomical basis of functional localization in the cortex. Nat Rev Neurosci 3(8):606-616.
17. Sallet J, et al. (2013) The organization of dorsal frontal cortex in humans and macaques. JNeurosci33(30):12255-12274.
18. Mars RB, Sallet J, Neubert FX, Rushworth MF (2013) Connectivity profiles reveal the relationship between brain areas for social cognition in human and monkey temporoparietal cortex. Proc Natl Acad Sci USA 110(26):10806-10811.
19. Neubert FX, Mars RB, Thomas AG, Sallet J, Rushworth MF (2014) Comparison of human ventral frontal cortex areas for cognitive control and language with areas in monkey frontal cortex. Neuron 81(3):700-713.
20. Plassmann H, O'Doherty J, Rangel A (2007) Orbitofrontal cortex encodes willingness to pay in everyday economic transactions. J Neurosci 27(37):9984-9988.
21. Boorman ED, Behrens TE, Woolrich MW, Rushworth MF (2009) How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action. Neuron 62(5):733-743.
22. Gläscher J, Hampton AN, O'Doherty JP (2009) Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making. Cereb Cortex 19(2):483-495.
23. Lim SL, O'Doherty JP, Rangel A (2011) The decision value computations in the vmPFC and striatum use a relative value code that is guided by visual attention. J Neurosci 31(37):13214-13223.
24. Lebreton M, Jorge S, Michel V, Thirion B, Pessiglione M (2009) An automatic valuation system in the human brain: Evidence from functional neuroimaging. Neuron 64(3):431-439.
25. Cooper JC, Kreps TA, Wiebe T, Pirkl T, Knutson B (2010) When giving is good: Ventromedial prefrontal cortex activation for others' intentions. Neuron 67(3):511-521.
26. Levy DJ, Glimcher PW (2011) Comparing apples and oranges: Using reward-specific and reward-general subjective value representation in the brain. J Neurosci 31(41):14693-14707.
27. Kable JW, Glimcher PW (2007) The neural correlates of subjective value during intertemporal choice. Nat Neurosci 10(12):1625-1633.
28. McNamee D, Rangel A, O'Doherty JP (2013) Category-dependent and categoryindependent goal-value codes in human ventromedial prefrontal cortex. Nat Neurosci 16(4):479-485.
29. De Martino B, Fleming SM, Garrett N, Dolan RJ (2013) Confidence in value-based choice. Nat Neurosci 16(1):105-110.
30. Barron HC, Dolan RJ, Behrens TE (2013) Online evaluation of novel choices by simultaneous representation of multiple memories. Nat Neurosci 16(10):1492-1498.
31. Mackey S, Petrides M (2010) Quantitative demonstration of comparable architectonic areas within the ventromedial and lateral orbital frontal cortex in the human and the macaque monkey brains. Eur J Neurosci 32(11):1940-1950.
32. Saleem KS, Logothetis NK (2007) A Combined MRI and Histology Atlas of the Rhesus Monkey Brain in Stereotaxic Coordinates (Academic, London; Burlington, MA), pp ix, 326 pp.
33. Grabenhorst F, Rolls ET (2011) Value, pleasure and choice in the ventral prefrontal cortex. Trends Cogn Sci 15(2):56-67.
34. Rolls ET, Grabenhorst F, Parris BA (2010) Neural systems underlying decisions about affective odors. J Cogn Neurosci 22(5):1069-1082.
35. Rolls ET, Grabenhorst F, Deco G (2010) Decision-making, errors, and confidence in the brain. J Neurophysiol 104(5):2359-2374.
36. Rolls ET, Grabenhorst F, Deco G (2010) Choice, difficulty, and confidence in the brain. Neuroimage 53(2):694-706.
37. Kolling N, Wittmann M, Rushworth MF (2014) Multiple neural mechanisms of decision making and their competition under changing risk pressure. Neuron 81(5):1190-1202.
38. Vogt BA, Vogt L, Farber NB, Bush G (2005) Architecture and neurocytology of monkey cingulate gyrus. J Comp Neurol 485(3):218-239.
39. Morecraft RJ, Cipolloni PB, Stilwell-Morecraft KS, Gedney MT, Pandya DN (2004) Cytoarchitecture and cortical connections of the posterior cingulate and adjacent somatosensory fields in the rhesus monkey. J Comp Neurol 469(1):37-69.
40. Nicolle A, et al. (2012) An agent independent axis for executed and modeled choice in medial prefrontal cortex. Neuron 75(6):1114-1121.
41. Murray EA, Wise SP, Drevets WC (2011) Localization of dysfunction in major depressive disorder: Prefrontal cortex and amygdala. Biol Psychiatry 69(12):e43-e54.
42. Johansen-Berg H, et al. (2008) Anatomical connectivity of the subgenual cingulate region targeted with deep brain stimulation for treatment-resistant depression. Cereb Cortex 18(6):1374-1383.
43. Braver TS, Barch DM, Gray JR, Molfese DL, Snyder A (2001) Anterior cingulate cortex and response conflict: effects of frequency, inhibition and errors. Cereb Cortex 11(9):825-836.
44. Duncan J, Owen AM (2000) Common regions of the human frontal lobe recruited by diverse cognitive demands. Trends Neurosci 23(10):475-483.
45. Frank MJ, Samanta J, Moustafa AA, Sherman SJ (2007) Hold your horses: Impulsivity, deep brain stimulation, and medication in parkinsonism. Science 318(5854):1309-1312.
46. Picard N, Strick PL (1996) Motor areas of the medial wall: A review of their location and functional activation. Cereb Cortex 6(3):342-353.
47. Dum RP, Strick PL (2002) Motor areas in the frontal lobe of the primate. Physiol Behav 77(4-5):677-682.
48. Walton ME, Devlin JT, Rushworth MFS (2004) Interactions between decision making and performance monitoring within prefrontal cortex. Nat Neurosci 7(11):1259-1265.
49. Behrens TE, Woolrich MW, Walton ME, Rushworth MF (2007) Learning the value of information in an uncertain world. Nat Neurosci 10(9):1214-1221.
50. O'Reilly JX, et al. (2013) Dissociable effects of surprise and model update in parietal and anterior cingulate cortex. Proc Natl Acad Sci USA 110(38):E3660-E3669.
51. Kennerley SW, Behrens TE, Wallis JD (2011) Double dissociation of value computations in orbitofrontal and anterior cingulate neurons. Nat Neurosci 14(12):1581-1589.
52. Matsumoto M, Matsumoto K, Abe H, Tanaka K (2007) Medial prefrontal cell activity signaling prediction errors of action values. Nat Neurosci 10(5):647-656.
53. Padoa-Schioppa C, Assad JA (2008) The representation of economic value in the orbitofrontal cortex is invariant for changes of menu. Nat Neurosci 11(1):95-102.
54. Walton ME, Behrens TE, Buckley MJ, Rudebeck PH, Rushworth MF (2010) Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning. Neuron 65(6):927-939.
55. Noonan MP, Mars RB, Rushworth MF (2011) Distinct roles of three frontal cortical areas in reward-guided behavior. J Neurosci 31(40):14399-14412.
56. Kringelbach ML, Rolls ET (2004) The functional neuroanatomy of the human orbitofrontal cortex: Evidence from neuroimaging and neuropsychology. Prog Neurobiol 72(5):341-372.
57. Rolls ET (2008) Functions of the orbitofrontal and pregenual cingulate cortex in taste, olfaction, appetite and emotion. Acta Physiol Hung 95(2):131-164.
58. Morrison SE, Salzman CD (2009) The convergence of information about rewarding and aversive stimuli in single neurons. J Neurosci 29(37):11471-11483.
59. Rich EL, Wallis JD (2014) Medial-lateral organization of the orbitofrontal cortex. J Cogn Neurosci 26(7):1347-1362.
60. Klein-Flügge MC, Barron HC, Brodersen KH, Dolan RJ, Behrens TE (2013) Segregated encoding of reward-identity and stimulus-reward associations in human orbitofrontal cortex. J Neurosci 33(7):3202-3211.
61. Levy I, Snell J, Nelson AJ, Rustichini A, Glimcher PW (2010) Neural representation of subjective value under risk and ambiguity. J Neurophysiol 103(2):1036-1047.
62. Noonan MP, et al. (2010) Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex. Proc Natl Acad Sci USA 107(47):20547-20552.
63. Tsujimoto S, Genovesio A, Wise SP (2010) Evaluating self-generated decisions in frontal pole cortex of monkeys. Nat Neurosci 13(1):120-126.
64. Johansen-Berg H, et al. (2004) Changes in connectivity profiles define functionally distinct regions in human medial frontal cortex. Proc Natl Acad Sci USA 101(36):13335-13340.
65. Johansen-Berg H, Rushworth MF (2009) Using diffusion imaging to study human connectional anatomy. Annu Rev Neurosci 32:75-94.
66. Mars RB, et al. (2011) Diffusion-weighted imaging tractography-based parcellation of the human parietal cortex and comparison with human and macaque resting-state functional connectivity. J Neurosci 31(11):4087-4100.
67. Scheperjans F, et al. (2008) Probabilistic maps, morphometry, and variability of cytoarchitectonic areas in the human superior parietal cortex. Cereb Cortex 18(9): 2141-2157.
68. Caspers S, et al. (2008) The human inferior parietal lobule in stereotaxic space. Brain Struct Funct 212(6):481-495.
69. Bludau S, et al. (2014) Cytoarchitecture, probability maps and functions of the human frontal pole. Neuroimage 93(Pt 2):260-275.
70. Beckmann M, Johansen-Berg H, Rushworth MF (2009) Connectivity-based parcellation of human cingulate cortex and its relation to functional specialization. J Neurosci 29(4):1175-1190.
71. Paus T, et al. (1996) Human cingulate and paracingulate sulci: Pattern, variability, asymmetry, and probabilistic map. Cereb Cortex 6(2):207-214.
72. Vogt BA, Nimchinsky EA, Vogt LJ, Hof PR (1995) Human cingulate cortex: Surface features, flat maps, and cytoarchitecture. J Comp Neurol 359(3):490-506.
73. Vogt BA, et al. (2013) Cingulate area 32 homologies in mouse, rat, macaque and human: Cytoarchitecture and receptor architecture. J Comp Neurol 521(18):4189-4204.
74. Kahnt T, Chang LJ, Park SQ, Heinzle J, Haynes JD (2012) Connectivity-based parcellation of the human orbitofrontal cortex. J Neurosci 32(18):6240-6250.
75. Ongür D, Price JL (2000) The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. Cereb Cortex 10(3):206-219.
76. Noonan MP, Sallet J, Rudebeck PH, Buckley MJ, Rushworth MF (2010) Does the medial orbitofrontal cortex have a role in social valuation? Eur J Neurosci 31(12):2341-2351.
77. Rudebeck PH, Murray EA (2011) Dissociable effects of subtotal lesions within the macaque orbital prefrontal cortex on reward-guided behavior. J Neurosci 31(29):10569-10578.
78. Rudebeck PH, Murray EA (2011) Balkanizing the primate orbitofrontal cortex: Distinct subregions for comparing and contrasting values. Ann N Y Acad Sci 1239:1-13.
79. Petrides M, Pandya DN (1999) Dorsolateral prefrontal cortex: Comparative cytoarchitectonic analysis in the human and the macaque brain and corticocortical connection patterns. Eur J Neurosci 11(3):1011-1036.
80. Morecraft RJ, et al. (2012) Cytoarchitecture and cortical connections of the anterior cingulate and adjacent somatomotor fields in the rhesus monkey. Brain Res Bull 87(4-5):457-497.
81. Walton ME, Bannerman DM, Alterescu K, Rushworth MFS (2003) Functional specialization within medial frontal cortex of the anterior cingulate for evaluating effortrelated decisions. J Neurosci 23(16):6475-6479.
82. Kennerley SW, Walton ME, Behrens TE, Buckley MJ, Rushworth MF (2006) Optimal decision making and the anterior cingulate cortex. Nat Neurosci 9(7):940-947.
83. Kerns JG, et al. (2004) Anterior cingulate conflict monitoring and adjustments in control. Science 303(5660):1023-1026.
84. Nelissen N, Stokes M, Nobre AC, Rushworth MF (2013) Frontal and parietal cortical interactions with distributed visual representations during selective attention and action selection. J Neurosci 33(42):16443-16458.
85. Yoshida W, Ishii S (2006) Resolution of uncertainty in prefrontal cortex. Neuron 50(5):781-789.
86. Koechlin E, Hyafil A (2007) Anterior prefrontal function and the limits of human decision-making. Science 318(5850):594-598.
87. Volman I, Roelofs K, Koch S, Verhagen L, Toni I (2011) Anterior prefrontal cortex inhibition impairs control over social emotional actions. Curr Biol 21(20):1766-1770.
88. Fleming SM, Weil RS, Nagy Z, Dolan RJ, Rees G (2010) Relating introspective accuracy to individual differences in brain structure. Science 329(5998):1541-1543.
89. O'Reilly JX, Beckmann CF, Tomassini V, Ramnani N, Johansen-Berg H (2010) Distinct and overlapping functional zones in the cerebellum defined by resting state functional connectivity. Cereb Cortex 20(4):953-965.
90. Amiez C, Petrides M (2012) Neuroimaging evidence of the anatomo-functional organization of the human cingulate motor areas. Cereb Cortex 24(3):563-578.