Cross-species studies of orbitofrontal cortex and value-based decision-making

Nature Neuroscience

Volumn 15, Issue 1, 2012, Pages 13-19

  Wallis, Jonathan D ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL BEHAVIOR; BRAIN FUNCTION; COMPARATIVE ANATOMY; DECISION MAKING; HUMAN; IMAGE ANALYSIS; NEUROANATOMY; NEUROIMAGING; NEUROPHYSIOLOGY; NONHUMAN; ORBITAL CORTEX; PRIORITY JOURNAL; REVIEW; SPECIES COMPARISON; SPECIES DIFFERENCE; TASK PERFORMANCE;

ANIMALS; DECISION MAKING; FRONTAL LOBE; HAPLORHINI; HUMANS; SOCIAL VALUES;

EID: 84655163444     PISSN: 10976256     EISSN: 15461726     Source Type: Journal    
DOI: 10.1038/nn.2956     Document Type: Review

References (92)

1. Cavada, C. & Schultz, W. The mysterious orbitofrontal cortex. Foreword. Cereb. Cortex 10, 205 (2000).
2. Gold, J.I. & Shadlen, M.N. The neural basis of decision making. Annu. Rev. Neurosci. 30, 535-574 (2007). (Pubitemid 47218767)
3. Rangel, A., Camerer, C. & Montague, P.R. A framework for studying the neurobiology of value-based decision making. Nat. Rev. Neurosci. 9, 545-556 (2008). (Pubitemid 351873461)
4. Damasio, A.R. Descartes' Error: Emotion, Reason, and the Human Brain (Putman, New York, 1994).
5. Bechara, A., Damasio, A.R., Damasio, H. & Anderson, S.W. Insensitivity to future consequences following damage to human prefrontal cortex. Cognition 50, 7-15 (1994).
6. Fellows, L.K. & Farah, M.J. The role of ventromedial prefrontal cortex in decision making: judgment under uncertainty or judgment per se? Cereb. Cortex 17, 2669-2674 (2007). (Pubitemid 47537827)
7. Manes, F. et al. Decision-making processes following damage to the prefrontal cortex. Brain 125, 624-639 (2002). (Pubitemid 34194416)
8. Bechara, A., Damasio, H., Tranel, D. & Anderson, S.W. Dissociation of working memory from decision making within the human prefrontal cortex. J. Neurosci. 18, 428-437 (1998). (Pubitemid 28046800)
9. Tsuchida, A., Doll, B.B. & Fellows, L.K. Beyond reversal: a critical role for human orbitofrontal cortex in flexible learning from probabilistic feedback. J. Neurosci. 30, 16868-16875 (2010).
10. Sescousse, G., Redoute, J. & Dreher, J.C. The architecture of reward value coding in the human orbitofrontal cortex. J. Neurosci. 30, 13095-13104 (2010).
11. Peters, J. & Buchel, C. Overlapping and distinct neural systems code for subjective value during intertemporal and risky decision making. J. Neurosci. 29, 15727-15734 (2009).
12. Smith, D.V. et al. Distinct value signals in anterior and posterior ventromedial prefrontal cortex. J. Neurosci. 30, 2490-2495 (2010).
13. FitzGerald, T.H., Seymour, B. & Dolan, R.J. The role of human orbitofrontal cortex in value comparison for incommensurable objects. J. Neurosci. 29, 8388-8395 (2009).
14. Basten, U., Biele, G., Heekeren, H.R. & Fiebach, C.J. How the brain integrates costs and benefits during decision making. Proc. Natl. Acad. Sci. USA 107, 21767-21772 (2010).
15. Talmi, D., Dayan, P., Kiebel, S.J., Frith, C.D. & Dolan, R.J. How humans integrate the prospects of pain and reward during choice. J. Neurosci. 29, 14617-14626 (2009).
16. Kable, J.W. & Glimcher, P.W. The neural correlates of subjective value during intertemporal choice. Nat. Neurosci. 10, 1625-1633 (2007). (Pubitemid 350175876)
17. Kahnt, T., Heinzle, J., Park, S.Q. & Haynes, J.D. The neural code of reward anticipation in human orbitofrontal cortex. Proc. Natl. Acad. Sci. USA 107, 6010-6015 (2010).
18. Croxson, P.L., Walton, M.E., O'Reilly, J.X., Behrens, T.E. & Rushworth, M.F. Effortbased cost-benefit valuation and the human brain. J. Neurosci. 29, 4531-4541 (2009).
19. Gottfried, J.A., O'Doherty, J. & Dolan, R.J. Encoding predictive reward value in human amygdala and orbitofrontal cortex. Science 301, 1104-1107 (2003). (Pubitemid 37022314)
20. Hare, T.A., O'Doherty, J., Camerer, C.F., Schultz, W. & Rangel, A. Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J. Neurosci. 28, 5623-5630 (2008).
21. Walton, M.E., Behrens, T.E., Buckley, M.J., Rudebeck, P.H. & Rushworth, M.F. Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning. Neuron 65, 927-939 (2010).
22. Baxter, M.G., Parker, A., Lindner, C.C., Izquierdo, A.D. & Murray, E.A. Control of response selection by reinforcer value requires interaction of amygdala and orbital prefrontal cortex. J. Neurosci. 20, 4311-4319 (2000). (Pubitemid 30365701)
23. Tremblay, L. & Schultz, W. Relative reward preference in primate orbitofrontal cortex. Nature 398, 704-708 (1999). (Pubitemid 29197648)
24. Wallis, J.D. & Miller, E.K. Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task. Eur. J. Neurosci. 18, 2069-2081 (2003). (Pubitemid 37372389)
25. Kennerley, S.W. & Wallis, J.D. Encoding of reward and space during a working memory task in the orbitofrontal cortex and anterior cingulate sulcus. J. Neurophysiol. 102, 3352-3364 (2009).
26. Padoa-Schioppa, C. & Assad, J.A. Neurons in the orbitofrontal cortex encode economic value. Nature 441, 223-226 (2006).
27. Morrison, S.E. & Salzman, C.D. The convergence of information about rewarding and aversive stimuli in single neurons. J. Neurosci. 29, 11471-11483 (2009).
28. Roesch, M.R. & Olson, C.R. Neuronal activity related to reward value and motivation in primate frontal cortex. Science 304, 307-310 (2004). (Pubitemid 38452186)
29. Schoenbaum, G., Chiba, A.A. & Gallagher, M. Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning. Nat. Neurosci. 1, 155-159 (1998).
30. Abe, H. & Lee, D. Distributed coding of actual and hypothetical outcomes in the orbital and dorsolateral prefrontal cortex. Neuron 70, 731-741 (2011).
31. Roesch, M.R. & Olson, C.R. Neuronal activity in primate orbitofrontal cortex reflects the value of time. J. Neurophysiol. 94, 2457-2471 (2005). (Pubitemid 41324670)
32. Roesch, M.R., Taylor, A.R. & Schoenbaum, G. Encoding of time-discounted rewards in orbitofrontal cortex is independent of value representation. Neuron 51, 509-520 (2006). (Pubitemid 44189799)
33. Kennerley, S.W., Dahmubed, A.F., Lara, A.H. & Wallis, J.D. Neurons in the frontal lobe encode the value of multiple decision variables. J. Cogn. Neurosci. 21, 1162-1178 (2009).
34. Kepecs, A., Uchida, N., Zariwala, H.A. & Mainen, Z.F. Neural correlates, computation and behavioral impact of decision confidence. Nature 455, 227-231 (2008).
35. Murray, E.A., O'Doherty, J.P. & Schoenbaum, G. What we know and do not know about the functions of the orbitofrontal cortex after 20 years of cross-species studies. J. Neurosci. 27, 8166-8169 (2007). (Pubitemid 47219598)
36. Padoa-Schioppa, C. Neurobiology of economic choice: a good-based model. Annu. Rev. Neurosci. 34, 333-359 (2010).
37. Wallis, J.D. Neuronal mechanisms in prefrontal cortex underlying adaptive choice behavior. Ann. NY Acad. Sci. 1121, 447-460 (2007).
38. Petrides, M. & Pandya, D.N. Comparative architectonic analysis of the human and macaque frontal cortex. in Handbook of Neuropsychology (eds. F. Boller & J. Grafman) 17-57 (Elsevier, New York, 1994).
39. Carmichael, S.T. & Price, J.L. Architectonic subdivision of the orbital and medial prefrontal cortex in the macaque monkey. J. Comp. Neurol. 346, 366-402 (1994). (Pubitemid 24258509)
40. Carmichael, S.T. & Price, J.L. Limbic connections of the orbital and medial prefrontal cortex in macaque monkeys. J. Comp. Neurol. 363, 615-641 (1995). (Pubitemid 26028725)
41. Ongür, D., An, X. & Price, J.L. Prefrontal cortical projections to the hypothalamus in macaque monkeys. J. Comp. Neurol. 401, 480-505 (1998). (Pubitemid 28509881)
42. Haber, S.N., Kunishio, K., Mizobuchi, M. & Lynd-Balta, E. The orbital and medial prefrontal circuit through the primate basal ganglia. J. Neurosci. 15, 4851-4867 (1995).
43. Romanski, L.M., Bates, J.F. & Goldman-Rakic, P.S. Auditory belt and parabelt projections to the prefrontal cortex in the rhesus monkey. J. Comp. Neurol. 403, 141-157 (1999). (Pubitemid 28566827)
44. Carmichael, S.T. & Price, J.L. Sensory and premotor connections of the orbital and medial prefrontal cortex of macaque monkeys. J. Comp. Neurol. 363, 642-664 (1995). (Pubitemid 26028726)
45. Cavada, C., Company, T., Tejedor, J., Cruz-Rizzolo, R.J. & Reinoso-Suarez, F. The anatomical connections of the macaque monkey orbitofrontal cortex. A review. Cereb. Cortex 10, 220-242 (2000). (Pubitemid 30159290)
46. Carmichael, S.T. & Price, J.L. Connectional networks within the orbital and medial prefrontal cortex of macaque monkeys. J. Comp. Neurol. 371, 179-207 (1996). (Pubitemid 26260010)
47. Plassmann, H., O'Doherty, J. & Rangel, A. Orbitofrontal cortex encodes willingness to pay in everyday economic transactions. J. Neurosci. 27, 9984-9988 (2007). (Pubitemid 47404004)
48. Ballard, K. & Knutson, B. Dissociable neural representations of future reward magnitude and delay during temporal discounting. Neuroimage 45, 143-150 (2009).
49. Mackey, S. & Petrides, M. Architectonic mapping of the medial region of the human orbitofrontal cortex by density profiles. Neuroscience 159, 1089-1107 (2009).
50. Croxson, P.L. et al. Quantitative investigation of connections of the prefrontal cortex in the human and macaque using probabilistic diffusion tractography. J. Neurosci. 25, 8854-8866 (2005). (Pubitemid 41384453)
51. Elston, G.N. Specialization of the neocortical pyramidal cell during primate evolution. in Evolution of Nervous Systems: a Comprehensive Reference. (eds. J. Kaas & T.M. Preuss), 191-242 (Elsevier, New York, 2007).
52. Price, J.L. Definition of the orbital cortex in relation to specific connections with limbic and visceral structures and other cortical regions. Ann. NY Acad. Sci. 1121, 54-71 (2007).
53. Wallis, J.D. Orbitofrontal cortex and its contribution to decision-making. Annu. Rev. Neurosci. 30, 31-56 (2007). (Pubitemid 47218750)
54. Gallagher, M., McMahan, R.W. & Schoenbaum, G. Orbitofrontal cortex and representation of incentive value in associative learning. J. Neurosci. 19, 6610-6614 (1999). (Pubitemid 29347459)
55. Valentin, V.V., Dickinson, A. & O'Doherty, J.P. Determining the neural substrates of goal-directed learning in the human brain. J. Neurosci. 27, 4019-4026 (2007). (Pubitemid 46597159)
56. O'Doherty, J., Kringelbach, M.L., Rolls, E.T., Hornak, J. & Andrews, C. Abstract reward and punishment representations in the human orbitofrontal cortex. Nat. Neurosci. 4, 95-102 (2001). (Pubitemid 32095532)
57. Tom, S.M., Fox, C.R., Trepel, C. & Poldrack, R.A. The neural basis of loss aversion in decision-making under risk. Science 315, 515-518 (2007). (Pubitemid 46175755)
58. Plassmann, H., O'Doherty, J.P. & Rangel, A. Appetitive and aversive goal values are encoded in the medial orbitofrontal cortex at the time of decision making. J. Neurosci. 30, 10799-10808 (2010).
59. Bouret, S. & Richmond, B.J. Ventromedial and orbital prefrontal neurons differentially encode internally and externally driven motivational values in monkeys. J. Neurosci. 30, 8591-8601 (2010).
60. Rudebeck, P.H. & Murray, E.A. Dissociable effects of subtotal lesions within the macaque orbital prefrontal cortex on reward-guided behavior. J. Neurosci. 31, 10569-10578 (2011).
61. Noonan, M.P. et al. Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex. Proc. Natl. Acad. Sci. USA 107, 20547-20552 (2010).
62. Rilling, J. et al. A neural basis for social cooperation. Neuron 35, 395-405 (2002). (Pubitemid 34876740)
63. Bartels, A. & Zeki, S. The neural correlates of maternal and romantic love. Neuroimage 21, 1155-1166 (2004). (Pubitemid 38314977)
64. King-Casas, B. et al. Getting to know you: reputation and trust in a two-person economic exchange. Science 308, 78-83 (2005). (Pubitemid 40471001)
65. Noonan, M.P., Sallet, J., Rudebeck, P.H., Buckley, M.J. & Rushworth, M.F. Does the medial orbitofrontal cortex have a role in social valuation? Eur. J. Neurosci. 31, 2341-2351 (2010).
66. Rudebeck, P.H., Buckley, M.J., Walton, M.E. & Rushworth, M.F. A role for the macaque anterior cingulate gyrus in social valuation. Science 313, 1310-1312 (2006). (Pubitemid 44330959)
67. Glover, G.H. & Law, C.S. Spiral-in/out BOLD fMRI for increased SNR and reduced susceptibility artifacts. Magn. Reson. Med. 46, 515-522 (2001). (Pubitemid 32831327)
68. Arana, F.S. et al. Dissociable contributions of the human amygdala and orbitofrontal cortex to incentive motivation and goal selection. J. Neurosci. 23, 9632-9638 (2003). (Pubitemid 37352063)
69. Chaudhry, A.M., Parkinson, J.A., Hinton, E.C., Owen, A.M. & Roberts, A.C. Preference judgments involve a network of structures within frontal, cingulate and insula cortices. Eur. J. Neurosci. 29, 1047-1055 (2009).
70. Logothetis, N.K., Pauls, J., Augath, M., Trinath, T. & Oeltermann, A. Neurophysiological investigation of the basis of the fMRI signal. Nature 412, 150-157 (2001). (Pubitemid 32674704)
71. Buzsáki, G., Kaila, K. & Raichle, M. Inhibition and brain work. Neuron 56, 771-783 (2007). (Pubitemid 350181358)
72. Logothetis, N.K. What we can do and what we cannot do with fMRI. Nature 453, 869-878 (2008). (Pubitemid 351832564)
73. Blake, R. & Logothetis, N.K. Visual competition. Nat. Rev. Neurosci. 3, 13-21 (2002).
74. Sirotin, Y.B. & Das, A. Anticipatory haemodynamic signals in sensory cortex not predicted by local neuronal activity. Nature 457, 475-479 (2009).
75. Kennerley, S.W. & Wallis, J.D. Evaluating choices by single neurons in the frontal lobe: outcome value encoded across multiple decision variables. Eur. J. Neurosci. 29, 2061-2073 (2009).
76. Padoa-Schioppa, C. Range-adapting representation of economic value in the orbitofrontal cortex. J. Neurosci. 29, 14004-14014 (2009).
77. Haynes, J.D. & Rees, G. Decoding mental states from brain activity in humans. Nat. Rev. Neurosci. 7, 523-534 (2006). (Pubitemid 43989773)
78. Norman, K.A., Polyn, S.M., Detre, G.J. & Haxby, J.V. Beyond mind-reading: multi-voxel pattern analysis of fMRI data. Trends Cogn. Sci. 10, 424-430 (2006). (Pubitemid 44308461)
79. van Duuren, E. et al. Neural coding of reward magnitude in the orbitofrontal cortex of the rat during a five-odor olfactory discrimination task. Learn. Mem. 14, 446-456 (2007).
80. van Duuren, E. et al. Single-cell and population coding of expected reward probability in the orbitofrontal cortex of the rat. J. Neurosci. 29, 8965-8976 (2009).
81. Canolty, R.T. et al. Oscillatory phase coupling coordinates anatomically dispersed functional cell assemblies. Proc. Natl. Acad. Sci. USA 107, 17356-17361 (2010).
82. van Wingerden, M., Vinck, M., Lankelma, J.V. & Pennartz, C.M. Learning-associated gamma-band phase-locking of action-outcome selective neurons in orbitofrontal cortex. J. Neurosci. 30, 10025-10038 (2010).
83. Burke, K.A., Franz, T.M., Miller, D.N. & Schoenbaum, G. The role of the orbitofrontal cortex in the pursuit of happiness and more specific rewards. Nature 454, 340-344 (2008).
84. Rudebeck, P.H., Walton, M.E., Smyth, A.N., Bannerman, D.M. & Rushworth, M.F. Separate neural pathways process different decision costs. Nat. Neurosci. 9, 1161-1168 (2006). (Pubitemid 44306310)
85. Furuyashiki, T., Holland, P.C. & Gallagher, M. Rat orbitofrontal cortex separately encodes response and outcome information during performance of goal-directed behavior. J. Neurosci. 28, 5127-5138 (2008).
86. Feierstein, C.E., Quirk, M.C., Uchida, N., Sosulski, D.L. & Mainen, Z.F. Representation of spatial goals in rat orbitofrontal cortex. Neuron 51, 495-507 (2006). (Pubitemid 44189800)
87. Tsujimoto, S., Genovesio, A. & Wise, S.P. Monkey orbitofrontal cortex encodes response choices near feedback time. J. Neurosci. 29, 2569-2574 (2009).
88. Lara, A.H., Kennerley, S.W. & Wallis, J.D. Encoding of gustatory working memory by orbitofrontal neurons. J. Neurosci. 29, 765-774 (2009).
89. Ongür, D., Ferry, A.T. & Price, J.L. Architectonic subdivision of the human orbital and medial prefrontal cortex. J. Comp. Neurol. 460, 425-449 (2003). (Pubitemid 36514619)
90. Palomero-Gallagher, N. & Zilles, K. Isocortex. in The Rat Nervous System (ed. G. Paxinos) 729-757 (Elsevier Academic Press, San Diego, CA, 2004).
91. Wise, S.P. Forward frontal fields: phylogeny and fundamental function. Trends Neurosci. 31, 599-608 (2008).
92. Mackey, S. & Petrides, M. Quantitative demonstration of comparable architectonic areas within the ventromedial and lateral orbital frontal cortex in the human and the macaque monkey brains. Eur. J. Neurosci. 32, 1940-1950 (2010).