The orbitofrontal cortex and the computation of subjective value: Consolidated concepts and new perspectives

Annals of the New York Academy of Sciences

Volumn 1239, Issue 1, 2011, Pages 130-137

  Padoa Schioppa, Camillo ^a,b,c   Cai, Xinying ^a  

^a WASHINGTON UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b WASHINGTON UNIVERSITY   (United States)

^c WASHINGTON UNIVERSITY IN ST LOUIS   (United States)

Author keywords

Abstract representation; Context adaptation; Decision making; Economic choice; Neuroeconomics; Transitivity

Indexed keywords

ARTICLE; BRAIN DAMAGE; BRAIN FUNCTION; BRAIN NERVE CELL; HUMAN; MENTAL FUNCTION; NONHUMAN; ORBITAL CORTEX; WORKING MEMORY;

EID: 83155189106     PISSN: 00778923     EISSN: 17496632     Source Type: Book Series    
DOI: 10.1111/j.1749-6632.2011.06262.x     Document Type: Article

References (74)

1. Padoa-Schioppa, C. 2007. Orbitofrontal cortex and the computation of economic value. Ann. N. Y. Acad. Sci. 1121: 232-253.
2. Padoa-Schioppa, C. & J.A. Assad. 2006. Neurons in orbitofrontal cortex encode economic value. Nature 441: 223-226.
3. Tremblay, L. & W. Schultz. 1999. Relative reward preference in primate orbitofrontal cortex. Nature 398: 704-708.
4. Roesch, M.R. & C.R. Olson. 2005. Neuronal activity in primate orbitofrontal cortex reflects the value of time. J. Neurophysiol. 94: 2457-2471.
5. Gallagher, M., R.W. McMahan & G. Schoenbaum. 1999. Orbitofrontal cortex and representation of incentive value in associative learning. J. Neurosci. 19: 6610-6614.
6. Pickens, C.L. et al. 2003. Different roles for orbitofrontal cortex and basolateral amygdala in a reinforcer devaluation task. J. Neurosci. 23: 11078-11084.
7. Izquierdo, A., R.K. Suda & E.A. Murray. 2004. Bilateral orbital prefrontal cortex lesions in rhesus monkeys disrupt choices guided by both reward value and reward contingency. J. Neurosci. 24: 7540-7548.
8. Padoa-Schioppa, C. 2011. Neurobiology of economic choice: a good-based model. Annu. Rev. Neurosci. 34: 333-359.
9. Kennerley, S.W. et al. 2009. Neurons in the frontal lobe encode the value of multiple decision variables. J. Cogn. Neurosci. 21: 1162-1178.
10. Kennerley, S.W. & J.D. Wallis. 2009. Evaluating choices by single neurons in the frontal lobe: outcome value encoded across multiple decision variables. Eur. J. Neurosci. 29: 2061-2073.
11. Sloan, J., S.W. Kennerley & J.D. Wallis. 2010. Neural encoding of cost-based decisions: effort versus delay. Soc. Neurosci. Meet. Plann. Abstract number 805.16.
12. Padoa-Schioppa, C. 2010. Neuronal encoding of decision value and goal value in the orbitofrontal cortex. Soc. Neurosci. Meet. Plann. Abstract number 306.11.
13. Watson, K.K. & M.L. Platt. 2009. Social reward encoding in primate orbitofrontal cortex. Soc. Neurosci. Meet. Plann. Abstract number 784.4.
14. Morrison, S.E. & C.D. Salzman. 2009. The convergence of information about rewarding and aversive stimuli in single neurons. J. Neurosci. 29: 11471-11483.
15. Plassmann, H., J. O'Doherty & A. Rangel. 2007. Orbitofrontal cortex encodes willingness to pay in everyday economic transactions. J. Neurosci. 27: 9984-9988.
16. Plassmann, H., J.P. O'Doherty & A. Rangel. 2010. Appetitive and aversive goal values are encoded in the medial orbitofrontal cortex at the time of decision making. J. Neurosci. 30: 10799-10808.
17. FitzGerald, T.H., B. Seymour & R.J. Dolan. 2009. The role of human orbitofrontal cortex in value comparison for incommensurable objects. J. Neurosci. 29: 8388-8395.
18. Levy, I. et al. 2010. Neural representation of subjective value under risk and ambiguity. J. Neurophysiol. 103: 1036-1047.
19. Christopoulos, G.I., et al. 2009. Neural correlates of value, risk, and risk aversion contributing to decision making under risk. J. Neurosci. 29: 12574-12583.
20. Hsu, M. et al. 2005. Neural systems responding to degrees of uncertainty in human decision-making. Science 310: 1680-1683.
21. Kable, J.W. & P.W. Glimcher. 2007. The neural correlates of subjective value during intertemporal choice. Nat. Neurosci. 10: 1625-1633.
22. Gregorios-Pippas, L., P.N. Tobler & W. Schultz. 2009. Short-term temporal discounting of reward value in human ventral striatum. J. Neurophysiol. 101: 1507-1523.
23. Peters, J. & C. Buchel. 2009. Overlapping and distinct neural systems code for subjective value during intertemporal and risky decision making. J. Neurosci. 29: 15727-15734.
24. Brooks, A.M. et al. 2010. From bad to worse: striatal coding of the relative value of painful decisions. Front. Neurosci. 4: 176.
25. Shenhav, A. & J.D. Greene. 2010. Moral judgments recruit domain-general valuation mechanisms to integrate representations of probability and magnitude. Neuron 67: 667-677.
26. Price, J.L. 2007. Definition of the orbital cortex in relation to specific connections with limbic and visceral structures and other cortical regions. Ann. N. Y. Acad. Sci. 1121: 54-71.
27. Wallis, J.D. In press. Cross-species studies of orbitofrontal function. Nat. Neurosci.
28. Weiskopf, N. et al. 2007. Optimized EPI for fMRI studies of the orbitofrontal cortex: compensation of susceptibility-induced gradients in the readout direction. MAGMA 20: 39-49.
29. Price, J.L. 1999. Prefrontal cortical networks related to visceral function and mood. Ann. N. Y. Acad. Sci. 877: 383-396.
30. Fredrikson, M. et al. 1998. Functional neuroanatomical correlates of electrodermal activity: a positron emission tomographic study. Psychophysiology 35: 179-185.
31. Critchley, H.D. 2005. Neural mechanisms of autonomic, affective, and cognitive integration. J. Comp. Neurol. 493: 154-166.
32. Ziegler, G. et al. 2009. The relation of ventromedial prefrontal cortex activity and heart rate fluctuations at rest. Eur. J. Neurosci. 30: 2205-2210.
33. Price, J.L. & W.C. Drevets. 2010. Neurocircuitry of mood disorders. Neuropsychopharmacology 35: 192-216.
34. Gottfried, J.A., J. O'Doherty & R.J. Dolan. 2003. Encoding predictive reward value in human amygdala and orbitofrontal cortex. Science 301: 1104-1107.
35. Arana, F.S. et al. 2003. Dissociable contributions of the human amygdala and orbitofrontal cortex to incentive motivation and goal selection. J. Neurosci. 23: 9632-9638.
36. Chaudhry, A.M. et al. 2009. Preference judgements involve a network of structures within frontal, cingulate and insula cortices. Eur. J. Neurosci. 29: 1047-1055.
37. Hare, T.A. et al. 2008. Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J. Neurosci. 28: 5623-5630.
38. Roesch, M.R., A.R. Taylor & G. Schoenbaum. 2006. Encoding of time-discounted rewards in orbitofrontal cortex is independent of value representation. Neuron 51: 509-520.
39. van Duuren, E. et al. 2007. Neural coding of reward magnitude in the orbitofrontal cortex of the rat during a five-odor olfactory discrimination task. Learn. Mem. 14: 446-456.
40. Kepecs, A. et al. 2008. Neural correlates, computation and behavioural impact of decision confidence. Nature 455: 227-231.
41. Roitman, J.D. & M.F. Roitman. 2010. Risk-preference differentiates orbitofrontal cortex responses to freely chosen reward outcomes. Eur. J. Neurosci. 31: 1492-1500.
42. Sul, J.H. et al. 2010. Distinct roles of rodent orbitofrontal and medial prefrontal cortex in decision making. Neuron 66: 449-460.
43. Feierstein, C.E. et al. 2006. Representation of spatial goals in rat orbitofrontal cortex. Neuron 51: 495-507.
44. Wise, S.P. 2008. Forward frontal fields: phylogeny and fundamental function. Trends Neurosci. 31: 599-608.
45. Damasio, A.R. 1994. Descartes' Error: Emotion, Reason, and the Human Brain. Putnam. New York, NY .
46. Fellows, L.K. 2007. Advances in understanding ventromedial prefrontal function: the accountant joins the executive. Neurology 68: 991-995.
47. Rudebeck, P.H. & E.A. Murray. 2011. Dissociable effects of subtotal lesions within the macaque orbital prefrontal cortex on reward-guided behavior. J. Neurosci. 31: 10569-10578.
48. Baxter, M.G. et al. 2008. Dorsolateral prefrontal lesions do not impair tests of scene learning and decision-making that require frontal-temporal interaction. Eur. J. Neurosci. 28: 491-499.
49. Buckley, M.J. et al. 2009. Dissociable components of rule-guided behavior depend on distinct medial and prefrontal regions. Science 325: 52-58.
50. Baxter, M.G. et al. 2009. Ventrolateral prefrontal cortex is required for performance of a strategy implementation task but not reinforcer devaluation effects in rhesus monkeys. Eur. J. Neurosci. 29: 2049-2059.
51. Chudasama, Y., K.S. Wright & E.A. Murray. 2008. Hippocampal lesions in rhesus monkeys disrupt emotional responses but not reinforcer devaluation effects. Biol. Psychiatry 63: 1084-1091.
52. Machado, C.J. & J. Bachevalier. 2007. The effects of selective amygdala, orbital frontal cortex or hippocampal formation lesions on reward assessment in nonhuman primates. Eur. J. Neurosci. 25: 2885-2904.
53. Malkova, L., D. Gaffan & E.A. Murray. 1997. Excitotoxic lesions of the amygdala fail to produce impairment in visual learning for auditory secondary reinforcement but interfere with reinforcer devaluation effects in rhesus monkeys. J. Neurosci. 17: 6011-6020.
54. Baxter, M.G. et al. 2000. Control of response selection by reinforcer value requires interaction of amygdala and orbital prefrontal cortex. J. Neurosci. 20: 4311-4319.
55. Simmons, J.M. et al. 2010. Selective ablations reveal that orbital and lateral prefrontal cortex play different roles in estimating predicted reward value. J. Neurosci. 30: 15878-15887.
56. Kazama, A. & J. Bachevalier. 2009. Selective aspiration or neurotoxic lesions of orbital frontal areas 11 and 13 spared monkeys' performance on the object discrimination reversal task. J. Neurosci. 29: 2794-2804.
57. Fellows, L.K. & M.J. Farah. 2007. The role of ventromedial prefrontal cortex in decision making: judgment under uncertainty or judgment per se? Cereb. Cortex 17: 2669-2674.
58. Camille, N. et al. 2011. Ventromedial frontal lobe damage disrupts value maximization in humans. J. Neurosci. 31: 7527-7532.
59. Padoa-Schioppa, C. & J.A. Assad. 2008. The representation of economic value in the orbitofrontal cortex is invariant for changes of menu. Nat. Neurosci. 11: 95-102.
60. Choi, S. et al. 2007. Consistency and heterogeneity of individual behavior under uncertainty. Am. Econ. Rev. 97: 1858-1876.
61. Harbaugh, W.T., K. Krause & T.R. Berry. 2001. GARP for kids: on the development of rational choice behavior. Am. Econ. Rev. 91: 1539-1545.
62. Sumpter, C., W. Temple & T. Foster. 1999. The transitivity of choices between different response requirements. J. Exp. Anal. Behav. 72: 235-249.
63. Padoa-Schioppa, C. 2009. Range-adapting representation of economic value in the orbitofrontal cortex. J. Neurosci. 29: 14004-14014.
64. Kobayashi, S., O. Pinto de Carvalho & W. Schultz. 2010. Adaptation of reward sensitivity in orbitofrontal neurons. J. Neurosci. 30: 534-544.
65. Hosokawa, T. et al. 2007. Neurons in the macaque orbitofrontal cortex code relative preference of both rewarding and aversive outcomes. Neurosci. Res. 57: 434-445.
66. Elliott, R., Z. Agnew & J.F. Deakin. 2008. Medial orbitofrontal cortex codes relative rather than absolute value of financial rewards in humans. Eur. J. Neurosci. 27: 2213-2218.
67. Shafir, S. 2002. Context-dependent violations of rational choice in honeybees (Apis mellifera) and gray jays (Perisoreus canadensis). Behav. Ecol. Sociobiol. 51: 180-187.
68. Tversky, A. 1969. The intransitivity of preferences. Psychol. Rev. 76: 31-48.
69. Thorpe, S.J., E.T. Rolls & S. Maddison. 1983. The orbitofrontal cortex: neuronal activity in the behaving monkey. Exp. Brain Res. 49: 93-115.
70. Simmons, J.M. & B.J. Richmond. 2008. Dynamic changes in representations of preceding and upcoming reward in monkey orbitofrontal cortex. Cereb. Cortex 18: 93-103.
71. Tsujimoto, S., A. Genovesio & S.P. Wise. 2009. Monkey orbitofrontal cortex encodes response choices near feedback time. J. Neurosci. 29: 2569-2574.
72. Grattan, L.E. & P.W. Glimcher. 2010. No evidence for spatial tuning in orbitofrontal cortex. Soc. Neurosci. Meet. Plann. abstract number 102.23.
73. Kennerley, S.W. & J.D. Wallis. 2009. Encoding of reward and space during a working memory task in the orbitofrontal cortex and anterior cingulate sulcus. J. Neurophysiol. 102: 3352-3364.
74. Abe, H. & D. Lee. 2011. Distributed coding of actual and hypothetical outcomes in the orbital and dorsolateral prefrontal cortex. Neuron 70: 731-741.