Neural representation of subjective value under risk and ambiguity

Journal of Neurophysiology

Volumn 103, Issue 2, 2010, Pages 1036-1047

  Levy, Ifat ^a   Snell, Jason ^b   Nelson, Amy J ^b,c   Rustichini, Aldo ^d   Glimcher, Paul W ^b  

^a YALE UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b NEW YORK UNIVERSITY   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d UNIVERSITY OF MINNESOTA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; AMBIGUITY; ARTICLE; AVERSION; BRAIN; BRAIN NERVE CELL; CELL ACTIVITY; CINGULATE GYRUS; CONTROLLED STUDY; CORPUS STRIATUM; DECISION MAKING; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; MALE; MONEY; PREFRONTAL CORTEX; PRIORITY JOURNAL; PROBABILITY; REWARD; RISK; SUBICULUM;

ADULT; BRAIN; BRAIN MAPPING; DECISION MAKING; FEMALE; HUMANS; NERVE NET; RISK-TAKING; UNCERTAINTY; YOUNG ADULT;

EID: 76649094553     PISSN: 00223077     EISSN: 15221598     Source Type: Journal    
DOI: 10.1152/jn.00853.2009     Document Type: Article

References (81)

1. Abdellaoui M, Bleichrodt H, Paraschiv C. Loss aversion under prospect theory: a parameter-free measurement. Manage Sci 53: 1659-1674, 2007.
2. Bach DR, Seymour B, Dolan RJ. Neural activity associated with the passive prediction of ambiguity and risk for aversive events. J Neurosci 29: 1648-1656, 2009.
3. Baxter MG, Murray EA. The amygdala and reward. Nat Rev Neurosci 3: 563-573, 2002.
4. Bayer HM, Glimcher PW. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47: 129-141, 2005.
5. Becker SW, Brownson FO. What price ambiguity - or the role of ambiguity in decision making. J Polit Econ 72: 62-73, 1964.
6. Bernoulli D. Exposition of a new theory on the measurement of risk. Econometrica 22: 23-36, 1954.
7. Bossaerts P, Ghirardato P, Guarnaschelli S, Zame WR. Ambiguity in asset markets: theory and experiment. Rev Finan Stud In press.
8. Boynton GA, Engel SA, Glover G, Heeger D. Linear systems analysis of functional magnetic resonance imaging in human V1. J Neurosci 16: 4207-4221, 1996.
9. Breiter HC, Aharon I, Kahneman D, Dale A, Shizgal P. Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron 30: 619-639, 2001.
10. Camerer C, Weber M. Recent developments in modeling preferences-uncertainty and ambiguity. J Risk Uncertainty 5: 325-370, 1992.
11. Chib VS, Rangel A, Shimojo S, O'Doherty JP. Evidence for a common representation of decision values for dissimilar goods in human ventromedial prefrontal cortex. J Neurosci 29: 12315-12320, 2009.
12. Curley SP, Yates JF. The center and range of the probability interval as factors affecting ambiguity preferences. Organ Behav Hum Dec 36: 273-287, 1985.
13. Curley SP, Yates JF, Abrams RA. Psychological sources of ambiguity avoidance. Organ Behav Hum Dec 38: 230-256, 1986.
14. De Martino B, Kumaran D, Holt B, Dolan RJ. The neurobiology of reference-dependent value computation. J Neurosci 29: 3833-3842, 2009.
15. Delgado MR, Locke HM, Stenger VA, Fiez JA. Dorsal striatum responses to reward and punishment: effects of valence and magnitude manipulations. Cogn Affect Behav Neurosci 3: 27-38, 2003.
16. Delgado MR, Nystrom LE, Fissell C, Noll DC, Fiez JA. Tracking the hemodynamic responses to reward and punishment in the striatum. J Neurophysiol 84: 3072-3077, 2000.
17. Elliott R, Newman JL, Longe OA, Deakin JF. Differential response patterns in the striatum and orbitofrontal cortex to financial reward in humans: a parametric functional magnetic resonance imaging study. J Neurosci 23: 303-307, 2003.
18. Ellsberg D. Risk, ambiguity, and the savage axioms. Q J Econ 75: 643-669, 1961.
19. FitzGerald TH, Seymour B, Dolan RJ. The role of human orbitofrontal cortex in value comparison for incommensurable objects. J Neurosci 29: 8388-8395, 2009.
20. Forman SD, Cohen JD, Fitzgerald M, Eddy WF, Mintun MA, Noll DC. Improved assessment of significant activation in functional magnetic-resonance- imaging (fMRI) - use of a cluster-size threshold. Magn Reson Med 33: 636-647, 1995.
21. Fox CR, Tversky A. Ambiguity aversion and comparative ignorance. Q J Econ 110: 585-603, 1995.
22. Friston J, Homes A, Worsley K, Poline J, Frith C, Frackwowiak R. Statistical parametric maps in functional imaging: a general linear approach. Hum Brain Mapp 2: 189-210, 1995.
23. Friston KJ, Buechel C, Fink GR, Morris J, Rolls E, Dolan RJ. Psycho-physiological and modulatory interactions in neuroimaging. Neuroimage 6: 218-229, 1997.
24. Gilboa I, Schmeidler D. Maxmin expected utility with non-unique prior. J Math Econ 18: 141-153, 1989.
25. Gitelman DR, Penny WD, Ashburner J, Friston KJ. Modeling regional and psychophysiologic interactions in fMRI: the importance of hemodynamic deconvolution. Neuroimage 19: 200-207, 2003.
26. Glascher J, Hampton AN, O'Doherty JP. Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making. Cereb Cortex 19: 483-495, 2009.
27. Glimcher PW. Understanding risk: a guide for the perplexed. Cogn Affect Behav Neurosci 8: 348-354, 2008.
28. Goldberg II, Harel M, Malach R. When the brain loses its self: prefrontal inactivation during sensorimotor processing. Neuron 50: 329-339, 2006.
29. Gottfried JA, O'Doherty J, Dolan RJ. Encoding predictive reward value in human amygdala and orbitofrontal cortex. Science 301: 1104-1107, 2003.
30. Hare TA, Camerer CF, Rangel A. Self-control in decision-making involves modulation of the vmPFC valuation system. Science 324: 646-648, 2009.
31. Hare TA, O'Doherty J, Camerer CF, Schultz W, Rangel A. Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J Neurosci 28: 5623-5630, 2008.
32. Heath C, Tversky A. Preference and belief - ambiguity and competence in choice under uncertainty. J Risk Uncertainty 4: 5-28, 1991.
33. Hogarth RM, Einhorn HJ. Venture theory - a model of decision weights. Manage Sci 36: 780-803, 1990.
34. Hsu M, Bhatt M, Adolphs R, Tranel D, Camerer CF. Neural systems responding to degrees of uncertainty in human decision-making. Science 310: 1680-1683, 2005.
35. Hsu M, Krajbich I, Zhao C, Camerer CF. Neural response to reward anticipation under risk is nonlinear in probabilities. J Neurosci 29: 2231-2237, 2009.
36. Huettel SA, Stowe CJ, Gordon EM, Warner BT, Platt ML. Neural signatures of economic preferences for risk and ambiguity. Neuron 49: 765-775, 2006.
37. Kable JW, Glimcher PW. The neural correlates of subjective value during intertemporal choice. Nat Neurosci 10: 1625-1633, 2007.
38. Kahneman D, Tversky A. Prospect theory - analysis of decision under risk. Econometrica 47: 263-291, 1979.
39. Knutson B, Adams CM, Fong GW, Hommer D. Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J Neurosci 21: RC159, 2001a.
40. Knutson B, Fong GW, Adams CM, Varner JL, Hommer D. Dissociation of reward anticipation and outcome with event-related fMRI. Neuroreport 12: 3683-3687, 2001b.
41. Knutson B, Fong GW, Bennett SM, Adams CM, Hommer D. A region of mesial prefrontal cortex tracks monetarily rewarding outcomes: characterization with rapid event-related fMRI. Neuroimage 18: 263-272, 2003.
42. Knutson B, Rick S, Wimmer GE, Prelec D, Loewenstein G. Neural predictors of purchases. Neuron 53: 147-156, 2007.
43. Knutson B, Taylor J, Kaufman M, Peterson R, Glover G. Distributed neural representation of expected value. J Neurosci 25: 4806-4812, 2005.
44. Kuhberger A, Perner J. The role of competition and knowledge in the Ellsberg task. J Behav Decision Making 16: 181-191, 2003.
45. Kuhnen CM, Knutson B. The neural basis of financial risk taking. Neuron 47: 763-770, 2005.
46. Lau B, Glimcher PW. Value representations in the primate striatum during matching behavior. Neuron 58: 451-463, 2008.
47. Luhmann CC, Chun MM, Yi DJ, Lee D, Wang XJ. Neural dissociation of delay and uncertainty in intertemporal choice. J Neurosci 28: 14459-14466, 2008.
48. Luk CH, Wallis JD. Dynamic encoding of responses and outcomes by neurons in medial prefrontal cortex. J Neurosci 29: 7526-7539, 2009.
49. Maccheroni F, Marinacci M, Rustichini A. Ambiguity aversion, robustness, and the variational representation of preferences. Econometrica 74: 1447-1498, 2006.
50. McClure SM, Ericson KM, Laibson DI, Loewenstein G, Cohen JD. Time discounting for primary rewards. J Neurosci 27: 5796-5804, 2007.
51. McClure SM, Laibson DI, Loewenstein G, Cohen JD. Separate neural systems value immediate and delayed monetary rewards. Science 306: 503-507, 2004a.
52. McClure SM, Li J, Tomlin D, Cypert KS, Montague LM, Montague PR. Neural correlates of behavioral preference for culturally familiar drinks. Neuron 44: 379-387, 2004b.
53. McCoy AN, Crowley JC, Haghighian G, Dean HL, Platt ML. Saccade reward signals in posterior cingulate cortex. Neuron 40: 1031-1040, 2003.
54. O'Doherty JP, Buchanan TW, Seymour B, Dolan RJ. Predictive neural coding of reward preference involves dissociable responses in human ventral midbrain and ventral striatum. Neuron 49: 157-166, 2006.
55. O'Doherty J, Critchley H, Deichmann R, Dolan RJ. Dissociating valence of outcome from behavioral control in human orbital and ventral prefrontal cortices. J Neurosci 23: 7931-7939, 2003.
56. O'Doherty JP, Deichmann R, Critchley HD, Dolan RJ. Neural responses during anticipation of a primary taste reward. Neuron 33: 815-826, 2002.
57. Padoa-Schioppa C, Assad JA. Neurons in the orbitofrontal cortex encode economic value. Nature 441: 223-226, 2006.
58. Padoa-Schioppa C, Assad JA. The representation of economic value in the orbitofrontal cortex is invariant for changes of menu. Nat Neurosci 11: 95-102, 2008.
59. Paton JJ, Belova MA, Morrison SE, Salzman CD. The primate amygdala represents the positive and negative value of visual stimuli during learning. Nature 439: 865-870, 2006.
60. Pine A, Seymour B, Roiser JP, Bossaerts P, Friston KJ, Curran HV, Dolan RJ. Encoding of marginal utility across time in the human brain. J Neurosci 29: 9575-9581, 2009.
61. Plassmann H, O'Doherty J, Rangel A. Orbitofrontal cortex encodes willingness to pay in everyday economic transactions. J Neurosci 27: 9984-9988, 2007.
62. Plassmann H, O'Doherty J, Shiv B, Rangel A. Marketing actions can modulate neural representations of experienced pleasantness. Proc Natl Acad Sci USA 105: 1050-1054, 2008.
63. Prelec D. The probability weighting function. Econometrica 66: 497-527, 1998.
64. Preuschoff K, Bossaerts P, Quartz SR. Neural differentiation of expected reward and risk in human subcortical structures. Neuron 51: 381-390, 2006.
65. Raichle ME, MacLeod AM, Snyder AZ, Powers WJ, Gusnard DA, Shulman GL. A default mode of brain function. Proc Natl Acad Sci USA 98: 676-682, 2001.
66. Rustichini A, Dickhaut J, Ghirardato P, Smith K, Pardo JV. A brain imaging study of the choice procedure. Games Econ Behav 52: 257-282, 2005.
67. Sah P, Faber ESL, De Armentia ML, Power J. The amygdaloid complex: anatomy and physiology. Physiol Rev 83: 803-834, 2003.
68. Samejima K, Ueda Y, Doya K, Kimura M. Representation of action-specific reward values in the striatum. Science 310: 1337-1340, 2005.
69. Schiller D, Freeman JB, Mitchell JP, Uleman JS, Phelps EA. A neural mechanism of first impressions. Nat Neurosci 12: 508-514, 2009.
70. Schultz W, Dayan P, Montague PR. A neural substrate of prediction and reward. Science 275: 1593-1599, 1997.
71. Sharot T, De Martino B, Dolan RJ. How choice reveals and shapes expected hedonic outcome. J Neurosci 29: 3760-3765, 2009.
72. Small DM, Jones-Gotman M, Dagher A. Feeding-induced dopamine release in dorsal striatum correlates with meal pleasantness ratings in healthy human volunteers. Neuroimage 19: 1709-1715, 2003.
73. Small DM, Veldhuizen MG, Felsted J, Mak YE, McGlone F. Separable substrates for anticipatory and consummatory food chemosensation. Neuron 57: 786-797, 2008.
74. Smith VL. Papers in Experimental Economics. Cambridge UK: Cambridge Univ. Press, 1991.
75. Talairach J, Tournoux P. Co-Planar Stereotaxic Atlas of the Human Brain. New York: Thieme Medical Publishers, 1988.
76. Tobler PN, O'Doherty JP, Dolan RJ, Schultz W. Reward value coding distinct from risk attitude-related uncertainty coding in human reward systems. J Neurophysiol 97: 1621-1632, 2007.
77. Tom SM, Fox CR, Trepel C, Poldrack RA. The neural basis of loss aversion in decision-making under risk. Science 315: 515-518, 2007.
78. Tremblay L, Schultz W. Relative reward preference in primate orbitofrontal cortex. Nature 398: 704-708, 1999.
79. Tversky A, Kahneman D. Advances in prospect-theory - cumulative representation of uncertainty. J Risk Uncertainty 5: 297-323, 1992.
80. Wallis JD, Miller EK. Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task. Eur J Neurosci 18: 2069-2081, 2003.
81. Weber M, Camerer C. Recent developments in modeling preferences under risk. Or Spektrum 9: 129-151, 1987.