The Computation of Stimulus Values in Simple Choice

Neuroeconomics: Decision Making and the Brain: Second Edition

Volumn , Issue , 2013, Pages 125-148

  Rangel, Antonio ^a   Clithero, John A ^a  

^a CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Attention; Drift diffusion model; Neuroeconomics; Simple choice; Stimulus value; Value comparison; VmPFC

Indexed keywords

EID: 84888384821     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1016/B978-0-12-416008-8.00008-5     Document Type: Chapter

References (106)

1. Armel K.C., Beaumel A., Rangel A. Biasing simple choices by manipulating relative visual attention. Judgment Decis. Making 2008, 3(5):396-403.
2. Basten U., Biele G., Heekeren H.R., Fiebach C.J. How the brain integrates costs and benefits during decision-making. Proc. Natl. Acad. Sci. U.S.A. 2010, 107(50):21767-21772.
3. Baumgartner T., Knoch D., Hotz P., Eisenegger C., Fehr E. Dorsolateral and ventromedial prefrontal cortex orchestrate normative choice. Nat. Neurosci. 2011, 14(11):1468-1474.
4. Becker G.M., Degroot M.H., Marschak J. Measuring utility by a single-response sequential method. Behav. Sci. 1964, 9(3):226-232.
5. Beckmann M., Johansen-Berg H., Rushworth M.F. Connectivity-based parcellation of human cingulate cortex and its relation to functional specialization. J. Neurosci. 2009, 29(4):1175-1190.
6. Behrens T.E.J., Woolrich M.W., Walton M.E., Rushworth M.F.S. Learning the value of information in an uncertain world. Nat. Neurosci. 2007, 10(9):1214-1221.
7. Boorman E.D., Behrens T.E., Woolrich M.W., Rushworth M.F. How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action. Neuron 2009, 62(5):733-743.
8. Camille N., Griffiths C.A., Vo K., Fellows L.K., Kable J.W. Ventromedial frontal lobe damage disrupts value maximization in humans. J. Neurosci. 2011, 31(20):7527-7532.
9. Camille N., Tsuchida A., Fellows L.K. Double dissociation of stimulus-value and action-value learning in humans with orbitofrontal or anterior cingulate cortex damage. J. Neurosci. 2011, 31(42):15048-15052.
10. Carmichael S.T., Price J.L. Sensory and premotor connections of the orbital and medial prefrontal cortex of macaque monkeys. J. Comp. Neurol. 1995, 363(4):642-664.
11. Chib V.S., Rangel A., Shimojo S., O'Doherty J.P. Evidence for a common representation of decision values for dissimilar goods in human ventromedial prefrontal cortex. J. Neurosci. 2009, 29(39):12315-12320.
12. Clithero J.A., Carter R.M., Huettel S.A. Local pattern classification differentiates processes of economic valuation. Neuroimage 2009, 45(4):1329-1338.
13. Clithero J.A., Tankersley D., Huettel S.A. Foundations of neuroeconomics: from philosophy to practice. PLoS Biol. 2008, 6(11):e298.
14. De Martino B., Kumaran D., Holt B., Dolan R.J. The neurobiology of reference-dependent value computation. J. Neurosci. 2009, 29(12):3833-3842.
15. Deisseroth K. Optogenetics. Nat. Methods 2011, 8(1):26-29.
16. Ericson K.M.M., Fuster A. Expectations as endowments: evidence on reference-dependent preferences from exchange and valuation experiments. Q. J. Econ. 2011, 126(4):1879-1907.
17. Fehr E., Rangel A. Neuroeconomic foundations of economic choice - recent advances. J. Econ. Perspect 2011, 25(4):3-30.
18. Fellows L.K., 2011. The neurology of value. In: Gottfried, J.A. (Ed.), Neurobiology of Sensation and Reward. Boca Raton (FL).
19. Fellows L.K., Farah M.J. The role of ventromedial prefrontal cortex in decision-making: judgment under uncertainty or judgment per se?. Cereb. Cortex 2007, 17(11):2669-2674.
20. Fenno L., Yizhar O., Deisseroth K. The development and application of optogenetics. Annu. Rev. Neurosci. 2011, 34:389-412.
21. FitzGerald T.H., Seymour B., Dolan R.J. The role of human orbitofrontal cortex in value comparison for incommensurable objects. J. Neurosci. 2009, 29(26):8388-8395.
22. Glascher J., Adolphs R., Damasio H., et al. Lesion mapping of cognitive control and value-based decision-making in the prefrontal cortex. Proc. Natl. Acad. Sci. U.S.A. 2012, 109(36):14681-14686.
23. Glascher J., Hampton A.N., O'Doherty J.P. Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision-making. Cereb. Cortex 2009, 19(2):483-495.
24. Glimcher P.W. Foundations of Neuroeconomic Analysis 2011, Oxford University Press, Oxford.
25. Gluth S., Rieskamp J., Buchel C. Deciding when to decide: time-variant sequential sampling models explain the emergence of value-based decisions in the human brain. J. Neurosci. 2012, 32(31):10686-10698.
26. Gold J.I., Shadlen M.N. The neural basis of decision-making. Annu. Rev. Neurosci. 2007, 30:535-574.
27. Grabenhorst F., Rolls E.T., Parris B.A., d'Souza A.A. How the brain represents the reward value of fat in the mouth. Cereb. Cortex 2010, 20(5):1082-1091.
28. Hare T.A., Camerer C.F., Knoepfle D.T., Rangel A. Value computations in ventral medial prefrontal cortex during charitable decision-making incorporate input from regions involved in social cognition. J. Neurosci. 2010, 30(2):583-590.
29. Hare T.A., Camerer C.F., Rangel A. Self-control in decision-making involves modulation of the vmPFC valuation system. Science 2009, 324(5927):646-648.
30. Hare T.A., Malmaud J., Rangel A. Focusing attention on the health aspects of foods changes value signals in vmPFC and improves dietary choice. J. Neurosci. 2011, 31(30):11077-11087.
31. Hare T.A., O'Doherty J., Camerer C.F., Schultz W., Rangel A. Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J. Neurosci. 2008, 28(22):5623-5630.
32. Hare T.A., Schultz W., Camerer C.F., O'Doherty J.P., Rangel A. Transformation of stimulus value signals into motor commands during simple choice. Proc. Natl. Acad. Sci. U.S.A. 2011, 108(44):18120-18125.
33. Harris A., Adolphs R., Camerer C., Rangel A. Dynamic construction of stimulus values in the ventromedial prefrontal cortex. PLoS One 2011, 6(6):e21074.
34. Hayden B.Y., Platt M.L. Neurons in anterior cingulate cortex multiplex information about reward and action. J. Neurosci. 2010, 30(9):3339-3346.
35. Heekeren H.R., Marrett S., Ungerleider L.G. The neural systems that mediate human perceptual decision-making. Nat. Rev. Neurosci. 2008, 9(6):467-479.
36. Hunt L.T., Kolling N., Soltani A., Woolrich M.W., Rushworth M.F., Behrens T.E. Mechanisms underlying cortical activity during value-guided choice. Nat. Neurosci. 2012, 15(3):470-476. S471-473.
37. Janowski V., Camerer C., Rangel A. Empathic decision-making involves vmPFC value signals that are modulated by social processing implemented in the IPL. Soc. Cogn. Affect. Neurosci 2013, 8(2):201-208.
38. Jenison R.L., Rangel A., Oya H., Kawasaki H., Howard M.A. Value encoding in single neurons in the human amygdala during decision-making. J. Neurosci. 2011, 31(1):331-338.
39. Jocham G., Hunt L.T., Near J., Behrens T.E. A mechanism for value-guided choice based on the excitation-inhibition balance in prefrontal cortex. Nat. Neurosci. 2012, 15(7):960-961.
40. Kable J.W., Glimcher P.W. The neural correlates of subjective value during intertemporal choice. Nat. Neurosci. 2007, 10(12):1625-1633.
41. Kahneman D., Tversky A. Prospect theory - analysis of decision under risk. Econometrica 1979, 47(2):263-291.
42. Kahnt T., Chang L.J., Park S.Q., Heinzle J., Haynes J.D. Connectivity-based parcellation of the human orbitofrontal cortex. J. Neurosci. 2012, 32(18):6240-6250.
43. Kahnt T., Heinzle J., Park S.Q., Haynes J.D. Decoding different roles for vmPFC and dlPFC in multi-attribute decision-making. Neuroimage 2011, 56(2):709-715.
44. Kennerley S.W., Behrens T.E., Wallis J.D. Double dissociation of value computations in orbitofrontal and anterior cingulate neurons. Nat. Neurosci. 2011, 14(12):1581-1589.
45. Kennerley S.W., Dahmubed A.F., Lara A.H., Wallis J.D. Neurons in the frontal lobe encode the value of multiple decision variables. J. Cogn. Neurosci. 2009, 21(6):1162-1178.
46. Kennerley S.W., Walton M.E., Behrens T.E.J., Buckley M.J., Rushworth M.F.S. Optimal decision-making and the anterior cingulate cortex. Nat. Neurosci. 2006, 9(7):940-947.
47. Knutson B., Rick S., Wimmer G.E., Prelec D., Loewenstein G. Neural predictors of purchases. Neuron 2007, 53(1):147-156.
48. Kobayashi S., Pinto de Carvalho O., Schultz W. Adaptation of reward sensitivity in orbitofrontal neurons. J. Neurosci. 2010, 30(2):534-544.
49. Krajbich I., Rangel A. Multialternative drift-diffusion model predicts the relationship between visual fixations and choice in value-based decisions. Proc. Natl. Acad. Sci. U.S.A. 2011, 108(33):13852-13857.
50. Krajbich I., Armel C., Rangel A. Visual fixations and the computation and comparison of value in simple choice. Nat. Neurosci. 2010, 13(10):1292-1298.
51. Krajbich I., Lu D., Camerer C., Rangel A. The attentional drift-diffusion model extends to simple purchasing decisions. Front. Psychol. 2012, 3:193.
52. Larsen J.T., McGraw A.P., Mellers B.A., Cacioppo J.T. The agony of victory and thrill of defeat: mixed emotional reactions to disappointing wins and relieving losses. Psychol. Sci. 2004, 15(5):325-330.
53. Lebreton M., Jorge S., Michel V., Thirion B., Pessiglione M. An automatic valuation system in the human brain: evidence from functional neuroimaging. Neuron 2009, 64(3):431-439.
54. Levy D.J., Glimcher P.W. Comparing apples and oranges: using reward-specific and reward-general subjective value representation in the brain. J. Neurosci. 2011, 31(41):14693-14707.
55. Levy D.J., Glimcher P.W. The root of all value: a neural common currency for choice. Curr. Opin. Neurobiol 2012, 22(6):1027-1038.
56. Levy I., Lazzaro S.C., Rutledge R.B., Glimcher P.W. Choice from non-choice: predicting consumer preferences from blood oxygenation level-dependent signals obtained during passive viewing. J. Neurosci. 2011, 31(1):118-125.
57. Lim S.L., O'Doherty J.P., Rangel A. The decision value computations in the vmPFC and striatum use a relative value code that is guided by visual attention. J. Neurosci. 2011, 31(37):13214-13223.
58. Lin A., Adolphs R., Rangel A. Social and monetary reward learning engage overlapping neural substrates. Soc. Cogn. Affect. Neurosci. 2012, 7(3):274-281.
59. Litt A., Plassmann H., Shiv B., Rangel A. Dissociating valuation and saliency signals during decision-making. Cereb. Cortex 2011, 21(1):95-102.
60. Luce R.D. Individual Choice Behavior A Theoretical Analysis 1959, Wiley, New York.
61. Maunsell J.H. Neuronal representations of cognitive state: reward or attention?. Trends Cogn. Sci. 2004, 8(6):261-265.
62. McClure S.M., Berns G.S., Montague P.R. Temporal prediction errors in a passive learning task activate human striatum. Neuron 2003, 38(2):339-346.
63. McDannald M.A., Takahashi Y.K., Lopatina N., Pietras B.W., Jones J.L., Schoenbaum G. Model-based learning and the contribution of the orbitofrontal cortex to the model-free world. Eur. J. Neurosci. 2012, 35(7):991-996.
64. McFadden D. Economic choices. Am. Econ. Rev. 2001, 91(3):351-378.
65. McFadden D.L. Revealed stochastic preference: a synthesis. Econ. Theor. 2005, 26(2):245-264.
66. Milosavljevic M., Koch C., Rangel A. Consumers can make decisions in as little as a third of a second. Judgment Decis. Making 2011, 6(6):520-530.
67. Milosavljevic M., Malmaud J., Huth A., Koch C., Rangel A. The drift diffusion model can account for the accuracy and reaction time of value-based choices under high and low time pressure. Judgment Decis. Making 2010, 5(6):437-449.
68. Noonan M.P., Walton M.E., Behrens T.E., Sallet J., Buckley M.J., Rushworth M.F. Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex. Proc. Natl. Acad. Sci. U.S.A. 2010, 107(47):20547-20552.
69. O'Doherty J., Winston J., Critchley H., Perrett D., Burt D.M., Dolan R.J. Beauty in a smile: the role of medial orbitofrontal cortex in facial attractiveness. Neuropsychologia 2003, 41(2):147-155.
70. O'Doherty J.P. Contributions of the ventromedial prefrontal cortex to goal-directed action selection. Ann. N.Y. Acad. Sci. 2011, 1239:118-129.
71. O'Doherty J.P., Dayan P., Friston K., Critchley H., Dolan R.J. Temporal difference models and reward-related learning in the human brain. Neuron 2003, 38(2):329-337.
72. Ongur D., Price J.L. The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. Cereb. Cortex 2000, 10(3):206-219.
73. Padoa-Schioppa C., Assad J.A. Neurons in the orbitofrontal cortex encode economic value. Nature 2006, 441(7090):223-226.
74. Park S.Q., Kahnt T., Rieskamp J., Heekeren H.R. Neurobiology of value integration: when value impacts valuation. J. Neurosci. 2011, 31(25):9307-9314.
75. Pearson J.M., Heilbronner S.R., Barack D.L., Hayden B.Y., Platt M.L. Posterior cingulate cortex: adapting behavior to a changing world. Trends Cogn. Sci. 2011, 15(4):143-151.
76. Peters J., Buchel C. Overlapping and distinct neural systems code for subjective value during intertemporal and risky decision-making. J. Neurosci. 2009, 29(50):15727-15734.
77. Philiastides M.G., Biele G., Heekeren H.R. A mechanistic account of value computation in the human brain. Proc. Natl. Acad. Sci. U.S.A. 2010, 107(20):9430-9435.
78. Picard N., Strick P.L. Imaging the premotor areas. Curr. Opin. Neurobiol. 2001, 11(6):663-672.
79. Plassmann H., O'Doherty J., Rangel A. Orbitofrontal cortex encodes willingness to pay in everyday economic transactions. J. Neurosci. 2007, 27(37):9984-9988.
80. Plassmann H., O'Doherty J., Shiv B., Rangel A. Marketing actions can modulate neural representations of experienced pleasantness. Proc. Natl. Acad. Sci. U.S.A. 2008, 105(3):1050-1054.
81. Plassmann H., O'Doherty J.P., Rangel A. Appetitive and aversive goal values are encoded in the medial orbitofrontal cortex at the time of decision-making. J. Neurosci. 2010, 30(32):10799-10808.
82. Prevost C., Pessiglione M., Metereau E., Clery-Melin M.L., Dreher J.C. Separate valuation subsystems for delay and effort decision costs. J. Neurosci. 2010, 30(42):14080-14090.
83. Rangel A., Hare T. Neural computations associated with goal-directed choice. Curr. Opin. Neurobiol. 2010, 20(2):262-270.
84. Rangel A., Camerer C., Montague P.R. A framework for studying the neurobiology of value-based decision-making. Nat. Rev. Neurosci. 2008, 9(7):545-556.
85. Ratcliff R. Theory of memory retrieval. Psychol. Rev. 1978, 85(2):59-108.
86. Ratcliff R., McKoon G. The diffusion decision model: theory and data for two-choice decision tasks. Neural. Comput. 2008, 20(4):873-922.
87. Roesch M.R., Olson C.R. Impact of expected reward on neuronal activity in prefrontal cortex, frontal and supplementary eye fields and premotor cortex. J. Neurophysiol. 2003, 90(3):1766-1789.
88. Roesch M.R., Olson C.R. Neuronal activity related to reward value and motivation in primate frontal cortex. Science 2004, 304(5668):307-310.
89. Roy M., Shohamy D., Wager T.D. Ventromedial prefrontal-subcortical systems and the generation of affective meaning. Trends Cogn. Sci. 2012, 16(3):147-156.
90. Rushworth M.F., Noonan M.P., Boorman E.D., Walton M.E., Behrens T.E. Frontal cortex and reward-guided learning and decision-making. Neuron 2011, 70(6):1054-1069.
91. Schoenbaum G., Roesch M.R., Stalnaker T.A., Takahashi Y.K. A new perspective on the role of the orbitofrontal cortex in adaptive behaviour. Nat. Rev. Neurosci. 2009, 10(12):885-892.
92. Schultz W., Dayan P., Montague P.R. A neural substrate of prediction and reward. Science 1997, 275(5306):1593-1599.
93. Sellitto M., Ciaramelli E., di Pellegrino G. Myopic discounting of future rewards after medial orbitofrontal damage in humans. J. Neurosci 2010, 30(49):16429-16436.
94. Shimojo S., Simion C., Shimojo E., Scheier C. Gaze bias both reflects and influences preference. Nat. Neurosci. 2003, 6(12):1317-1322.
95. Smith D.V., Hayden B.Y., Truong T.K., Song A.W., Platt M.L., Huettel S.A. Distinct value signals in anterior and posterior ventromedial prefrontal cortex. J. Neurosci. 2010, 30(7):2490-2495.
96. Sokol-Hessner P., Hutcherson C., Hare T., Rangel A. Decision value computation in DLPFC and VMPFC adjusts to the available decision time. Eur. J. Neurosci. 2012, 35(7):1065-1074.
97. Talmi D., Dayan P., Kiebel S.J., Frith C.D., Dolan R.J. How humans integrate the prospects of pain and reward during choice. J. Neurosci. 2009, 29(46):14617-14626.
98. Tom S.M., Fox C.R., Trepel C., Poldrack R.A. The neural basis of loss aversion in decision-making under risk. Science 2007, 315(5811):515-518.
99. Tusche A., Bode S., Haynes J.D. Neural responses to unattended products predict later consumer choices. J. Neurosci. 2010, 30(23):8024-8031.
100. Tversky A., Kahneman D. Advances in prospect-theory - cumulative representation of uncertainty. J. Risk Uncertain. 1992, 5(4):297-323.
101. Wallis J.D. Cross-species studies of orbitofrontal cortex and value-based decision-making. Nat. Neurosci. 2012, 15(1):13-19.
102. Wallis J.D., Kennerley S.W. Heterogeneous reward signals in prefrontal cortex. Curr. Opin. Neurobiol. 2010, 20(2):191-198.
103. Wilson E.O. Consilience: the Unity of Knowledge 1998, Knopf, New York, (Distributed by Random House). first ed.
104. Wise S.P. Forward frontal fields: phylogeny and fundamental function. Trends Neurosci. 2008, 31(12):599-608.
105. Wu S.W., Delgado M.R., Maloney L.T. The neural correlates of subjective utility of monetary outcome and probability weight in economic and in motor decision under risk. J. Neurosci. 2011, 31(24):8822-8831.
106. Wunderlich K., Rangel A., O'Doherty J.P. Economic choices can be made using only stimulus values. Proc. Natl. Acad. Sci. U.S.A. 2010, 107(34):15005-15010.