Value normalization in decision making: Theory and evidence

Current Opinion in Neurobiology

Volumn 22, Issue 6, 2012, Pages 970-981

  Rangel, Antonio ^a   Clithero, John A ^a  

^a CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DECISION MAKING; HUMAN; METHODOLOGY; PHYSIOLOGY; PSYCHOLOGICAL MODEL; PSYCHOLOGICAL THEORY; PSYCHOMETRY; REVIEW; SENSATION;

CHOICE BEHAVIOR; DECISION MAKING; HUMANS; MODELS, PSYCHOLOGICAL; PSYCHOLOGICAL THEORY; PSYCHOMETRICS; SENSATION;

EID: 84878200899     PISSN: 09594388     EISSN: 18736882     Source Type: Journal    
DOI: 10.1016/j.conb.2012.07.011     Document Type: Review

References (74)

1. Grabenhorst F., Rolls E.T. Value, pleasure and choice in the ventral prefrontal cortex. Trends Cogn Sci 2011, 15:56-67.
2. Padoa-Schioppa C. Neurobiology of economic choice: a good-based model. Annu Rev Neurosci 2011, 34:333-359.
3. Rangel A., Hare T. Neural computations associated with goal-directed choice. Curr Opin Neurobiol 2010, 20:262-270.
4. Rushworth M.F., Noonan M.P., Boorman E.D., Walton M.E., Behrens T.E. Frontal cortex and reward-guided learning and decision-making. Neuron 2011, 70:1054-1069.
5. Wallis J.D., Kennerley S.W. Heterogeneous reward signals in prefrontal cortex. Curr Opin Neurobiol 2010, 20:191-198.
6. Cai X., Padoa-Schioppa C. Neuronal encoding of subjective value in dorsal and ventral anterior cingulate cortex. J Neurosci 2012, 32:3791-3808.
7. Kennerley S.W., Wallis J.D. Evaluating choices by single neurons in the frontal lobe: outcome value encoded across multiple decision variables. Eur J Neurosci 2009, 29:2061-2073.
8. Padoa-Schioppa C., Assad J.A. The representation of economic value in the orbitofrontal cortex is invariant for changes of menu. Nat Neurosci 2008, 11:95-102.
9. Padoa-Schioppa C., Assad J.A. Neurons in the orbitofrontal cortex encode economic value. Nature 2006, 441:223-226.
10. Plassmann H., O'Doherty J., Rangel A. Orbitofrontal cortex encodes willingness to pay in everyday economic transactions. J Neurosci 2007, 27:9984-9988.
11. Plassmann H., O'Doherty J.P., Rangel A. Appetitive and aversive goal values are encoded in the medial orbitofrontal cortex at the time of decision making. J Neurosci 2010, 30:10799-10808.
12. Litt A., Plassmann H., Shiv B., Rangel A. Dissociating valuation and saliency signals during decision-making. Cereb Cortex 2011, 21:95-102.
13. Chib V.S., Rangel A., Shimojo S., O'Doherty J.P. Evidence for a common representation of decision values for dissimilar goods in human ventromedial prefrontal cortex. J Neurosci 2009, 29:12315-12320.
14. Lim S.L., O'Doherty J.P., Rangel A. The decision value computations in the vmPFC and striatum use a relative value code that is guided by visual attention. J Neurosci 2011, 31:13214-13223.
15. Boorman E.D., Behrens T.E.J., Woolrich M.W., Rushworth M.F.S. How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action. Neuron 2009, 62:733-743.
16. Levy D.J., Glimcher P.W. Comparing apples and oranges: using reward-specific and reward-general subjective value representation in the brain. J Neurosci 2011, 31:14693-14707.
17. Levy I., Snell J., Nelson A.J., Rustichini A., Glimcher P.W. Neural representation of subjective value under risk and ambiguity. J Neurophysiol 2010, 103:1036-1047.
18. FitzGerald T.H., Seymour B., Dolan R.J. The role of human orbitofrontal cortex in value comparison for incommensurable objects. J Neurosci 2009, 29:8388-8395.
19. Wunderlich K., Rangel A., O'Doherty J.P. Economic choices can be made using only stimulus values. Proc Natl Acad Sci USA 2010, 107:15005-15010.
20. Harris A., Adolphs R., Camerer C., Rangel A. Dynamic construction of stimulus values in the ventromedial prefrontal cortex. PLoS ONE 2011, 6:e21074.
21. Grabenhorst F., D'Souza A.A., Parris B.A., Rolls E.T., Passingham R.E. A common neural scale for the subjective pleasantness of different primary rewards. Neuroimage 2010, 51:1265-1274.
22. Plassmann H., O'Doherty J., Shiv B., Rangel A. Marketing actions can modulate neural representations of experienced pleasantness. Proc Natl Acad Sci USA 2008, 105:1050-1054.
23. de Araujo I.E., Kringelbach M.L., Rolls E.T., McGlone F. Human cortical responses to water in the mouth, and the effects of thirst. J Neurophysiol 2003, 90:1865-1876.
24. Anderson A.K., Christoff K., Stappen I., Panitz D., Ghahremani D.G., Glover G., Gabrieli J.D.E., Sobel N. Dissociated neural representations of intensity and valence in human olfaction. Nat Neurosci 2003, 6:196-202.
25. Kringelbach M.L., O'Doherty J., Rolls E.T., Andrews C. Activation of the human orbitofrontal cortex to a liquid food stimulus is correlated with its subjective pleasantness. Cereb Cortex 2003, 13:1064-1071.
26. Small D.M., Gregory M.D., Mak Y.E., Gitelman D., Mesulam M.M., Parrish T. Dissociation of neural representation of intensity and affective valuation in human gustation. Neuron 2003, 39:701-711.
27. Hollerman J.R., Schultz W. Dopamine neurons report an error in the temporal prediction of reward during learning. Nat Neurosci 1998, 1:304-309.
28. Schultz W. Multiple reward signals in the brain. Nat Rev Neurosci 2000, 1:199-207.
29. Bayer H.M., Glimcher P.W. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 2005, 47:129-141.
30. D'Ardenne K., McClure S.M., Nystrom L.E., Cohen J.D. BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science 2008, 319:1264-1267.
31. O'Doherty J.P., Dayan P., Friston K., Critchley H., Dolan R.J. Temporal difference models and reward-related learning in the human brain. Neuron 2003, 38:329-337.
32. Pessiglione M., Seymour B., Flandin G., Dolan R.J., Frith C.D. Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature 2006, 442:1042-1045.
33. Wunderlich K., Rangel A., O'Doherty J.P. Neural computations underlying action-based decision making in the human brain. Proc Natl Acad Sci USA 2009, 106:17199-17204.
34. Busemeyer J.R., Townsend J.T. Decision field-theory - a dynamic cognitive approach to decision-making in an uncertain environment. Psychol Rev 1993, 100:432-459.
35. Krajbich I., Armel C., Rangel A. Visual fixations and the computation and comparison of value in simple choice. Nat Neurosci 2010, 13:1292-1298.
36. McFadden D.L. Revealed stochastic preference: a synthesis. Econ Theory 2005, 26:245-264.
37. Milosavljevic M., Malmaud J., Huth A., Koch C., Rangel A. The Drift Diffusion Model can account for the accuracy and reaction time of value-based choices under high and low time pressure. Judgm Decis Making 2010, 5:437-449.
38. Carandini M., Heeger D.J. Normalization as a canonical neural computation. Nat Rev Neurosci 2012, 13:51-62.
39. Barlow H.B. Possible principles underlying the transformation of sensory messages. Sensory Communication 1961, 217-234. MIT Press. W.A. Rosenblith (Ed.).
40. Laughlin S. A simple coding procedure enhances a neurons information capacity. Z Naturforsch [C] 1981, 36:910-912.
41. Gutnisky D.A., Dragoi V. Adaptive coding of visual information in neural populations. Nature 2008, 452:220-224.
42. Brenner N., Bialek W., de Ruyter van Steveninck R. Adaptive rescaling maximizes information transmission. Neuron 2000, 26:695-702.
43. Wark B., Lundstrom B.N., Fairhall A. Sensory adaptation. Curr Opin Neurobiol 2007, 17:423-429.
44. Heeger D.J. Normalization of cell responses in cat striate cortex. Vis Neurosci 1992, 9:181-197.
45. Normann R.A., Perlman I. Effects of background illumination on the photoresponses of red and green cones. J Physiol 1979, 286:491-507.
46. Bunzeck N., Dayan P., Dolan R.J., Duzel E. A common mechanism for adaptive scaling of reward and novelty. Hum Brain Mapp 2010, 31:1380-1394.
47. Kobayashi S., Pinto de Carvalho O., Schultz W. Adaptation of reward sensitivity in orbitofrontal neurons. J Neurosci 2010, 30:534-544.
48. Tobler P.N., Fiorillo C.D., Schultz W. Adaptive coding of reward value by dopamine neurons. Science 2005, 307:1642-1645.
49. Glascher J., Daw N., Dayan P., O'Doherty J.P. States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 2010, 66:585-595.
50. Simon D.A., Daw N.D. Neural correlates of forward planning in a spatial decision task in humans. J Neurosci 2011, 31:5526-5539.
51. Padoa-Schioppa C. Range-adapting representation of economic value in the orbitofrontal cortex. J Neurosci 2009, 29:14004-14014.
52. Sallet J., Quilodran R., Rothe M., Vezoli J., Joseph J.P., Procyk E. Expectations, gains, and losses in the anterior cingulate cortex. Cogn Affect Behav Neurosci 2007, 7:327-336.
53. Tremblay L., Schultz W. Relative reward preference in primate orbitofrontal cortex. Nature 1999, 398:704-708.
54. Park S.Q., Kahnt T., Talmi D., Rieskamp J., Dolan R.J., Heekeren H.R. Adaptive coding of reward prediction errors is gated by striatal coupling. Proc Natl Acad Sci USA 2012, 109:4285-4289.
55. Kennerley S.W., Behrens T.E., Wallis J.D. Double dissociation of value computations in orbitofrontal and anterior cingulate neurons. Nat Neurosci 2011, 14:1581-1589.
56. Seymour B., McClure S.M. Anchors, scales and the relative coding of value in the brain. Curr Opin Neurobiol 2008, 18:173-178.
57. Kahneman D., Tversky A. Prospect theory - analysis of decision under risk. Econometrica 1979, 47:263-291.
58. Koszegi B., Rabin M. A model of reference-dependent preferences. Q J Econ 2006, 121:1133-1165.
59. Tom S.M., Fox C.R., Trepel C., Poldrack R.A. The neural basis of loss aversion in decision-making under risk. Science 2007, 315:515-518.
60. De Martino B., Kumaran D., Holt B., Dolan R.J. The neurobiology of reference-dependent value computation. J Neurosci 2009, 29:3833-3842.
61. Louie K., Grattan L.E., Glimcher P.W. Reward value-based gain control: divisive normalization in parietal cortex. J Neurosci 2011, 31:10627-10639.
62. Louie K., Glimcher P.W. Efficient coding and the neural representation of value. Ann NY Acad Sci 2012, 1251:13-32.
63. de Araujo I.E., Rolls E.T., Velazco M.I., Margot C., Cayeux I. Cognitive modulation of olfactory processing. Neuron 2005, 46:671-679.
64. Bermudez M.A., Schultz W. Reward magnitude coding in primate amygdala neurons. J Neurophysiol 2010, 104:3424-3432.
65. Behrens T.E.J., Hunt L.T., Woolrich M.W., Rushworth M.F.S. Associative learning of social value. Nature 2008, 456:245-250.
66. Berniker M., Voss M., Kording K. Learning priors for bayesian computations in the nervous system. PLoS ONE 2010, 5.
67. O'Reilly J.X., Jbabdi S., Behrens T.E. How can a Bayesian approach inform neuroscience?. Eur J Neurosci 2012, 35:1169-1179.
68. Hare T.A., Camerer C.F., Rangel A. Self-control in decision-making involves modulation of the vmPFC valuation system. Science 2009, 324:646-648.
69. Fehr E., Rangel A. Neuroeconomic foundations of economic choice-recent advances. J Econ Perspect 2011, 25:3-30.
70. Ohshiro T., Angelaki D.E., DeAngelis G.C. A normalization model of multisensory integration. Nat Neurosci 2011, 14:775-782.
71. Olsen S.R., Bhandawat V., Wilson R.I. Divisive normalization in olfactory population codes. Neuron 2010, 66:287-299.
72. Hosokawa T., Kato K., Inoue M., Mikami A. Neurons in the macaque orbitofrontal cortex code relative preference of both rewarding and aversive outcomes. Neurosci Res 2007, 57:434-445.
73. Elliott R., Agnew Z., Deakin J.F.W. Medial orbitofrontal cortex codes relative rather than absolute value of financial rewards in humans. Eur J Neurosci 2008, 27:2213-2218.
74. Nieuwenhuis S., Heslenfeld D.J., von Geusau N.J.A., Mars R.B., Holroyd C.B., Yeung N. Activity in human reward-sensitive brain areas is strongly context dependent. Neuroimage 2005, 25:1302-1309.