Neuronal signals for reward risk in frontal cortex

Annals of the New York Academy of Sciences

Volumn 1239, Issue 1, 2011, Pages 109-117

  Schultz, Wolfram ^a   O'Neill, Martin ^a   Tobler, Philippe N ^a,b   Kobayashi, Shunsuke ^a,c  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b UNIVERSITY OF ZURICH   (Switzerland)

^c FUKUSHIMA MEDICAL UNIVERSITY   (Japan)

Author keywords

Choice; Decision; Neuroeconomics; Standard deviation; Variance

Indexed keywords

ARTICLE; DECISION MAKING; FRONTAL CORTEX; HUMAN; NEUROPHYSIOLOGY; NONHUMAN; REWARD; RISK; SIGNAL TRANSDUCTION;

EID: 83155189110     PISSN: 00778923     EISSN: 17496632     Source Type: Book Series    
DOI: 10.1111/j.1749-6632.2011.06256.x     Document Type: Article

References (38)

1. O'Neill, M. & W. Schultz. 2010. Coding of reward risk distinct from reward value by orbitofrontal neurons. Neuron 68: 789-800.
2. McCoy, A.N. & M.L. Platt. 2005. Risk-sensitive neurons in macaque posterior cingulate cortex. Nat. Neurosci. 8: 1220-1227.
3. Kacelnik, A. & M. Bateson. 1997. Risk-sensitivity: crossroads for decision-making. Trends Cog. Neurosci. 8: 304-309.
4. Paulsen, D.J., M.L. Platt, S.A. Huettel & E.M. Brannon. 2011. Decision-making under risk in children, adolescents, and young adults. Front. Psychol. 2: 72: 1-6.
5. Kepecs, A., N. Uchda, H. Zariwala & Z.F. Mainen. 2008. Neural correlates, computation and behavioural impact of decision confidence. Nature 455: 227-231.
6. Roitman, J.D. & M.F. Roitman. 2010. Risk-preference differentiates orbitofrontal cortex responses to freely chosen reward outcomes. Eur. J. Neurosci. 31: 1492-1500.
7. Fiorillo, C.D., P.N. Tobler & W. Schultz. 2003. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299: 1898-1902.
8. Sutton, R.S. & A.G. Barto 1981. Toward a modern theory of adaptive networks: expectation and prediction. Psychol. Rev. 88: 135-170.
9. Niv Y., M.O. Duff & P. Dayan. 2005. Dopamine, uncertainty and TD learning. Behav. Brain Funct. 1: 6: 1-9.
10. Fiorillo, C.D., P.N. Tobler & W. Schultz. 2005. Evidence that the delay-period activity of dopamine neurons corresponds to reward uncertainty rather than backpropagating TD errors. Behav. Brain Funct. 1: 7: 1-5.
11. Schultz, W. 2006. Behavioral theories and the neurophysiology of reward. Ann. Rev. Psychol. 57: 87-115.
12. Suri, R. & W. Schultz. 1999. A neural network with dopamine-like reinforcement signal that learns a spatial delayed response task. Neuroscience 91: 871-890.
13. Pearce, J.M. & G. Hall. 1980. A model for Pavlovian conditioning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychol. Rev. 87: 532-552.
14. Basso, M.A. & R.H. Wurtz. 1997. Modulation of neuronal activity by target uncertainty. Nature 398: 66-69.
15. Weber, E. U., A.R. Blais & N. Betz. 2002. A domain-specific risk-attitude scale: measuring risk perceptions and risk behaviors. J. Behav. Dec. Mak. 15: 263-290.
16. Caraco, T., S. Martindale & T.S. Whitham. 1980. An empirical demonstration of risk-sensitive foraging preferences. Anim. Behav. 28: 820-830.
17. Caraco, T., W.U. Blankenhorn, G.M. Gregory, et al. 1990. Risk-sensitivity: ambient temperature affects foraging choice. Anim. Behav. 39: 338-345.
18. Weber, E.U. & R.A. Milliman. 1997. Perceived risk attitudes: relating risk perception to risky choice. Manag. Sci. 43: 123-144.
19. Tobler, P.N., J.P. O'Doherty, R.J. Dolan & W. Schultz. 2007. Reward value coding distinct from risk attitude-related uncertainty coding in human reward systems. J. Neurophysiol. 97: 1621-1632.
20. Preuschoff, K., P. Bossaerts & S.R. Quartz. 2006. Neural differentiation of expected reward and risk in human subcortical structures. Neuron 51: 381-390.
21. Hsu, M., M. Bhatt, R. Adolphs, et al. 2005. Neural systems responding to degrees of uncertainty in human decision-making. Science 310: 1680-1683.
22. Huettel, S.A., C.J. Stowe, E.M. Gordon, et al. 2006. Neural signatures of economic preferences for risk and ambiguity. Neuron 49: 765-775.
23. Levy, H. & H.M. Markowitz. 1979. Approximating expected utility by a function of mean and variance. Am. Econ. Rev. 69: 308-317.
24. Tobler, P.N., G.I. Christopoulos, J.P. O'Doherty, et al. 2009. Risk-dependent reward value signal in human prefrontal cortex. Proc. Natl. Acad. Sci. USA 106: 7185-7190.
25. Tinklepaugh, O.L. 1928. An experimental study of representation factors in monkeys. J. Comp. Psychol. 8: 197-236.
26. Crespi, L.P. 1942. Quantitative variation in incentive and performance in the white rat. Am. J. Psychol. 40: 467-517.
27. Black, R.W. 1968. Shifts in magnitude of reward and contrast effects in instrumental and selective learning: a reinterpretation. Psychol. Rev. 75: 114-126.
28. Kahneman, D. & A. Tversky. 1979. Prospect theory: an analysis of decision under risk. Econometrica 47: 263-291.
29. Tremblay, L. & W. Schultz. 1999. Relative reward preference in primate orbitofrontal cortex. Nature 398: 704-708.
30. Hosokawa, T., K. Kato, M. Inoue & A. Mikami. 2007. Neurons in the macaque orbitofrontal cortex code relative preference of both rewarding and aversive outcomes. Neurosci. Res. 57: 434-445.
31. Padoa-Schioppa, C. 2009. Range-adapting representation of economic value in the orbotofrontal cortex. J. Neurosci. 29: 14 004-14 014.
32. Nieuwenhuis, S., D.J. Heslenfeld, N. Alting van Geusau, et al. 2005. Activity in human reward-sensitive brain areas is strongly context dependent. Neuroimage 25: 1302-1309.
33. Elliott, R, Z. Agnew & J.F.W. Deakin. 2008. Medial orbitofrontal cortex codes relative rather than absolute value of financial rewards in humans. Eur. J. Neuroci. 27: 2213-2218.
34. Watanabe, M., K. Hikosaka, M. Sakagami & S.I. Shirakawa. 2002. Coding and monitoring of behavioral context in the primate prefrontal cortex. J. Neurosci. 22: 2391-2400.
35. Cromwell, H.C., O.K. Hassani & W. Schultz. 2005. Relative reward processing in primate striatum. Exp. Brain Res. 162: 520-525.
36. Bermudez, M. & W. Schultz. 2010. Reward magnitude coding in primate amygdala neurons. J. Neurophysiol. 104: 3424-3432.
37. Breiter, H.C., I. Aharon, D. Kahneman, et al. 2001. Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron 30: 619-639.
38. Kobayashi, S., O. Pinto de Carvalho & W. Schultz. 2010. Adaptation of reward sensitivity in orbitofrontal neurons. J. Neurosci. 30: 534-544.