Neural representation of reward probability: Evidence from the Illusion of control

Journal of Cognitive Neuroscience

Volumn 25, Issue 6, 2013, Pages 852-861

  Kool, Wouter ^a   Getz, Sarah J ^a   Botvinick, Matthew M ^a  

^a PRINCETON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; BEHAVIOR; BEHAVIOR CONTROL; COGNITION; DECISION MAKING; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUNCTIONAL NEUROIMAGING; GAMBLING; HUMAN; HUMAN EXPERIMENT; ILLUSION OF CONTROL; MALE; NORMAL HUMAN; OUTCOME ASSESSMENT; PRIORITY JOURNAL; PROBABILITY; REINFORCEMENT; REWARD;

EID: 84876989311     PISSN: 0898929X     EISSN: 15308898     Source Type: Journal    
DOI: 10.1162/jocn_a_00369     Document Type: Article

References (56)

1. Abler, B., Walter, H., Erk, S., Kammerer, H., & Spitzer, M. (2006). Prediction error as a linear function of reward probability is coded in human nucleus accumbens. Neuroimage, 31, 790-795.
2. Allais, P. M. (1953). Le comportement de l'homme rationnel devant le risque: Critique des postulats et axiomes de l'école Américaine. Econometrica: Journal of the Econometric Society, 21, 503-546.
3. Bernoulli, D. (1954). Exposition of a new theory on the measurement of risk. Econometrica, 22, 23-36.
4. Berns, G. S., Capra, C.M., Chappelow, J., Moore, S., & Noussair, C. (2008). Nonlinear neurobiological probability weighting functions for aversive outcomes. Neuroimage, 39, 2047-2057.
5. Bown, N. J., Read, D., & Summers, B. (2003). The lure of choice. Journal of Behavioral Decision Making, 16, 297-308.
6. Brainard, D. H. (1997). The psychophysics toolbox. Spatial Vision, 10, 433-436.
7. Browning, M., & Harmer, C. J. (2012). Expectancy and surprise predict neural and behavioral measures of attention to threatening stimuli. Neuroimage, 59, 1942-1948.
8. Clark, L., Lawrence, A. J., Astley-Jones, F., & Gray, N. (2009). Gambling near-misses enhance motivation to gamble and recruit win-related brain circuitry. Neuron, 61, 481-490.
9. Cox, R. (1996). AFNI: Software for analysis and visualization of functional magnetic resonance neuroimages. Computers and Biomedical Research, 29, 162-173.
10. Daw, N. D., Niv, Y., & Dayan, P. (2005). Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature Neuroscience, 8, 1704-1711.
11. De Martino, B., Kumaran, D., Holt, B., & Dolan, R. J. (2009). The neurobiology of reference-dependent value computation. The Journal of Neuroscience, 29, 3833-3842.
12. Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003). Discrete coding of reward probability and uncertainty by dopamine neurons. Science, 299, 1898-1902.
13. FitzGerald, T. H. B., Seymour, B., Bach, D. R., & Dolan, R. J. (2010). Differentiable neural substrates for learned and described value and risk. Current Biology, 20, 1823-1829.
14. Fossati, P., Hevenor, S. J., Graham, S. J., Grady, C., Keightley, M. L., Craik, F., et al. (2003). In search of the emotional self: An fMRI study using positive and negative emotional words. American Journal of Psychiatry, 160, 1938-1945.
15. Hayden, B. Y., Heilbronner, S. R., Pearson, J. M., & Platt, M. L. (2011). Surprise signals in anterior cingulate cortex: Neuronal encoding of unsigned reward prediction errors driving adjustment in behavior. Journal of Neuroscience, 31, 4178-4187.
16. Hertwig, R., Barron, G., Weber, E. U., & Erev, I. (2004). Decisions from experience and the effect of rare events in risky choice. Psychological Science, 15, 534-539.
17. Hertwig, R., & Erev, I. (2009). The description-experience gap in risky choice. Trends in Cognitive Sciences, 13, 517-523.
18. Hsu, M., Krajbich, I., Zhao, C., & Camerer, C. F. (2009). Neural response to reward anticipation under risk is nonlinear in probabilities. Journal of Neuroscience, 29, 2231-2237.
19. Huettel, S., Stowe, C., Gordon, E., Warner, B., & Platt, M. (2006). Neural signatures of economic preferences for risk and ambiguity. Neuron, 49, 765-775.
20. Hutcherson, C. A., Plassmann, H., Gross, J. J., & Rangel, A. (2012). Cognitive regulation during decision-making shifts behavioral control between ventromedial and dorsolateral prefrontal value systems. The Journal of Neuroscience, 32, 13543-13554.
21. Isen, A. M., & Geva, N. (1987). The influence of positive affect on acceptable level of risk: The person with a large canoe has a large worry. Organizational Behavior and Human Decision Processes, 39, 145-154.
22. Isen, A. M., & Patrick, R. (1983). The effect of positive feelings on risk taking: When the chips are down. Organizational Behavior and Human Performance, 31, 194-202.
23. Jessup, R. K., & O'Doherty, J. P. (2011). Human dorsal striatal activity during choice discriminates reinforcement learning behavior from the gambler's fallacy. Journal of Neuroscience, 31, 6296-6304.
24. Johnson, M. K., Raye, C. L., Mitchell, K. J., Touryan, S. R., Green, E. J., & Nolen-Hoeksema, S. (2006). Dissociating medial frontal and posterior cingulate activity during self-reflection. Social Cognitive and Affective Neuroscience, 1, 56-64.
25. Johnson, S. C., Baxter, L. C., Wilder, L. S., Pipe, J. G., Heiserman, J. E., & Prigatano, G. P. (2002). Neural correlates of self-reflection. Brain, 125, 1808-1814.
26. Kahneman, D., Knetsch, J. L., & Thaler, R. H. (1990). Experimental tests of the endowment effect and the Coase theorem. The Journal of Political Economy, 98, 1325-1348.
27. Kahneman, D., & Tversky, A. (1979). Prospect theory: An analysis of decision under risk. Econometrica: Journal of the Econometric Society, 47, 263-292.
28. Kobayashi, S., Lauwereyns, J., Koizumi, M., Sakagami, M., & Hikosaka, O. (2002). Influence of reward expectation on visuospatial processing in macaque lateral prefrontal cortex. Journal of Neurophysiology, 87, 1488-1498.
29. Langer, E. J. (1975). The illusion of control. Journal of Personality and Social Psychology, 32, 311-328.
30. Langer, E. J., & Rodin, J. (1976). The effects of choice and enhanced personal responsibility for the aged: A field experiment in an institutional setting. Journal of Personality and Social Psychology, 34, 191-198.
31. Leotti, L. A., & Delgado, M. (2011). The inherent reward of choice. Psychological Science, 22, 1310-1318.
32. Leotti, L. A., Iyengar, S. S., & Ochsner, K. N. (2010). Born to choose: The origins and value of the need for control. Trends in Cognitive Sciences, 14, 457-463.
33. Litt, A., Plassmann, H., Shiv, B., & Rangel, A. (2011). Dissociating valuation and saliency signals during decision-making. Cerebral Cortex, 21, 95-102.
34. McClure, S. M., Ericson, K. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2007). Time discounting for primary rewards. Journal of Neuroscience, 27, 5796.
35. Montague, P. R., Dayan, P., & Sejnowski, T. J. (1996). A framework for mesencephalic dopamine systems based on predictive Hebbian learning. The Journal of Neuroscience, 16, 1936-1947.
36. Ochsner, K. N., Beer, J. S., Robertson, E. R., Cooper, J. C., Gabrieli, J. D. E., Kihlstrom, J. F., et al. (2005). The neural correlates of direct and reflected self-knowledge. Neuroimage, 28, 797-814.
37. Padoa-Schioppa, C., & Assad, J. A. (2006). Neurons in the orbitofrontal cortex encode economic value. Nature, 441, 223-226.
38. Paulus, M. P., & Frank, L. R. (2006). Anterior cingulate activity modulates nonlinear decision weight function of uncertain prospects. Neuroimage, 30, 668-677.
39. Pelli, D. G. (1997). The VideoToolbox software for visual psychophysics: Transforming numbers into movies. Spatial Vision, 10, 437-442.
40. Platt, M. L., & Glimcher, P. W. (1999). Neural correlates of decision variables in parietal cortex. Nature, 400, 233-238.
41. Presson, P. K., & Benassi, V. A. (1996). Illusion of control: A meta-analytic review. Journal of Social Behavior and Personality, 11, 493-510.
42. Preuschoff, K., Quartz, S., & Bossaerts, P. (2008). Human insula activation reflects risk prediction errors as well as risk. The Journal of Neuroscience, 28, 2745-2752.
43. Rangel, A., & Hare, T. (2010). Neural computations associated with goal-directed choice. Current Opinion in Neurobiology, 20, 262-270.
44. Rescorla, R. A., & Wagner, A. R. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In A. H. Black & W. F. Prokasy (Eds.), Classical conditioning: II. Current research and theory (pp. 64-99). New York: Appleton-Century-Crofts.
45. Roesch, M. R., Singh, T., Brown, P. L., Mullins, S. E., & Schoenbaum, G. (2009). Ventral striatal neurons encode the value of the chosen action in rats deciding between differently delayed or sized rewards. Journal of Neuroscience, 29, 13365-13376.
46. Schultz, W., Dayan, P., & Montague, P. R. (1997). A neural substrate of prediction and reward. Science, 275, 1593-1599.
47. Simon, D. A., & Daw, N. D. (2011). Neural correlates of forward planning in a spatial decision task in humans. Journal of Neuroscience, 31, 5526-5539.
48. Starmer, C. (2000). Developments in non-expected utility theory: The hunt for a descriptive theory of choice under risk. Journal of Economic Literature, 38, 332-382.
49. Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: An introduction. Cambridge, MA: MIT Press.
50. Talairach, J., & Tournoux, P. (1988). Co-planar stereotaxic atlas of the human brain. New York: Theme Medical Publishers.
51. Thompson, S. Z., Armstrong, W., & Thomas, C. (1998). Illusions of control, underestimations, and accuracy: A control heuristic explanation. Psychological Bulletin, 123, 143-161.
52. Tobler, P. N., Christopoulos, G. I., O'Doherty, J. P., Dolan, R. J., & Schultz, W. (2008). Neuronal distortions of reward probability without choice. Journal of Neuroscience, 28, 11703-11711.
53. Trepel, C., Fox, C. R., & Poldrack, R. A. (2005). Prospect theory on the brain? Toward a cognitive neuroscience of decision under risk. Cognitive Brain Research, 23, 34-50.
54. Tversky, A., & Kahneman, D. (1992). Advances in prospect theory: Cumulative representation of uncertainty. Journal of Risk and Uncertainty, 5, 297-323.
55. von Neumann, J., & Morgenstern, O. (1944). Theory of games and economic behavior. Princeton, NJ: Princeton University Press.
56. Vul, E., & Kanwisher, N. (2010). Begging the question: The non-independence error in fMRI data analysis. In S. J. Hanson & M. Bunzl (Eds.), Foundational Issues in Human Brain Mapping (pp. 71-91). Cambridge, MA: MIT Press.