The neural substrates of probabilistic and intertemporal decision making

Brain Research

Volumn 1234, Issue , 2008, Pages 104-115

  Weber, Bethany J ^a   Huettel, Scott A ^a  

^a DUKE UNIVERSITY   (United States)

Author keywords

Choice; Delay; Intraparietal sulcus; Posterior parietal cortex; Risk; Utility

Indexed keywords

ADULT; ARTICLE; CINGULATE GYRUS; CORPUS STRIATUM; DECISION MAKING; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; MALE; NEUROIMAGING; NORMAL HUMAN; PARIETAL LOBE; PRIORITY JOURNAL; PROBABILITY; RESPONSE TIME; REWARD; SUBICULUM;

ADULT; BRAIN; CHOICE BEHAVIOR; DECISION MAKING; FEMALE; FUNCTIONAL LATERALITY; GAMBLING; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; INDIVIDUALITY; MAGNETIC RESONANCE IMAGING; MALE; REWARD; RISK; RISK-TAKING; TIME FACTORS; YOUNG ADULT;

EID: 52049125932     PISSN: 00068993     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.brainres.2008.07.105     Document Type: Article

References (76)

1. Addis D.R., Wong A.T., and Schacter D.L. Remembering the past and imagining the future: common and distinct neural substrates during event construction and elaboration. Neuropsychologia 45 (2007) 1363-1377
2. Allais M. Le comportement de l'homme rationnel devant le risque: Critique le postulats et axioms de L'École Américaine. Econometrica 21 (1953) 503-546
3. Barron G., and Erev I. Small feedback-based decisions and their limited correspondence to description-based decisions. J. Behav. Decis. Mak. 16 (2003) 215-233
4. Becker G., DeGroot M., and Marschak J. Measuring utility by a single-response sequential method. Behav. Sci. 9 (1964)
5. Beckmann C.F., Jenkinson M., and Smith S.M. General multilevel linear modeling for group analysis in FMRI. NeuroImage 20 (2003) 1052-1063
6. Bellec P., Perlbarg V., Jbabdi S., Pelegrini-Issac M., Anton J.L., Doyon J., and Benali H. Identification of large-scale networks in the brain using fMRI. Neuroimage 29 (2006) 1231-1243
7. Brainard D.H. The psychophysics toolbox. Spat. Vis. 10 (1997) 433-436
8. Buckner R.L., and Carroll D.C. Self-projection and the brain. Trends Cogn. Sci. 11 (2007) 49-57
9. Bunge S.A., Hazeltine E., Scanlon M.D., Rosen A.C., and Gabrieli J.D. Dissociable contributions of prefrontal and parietal cortices to response selection. NeuroImage 17 (2002) 1562-1571
10. Cabeza R., Prince S.E., Daselaar S.M., Greenberg D.L., Budde M., Dolcos F., LaBar K.S., and Rubin D.C. Brain activity during episodic retrieval of autobiographical and laboratory events: an fMRI Study using a novel photo paradigm. J. Cogn. Neurosci. 16 (2004) 1583-1594
11. Cantlon J.F., Brannon E.M., Carter E.J., and Pelphrey K.A. Functional imaging of numerical processing in adults and 4-y-old children. Plos Biology 4 (2006) 844-854
12. Cardinal R.N., and Cheung T.H. Nucleus accumbens core lesions retard instrumental learning and performance with delayed reinforcement in the rat. BMC Neuroscience 6 (2005)
13. Cardinal R.N., and Howes N.J. Effects of lesions of the nucleus accumbens core on choice between small certain rewards and large uncertain rewards in rats. Bmc Neuroscience 6 (2005)
14. Chapman G.B., and Weber B.J. Decision biases in intertemporal choice and choice under uncertainty: testing a common account. Mem. & Cog. 34 (2006) 589-602
15. Coricelli G., Critchley H.D., Joffily M., O'Doherty J.P., Sirigu A., and Dolan R.J. Regret and its avoidance: a neuroimaging study of choice behavior. Nat. Neurosci. 8 (2005) 1255-1262
16. Crean J.P., de Wit H., and Richards J.B. Reward discounting as a measure of impulsive behavior in a psychiatric outpatient population. Exp. Clin. Psychopharmacol. 8 (2000) 155-162
17. Damasio A.R., Everitt B.J., and Bishop D. The somatic marker hypothesis and the possible functions of the prefrontal cortex [and discussion]. Philosophical Transactions: Biological Sciences 351 (1996) 1413-1420
18. Damoiseaux J.S., Rombouts S.A., Barkhof F., Scheltens P., Stam C.J., Smith S.M., and Beckmann C.F. Consistent resting-state networks across healthy subjects. Proc. Natl. Acad. Sci. U. S. A. 103 (2006) 13848-13853
19. Dehaene S., Dehaene-Lambertz G., and Cohen L. Abstract representation of numbers in the animal and human brain (vol 21, pg 355, 1998). Trends Neurosci. 21 (1998) 509
20. Dehaene S., Piazza M., Pinel P., and Cohen L. Three parietal circuits for number processing. Cogn. Neuropsychol. 20 (2003) 487-506
21. Dickhaut J., McCabe K., Nagode J.C., Rustichini A., Smith K., and Pardo J.V. The impact of the certainty context on the process of choice. Proc. Natl. Acad. Sci. 100 (2003) 3536-3541
22. Green L., and Myerson J. Exponential versus hyperbolic discounting of delayed outcomes: risk and waiting time. Am. Zool. 36 (1996) 496-505
23. Green L., Myerson J., and Ostaszewski P. Amount of reward has opposite effects on the discounting of delayed and probabilistic outcomes. J. Exp. Psychol. Learn. Mem. Cogn. 25 (1999) 418-427
24. Gusnard D.A., and Raichle M.E. Searching for a baseline: functional imaging and the resting human brain. Nat. Rev. Neurosci. 2 (2001) 685-694
25. Hariri A.R., Brown S.M., Williamson D.E., Flory J.D., de Wit H., and Manuck S.B. Preference for immediate over delayed rewards is associated with magnitude of ventral striatal activity. J. Neurosci. 26 (2006) 13213-13217
26. Hayden B.Y., and Platt M.L. Temporal discounting predicts risk sensitivity in rhesus macaques. Curr. Biol. 17 (2007) 49-53
27. Henson R. Forward inference using functional neuroimaging: dissociations versus associations. Trends Cogn. Sci. 10 (2006) 64-69
28. Hsu M., Bhatt M., Adolphs R., Tranel D., and Camerer C.F. Neural systems responding to degrees of uncertainty in human decision-making. Science 310 (2005) 1680-1683
29. Huettel S.A., Misiurek J., Jurkowski A.J., and McCarthy G. Dynamic and strategic aspects of executive processing. Brain Res. 1000 (2004) 78-84
30. Huettel S.A., Song A.W., and McCarthy G. Decisions under uncertainty: probabilistic context influences activation of prefrontal and parietal cortices. J. Neurosci. 25 (2005) 3304-3311
31. Huettel S.A., Stowe C.J., Gordon E.M., Warner B.T., and Platt M.L. Neural signatures of economic preferences for risk and ambiguity. Neuron 49 (2006) 765-775
32. Kable J.W., and Glimcher P.W. The neural correlates of subjective value during intertemporal choice. Nat. Neurosci. 10 (2007) 1625-1633
33. Kahneman D., and Tversky A. Prospect theory: analysis of decision under risk. Econometrica 47 (1979) 263-291
34. Keren G., and Wagenaar W.A. Violation of utility-theory in unique and repeated gambles. J. Exp. Psychol. Learn. Mem. Cogn. 13 (1987) 387-391
35. Keren G., and Roelofsma P. Immediacy and certainty in intertemporal choice. Org. Behav. Hum. Decis. Processes 63 (1995) 287-297
36. Kheramin S., Body S., Ho M.Y., Velazquez-Martinez D.N., Bradshaw C.M., Szabadi E., Deakin J.F.W., and Anderson I.M. Role of the orbital prefrontal cortex in choice between delayed and uncertain reinforcers: a quantitative analysis. Behav. Processes 64 (2003) 239-250
37. Kuhnen C.M., and Knutson B. The neural basis of financial risk taking. Neuron 47 (2005) 763-770
38. Loewenstein G. Anticipation and the valuation of delayed consumption. Econ. J. 97 (1987) 666-684
39. Mason M.F., Norton M.I., Van Horn J.D., Wegner D.M., Grafton S.T., and Macrae C.N. Wandering minds: the default network and stimulus-independent thought. Science 315 (2007) 393-395
40. Mazur J.E. Theories of probabilistic reinforcement. J. Exp. Anal. Behav. 51 (1989) 87-99
41. McClure S.M., Laibson D.I., Loewenstein G., and Cohen J.D. Separate neural systems value immediate and delayed monetary rewards. Science 306 (2004) 503-507
42. McClure S.M., Ericson K.M., Laibson D.I., Loewenstein G., and Cohen J.D. Time discounting for primary rewards. J. Neurosci. 27 (2007) 5796-5804
43. McCoy A.N., and Platt M.L. Risk-sensitive neurons in macaque posterior cingulate cortex. Nat. Neurosci. 8 (2005) 1220-1227
44. Mellers B.A., Schwartz A., Ho K., and Ritov I. Decision affect theory: emotional reactions to the outcomes of risky options. Psychol. Sci. 8 (1997) 423-429
45. Mitchell S.H. Measures of impulsivity in cigarette smokers and non-smokers. Psychopharmacology 146 (1999) 455-464
46. Mitchell S.H. Effects of short-term nicotine deprivation on decision-making: delay, uncertainty and effort discounting. Nicotine Tob. Res. 6 (2004) 819-828
47. Mobini S., Chiang T.J., Ho M.Y., Bradshaw C.M., and Szabadi E. Effects of central 5-hydroxytryptamine depletion on sensitivity to delayed and probabilistic reinforcement. Psychopharmacology 152 (2000) 390-397
48. Myerson J., Green L., and Warusawitharana M. Area under the curve as a measure of discounting. J. Exp. Anal. Behav. 76 (2001) 235-243
49. Myerson J., Green L., Hanson J.S., Holt D.D., and Estle S.J. Discounting delayed and probabilistic rewards: processes and traits. J. Econ. Psychol. 24 (2003) 619-635
50. Ohmura Y., Takahashi T., and Kitamura N. Discounting delayed and probabilistic monetary gains and losses by smokers of cigarettes. Psychopharmacology 182 (2005) 508-515
51. Okuda J., Fujii T., Ohtake H., Tsukiura T., Tanji K., Suzuki K., Kawashima R., Fukuda H., Itoh M., and Yamadori A. Thinking of the future and past: the roles of the frontal pole and the medial temporal lobes. Neuroimage 19 (2003) 1369-1380
52. Paulus M.P., Hozack N., Zauscher B., McDowell J.E., Frank L., Brown G.G., and Braff D.L. Prefrontal, parietal, and temporal cortex networks underlie decision-making in the presence of uncertainty. Neuroimage 13 (2001) 91-100
53. Paulus M.P., Rogalsky C., Simmons A., Feinstein J.S., and Stein M.B. Increased activation in the right insula during risk-taking decision making is related to harm avoidance and neuroticism. Neuroimage 19 (2003) 1439-1448
54. Pelli D.G. The VideoToolbox software for visual psychophysics: transforming numbers into movies. Spat. Vis. 10 (1997) 437-442
55. Piazza M., Izard V., Pinel P., Le Bihan D., and Dehaene S. Tuning curves for approximate numerosity in the human intraparietal sulcus. Neuron 44 (2004) 547-555
56. Plassman H., O'Doherty J.P., and Rangel A. Orbitofrontal cortex encodes willingness to pay in everyday economic transactions. J. Neurosci. 27 (2007) 9984-9988
57. Platt M.L., and Glimcher P.W. Neural correlates of decision variables in parietal cortex. Nature 400 (1999) 233-238
58. Prelec D., and Loewenstein G. Decision-making over time and under uncertainty-a common approach. Manage. Sci. 37 (1991) 770-786
59. Preuschoff K., Quartz S.R., and Bossaerts P. Human insula activation reflects risk prediction errors as well as risk. J. Neurosci. 28 (2008) 2745-2752
60. Rachlin H., Logue A.W., Gibbon J., and Frankel M. Cognition and behavior in studies of choice. Psychol. Rev. 93 (1986) 33-45
61. Rachlin H., Raineri A., and Cross D. Subjective probability and delay. J. Exp. Anal. Behav. 55 (1991) 233-244
62. Rachlin H., Brown J., and Cross D. Discounting in judgments of delay and probability. J. Behav. Decis. Mak. 13 (2000) 145-159
63. Raichle M.E., MacLeod A.M., Snyder A.Z., Powers W.J., Gusnard D.A., and Shulman G.L. A default mode of brain function. Proc. Natl. Acad. Sci. 98 (2001) 676-682
64. Reynolds B., Karraker K., Horn K., and Richards J.B. Delay and probability discounting as related to different stages of adolescent smoking and non-smoking. Behav. Processes 64 (2003) 333-344
65. Reynolds B., Richards J.B., Horn K., and Karraker K. Delay discounting and probability discounting as related to cigarette smoking status in adults. Behav. Processes 65 (2004) 35-42
66. Richards J.B., Zhang L., Mitchell S.H., and de Wit H. Delay or probability discounting in a model of impulsive behavior: Effect of alcohol. J. Exp. Anal. Behav. 71 (1999) 121-143
67. Rogers R.D., Owen A.M., Middleton H.C., Williams E.J., Pickard J.D., Sahakian B.J., and Robbins T.W. Choosing between small, likely rewards and large, unlikely rewards activates inferior and orbital prefrontal cortex. J. Neurosci. 19 (1999) 9029-9038
68. Rotter J.B. Social Learning and Clinical Psychology (1954), Prentice-Hall, Englewood Cliffs, NJ
69. Smith S.M., Jenkinson M., Woolrich M.W., Beckmann C.F., Behrens T.E.J., Johansen-Berg H., Bannister P.R., De Luca M., Drobnjak I., Flitney D.E., Niazy R.K., Saunders J., Vickers J., Zhang Y., De Stefano N., Brady J.M., and Matthews P.M. Advances in functional and structural MR image analysis and implementation as FSL. NeuroImage 23 (2004) S208-S219
70. Smith S.M., Beckmann C.F., Ramnani N., Woolrich M.W., Bannister P.R., Jenkinson M., Matthews P.M., and McGonigle D.J. Variability in fMRI: a re-examination of inter-session differences. Hum. Brain Mapp. 24 (2005) 248-257
71. Szpunar K.K., Watson J.M., and McDermott K.B. Neural substrates of envisioning the future. Proc. Natl. Acad. Sci. 104 (2007) 642-647
72. Tanaka S.C., Doya K., Okada G., Ueda K., Okamoto Y., and Yamawaki S. Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops. Nat. Neurosci. 7 (2004) 887-893
73. Thaler R. Some empirical-evidence on dynamic inconsistency. Econ. Lett. 8 (1981) 201-207
74. Venkatraman V., Ansari D., and Chee M.W.L. Neural correlates of symbolic and non-symbolic arithmetic. Neuropsychologia 43 (2005) 744-753
75. Weber B.J., and Chapman G.B. Playing for peanuts: why is risk seeking more common for low-stakes gambles?. Org. Behav. Human Decis. Process. 97 (2005) 31-46
76. Wittmann M., Leland D.S., and Paulus M.P. Time and decision making: differential contribution of the posterior insular cortex and the striatum during a delay discounting task. Exp. Brain Res. 179 (2007) 643-653