Myopic discounting of future rewards after medial orbitofrontal damage in humans

Journal of Neuroscience

Volumn 30, Issue 49, 2010, Pages 16429-16436

  Sellitto, Manuela ^a,b   Ciaramelli, Elisa ^b   Di Pellegrino, Giuseppe ^a,b  

^a UNIVERSITY OF BOLOGNA   (Italy)

^b Centro Studi e Ricerche in Neuroscienze Cognitive   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; COGNITION; CONTROLLED STUDY; FEMALE; FRONTAL LOBE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; IMPULSIVENESS; MAJOR CLINICAL STUDY; MALE; MEDIAL ORBITOFRONTAL CORTEX; MENTAL TASK; MINI MENTAL STATE EXAMINATION; MONEY; NORMAL HUMAN; ORBITAL CORTEX; PRIORITY JOURNAL; REWARD; SELF REPORT; TEMPORAL DISCOUNTING;

ADULT; AGED; ANALYSIS OF VARIANCE; AREA UNDER CURVE; BRAIN INJURIES; CHOICE BEHAVIOR; COGNITION DISORDERS; FEMALE; FRONTAL LOBE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; IMPULSIVE BEHAVIOR; MAGNETIC RESONANCE IMAGING; MALE; MIDDLE AGED; NEUROPSYCHOLOGICAL TESTS; OXYGEN; REINFORCEMENT SCHEDULE; REWARD; TIME FACTORS;

EID: 78650043069     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.2516-10.2010     Document Type: Article

References (75)

1. Ainslie G (1975) Specious reward: a behavioral theory of impulsiveness and impulse control. Psychol Bull 82:463-496.
2. Ainslie GW (1974) Impulse control in pigeons. J Exp Anal Behav 21:485-489.
3. Anderson SW, Barrash J, Bechara A, Tranel D (2006) Impairments of emotion and real-world complex behavior following childhood- or adultonset damage to ventromedial prefrontal cortex. J Int Neuropsychol Soc 12:224-235.
4. Andrews-Hanna JR, Reidler JS, Sepulcre J, Poulin R, Buckner RL (2010) Functional-anatomic fractionation of the brain's default network. Neuron 65:550-562.
5. Arana FS, Parkinson JA, Hinton E, Holland AJ, Owen AM, Roberts AC (2003) Dissociable contributions of the human amygdala and orbitofrontal cortex to incentive motivation and goal selection. J Neurosci 23:9632-9638.
6. Ballard K, Knutson B (2009) Dissociable neural representations of future reward magnitude and delay during temporal discounting. Neuroimage 45:143-150.
7. Barrash J, Tranel D, Anderson SW (2000) Acquired personality disturbances associated with bilateral damage to the ventromedial prefrontal region. Dev Neuropsychol 18:355-381. (Pubitemid 32488523)
8. Bechara A (2005) Decision making, impulse control and loss of willpower to resist drugs: a neurocognitive perspective. Nat Neurosci 8:1458-1463.
9. Bechara A, Damasio AR (2005) The somatic marker hypothesis: a neural theory of economic decision. Games Econ Behav 52:336-372.
10. Bechara A, Van Der Linden M (2005) Decision-making and impulse control after frontal lobe injuries. Curr Opin Neurol 18:734-739.
11. Bechara A, Damasio H, Tranel D, Damasio AR (1997) Deciding advantageously before knowing the advantageous strategy. Science 275:1293-1295.
12. Beer JS, John OP, Scabini D, Knight RT (2006) Orbitofrontal cortex and social behavior: integrating self-monitoring and emotion-cognition interactions. J Cogn Neurosci 18:871-879.
13. Berlin HA, Rolls ET, Kischka U (2004) Impulsivity, time perception, emotion and reinforcement sensitivity in patients with orbitofrontal cortex lesions. Brain 127:1108-1126.
14. Bickel WK, Pitcock JA, Yi R, Angtuaco EJ (2009) Congruence of BOLD response across intertemporal choice conditions: fictive and real money gains and losses. J Neurosci 29:8839-8846.
15. Buckner RL, Carroll DC (2007) Self-projection and the brain. Trends Cogn Sci 11:49-57.
16. Cardinal RN, Winstanley CA, Robbins TW, Everitt BJ (2004) Limbic corticostriatal systems and delayed reinforcement. Ann N Y Acad Sci 1021:33-50.
17. Catania AC (1998) Learning, Ed 4. Upper Saddle River, NJ: Prentice Hall.
18. Charlton SR, Fantino E (2008) Commodity specific rates of temporal discounting: does metabolic function underlie differences in rates of discounting? Behav Processes 77:334-342.
19. Chib VS, Rangel A, Shimojo S, O'Doherty JP (2009) Evidence for a common representation of decision values for dissimilar goods in human ventromedial prefrontal cortex. J Neurosci 29:12315-12320.
20. Christakou A, Brammer M, Giampietro V, Rubia K (2009) Right ventromedial and dorsolateral prefrontal cortices mediate adaptive decisions under ambiguity by integrating choice utility and outcome evaluation. J Neurosci 29:11020-11028.
21. Ciaramelli E, Ghetti S (2007) What are confabulators' memories made of? A study of subjective and objective measures of recollection in confabulation. Neuropsychologia 45:1489-1500.
22. Damasio AR (1994) Descartes' error: emotion, reason, and the human brain. New York: Putnam.
23. Du W, Green L, Myerson J (2002) Cross-cultural comparisons of discounting delayed and probabilistic rewards. Psychol Rec 52:479-492.
24. Estle SJ, Green L, Myerson J, Holt DD (2007) Discounting of monetary and directly consumable rewards. Psychol Sci 18:58-63.
25. Fellows LK, Farah MJ (2005) Dissociable elements of human foresight: a role for the ventromedial frontal lobes in framing the future, but not in discounting future rewards. Neuropsychologia 43:1214-1221.
26. Figner B, Knoch D, Johnson EJ, Krosch AR, Lisanby SH, Fehr E, Weber EU (2010) Lateral prefrontal cortex and self-control in intertemporal choice. Nat Neurosci 13:538-539.
27. FitzGerald TH, Seymour B, Dolan RJ (2009) The role of human orbitofrontal cortex in value comparison for incommensurable objects. J Neurosci 29:8388-8395.
28. Folstein MF, Folstein SE, McHugh PR (1975) "Mini-mental state": a practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res 12:189-198.
29. Fossati A, Di Ceglie A, Acquarini E, Barratt ES (2001) Psychometric properties of an Italian version of the Barratt impulsiveness scale-11 (BIS-11) in nonclinical subjects. J Clin Psychol 57:815-828.
30. Frederick S, Loewenstein G, O'Donoghue T (2002) Time discounting and time preference: a critical review. J Econ Lit 40:351-401.
31. Green L, Myerson J (2004) A discounting framework for choice with delayed and probabilistic rewards. Psychol Bull 130:769-792. (Pubitemid 39216582)
32. Hare TA, Camerer CF, Rangel A (2009) Self-control in decision-making involves modulation of the vmPFC valuation system. Science 324:646-648.
33. Hare TA, Camerer CF, Knoepfle DT, Rangel A (2010) Value computations in ventral medial prefrontal cortex during charitable decision making incorporate input from regions involved in social cognition. J Neurosci 30:583-590.
34. Holt DD, Green L, Myerson J (2003) Is discounting impulsive? Evidence from temporal and probability discounting in gambling and non-gambling college students. Behav Processes 64:355-367.
35. International Committee of Medical Journal Editors (1991) Statements from the Vancouver group. Br Med J 302:1194.
36. Jimura K, Myerson J, Hilgard J, Braver TS, Green L (2009) Are people really more patient than other animals? Evidence from human discounting of real liquid rewards. Psychon Bull Rev 16:1071-1075.
37. Johnson MW, Bickel WK (2002) Within-subject comparison of real and hypothetical money rewards in delay discounting. J Exp Anal Behav 77:129-146.
38. Johnson MW, Bickel WK (2008) An algorithm for identifying nonsystematic delay-discounting data. Exp Clin Psychopharmacol 16:264-274.
39. Kable JW, Glimcher PW (2007) The neural correlates of subjective value during intertemporal choice. Nat Neurosci 10:1625-1633.
40. Kable JW, Glimcher PW (2010) An "as soon as possible" effect in human intertemporal decision making: behavioral evidence and neural mechanisms. J Neurophysiol 103:2513-2531.
41. Kirby KN, Herrnstein RJ (1995) Preference reversals due to myopic discounting of delayed reward. Psychol Sci 6:83-89.
42. Kirby KN, Marakovic NN (1995) Modeling myopic decisions: evidence for hyperbolic delay-discounting within subjects and amounts. Organ Behav Hum Dec 64:22-30.
43. Kirby KN, Petry NM (2004) Heroin and cocaine abusers have higher discount rates for delayed rewards than alcoholics or non-drug-using controls. Addiction 99:461-471.
44. Kringelbach ML (2005) The human orbitofrontal cortex: linking reward to hedonic experience. Nat Rev Neurosci 6:691-702. (Pubitemid 43160318)
45. Luhmann CC (2009) Temporal decision-making: insights from cognitive neuroscience. Front Behav Neurosci 3:39.
46. Mazur JE (1987) An adjusting procedure for studying delayed reinforcement. In: Quantitative analyses of behavior: the effect of delay and of intervening events on reinforcement value, Vol 5 (Commons ML, Mazur JE, Nevin JA, Rachlin H, eds), pp 55-73. Hillsdale, NJ: Erlbaum.
47. McClure SM, Laibson DI, Loewenstein G, Cohen JD (2004) Separate neural systems value immediate and delayed monetary rewards. Science 306: 503-507.
48. McClure SM, Ericson KM, Laibson DI, Loewenstein G, Cohen JD (2007) Time discounting for primary rewards. J Neurosci 27:5796-5804.
49. Mobini S, Body S, Ho MY, Bradshaw CM, Szabadi E, Deakin JF, Anderson IM (2002) Effects of lesions of the orbitofrontal cortex on sensitivity to delayed and probabilistic reinforcement. Psychopharmacology (Berl) 160:290-298.
50. Modirrousta M, Fellows LK (2008) Medial prefrontal cortex plays a critical and selective role in 'feeling of knowing' meta-memory judgments. Neuropsychologia 46:2958-2965.
51. Montague PR, Berns GS (2002) Neural economics and the biological substrates of valuation. Neuron 36:265-284.
52. Moretti L, Dragone D, di Pellegrino G (2009) Reward and social valuation deficits following ventromedial prefrontal damage. J Cogn Neurosci 21:128-140.
53. Murray EA, O'Doherty JP, Schoenbaum G (2007) What we know and do not know about the functions of the orbitofrontal cortex after 20 years of cross-species studies. J Neurosci 27:8166-8169.
54. Myerson J, Green L (1995) Discounting of delayed rewards: models of individual choice. J Exp Anal Behav 64:263-276.
55. Myerson J, Green L, Warusawitharana M (2001) Area under the curve as a measure of discounting. J Exp Anal Behav 76:235-243.
56. Myerson J, Green L, Hanson JS, Holt DD, Estle SJ (2003) Discounting delayed and probabilistic rewards: processes and traits. J Econ Psychol 24:619-635.
57. Noonan MP, Sallet J, Rudebeck PH, Buckley MJ, Rushworth MF (2010) Does the medial orbitofrontal cortex have a role in social valuation? Eur J Neurosci 31:2341-2351.
58. O'Doherty JP (2004) Reward representations and reward-related learning in the human brain: insights from neuroimaging. Curr Opin Neurobiol 14:769-776.
59. Odum AL, Rainaud CP (2003) Discounting of delayed hypothetical money, alcohol, and food. Behav Processes 64:305-313.
60. Padoa-Schioppa C, Assad JA (2006) Neurons in the orbitofrontal cortex encode economic value. Nature 441:223-226.
61. Peters J, Büchel C (2009) Overlapping and distinct neural systems code for subjective value during intertemporal and risky decision making. J Neurosci 29:15727-15734.
62. Pine A, Seymour B, Roiser JP, Bossaerts P, Friston KJ, Curran HV, Dolan RJ (2009) Encoding of marginal utility across time in the human brain. J Neurosci 29:9575-9581.
63. Rachlin H, Raineri A, Cross D (1991) Subjective probability and delay. J Exp Anal Behav 55:233-244.
64. Roesch MR, Taylor AR, Schoenbaum G (2006) Encoding of timediscounted rewards in orbitofrontal cortex is independent of value representation. Neuron 51:509-520.
65. Rorden C, Brett M (2000) Stereotaxic display of brain lesions. Behav Neurol 12:191-200.
66. Rosati AG, Stevens JR, Hare B, Hauser MD (2007) The evolutionary origins of human patience: temporal preferences in chimpanzees, bonobos, and human adults. Curr Biol 17:1663-1668.
67. Rudebeck PH, Walton ME, Smyth AN, Bannerman DM, Rushworth MF (2006) Separate neural pathways process different decision costs. Nat Neurosci 9:1161-1168.
68. Rushworth MF, Buckley MJ, Behrens TE, Walton ME, Bannerman DM (2007) Functional organization of the medial frontal cortex. Curr Opin Neurol 17:220-227.
69. Schoenbaum G, Roesch MR, Stalnaker TA (2006) Orbitofrontal cortex, decision-making and drug addiction. Trends Neurosci 29:116-124.
70. Schoenbaum G, Roesch MR, Stalnaker TA, Takahashi YK (2009) A new perspective on the role of the orbitofrontal cortex in adaptive behaviour. Nat Rev Neurosci 10:885-892.
71. Schooler JW (2002) Re-representing consciousness: dissociations between experience and meta-consciousness. Trends Cogn Sci 6:339-344.
72. Soman D, Ainslie G, Frederick S, Li X, Lynch J, Moreau P, Mitchell A, Read D, Sawyer A, Trope Y, Wertenbroch K, Zauberman G (2005) The psychology of intertemporal discounting: why are distant events valued differently from proximal ones? Market Lett 16:347-360.
73. Spinnler H, Tognoni G (1987) Standardizzazione e taratura italiana di Test Neuropsicologici. Ital J Neurol Sci 6 (Suppl 8):1-120.
74. Talmi D, Dayan P, Kiebel SJ, Frith CD, Dolan RJ (2009) How humans integrate the prospect of pain and reward during choice. J Neurosci 29:14617-14626.
75. Winstanley CA, Theobald DE, Cardinal RN, Robbins TW (2004) Contrasting roles of basolateral amygdale and orbitofrontal cortex in impulsive choice. J Neurosci 24:4718-4722.