Formal Comparison of Dual-Parameter Temporal Discounting Models in Controls and Pathological Gamblers

PLoS ONE

Volumn 7, Issue 11, 2012, Pages

  Peters, Jan ^a   Miedl, Stephan Franz ^a   Büchel, Christian ^a  

^a UNIVERSITY MEDICAL CENTER HAMBURG EPPENDORF   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; BAYES THEOREM; CHI SQUARE TEST; CONSTANT SENSITIVITY MODEL; CORRELATION ANALYSIS; HUMAN; INTERMETHOD COMPARISON; MAGNITUDE ESTIMATION METHOD; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; MAXIMUM LIKELIHOOD METHOD; PROBABILITY; SCALE UP; SCORING SYSTEM; SENSITIVITY ANALYSIS; STATISTICAL DISTRIBUTION;

CHOICE BEHAVIOR; GAMBLING; HUMANS; MODELS, PSYCHOLOGICAL; MODELS, STATISTICAL; REWARD; TIME FACTORS;

EID: 84870718759     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0047225     Document Type: Article

References (81)

1. Green L, Myerson J, (2004) A discounting framework for choice with delayed and probabilistic rewards. Psychol Bull 130: 769-792.
2. Frederick S, Loewenstein G, O'Donoghue T, (2002) Time Discounting and Time Preference: A Critical Review. Journal of Economic Literature 40: 351-401.
3. Bickel WK, Miller ML, Yi R, Kowal BP, Lindquist DM, et al. (2007) Behavioral and neuroeconomics of drug addiction: competing neural systems and temporal discounting processes. Drug Alcohol Depend 90Suppl 1: S85-91.
4. Bickel WK, Jarmolowicz DP, Mueller ET, Koffarnus MN, Gatchalian KM, (2012) Excessive discounting of delayed reinforcers as a trans-disease process contributing to addiction and other disease-related vulnerabilities: Emerging evidence. Pharmacol Ther 134: 287-297.
5. Peters J, Buchel C, (2011) The neural mechanisms of inter-temporal decision-making: understanding variability. Trends Cogn Sci 15: 227-239.
6. Sellitto M, Ciaramelli E, Di Pellegrino G, (2011) The neurobiology of intertemporal choice: insight from imaging and lesion studies. Rev Neurosci 22: 565-574.
7. Killeen PR, (2009) An additive-utility model of delay discounting. Psychol Rev 116: 602-619.
8. Samuelson PA, (1937) A note on measurement of utility. Review of Economic Studies 4: 155-161.
9. Mazur JE (1987) An adjusting procedure for studying delayed reinforcement. In: Commons ML, Mazur JE, Nevin JA, Rachlin H, editors. Quantitative analyses of behavior: Vol 5 The effect of delay and of intervening events on reinforcement value. Hillsdale, NJ: Erlbaum. pp. 55-73.
10. McKerchar TL, Green L, Myerson J, Pickford TS, Hill JC, et al. (2009) A comparison of four models of delay discounting in humans. Behav Processes 81: 256-259.
11. Loewenstein G, Prelec D, (1992) Anomalies in intertemporal choice: Evidence and an interpretation. The Quarterly Journal of Economics 107: 573-597.
12. Ebert J, Prelec D, (2007) The Fragility of Time: Time-Insensitivity and Valuation of the Near and Far Future. Managment Science 53: 1423-1438.
13. Bleichrodt H, Rohde KIM, Wakker P, (2009) Non-hyperbolic time inconsistency. Games and Economic Behavior 66: 27-38.
14. Yi R, Landes RD, Bickel WK, (2009) Novel Models of Intertemporal Valuation: Past and Future Outcomes. J Neurosci Psychol Econ 2: 102.
15. Rachlin H, (2006) Notes on discounting. J Exp Anal Behav 85: 425-435.
16. Kable JW, Glimcher PW, (2010) An "as soon as possible" effect in human intertemporal decision making: behavioral evidence and neural mechanisms. J Neurophysiol 103: 2513-2531.
17. Read D, Scholten M, (2006) Discounting by Intervals: A Generalized Model of Intertemporal Choice. Managment Science 52: 1424-1436.
18. Green L, Myerson J, Macaux EW, (2005) Temporal discounting when the choice is between two delayed rewards. J Exp Psychol Learn Mem Cogn 31: 1121-1133.
19. Thaler R, (1981) Some empirical evidence on dynamic inconsistency. Economics Letters 8: 201-207.
20. Myerson J, Green L, (1995) Discounting of delayed rewards: Models of individual choice. J Exp Anal Behav 64: 263-276.
21. Kalenscher T, Windmann S, Diekamp B, Rose J, Güntürkün O, et al. (2005) Single units in the pigeon brain integrate reward amount and time-to-reward in an impulsive choice task. Curr Biol 15: 594-602.
22. Kable JW, Glimcher PW, (2007) The neural correlates of subjective value during intertemporal choice. Nat Neurosci 10: 1625-1633.
23. van der Pol M, Cairns J, (2010) Descriptive validity of alternative intertemporal models for health outcomes: an axiomatic test. Health Econ 20: 770-782.
24. Takahashi T, Oono H, Radford M, (2008) Psychphysics of time perception and intertemporal choice models. Physica A 387: 2066-2074.
25. Johnson MW, Bickel WK, (2008) An algorithm for identifying nonsystematic delay-discounting data. Exp Clin Psychopharmacol 16: 264-274.
26. Peters J, Buchel C, (2009) Overlapping and Distinct Neural Systems Code for Subjective Value during Intertemporal and Risky Decision Making. J Neurosci 29: 15727-15734.
27. Kim S, Hwang J, Lee D, (2008) Prefrontal coding of temporally discounted values during intertemporal choice. Neuron 59: 161-172.
28. Monterosso J, Ainslie G, (1999) Beyond discounting: possible experimental models of impulse control. Psychopharmacology (Berl) 146: 339-347.
29. Figner B, Knoch D, Johnson EJ, Krosch AR, Lisanby SH, et al. (2010) Lateral prefrontal cortex and self-control in intertemporal choice. Nat Neurosci 13: 538-539.
30. McClure SM, Laibson DI, Loewenstein G, Cohen JD, (2004) Separate neural systems value immediate and delayed monetary rewards. Science 306: 503-507.
31. Bjork JM, Momenan R, Hommer DW, (2008) Delay Discounting Correlates with Proportional Lateral Frontal Cortex Volumes. Biol Psychiatry 65(8): 710-713.
32. Berns GS, Laibson D, Loewenstein G, (2007) Intertemporal choice- toward an integrative framework. Trends Cogn Sci 11: 482-488.
33. Wittmann M, Paulus MP, (2008) Decision making, impulsivity and time perception. Trends Cogn Sci 12: 7-12.
34. Radu PT, Yi R, Bickel WK, Gross JJ, McClure SM, (2011) A mechanism for reducing delay discounting by altering temporal attention. J Exp Anal Behav 96: 363-385.
35. Zauberman G, Kyu Kim B, Malkoc SA, Bettman JR, (2009) Discounting Time and Time Discounting: Subjective Time Perception and Intertemporal Preferences. Journal of Marketing Research XLVI: 543-556.
36. Kim B, Zauberman G, (2009) Perception of Anticipatory Time in Temporal Discounting. Journal of Neuroscience, Psychology, and Economics 2: 91-101.
37. Ray D, Bossaerts P, (2011) Positive temporal dependence of the biological clock implies hyperbolic discounting. Front Neurosci 5: 2.
38. Nakahara H, Kaveri S, (2010) Internal-time temporal difference model for neural value-based decision making. Neural Comput 22: 3062-3106.
39. McKerchar TL, Green L, Myerson J, (2010) On the scaling interpretation of exponents in hyperboloid models of delay and probability discounting. Behav Processes 84: 440-444.
40. Read D, (2001) Is Time-Discounting Hyperbolic or Subadditive? J Risk Uncertainty 23: 5-32.
41. Pine A, Seymour B, Roiser JP, Bossaerts P, Friston KJ, et al. (2009) Encoding of marginal utility across time in the human brain. J Neurosci 29: 9575-9581.
42. Stevens SS, (1957) On the psychophysical law. Psychol Rev 64: 153-181.
43. Laibson D, (1997) Golden Eggs and Hyperbolic Discounting. Quart J Econom 112: 443-477.
44. McClure SM, Ericson KM, Laibson DI, Loewenstein G, Cohen JD, (2007) Time discounting for primary rewards. J Neurosci 27: 5796-5804.
45. Pitt MA, Myung IJ, (2002) When a good fit can be bad. Trends Cogn Sci 6: 421-425.
46. Akaike H, (1974) A new look at the statistical model identification. IEEE Transactions on Automatic Control 19: 716-723.
47. Schwarz G, (1978) Estimating the dimesion of a model. The Annals of Statistics 6: 461-464.
48. Lewandowsky S, Farrell S (2011) Computational Modeling in Cognition: Principles and Practice. Thousand Oaks, California: SAGE Publications.
49. Peters J, Buchel C, (2010) Episodic future thinking reduces reward delay discounting through an enhancement of prefrontal-mediotemporal interactions. Neuron 66: 138-148.
50. Miedl SF, Peters J, Buchel C, (2012) Altered neural reward representations in pathological gamblers revealed by delay and probability discounting. Arch Gen Psychiatry 69: 177-186.
51. Prevost C, Pessiglione M, Metereau E, Clery-Melin ML, Dreher JC, (2010) Separate valuation subsystems for delay and effort decision costs. J Neurosci 30: 14080-14090.
52. Daw N (2011) Trial by trial data analysis using computational models.; Delgado MR, Phelps EA, Robbins T, editors. Oxford, UK: Oxford University Press. 3-38 p.
53. Madden GJ, Bickel WK, Jacobs EA, (1999) Discounting of delayed rewards in opioid-dependent outpatients: exponential or hyperbolic discounting functions? Exp Clin Psychopharmacol 7: 284-293.
54. Bickel WK, Odum AL, Madden GJ, (1999) Impulsivity and cigarette smoking: delay discounting in current, never, and ex-smokers. Psychopharmacology (Berl) 146: 447-454.
55. Petry NM, Casarella T, (1999) Excessive discounting of delayed rewards in substance abusers with gambling problems. Drug Alcohol Depend 56: 25-32.
56. Stephan KE, Penny WD, Daunizeau J, Moran RJ, Friston KJ, (2009) Bayesian model selection for group studies. Neuroimage 46: 1004-1017.
57. Dixon MR, Marley J, Jacobs EA, (2003) Delay discounting by pathological gamblers. J Appl Behav Anal 36: 449-458.
58. Petry NM, (2001) Pathological gamblers, with and without substance use disorders, discount delayed rewards at high rates. J Abnorm Psychol 110: 482-487.
59. Alessi SM, Petry NM, (2003) Pathological gambling is associated with impulsivity in a delay discounting procedure. Behav Processes 64: 345-354.
60. Glascher J, Hampton AN, O'Doherty JP, (2009) Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making. Cereb Cortex 19: 483-495.
61. Pessiglione M, Seymour B, Flandin G, Dolan RJ, Frith CD, (2006) Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature 442: 1042-1045.
62. Peters J, Bromberg U, Schneider S, Brassen S, Menz M, et al. (2011) Lower Ventral Striatal Activation During Reward Anticipation in Adolescent Smokers. Am J Psychiatry 168(5): 540-9.
63. Pine A, Shiner T, Seymour B, Dolan RJ, (2010) Dopamine, time, and impulsivity in humans. J Neurosci 30: 8888-8896.
64. Wagenmakers EJ, Farrell S, (2004) AIC model selection using Akaike weights. Psychon Bull Rev 11: 192-196.
65. Bach DR, Hulme O, Penny WD, Dolan RJ, (2011) The known unknowns: neural representation of second-order uncertainty, and ambiguity. J Neurosci 31: 4811-4820.
66. Morgan BJT (2009) Applied Stochastic Modelling: Chapman & Hall/CRC.
67. Huber DE, (2006) Computer simulations of the ROUSE model: an analytic simulation technique and a comparison between the error variance-covariance and bootstrap methods for estimating parameter confidence. Behav Res Methods 38: 557-568.
68. Gill J, King G, (2004) What to Do When Your Hessian Is Not Invertible. Sociological Methods & Research 33: 54-87.
69. Ballard K, Knutson B, (2009) Dissociable neural representations of future reward magnitude and delay during temporal discounting. Neuroimage 45: 143-150.
70. Green L, Fry A, Myerson J, (1994) Discounting of delayed rewards: a life-span comparison. Psychol Sci 5: 33-36.
71. Kurth-Nelson Z, Bickel W, Redish AD, (2012) A theoretical account of cognitive effects in delay discounting. Eur J Neurosci 35: 1052-1064.
72. Grace RC, (1999) The Matching Law And Amount-dependent Exponential Discounting As Accounts Of Self-control Choice. J Exp Anal Behav 71: 27-44.
73. Scholten M, Read D, (2010) The psychology of intertemporal tradeoffs. Psychol Rev 117: 925-944.
74. Doyle JR, Chen HC, Savani K, (2011) New designs for research in delay discounting. Judgement and Decision Making 6: 759-770.
75. Ohmura Y, Takahashi T, Kitamura N, Wehr P, (2006) Three-month stability of delay and probability discounting measures. Exp Clin Psychopharmacol 14: 318-328.
76. Simpson CA, Vuchinich RE, (2000) Reliability of a measure of temporal discounting. The Psychological Record 50: 3-16.
77. Kirby KN, (2009) One-year temporal stability of delay-discount rates. Psychon Bull Rev 16: 457-462.
78. Jimura K, Myerson J, Hilgard J, Keighley J, Braver TS, et al. (2011) Domain independence and stability in young and older adults' discounting of delayed rewards. Behav Processes 87: 253-259.
79. Odum AL, (2011) Delay discounting: trait variable? Behav Processes 87: 1-9.
80. Stewart N, Chater N, Brown GD, (2006) Decision by sampling. Cogn Psychol 53: 1-26.
81. Ungemach C, Stewart N, Reimers S, (2011) How incidental values from the environment affect decisions about money, risk, and delay. Psychol Sci 22: 253-260.