A discounting framework for choice with delayed and probabilistic rewards

Psychological Bulletin

Volumn 130, Issue 5, 2004, Pages 769-792

  Green, Leonard ^a,b   Myerson, Joel ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

^b WASHINGTON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DECISION MAKING; HUMAN; REVIEW; REWARD; STATISTICAL MODEL; TIME;

CHOICE BEHAVIOR; HUMANS; MODELS, STATISTICAL; REWARD; TIME FACTORS;

EID: 4544335609     PISSN: 00332909     EISSN: None     Source Type: Journal    
DOI: 10.1037/0033-2909.130.5.769     Document Type: Review

References (118)

1. Ainslie, G. (1975). Specious reward: A behavioral theory of impulsiveness and impulse control, Psychological Bulletin, 82, 463-496.
2. Ainslie, G. (1992). Picoeconomics: The strategic interaction of successive motivational states within the person. Cambridge. England: Cambridge University Press.
3. Ainslie, G. (2001). Breakdown of will. Cambridge. England: Cambridge University Press.
4. Ainslie, G., & Haendel, V. (1983). The motives of the will. In E. Gottheil K. A. Druley, T. E. Skoloda, & H. M. Waxman (Eds.), Etiologic aspects of alcohol and drug abuse (pp. 119-140). Springfield, IL: Charles C Thomas.
5. Ainslie, G., & Herrnstein, R. J. (1981). Preference reversal and delayed reinforcement. Animal Learning & Behavior, 9, 476-482.
6. Alessi, S. M., & Petty, N. M. (2003). Pathological gambling severity is associated with impulsivity in a delay discounting procedure. Behavioural Processes, 64, 345-354.
7. Allais, M. (1953). Le comportement de l'homme rationnel devant le risque: Critique des postulats et axioms de l'École Américaine [Behavior of rational man under risk: Critique of the postulate and axioms of the American school]. Econometrica, 21, 503-546.
8. Angeletos, G. M., Laibson, D., Repetto, A., Tobacman, J., & Weinberg, S. (2001). The hyperbolic consumption model: Calibration, simulation, and empirical evaluation. Journal of Economic Perspectives, 15, 47-68.
9. Baker, F., Johnson, M. W., & Bickel, W. K. (2003). Delay discounting in current and never-before cigarette smokers: Similarities and differences across commodity, sign, and magnitude. Journal of Abnormal Psychology, 112, 382-392.
10. Barratt, E. S. (1985). Impulsiveness defined within a systems model of personality. In C. D. Spielberger & J. N. Butcher (Eds.), Advances in personality assessment (Vol. 5, pp. 113-132). Hillsdale, NJ: Erlbaum.
11. Barratt, E. S., & Stanford, M. S. (1995). Impulsiveness. In C. G. Costello (Ed.), Personality characteristics of the personality disordered (pp. 91-119). New York: Wiley.
12. Benzion, U., Rapoport, A., & Yagil, J. (1989). Discount rates inferred from decisions: An experimental study. Management Science, 35, 270-284.
13. Bickel, W. K., & Marsch, L. A. (2001). Toward a behavioral economic understanding of drug dependence: Delay discounting processes. Addiction, 96, 73-86.
14. Bickel, W. K., Odum, A. L., & Madden, G. J. (1999). Impulsivity and cigarette smoking: Delay discounting in current, never, and ex-smokers. Psychopharmacology, 146, 447-454.
15. Camerer, C. (1995). Individual decision making. In J. H. Kagel & A. E. Roth (Eds.), The handbook of experimental economics (pp. 587-703). Princeton, NJ: Princeton University Press.
16. Camerer, C. F., & Hogarth, R. M. (1999). The effects of financial incentives in experiments: A review and capital-labor production framework. Journal of Risk and Uncertainty, 19, 7-42.
17. Chapman, G. B. (1996). Temporal discounting and utility for health and money. Journal of Experimental Psychology: Learning, Memory, and Cognition, 22, 771-791.
18. Chapman, G. B., Brewer, N. T., Coups, E. J., Brownlee, S., Leventhal, H., & Leventhal, E. A. (2001). Value for the future and preventive health behavior. Journal of Experimental Psychology: Applied, 7, 235-250.
19. Chapman, G. B., & Elstein, A. S. (1995). Valuing the future: Temporal discounting of health and money. Medical Decision Making, 15, 373-386.
20. Christensen, J., Parker, S., Silberberg, A., & Hursh, S. (1998). Trade-offs in choice between risk and delay depend on monetary amounts. Journal of the Experimental Analysis of Behavior, 69, 123-139.
21. Coffey, S. F., Gudleski, G. D., Saladin, M. E., & Brady, K. T. (2003). Impulsivity and rapid discounting of delayed hypothetical rewards in cocaine-dependent individuals. Experimental and Clinical Psychopharmacology, 11, 18-25.
22. Costa, P. T., Jr., & McCrea, R. R. (1989). Personality continuity and the changes of adult life. In M. Storandt & G. R. VandenBos (Eds.), The adult years: Continuity and change (pp. 45-77). Washington, DC: American Psychological Association.
23. Du, W., Green, L., & Myerson, J. (2002). Cross-cultural comparisons of discounting delayed and probabilistic rewards. Psychological Record, 52, 479-492.
24. Estle, S. J., Green, L., Myerson, J., & Holt, D. D. (2003, May). Effects of amount on discounting delayed and probabilistic gains and losses. Poster session presented at the annual meeting of the Society for the Quantitative Analyses of Behavior, San Francisco.
25. Eysenck, S. B., & Eysenck, H. J. (1977). The place of impulsiveness in a dimensional system of personality description. British Journal of Social and Clinical Psychology, 16, 57-68.
26. Eysenck, S. B., & Eysenck, H. J. (1978). Impulsiveness and venturesomeness: Their position in a dimensional system of personality description. Psychological Reports, 43, 1247-1255.
27. Eysenck, S. B., Eysenck, H. J., & Barrett, P. (1985). A revised version of the Psychoticism scale. Personality and Individual Differences, 6, 21-29.
28. Eysenck, S. B., Pearson, P. R., Easting, G., & Allsopp, J. F. (1985). Age norms for impulsiveness, venturesomeness and empathy in adults. Personality and Individual Differences, 6, 613-619.
29. Fehr, E. (2002, January 17). The economics of impatience. Nature, 415, 269-272.
30. Frederick, S., Loewenstein, G., & O'Donoghue, T. (2002). Time discounting and time preference: A critical review. Journal of Economic Literature, 40, 351-401.
31. Giordano, L. A., Bickel, W. K., Loewenstein, G., Jacobs, E. A., Marsch, L., & Badger, G. J. (2002). Mild opioid deprivation increases the degree that opioid-dependent outpatients discount delayed heroin and money. Psychopharmacology, 163, 174-182.
32. Grace, R. C. (1999). The matching law and amount-dependent exponential discounting as accounts of self-control choice. Journal of the Experimental Analysis of Behavior, 71, 27-44.
33. Green, L., & Estle, S. J. (2003). Preference reversals with food and water reinforcers in rats. Journal of the Experimental Analysis of Behavior, 79, 233-242.
34. Green, L., Fisher, E. B., Jr., Perlow, S., & Sherman, L. (1981). Preference reversal and self-control: Choice as a function of reward amount and delay. Behaviour Analysis Letters, 1, 43-51.
35. Green, L., Fristoe, N., & Myerson, J. (1994). Temporal discounting and preference reversals in choice between delayed outcomes. Psychonomic Bulletin & Review, 1, 383-389.
36. Green, L., Fry, A. F., & Myerson, J. (1994). Discounting of delayed rewards: A life-span comparison. Psychological Science, 5, 33-36.
37. Green, L., & Myerson, J. (1993). Alternative frameworks for the analysis of self control. Behavior and Philosophy, 21, 37-47.
38. Green, L., & Myerson, J. (1996). Exponential versus hyperbolic discounting of delayed outcomes: Risk and waiting time. American Zoologist, 36, 496-505.
39. Green, L., Myerson, J., Holt, D. D., Slevin, J. R., & Estle, S. J. (2004). Discounting of delayed food rewards in pigeons and rats: Is there a magnitude effect? Journal of the Experimental Analysis of Behavior, 81, 39-50.
40. Green, L., Myerson, J., Lichtman, D., Rosen, S., & Fry, A. (1996). Temporal discounting in choice between delayed rewards: The role of age and income. Psychology and Aging, 11, 79-84.
41. Green, L., Myerson, J., & McFadden, E. (1997). Rate of temporal discounting decreases with amount of reward. Memory & Cognition, 25, 715-723.
42. Green, L., Myerson, J., & Ostaszewski, P. (1999a). Amount of reward has opposite effects on the discounting of delayed and probabilistic outcomes. Journal of Experimental Psychology: Learning, Memory, and Cognition, 25, 418-427.
43. Green, L., Myerson, J., & Ostaszewski, P. (1999b). Discounting of delayed rewards across the life span: Age differences in individual discounting functions. Behavioural Processes, 46, 89-96.
44. Harless, D. W., & Camerer, C. F. (1994). The predictive utility of generalized expected utility theories. Econometrica, 62, 1251-1289.
45. Heyman, G. M. (1996). Resolving the contradictions of addiction. Behavioral and Brain Sciences, 19, 561-574.
46. Holt, D. D., Green, L., & Myerson, J. (2003). Is discounting impulsive? Evidence from temporal and probability discounting in gambling and non-gambling college students. Behavioural Processes, 64, 355-367.
47. Houston, A., Kacelnik, A., & McNamara, J. (1982). Some learning rules for acquiring information. In D. McFarland (Ed.), Functional ontogeny (pp. 140-191). Boston: Pitman.
48. Ibáñez, A., Blanco, C., Donahue, E., Lesieur, H. R., de Castro, I. P., Fernández-Piqueras, J., & Sáiz-Ruiz, J. (2001). Psychiatric comorbidity in pathological gamblers seeking treatment. American Journal of Psychiatry, 158, 1733-1735.
49. Johnson, M. W., & Bickel, W. K. (2002). Within-subject comparison of real and hypothetical money rewards in delay discounting. Journal of the Experimental Analysis of Behavior, 77, 129-146.
50. Kagel, J. H., Battalio, R. C., & Green, L. (1995). Economic choice theory: An experimental analysis of animal behavior. Cambridge, England: Cambridge University Press.
51. Kagel, J. H., Green, L., & Caraco, T. (1986). When foragers discount the future: Constraint or adaptation? Animal Behaviour, 34, 271-283.
52. Kahneman, D., & Tversky, A. (1979). Prospect theory: An analysis of decision under risk. Econometrica, 47, 263-292.
53. Keeney, R. L., & Raiffa, H. (1993). Decisions with multiple objectives: Preferences and value tradeoffs. New York: Wiley.
54. Kirby, K. N. (1997). Bidding on the future: Evidence against normative discounting of delayed rewards. Journal of Experimental Psychology: General, 126, 54-70.
55. Kirby, K. N., & Hermstein, R. J. (1995). Preference reversals due to myopic discounting of delayed reward. Psychological Science, 6, 83-89.
56. Kirby, K. N., & Maraković, N. N. (1995). Modeling myopic decisions: Evidence for hyperbolic delay-discounting within subjects and amounts. Organization Behavior and Human Decision Processes, 64, 22-30.
57. Kirby, K. N., & Maraković, N. N. (1996). Delay-discounting probabilistic rewards: Rates decrease as amounts increase. Psychonomic Bulletin & Reviw. 3, 100-104.
58. Kirby, K. N., Petry, N. M., & Bickel, W. K. (1999). Heroin addicts have higher discount rates for delayed rewards than non-drug-using controls. Journal of Experimental Psychology: General, 128, 78-87.
59. Kirby, K. N., & Santiesteban, M. (2003). Concave utility, transaction costs, and risk in measuring discounting of delayed rewards. Journal of Experimental Psychology: Learning, Memory, and Cognition, 29, 66-79.
60. Kollins, S. H. (2003). Delay discounting is associated with substance use in college students. Addictive Behaviors, 28, 1167-1173.
61. Koopmans, T. C. (1960). Stationary ordinal utility and impatience. Econometrica, 28, 287-309.
62. Koopmans, T. C., Diamond, P. A., & Williamson, R. E. (1964). Stationary utility and time perspective. Econometrica, 32, 82-100.
63. Laibson, D. (1997). Golden eggs and hyperbolic discounting. Quarterly Journal of Economics, 62, 443-477.
64. Lesieur, H. R., & Bloom, S. B. (1987). The South Oaks Gambling Screen (SOGS): A new instrument for the identification of pathological gamblers. American Journal of Psychiatry, 144, 1184-1188.
65. Loewsnstein, G., & Elster, J. (Eds.). (1992). Choice overtime. New York: Russell Sage Foundation.
66. Loewenstein, G., & Prelec, D. (1992), Anomalies in intertemporal choice: Evidence and an interpretation. Quarterly Journal of Economics, 107, 573-597.
67. Loewenstein, G., & Thaler, R. H. (1989). Intertemporal choice. Journal of Economic Perspectives, 3, 181-193.
68. Logue, A. W. (1988). Research on self-control: An integrating framework. Behavioral and Brain Sciences, 11, 665-679.
69. Logue, A. W., & Anderson, Y. D. (2001). Higher-education administrators: When the future does not make a difference. Psychological Science, 12, 276-281.
70. Luce, R. D., & Krumhansl, C. L. (1988). Measurement, scaling, and psychophysics. In R. C. Atkinson, R. J. Herrnstein, G. Lindzey, & R. D. Luce (Eds.), Stevens' handbook of experimental psychology, Vol. 1: Perception and motivation (2nd ed., pp. 3-74). Oxford, England: Wiley.
71. Lyons, C. A., & Ghezzi, P. M. (1995). Wagering on a large scale: Relationships between public gambling and game manipulations in two state lotteries. Journal of Applied Behavior Analysis, 28, 127-137
72. Madden, G. J., Begotka, A. M., Raiff, B. R., & Kastern, L. L. (2003). Delay discounting of real and hypothetical rewards. Experimental and Clinical Psychopharmacology, 11, 139-145.
73. Madden, G. J., Petry, N. M., Badger, G. J., & Bickel, W. K. (1997). Impulsive and self-control choices in opiod-dependent patients and non-drug-using control participants: Drug and monetary rewards. Experimental and Clinical Psychopharmacology, 5, 256-262.
74. Mazur, J. E. (1987). An adjusting procedure for studying delayed reinforcement, In M. L. Commons, J. E. Mazur, J. A. Nevin, & H. Rachlin (Eds.), Quantitative analyses of behavior: Vol. 5. The effect of delay and of intervening events an reinforcement value (pp. 55-73). Hillsdale, NJ: Erlbaum.
75. Mischel. W., Shoda, Y., & Rodriguez, M. L. (1989, May 26). Delay of gratification in children. Science, 244, 933-938.
76. Mitchell, S. H. (1999). Measures of impulsivity in cigarette smokers and non-smokers, Psychopharmacology, 146, 455-464.
77. Murphy, J. G., Vuchinich, R. E., & Simpson, C. A. (2001), Delayed reward and cost discounting. Psychological Record, 51, 571-588.
78. Myerson, J., & Green, L. (1995). Discounting of delayed rewards: Models of individual choice. Journal of the Experimental Analysis of Behavior, 64, 263-276.
79. Myerson, J., Green, L., Hanson, J. S., Holt, D. D., & Estle, S. J. (2003). Discounting delayed and probabilistic rewards: Processes and traits. Journal of Economic Psychology, 24, 619-635.
80. Myerson, J., Green, L., & Warusawitharana, M. (2001). Area under the curve as a measure of discounting. Journal of the Experimental Analysis of Behavior, 76, 235-243.
81. Odum, A. L., Madden, G. J., Badger, G. J., & Bickel, W. K. (2000). Needle sharing in opioid-dependent outpatients: Psychological processes underlying risk. Drug and Alcohol Dependence, 60, 259-266.
82. Odum, A. L., & Rainaud, C. P. (2003). Discounting of delayed hypothetical money, alcohol, and food. Behavioural Processes, 64, 305-313.
83. Ostaszewski, P. (1996). The relation between temperament and rate of temporal discounting. European Journal of Personality, 10, 161-172.
84. Ostaszewski, P. (1997). Temperament and the discounting of delayed and probabilistic rewards: Conjoining European and American psychological traditions. European Psychologist, 2, 35-43.
85. Ostaszewski, P., Green, L., & Myerson, J. (1998). Effects of inflation on the subjective value of delayed and probabilistic rewards. Psychonomic Bulletin & Review, 5, 324-333.
86. Petty, N. M. (2001a). Delay discounting of money and alcohol in actively using alcoholics, currently abstinent alcoholics, and controls. Psychopharmacology, 154, 243-250.
87. Petry, N. M. (2001b). Pathological gamblers, with and without substance abuse disorders, discount delayed rewards at high rates. Journal of Abnormal Psychology, 110, 482-487.
88. Petry, N. M. (2002). Discounting of delayed rewards in substance abusers: Relationship to antisocial personality disorder. Psychophannacology, 162, 425-432.
89. Petry, N. M., & Casarella, T. (1999). Excessive discounting of delayed rewards in substance abusers with gambling problems. Drug and Alcohol Dependence, 56, 25-32.
90. Prelec, D., & Loewenstein, G. (1991). Decision making over time and under uncertainty: A common approach. Management Science, 37, 770-786.
91. Rachlin, H. (1971). On the tautology of the matching law. Journal of the Experimental Analysis of Behavior. 15, 249-251.
92. Rachlin, H. (1989). Judgment, decision, and choice: A cognitive/behavioral synthesis. New York: Freeman.
93. Rachlin, H. (1995). Self-control: Beyond commitment. Behavioral and Brain Sciences, 18, 109-121.
94. Rachlin, H., Castrogiovanni, A., & Cross, D. (1987). Probability and delay in commitment. Journal of the Experimental Analysis of Behavior, 48, 347-353.
95. Rachlin, H., & Green, L. (1972). Commitment, choice and self-control. Journal of the Experimental Analysis of Behavior, 17, 15-22.
96. Rachlin, H., Logue, A. W., Gibbon, I. & Frankel, M. (1986). Cognition and behavior in studies of choice. Psychological Review, 93, 33-55.
97. Rachlin, H., Raineri, A., & Cross, D. (1991). Subjective probability and delay. Journal of the Experimental Analysis of Behavior, 55, 233-244.
98. Rachlin, H., Siegel, E., & Cross, D. (1994). Lotteries and the time horizon. Psychological Science, 5, 390-393.
99. Raineri, A., & Rachlin, H. (1993). The effect of temporal constraints on the value of money and other commodities. Journal of Behavioral Decision Making, 6, 77-94.
100. Reynolds, B., Richards J. B., Horn, K., & Karraker, K. (2004). Delay discounting and probability discounting as related to cigarette smoking status in adults. Behavioural Processes, 65, 35-42.
101. Richards, J. B., Mitchell, S. H., de Wit, H., & Seiden, L. S. (1997). Determination of discount functions in rats with an adjusting-amount procedure. Journal of the Experimental Analysis of Behavior, 67, 353-366.
102. Richards, J. B., Zhang, L., Mitchell, S. H., & de Wit, H. (1999). Delay or probability discounting in a model of impulsive behavior: Effect of alcohol. Journal of the Experimental Analysis of Behavior, 71, 121-143.
103. Roberts, S., & Pashler, H. (2000). How persuasive is a good fit? A comment on theory testing. Psychological Review, 107, 358-367.
104. Rodgers, J. L., & Rowe, D. C. (2002). Theory development should begin (but not end) with good empirical fits: A comment on Roberts and Pashler (2000). Psychological Review, 109, 599-604.
105. Rodriguez, M. L., & Logue, A. W. (1988). Adjusting delay to reinforcement: Comparing choice in pigeons and humans. Journal of the Experimental Psychology: Animal Behavior Processes, 14, 105-117.
106. Schoenfelder, T. E., & Hantula, D. A. (2003). A job with a future? Delay discounting, magnitude effects, and domain independence of utility for career decisions. Journal of Vocational Behavior, 62, 43-55.
107. Simpson, C. A., & Vuchinich, R. E. (2000). Reliability of a measure of temporal discounting. Psychological Record, 50, 3-16.
108. Starmer, C. (2000). Developments in non-expected utility theory: The hunt for a descriptive of choice under risk. Journal of Economic Literature, 38, 332-382.
109. Steel, Z., & Blaszczynski, A. (1998). Impulsivity, personality disorders and pathological gambling severity. Addiction, 93, 895-905.
110. Stevens, S. S. (1957). On the psychophysical law. Psychological Review, 64, 153-181.
111. Stevenson, M. K. (1986). A discounting model for decisions with delayed positive and negative outcomes. Journal of Experimental Psychology: General, 115, 131-154.
112. Thaler, R. (1981). Some empirical evidence on dynamic inconsistency. Economics Letters, 8, 201-207.
113. Thaler, R. H. (1991). Quasi rational economics. New York: Russell Sage Foundation.
114. Tversky, A., & Kahneman, D. (1981, January 30). The framing of decisions and the psychology of choice. Science, 211, 453-458.
115. Tversky, A., & Kahneman, D. (1992). Advances in prospect theory: Cumulative representation of uncertainty. Journal of Risk and Uncertainty, 5, 297-323.
116. Vuchinich, R. E., & Simpson, C. A. (1998). Hyperbolic temporal discounting in social drinkers and problem drinkers. Experimental and Clinical Psychopharmacology, 6, 292-305.
117. World Health Organization. (2000). Obesity: Preventing and managing the global epidemic. Report of a WHO consultation (WHO Technical Report Series No. 894). Geneva, Switzerland: Author.
118. Zuckerman, M. (1971). Dimensions of sensation seeking. Journal of Consulting and Clinical Psychology, 36, 45-52.