Learning to wait for more likely or just more: Greater tolerance to delays of reward with increasingly longer delays

Journal of the Experimental Analysis of Behavior

Volumn 103, Issue 1, 2015, Pages 108-124

  Rung, Jillian M ^a   Young, Michael E ^b  

^a UTAH STATE UNIVERSITY   (United States)

^b KANSAS STATE UNIVERSITY   (United States)

Author keywords

Delay discounting; Delay tolerance; Delayed gratification; Human; Impulsivity; Self control; Training

Indexed keywords

DELAY DISCOUNTING; FEMALE; HUMAN; IMPULSIVENESS; LEARNING; MALE; PSYCHOLOGICAL MODEL; REWARD; TIME; VIDEO GAME;

DELAY DISCOUNTING; FEMALE; HUMANS; IMPULSIVE BEHAVIOR; LEARNING; MALE; MODELS, PSYCHOLOGICAL; REWARD; TIME FACTORS; VIDEO GAMES;

EID: 84920964368     PISSN: 00225002     EISSN: 19383711     Source Type: Journal    
DOI: 10.1002/jeab.132     Document Type: Article

References (49)

1. Akaike, H. ( 1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19(6), 716-723. DOI: 10.1109/TAC.1974.1100705
2. Anderson, J. R., Kuroshima, H., & Fujita, K. ( 2010). Delay of gratification in capuchin monkeys (cebus apella) and squirrel monkeys (saimiri sciureus). Journal of Comparative Psychology, 124(2), 205-210. DOI: 10.1037/a0018240
3. Ayduk, O., Mendoza-Denton, R., Mischel, W., Downey, G., Peake, P. K., & Rodriguez, M. ( 2000). Regulating the interpersonal self: Strategic self-regulation for coping with rejection sensitivity. Journal of Personality and Social Psychology, 79(5), 776-792. DOI: 10.1037/0022-3514.79.5.776
4. Beran, M. J. ( 2002). Maintenance of self-imposed delay of gratification by four chimpanzees (Pan troglodytes) and an orangutan (Pongo pygmaeus). The Journal of General Psychology, 129(1), 49-66.
5. Berry, M. S., Sweeney, M. M., Morath, J., Odum, A. L., & Jordan, K. E. ( 2014). The nature of impulsivity: Visual exposure to natural environments decreases impulsive decision-making in a delay discounting task. PloS one, 9(5), e97915. DOI: 10.1371/journal.pone.0097915
6. Bickel, W. K., Odum, A. L., & Madden, G. J. ( 1999). Impulsivity and cigarette smoking: Delay discounting in current, never, and ex-smokers. Psychopharmacology, 146(4), 447-454. DOI: 10.1007/PL00005490
7. Cohen, J. D., MacWhinney, B., Flatt, M., & Provost, J. ( 1993). PsyScope: An interactive graphic system for designing and controlling experiments in the psychology laboratory using Macintosh computers. Behavior Research Methods, Instruments & Computers, 25(2), 257-271. DOI: 10.3758/BF03204507
8. Dixon, M. R., Hayes, L. J., Binder, L. M., Manthey, S., Sigman, C., & Zdanowski, D. M. ( 1998). Using a self-control training procedure to increase appropriate behavior. Journal of Applied Behavior Analysis, 31(2), 203-210. DOI: 10.1901/jaba.1998.31-203
9. Du, W., Green, L., & Myerson, J. ( 2002). Cross-cultural comparisons of discounting delayed and probabilistic rewards. The Psychological Record, 52(4), 479-492.
10. Evenden, J. L. ( 1999). Varieties of impulsivity. Psychopharmacology, 146, 348-361.
11. Forzano, L. B., & Logue, A. W. ( 1995). Self-control and impulsiveness in children and adults: Effects of food preferences. Journal of the Experimental Analysis of Behavior, 64(1), 33-46. DOI: 10.1901/jeab.1995.64-33
12. Forzano, L. B., Porter, J. M., & Mitchell, T. R. ( 1997). Self-control and impulsiveness in adult human females: Effects of food preferences. Learning and Motivation, 28(4), 622-641. DOI: 10.1006/lmot.1997.0982
13. Green, L., Fristoe, N., & Myerson, J. ( 1994). Temporal discounting and preference reversals in choice between delayed outcomes. Psychonomic Bulletin & Review, 1(3), 383-389.
14. Green, L., Myerson, J., & McFadden, E. ( 1997). Rate of temporal discounting decreases with amount of reward. Memory & Cognition, 25(5), 715-723. DOI: 10.3758/BF03211314
15. Johnson, M. W., & Bickel, W. K. ( 2002). Within-subject comparison of real and hypothetical money rewards in delay discounting. Journal of the Experimental Analysis of Behavior, 77(2), 129-146. DOI: 10.1901/jeab.2002.77-129
16. Johnson, M. W., & Bickel, W. K. ( 2008). An algorithm for identifying nonsystematic delay-discounting data. Experimental and Clinical Psychopharmacology, 16(3), 264-274. DOI: 10.1037/1064-1297.16.3.264
17. Kahneman, D., & Tversky, A. ( 1979). Prospect theory: An analysis of decisions under risk. Econometrica, 47, 313-327.
18. Kidd, C., Palmeri, H., & Aslin, R. N. ( 2013). Rational snacking: Young children's decision-making on the marshmallow task is moderated by beliefs about environmental reliability. Cognition, 126(1), 109-114. DOI: 10.1016/j.cognition.2012.08.004
19. King, G. R., & Logue, A. W. ( 1990). Choice in a self-control paradigm: Effects of reinforcer quality. Behavioural Processes, 22(1-2), 89-99. DOI: 10.1016/0376-6357(90)90010-D
20. Kirby, K. N., & Petry, N. M. ( 2004). Heroin and cocaine abusers have higher discount rates for delayed rewards than alcoholics or non-drug-using controls. Addiction, 99(4), 461-471. DOI: 10.1111/j.1360-0443.2003.00669.x
21. Laird, N. M. & Ware, J. H. ( 1982). Random-effects models for longitudinal data. Biometrics, 38, 963-974.
22. Lynam, D. R., Smith, G. T., Whiteside, S. P., & Cyders, M. A. ( 2006). The UPPS-P: Assessing five personality pathways to impulsive behavior (Technical Report). West Lafayette: Purdue University.
23. Madden, G. J., Petry, N. M., Badger, G. J., & Bickel, W. K. ( 1997). Impulsive and self-control choices in opioid-dependent patients and non-drug-using control patients: Drug and monetary rewards. Experimental and Clinical Psychopharmacology, 5(3), 256-262. DOI: 10.1037/1064-1297.5.3.256
24. Mazur, J. E. & Logue, A. W. ( 1978). Choice in a self-control paradigm: Effects of a fading procedure. Journal of the Experimental Analysis of Behavior, 30(1), 11-17. DOI: 10.1901/jeab.1978.30-11
25. Mischel, W. & Ebbesen, E. B. ( 1970). Attention in delay of gratification. Journal of Personality and Social Psychology, 16(2), 329-337. DOI: 10.1037/h0029815
26. Mischel, W., Ebbesen, E. B., & Zeiss, A. ( 1972). Cognitive and attentional mechanisms in delay of gratification. Journal of Personality and Social Psychology, 21(2), 204-218. DOI: 10.1037/h0032198
27. Mischel, W. & Grusec, J. ( 1967). Waiting for rewards and punishments: Effects of time and probability on choice. Journal of Personality and Social Psychology, 5(1), 24-31. DOI: 10.1037/h0024180
28. Morrison, K. L., Madden, G. J., Odum, A. L., Friedel, J. E., & Twohig, M. P. ( 2014). Altering impulsive decision making with an acceptance-based procedure. Behavior Therapy, 45, 630-639. DOI: 10.1016/j.beth.2014.01.001
29. Myerson, J., Green, L., & Warusawitharana, M. ( 2001). Area under the curve as a measure of discounting. Journal of the Experimental Analysis of Behavior, 76(2), 235-243. DOI: 10.1901/jeab.2001.76-235
30. Newman, A. & Bloom, R. ( 1981). Self-control of smoking: I. Effects of experience with imposed, increasing, decreasing and random delays. Behaviour Research and Therapy, 19(3), 187-192. DOI: 10.1016/0005-7967(81)90001-2
31. Newman, A. & Kanfer, F. H. ( 1976). Delay of gratification in children: The effects of training under fixed, decreasing and increasing delay of reward. Journal of Experimental Child Psychology, 21(1), 12-24. DOI: 10.1016/0022-0965(76)90053-9
32. Paglieri, F. ( 2013). The costs of delay: Waiting versus postponing in intertemporal choice. Journal of the Experimental Analysis of Behavior, 99(3), 362-377. DOI: 10.1002/jeab.18
33. Pelé, M., Dufour, V., Micheletta, J., & Thierry, B. ( 2010). Long-tailed macaques display unexpected waiting abilities in exchange tasks. Animal Cognition, 13(2), 263-271.
34. Petry, N. M. ( 2001). Delay discounting of money and alcohol in actively using alcoholics, currently abstinent alcoholics, and controls. Psychopharmacology, 154(3), 243-250. DOI: 10.1007/s002130000638
35. Pinheiro, J. C. & Bates, D. M. ( 2004). Mixed-effects models in S and S-PLUS. New York: Springer.
36. Rachlin, H., Raineri, A., & Cross, D. ( 1991). Subjective probability and delay. Journal of the Experimental Analysis of Behavior, 55(2), 233-244. DOI: 10.1901/jeab.1991.55-233
37. Radu, P. T., Yi, R., Bickel, W. K., Gross, J. J., & McClure, S. M. ( 2011). A mechanism for reducing delay discounting by altering temporal attention. Journal of the Experimental Analysis of Behavior, 96(3), 363-385. DOI: 10.1901/jeab.2011.96-363
38. Rasmussen, E. B., Lawyer, S. R., & Reilly, W. ( 2010). Percent body fat is related to delay and probability discounting for food in humans. Behavioural Processes, 83(1), 23-30. DOI: 10.1016/j.beproc.2009.09.001
39. Rung, J. M., & Young, M. E. ( 2014). Training tolerance to delay using the escalating interest task. The Psychological Record, 64(3), 423-431. DOI: 10.1007/s40732-014-0045-8
40. Saville, B. K., Gisbert, A., Kopp, J., & Telesco, C. ( 2010). Internet addiction and delay discounting in college students. The Psychological Record, 60(2), 273-286.
41. Schlam, T. R., Wilson, N. L., Shoda, Y., Mischel, W., & Ayduk, O. ( 2013). Preschoolers' delay of gratification predicts their body mass 30 years later. The Journal of Pediatrics, 162(1), 90-93. DOI: 10.1016/j.jpeds.2012.06.049
42. Shoda, Y., Mischel, W., & Peake, P. K. ( 1990). Predicting adolescent cognitive and self-regulatory competencies from preschool delay of gratification: Identifying diagnostic conditions. Developmental Psychology, 26(6), 978-986. DOI: 10.1037/0012-1649.26.6.978
43. Stein, J. S., Johnson, P. S., Renda, C., Smits, R. R., Liston, K. J., Shahan, T. A., & Madden, G. J. ( 2013). Early and prolonged exposure to reward delay: Effects on impulsive choice and alcohol self-administration in male rats. Experimental and Clinical Psychopharmacology, 21(2), 172-180. DOI: 10.1037/a0031245
44. Vanderveldt, A., Green, L., & Myerson, J. ( 2014). Discounting of monetary rewards that are both delayed and probabilistic: Delay and probability combine multiplicatively, not additively. Journal of Experimental Psychology: Learning, Memory, and Cognition, DOI: 10.1037/xlm0000029
45. Webb, T. L. & Young, M. E. (in press). Waiting when both certainty and magnitude are increasing: Certainty overshadows magnitude. Journal of Behavioral Decision Making.
46. Young, M. E., Webb, T. L., & Jacobs, E. A. ( 2011). Deciding when to "cash in" when outcomes are continuously improving: An escalating interest task. Behavioural Processes, 88(2), 101-110. DOI: 10.1016/j.beproc.2011.08.003
47. Young, M. E., Webb, T. L., Rung, J. M., & Jacobs, E. A. ( 2013a). Sensitivity to changing contingencies in an impulsivity task. Journal of the Experimental Analysis of Behavior, 99(3), 335-345. DOI: 10.1002/jeab.24
48. Young, M. E., Webb, T. L., Rung, J. M., & McCoy, A. W. ( 2014). Outcome probability versus magnitude: When waiting benefits one at the cost of the other. PloS one, 9(6), e98996. DOI: 10.1371/journal.pone.0098996
49. Young, M. E., Webb, T. L., Sutherland, S. C., & Jacob, E. A. ( 2013b). Magnitude effects for experienced rewards at short delays in the escalating interest task. Psychonomic Bulletin & Review, 20(2), 302-309. DOI: 10.3758/s13423-012-0350-7