Deciding when to "cash in" when outcomes are continuously improving: An escalating interest task

Behavioural Processes

Volumn 88, Issue 2, 2011, Pages 101-110

  Young, Michael E ^a   Webb, Tara L ^a   Jacobs, Eric A ^a  

^a SOUTHERN ILLINOIS UNIVERSITY   (United States)

Author keywords

Delay discounting; Impulsivity; Magnitude; Probability; Video game

Indexed keywords

DAMAGE; MAGNITUDE; PROBABILITY; SENSITIVITY ANALYSIS; TIMESCALE; WEAPON;

ARTICLE; FEMALE; HUMAN; HUMAN EXPERIMENT; IMPULSIVENESS; MALE; MATHEMATICAL MODEL; NORMAL HUMAN; PROBABILITY; TASK PERFORMANCE; VIDEORECORDING;

ADULT; AGE FACTORS; ALGORITHMS; CHOICE BEHAVIOR; CONDITIONING, OPERANT; ENVIRONMENT; FEMALE; HUMANS; IMPULSIVE BEHAVIOR; INHIBITION (PSYCHOLOGY); LOGISTIC MODELS; MALE; PROBABILITY; PSYCHOMOTOR PERFORMANCE; REACTION TIME; REINFORCEMENT (PSYCHOLOGY); SEX FACTORS; SMOKING; VIDEO GAMES; YOUNG ADULT;

ANIMALIA;

EID: 80052938447     PISSN: 03766357     EISSN: 18728308     Source Type: Journal    
DOI: 10.1016/j.beproc.2011.08.003     Document Type: Article

References (57)

1. Acheson A., Reynolds B., Richards J.B., de Wit H. Diazepam impairs behavioral inhibition but not delay discounting or risk taking in healthy adults. Experimental and Clinical Psychopharmacology 2006, 14:190-198.
2. Akaike H. A new look at the statistical model identification. IEEE Transactions on Automatic Control 1974, 19:716-723.
3. Alessi S.M., Petry N.M. Pathological gambling severity is associated with impulsivity in a delay discounting procedure. Behavioural Processes 2003, 64(3):345-354.
4. Anderson J.R., Kuroshima H., Fujita K. Delay of gratification in capuchin monkeys (Cebus apella) and squirrel monkeys (Saimiri sciureus). Journal of Comparative Psychology 2010, 124:205-210.
5. Barratt E.S. Anxiety and impulsiveness related to psychomotor efficiency. Perceptual and Motor Skills 1959, 9:191-198.
6. Beran M.J., Evans T.A. Maintenance of delay of gratification by four chimpanzees (Pan troglodytes): the effects of delayed reward visibility, experimenter presence, and extended delay intervals. Behavioural Processes 2006, 73:315-324.
7. Beran M.J., Evans T.A. Delay of gratification by chimpanzees (Pan troglodytes) in working and waiting situations. Behavioural Processes 2009, 80:177-181.
8. Bickel W.K., Odum A.L., Madden G.J. Impulsivity and cigarette smoking: delay discounting in current, never, and ex-smokers. Psychopharmacology 1999, 146(4):447-454.
9. Brunswik E. Representative design and probabilistic theory in a functional psychology. Psychological Review 1955, 62:193-217.
10. Cohen J.D., MacWhinney B., Flatt M., Provost J. PsyScope: a new graphic interactive environment for designing psychology experiments. Behavioral Research Methods, Instruments, and Computers 1993, 25:257-271.
11. Dougherty D.M., Marsh-Richard D.M., Hatzis E.S., Nouvion S.O., Mathias C.W. A test of alcohol dose effects on multiple behavioral measures of impulsivity. Drug and Alcohol Dependence 2008, 96:111-120.
12. Dougherty D.M., Mathias C.W., Marsh D.M., Jagar A.A. Laboratory behavioral measures of impulsivity. Behavior Research Methods 2005, 37:82-90.
13. Dougherty D.M., Mathias C.W., Marsh-Richard D.M., Furr R.M., Nouvion S.O., Dawes M.A. Distinctions in behavioral impulsivity: implications for substance abuse research. Additive Disorders and Their Treatment 2009, 8:61-73.
14. Flora S.R., Pavlik W.B. Human self-control and the density of reinforcement. Journal of the Experimental Analysis of Behavior 1992, 57:201-208.
15. Gelman A., Hill J. Data Analysis Using Regression and Multilevel/Hierarchical Models 2006, Cambridge University Press, New York.
16. Green L., Myerson J. A discounting framework for choice with delayed and probabilistic rewards. Psychological Bulletin 2004, 130(5):769-792.
17. Heatherton T.F., Kozlowski L.T., Frecker R.C., Fagerström K.O. The Fagerström test for nicotine dependence: a revision of the Fagerström tolerance questionnaire. British Journal of Addiction 1991, 86:1119-1127.
18. Hyten C., Madden G.J., Field D.P. Exchange delays and impulsive choice in adult humans. Journal of the Experimental Analysis of Behavior 1994, 62(2):225-233.
19. Jimura K., Myerson J., Hilgard J., Braver T.S., Green L. Are people really more patient than other animals? Evidence from human discounting of real liquid rewards. Psychonomic Bulletin & Review 2009, 16:1071-1075.
20. Johnson M.W., Bickel W.K. Within-subject comparison of real and hypothetical money rewards in delay discounting. Journal of the Experimental Analysis of Behavior 2002, 77:129-146.
21. Johnson M.W., Bickel W.K., Baker F. Moderate drug use and delay discounting: a comparison of heavy, light, and never smokers. Experimental and Clinical Psychopharmacology 2007, 15:187-194.
22. Jonsson E.N., Karlsson M.O., Wade J.R. Nonlinearity detection: advantages of nonlinear mixed-effects modeling. AAPS PharmSci 2000, 2(3). article 32.
23. Kahneman D., Tversky A. Prospect theory: an analysis of decisions under risk. Econometrica 1979, 47:313-327.
24. Lagorio C.H., Madden G.J. Delay discounting of real and hypothetical rewards III: steady-state assessments, forced-choice trials, and all real rewards. Behavioural Processes 2005, 69:173-187.
25. Lane S.D., Cherek D.R., Pietras C.J., Tcheremissine O.V. Measurement of delay discounting using trial-by-trial consequences. Behavioural Processes 2003, 64:287-303.
26. Lane S.D., Cherek D.R., Rhoades H.M., Pietras C.J., Tcheremissine O.V. Relationships among laboratory and psychometric measures of impulsivity: implications in substance abuse and dependence. Addictive Disorders and Their Treatment 2003, 2:33-40.
27. Lindstrom M.J., Bates D.M. Nonlinear mixed effects models for repeated measures data. Biometrics 1990, 46:673-687.
28. Logue A.W. Research on self-control: an integrating framework. Behavioral & Brain Sciences 1988, 11:665-678.
29. Logue A.W., Pena-Correal T.E., Rodriguez M.L., Kabela E. Self-control in adult humans: variation in positive reinforcer amount and delay. Journal of the Experimental Analysis of Behavior 1986, 46:159-173.
30. Macmillan N.A., Creelman C.D. Detection Theory: A User's Guide 2004, Lawrence Erlbaum, Mahwah, NJ.
31. Mazur J.E. An adjusting delay procedure for studying delayed reinforcement. The Effect of Delay and Intervening Events on Reinforcement Value 1987, vol. 5:55-73. Erlbaum, Hillsdale, NJ.
32. Mazur J.E. Estimation of indifference points with an adjusting-delay procedure. Journal of the Experimental Analysis of Behavior 1988, 49(1):37-47.
33. Mazur J.E. Choice and self-control. Handbook of Research Methods in Human Operant Behavior 1998, 131-161. Plenum Press, New York. K.A. Lattal, M. Perone (Eds.).
34. McClure S.M., Ericson K.M., Laibson D.I., Loewenstein G., Cohen J.D. Time discounting for primary rewards. Journal of Neuroscience 2007, 27:5796-5804.
35. Millar A., Navarick D.J. Self-control and choice in humans: effects of video game playing as a positive reinforcer. Learning and Motivation 1984, 15:203-218.
36. Mischel W., Ebbesen E.B. Attention in delay of gratification. Journal of Personality and Social Psychology 1970, (16):329-337.
37. Mitchell S.H. Measures of impulsivity in cigarette smokers and non-smokers. Psychopharmacology 1999, 146(4):455-464.
38. Navarick D.J. Negative reinforcement and choice in humans. Learning & Motivation 1982, 13:361-377.
39. Patton J.H., Stanford M.S., Barratt E.S. Factor structure of the Barratt impulsiveness scale. Journal of Clinical Psychology 1995, 51:768-774.
40. Pele M., Dufour V., Micheletta J., Thierry B. Long-tailed macaques display unexpected waiting abilities in exchange tasks. Animal Cognition 2010, 13:263-271.
41. Petry N.M. Delay discounting of money and alcohol in actively using alcoholics, currently abstinent alcoholics, and controls. Psychopharmacology 2001, 154:243-250.
42. Pinheiro J.C., Bates D.M. Mixed-Effects Models in S and S-PLUS 2004, Springer, New York.
43. Rachlin H.C. The Science of Self-Control 2000, Harvard University Press, Cambridge, MA.
44. Rachlin H.C. Notes on discounting. Journal of the Experimental Analysis of Behavior 2006, 85:425-535.
45. Rachlin H.C., Green L. Commitment, choice and self-control. Journal of the Experimental Analysis of Behavior 1972, 17:15-22.
46. Rachlin H.C., Raineri A., Cross D. Subjective probability and delay. Journal of the Experimental Analysis of Behavior 1991, 55:233-244.
47. Raudenbush S.W., Bryk A.S. Hierarchical Linear Models: Applications and Data Analysis Methods 2002, Sage Publishing, Newbury Park, CA. second ed.
48. Redish A.D., Kurth-Nelson Z. Neural models of delay discounting. Impulsivity: The Behavioral and Neurological Science of Discounting 2009, American Psychological Association, Washington, DC. G.J. Madden, W.K. Bickel (Eds.).
49. Reynolds B., Penfold R.B., Patak M. Dimensions of impulsive behavior in adolescents: laboratory behavioral assessments. Experimental and Clinical Psychopharmacology 2008, 16:124-131.
50. Reynolds B., Richards J.B., de Wit H. Acute-alcohol effects on the Experiential Discounting Task (EDT) and a question-based measure of delay discounting. Pharmacology, Biochemistry and Behavior 2006, 83:194-202.
51. Reynolds B., Schiffbauer R. Delay of gratification and delay discounting: a unifying feedback model of delay-related impulsive behavior. Psychological Record 2005, 55:439-460.
52. Shafir S., Reich T., Tsur E., Erev I., Lotem A. Perceptual accuracy and conflicting effects of certainty on risk-taking behaviour. Nature 2008, 453:917-920.
53. Solnick J.V., Kannenberg C.H., Eckerman D.A., Waller M.B. An experimental analysis of impulsivity and impulse control in humans. Learning & Motivation 1980, 11:61-77.
54. Swann A.C., Bjork J.M., Moeller F.G., Dougherty D.M. Two models of impulsivity: relationship to personality traits and psychopathology. Biological Psychiatry 2002, 51:988-994.
55. Wingrove J., Bond A.J. Impulsivity: a state as well as trait variable does mood awareness explain low correlations between trait and behavioural measures of impulsivity?. Personality and Individual Differences 1997, 22:333-339.
56. Winstanley C.A. The neural and neurochemical basis of delay discounting. Impulsivity: The Behavioral and Neurological Science of Discounting 2009, American Psychological Association, Washington, DC. G.J. Madden, W.K. Bickel (Eds.).
57. Young M.E., Nguyen N. The problem of delayed causation in a video game: constant, varied, and filled delays. Learning and Motivation 2009, 40:298-312.