Is it patience or motivation? On motivational confounds in intertemporal choice tasks

Journal of the Experimental Analysis of Behavior

Volumn 103, Issue 1, 2015, Pages 196-217

  Paglieri, Fabio ^a   Addessi, Elsa ^a   Sbaffi, Agnese ^b   Tasselli, Maria Isabella ^c   Delfino , Alexia ^d  

^a INSTITUTE OF COGNITIVE SCIENCES AND TECHNOLOGIES   (Italy)

^b LUISS UNIVERSITY   (Italy)

^c SAPIENZA UNIVERSITY OF ROME   (Italy)

^d LONDON SCHOOL OF ECONOMICS   (United Kingdom)

Author keywords

Confounds.; Delay discounting; Intertemporal choice.; Motivation.; Reward type.

Indexed keywords

ADOLESCENT; ADULT; DECISION MAKING; DELAY DISCOUNTING; FEMALE; HUMAN; MALE; MOTIVATION; QUESTIONNAIRE; REWARD; TIME; YOUNG ADULT;

ADOLESCENT; ADULT; CHOICE BEHAVIOR; DELAY DISCOUNTING; FEMALE; HUMANS; MALE; MOTIVATION; REWARD; SURVEYS AND QUESTIONNAIRES; TIME FACTORS; YOUNG ADULT;

EID: 84920945568     PISSN: 00225002     EISSN: 19383711     Source Type: Journal    
DOI: 10.1002/jeab.118     Document Type: Article

References (120)

1. Addessi, E., Bellagamba, F., Delfino, A., De Petrillo, F., Focaroli, V., Macchitella, L., ⋯ Paglieri, F. (2014). Waiting by mistake: Symbolic representation of rewards modulates intertemporal choice in capuchin monkeys, preschool children and adult humans. Cognition, 130, 428-441.
2. Addessi, E., Paglieri, F., Beran, M., Evans, T., Macchitella, L., De Petrillo, F., & Focaroli, V. (2013). Delay choice vs. delay maintenance: Different measures of delayed gratification in capuchin monkeys (Cebus apella). Journal of Comparative Psychology, 127(4), 392-398.
3. Addessi, E., Paglieri, F., & Focaroli, V. (2011). The ecological rationality of delay tolerance: Insights from capuchin monkeys. Cognition, 119, 142-147.
4. Addessi, E., & Rossi, S. (2011). Tokens improve capuchin performance in the reverse-reward contingency task. Proceedings of the Royal Society of London, 278, 849-854.
5. Ainslie, G. (2001). Breakdown of will. New York: Cambridge University Press.
6. Amici, F., Aureli, F., & Call, J. (2008). Fission-fusion dynamics, behavioral flexibility, and inhibitory control in primates. Current Biology, 18, 1415-1419.
7. Anderson, J., Kuroshima, H., & Fujita, K. (2010). Delay of gratification in capuchin monkeys (Cebus apella) and squirrel monkeys (Saimiri sciureus). Journal of Comparative Psychology, 124, 205-210.
8. Ariely, D. (2008). Predictably irrational: The hidden forces that shape our decisions. New York: Harper-Collins.
9. Beran, M. (2002). Maintenance of self-imposed delay of gratification by four chimpanzees (Pan troglodytes) and an orangutan (Pongo pygmaeus). Journal of General Psychology, 129, 49-66.
10. Beran, M. J., & Evans, T. A. (2006). Maintenance of delay of gratification by four chimpanzees (Pan troglodytes): The effects of delayed reward visibility, experimenter presence, and extended delay intervals. Behavioural Processes, 73, 315-324.
11. Beran, M., Evans, T., Paglieri, F., McIntyre, J., Addessi, E., & Hopkins, W. (2014). Chimpanzees (Pan troglodytes) can wait, when they choose to: A study with the hybrid delay task. Animal Cognition, 17, 197-205.
12. Beran, M., Pate, J., & Rumbaugh, D. (1999). Delay of gratification in chimpanzees (Pan troglodytes). Developmental Psychobiology, 34, 119-127.
13. Berns, G., Laibson, D., & Loewenstein, G. (2007). Intertemporal choice - toward an integrative framework. Trends in Cognitive Science, 11, 482-488.
14. Bickel, W., Jarmolowicz, D., Mueller, E., Koffarnus, M., & Gatchalian, K. (2012). Excessive discounting of delayed reinforcers as a trans-disease process contributing to addiction and other disease-related vulnerabilities: Emerging evidence. Pharmacology & Therapeutics, 134(3), 287-297.
15. Bickel, W., & Marsch, L. (2001). Toward a behavioral economic understanding of drug dependence: Delay discounting processes. Addiction, 96, 73-86.
16. Bickel, W., Odum, A., & Madden, G. (1999). Impulsivity and cigarette smoking: delay discounting in current, never, and ex-smokers. Psychopharmacology, 146, 447-454.
17. Boysen, S. (2006). The impact of symbolic representations on chimpanzee cognition. In S. Hurley & M. Nudds (Eds.), Rational animals? (pp 489-511). New York: Oxford University Press.
18. Boysen, S., & Berntson, G. (1995). Responses to quantity: Perceptual versus cognitive mechanisms in chimpanzees (Pan troglodytes). Journal of Experimental Psychology: Animal Behavior Processes A, 21, 82-86.
19. Boysen, S., Berntson, G., Hannan, M., & Cacioppo, J. (1996). Quantity-based interference and symbolic representations in chimpanzees (Pan troglodytes). Journal of Experimental Psychology, Animal Behavior Processes, 22, 76-86.
20. Boysen, S., Mukobi, K., & Berntson, G. (1999). Overcoming response bias using symbolic representations of number by chimpanzees (Pan troglodytes). Animal Learning & Behavior, 27, 229-235.
21. Briers, B., Pandelaere, M., Dewitte, S., & Warlop, L. (2006). Hungry for money: The desire for caloric resources increases the desire for financial resources and vice versa. Psychological Science, 17, 939-943. DOI: 10.1111/j.1467-9280.2006.01808.x
22. Carlson, S., Davis, A., & Leach, J. (2005). Less is more. Executive function and symbolic representation in preschool children. Psychological Science, 16, 609-616.
23. Chapman, G. (1996). Temporal discounting and utility for health and money. Journal of Experimental Psychology. Learning, Memory, and Cognition, 22, 771-791.
24. Charlton, S., & Fantino, E. (2008). Commodity specific rates of temporal discounting: Does metabolic function underlie differences in rate of discounting. Behavioural Processes, 77(3), 334-342.
25. Coffey, S. F., Gudleski, G. D., Saladin, M. E., & Brady, K. T. (2003). Impulsivity and rapid discounting of delayed hypothetical rewards in cocaine-dependent individuals. Experimental Clinical Psychopharmacology, 11, 18-25.
26. De Wit, H., & Mitchell, S. H. (2010). Drug effects on delay discounting. In G. Madden & W. Bickel (Eds.), Impulsivity: The behavioral and neurological science of discounting (pp. 213-241). Washington: American Psychological Association.
27. Dewey, J. (1931) Context and thought. In J. A. Boydston & A. Sharpe (Eds.), John Dewey: The later works, 1925-1953 (Vol. 6, pp. 3-21). Carbondale Southern Illinois: University Press.
28. Di Chiara, G., & Bassareo, V. (2007). Reward system and addiction: what dopamine does and doesn't do. Current Opinions in Pharmacology, 7(1), 69-76.
29. Duckworth, A., & Kern, M. (2011). A meta-analysis of the convergent validity of self-control measures. Journal of Research in Personality, 45, 259-268.
30. Elster, J. (1979). Ulysses and the sirens. Cambridge Cambridge University Press.
31. Elster, J. (2000). Ulysses unbound. Studies in rationality, precommitment, and constraints. Cambridge: Cambridge University Press.
32. Estle, S. J., Green, L., Myerson, J., & Holt, D. D. (2007). Discounting of monetary and directly consumable rewards. Psychological Science, 18, 58-63.
33. Evans, T., & Beran, M. (2007). Chimpanzees use self-distraction to cope with impulsivity. Biology Letters, 3, 599-602.
34. Evans, T., Beran, M., Paglieri, F., & Addessi, E. (2012). Delaying gratification for food and tokens in capuchin monkeys (Cebus apella) and chimpanzees (Pan troglodytes): When quantity is salient, symbolic stimuli do not improve performance. Animal Cognition, 15, 539-548.
35. Evenden, J. (1999). Varieties of impulsivity. Psychopharmacology, 146, 348-361.
36. Frederick, S., Loewenstein, G., & O'Donoghue, T. (2002). Time discounting and time preference: A critical review. Journal of the Economic Literature, 40, 351-401.
37. Genty, E., Karpel H., & Silberberg A. (2012). Time preferences in long-tailed macaques (Macaca fascicularis) and humans (Homo sapiens). Animal Cognition, 15(6), 1161-1172.
38. Gratton, A., & Wise, R. A. (1994). Drug- and behavior-associated changes in dopamine-related electrochemical signals during intravenous cocaine self-administration in rats. The Journal of Neuroscience, 14, 4130-4146.
39. Gray, J., Amlung, M., Acker, J., Sweet, L., & MacKillop, J. (2014). Item-based analysis of delayed reward discounting decision making. Behavioural Processes, 103, 256-260.
40. Green, L., & Myerson, J. (2004). A discounting framework for choice with delayed and probabilistic rewards. Psychological Bulletin, 130, 769-792.
41. Green, L., & Myerson, J. (2010). Experimental and correlational analyses of delay and probability discounting. In G. Madden & W. Bickel (Eds.), Impulsivity: the behavioral and neurological science of discounting (pp. 67-92). Washington, DC: American Psychological Association.
42. Green, L., Myerson, J., & McFadden, E. (1997). Rate of temporal discounting decreases with amount of reward. Memory & Cognition, 25, 715-723.
43. Green, L., Myerson, J., & Ostaszewski, P. (1999). Amount of reward has opposite effects on the discounting of delayed and probabilistic outcomes. Journal of Experimental Psychology: Learning, Memory, and Cognition, 25, 418-427.
44. Heil, S., Johnson, M., Higgins, S., & Bickel, W. (2006). Delay discounting in currently using and currently abstinent cocaine-dependent outpatients and non-drug-using matched controls. Addictive Behaviour, 31, 1290-1294.
45. Herrmann, E., Hand, D., Johnson, M., Badger, G., & Heil, S. (in press). Examining delay discounting of condom-protected sex among opioid-dependent women and non-drug-using control women. Drug and Alcohol Dependence.
46. Heyman, J., & Ariely, D. (2004). Effort for payment: A tale of two markets. Psychological Science, 15, 787-793.
47. Holton, R. (2009). Willing, wanting, waiting. Oxford: Oxford University Press.
48. Jimura, K., Myerson, J., Hilgard, J., Braver, T., & Green, L. (2009). Are people really more patient than other animals? Evidence from human discounting of real liquid rewards. Psychonomic Bulletin & Review, 16, 1071-1075.
49. Jimura, K., Myerson, J., Hilgard, J., Keighley, J., Braver, T., & Green, L. (2011). Domain independence and stability in young and older adults' discounting of delayed rewards. Behavioural Processes, 87, 253-259.
50. Johnson, M. W., Bickel, W. K., Baker, F., Moore, B. A., Badger, G. J., & Budney, A. J. (2010). Delay discounting in current and former marijuana-dependent individuals. Experimental and Clinical Psychopharmacology, 18, 99-107.
51. Johnson, M., & Bruner, N. (2012). The Sexual Discounting Task: HIV risk behavior and the discounting of delayed sexual rewards in cocaine dependence. Drug & Alcohol Dependence, 123(1-3), 15-21.
52. Johnson, M., & Bruner, N. (2013). Test-retest reliability and gender differences in the Sexual Discounting Task among cocaine-dependent individuals. Experimental Clinical Psychopharmacololgy, 21(4), DOI: 10.1037/a0033071
53. Kacelnik, A. (2003). The evolution of patience. In G. Loewenstein, D. Read, & R. Baumeister (Eds.), Time and decision: economic and psychological perspectives on intertemporal choice (pp. 115-138). New York: Russell Sage Foundation.
54. Kalenscher, T., & Pennartz, C. (2008). Is a bird in the hand worth two in the future? The neuroeconomics of intertemporal decision-making. Progresses in Neurobiology, 84, 284-315.
55. Kirby, K. (1997). Bidding on the future: Evidence against normative discounting of delayed rewards. Journal of Experimental Psychology: General, 126, 54-70.
56. Kirby, K., & Guastello, B. (2001). Making choices in anticipation of similar future choices can increase self-control. Journal of Experimental Psychology: Applied, 7, 154-164.
57. Kirby, K., & Maraković, N. (1996). Delay-discounting probabilistic rewards: Rates decrease as amounts increase. Psychonomic Bulletin & Review, 3, 100-104.
58. Kirby, K. N., Petry, N. M., & Bickel, W. K. (1999). Heroin addicts discount delayed rewards at higher rates than non-drug using controls. Journal of Experimental Psychology: General, 128, 78-87.
59. Kiyatkin, E., & Gratton, A. (1994). Electrochemical monitoring of extracellular dopamine in nucleus accumbens of rats lever-pressing for food. Brain Research, 652, 225-234.
60. Kiyatkin, E., Wise, R., & Gratton, A. (1993). Drug- and behavior-associated changes in dopamine-related electrochemical signals during intravenous heroin self-administration in rats. Synapse, 14, 60-72.
61. Lea, S. E. G., & Webley, P. (2006). Money as tool, money as drug: the biological psychology of a strong incentive. Behavioural Brain Science, 29, 161-209.
62. Loewenstein, G. (1996). Out of control: Visceral influences on behavior. Organizational Behaviour & Human Decision, 65, 272-292.
63. Loewenstein, G. (1999). A visceral account of addiction. In J. Elster & O. J. Skog (Eds.), Getting hooked: Rationality and addiction (pp. 235-264). Cambridge: Cambridge University Press.
64. Loewenstein, G. F., Hsee, C. K., Weber, E. U., & Welch, N. (2001). Risks as feelings. Psychological Bulletin, 127, 267-286.
65. Loewenstein, G., & Thaler, R. H. (1989). Anomalies: Intertemporal choice. Journal of Economic Perspectives, 3, 181-194.
66. Luhmann, C. (2009). Temporal decision-making: Insights from cognitive neuroscience. Frontiers in Behavioral Neuroscience, 3(39), DOI: 10.3389/neuro.08.039.2009
67. MacKillop, J. (2013). Integrating behavioral economics and behavioral genetics: Delayed reward discounting as an endophenotype for addictive disorders. Journal of the Experimental Analysis of Behavior, 99, 14-31.
68. Madden, G., Bickel, W., & Jacobs, E. (1999). Discounting of delayed rewards in opioid-dependent outpatients: Exponential or hyperbolic discounting functions. Experimental Clinical Psychopharmacology, 7, 284-293.
69. Madden, G., & Johnson, P. (2010). A delay-discounting primer. In G. Madden & W. Bickel (Eds.), Impulsivity: The behavioral and neurological science of discounting (pp. 11-37). Washington, DC: American Psychological Association.
70. Madden, G., Petry, N., Badger, G., & Bickel, W. (1997). Impulsive and self-control choices in opioid-dependent patients and non-drug-using control participants: drug and monetary rewards. Experimental Clinical Psychopharmacology, 5, 256-262.
71. Mazur, J. E. (1988). Estimation of indifference points with an adjusting delay procedure. Journal of the Experimental Analysis of Behavior, 49, 37-47.
72. McClure, S., Ericson, K., Laibson, D., Loewenstein, G., & Cohen, J. (2007). Time discounting for primary rewards. Journal of Neuroscience, 27, 5796-5804.
73. McClure, S., Laibson, D., Loewenstein, G., & Cohen, J. (2004). Separate neural systems value immediate and delayed monetary rewards. Science, 306, 503-507.
74. Metcalfe, J., & Mischel, W. (1999). A hot/cool system analysis of delay of gratification: Dynamics of willpower. Psychological Review, 106, 3-19.
75. Mischel, W., Shoda, Y., & Rodriguez, M. (1989). Delay of gratification in children. Science, 244, 933-938.
76. Mitchell, S. (1999). Measures of impulsivity in cigarette smokers and nonsmokers. Psychopharmacology, 146, 455-464.
77. Myerson, J., Green, L., & Warusawitharana, M. (2001). Area under the curve as a measure of discounting. Journal of the Experimental Analysis of Behavior, 76, 235-243.
78. Odum, A., & Baumann, A. (2007). Cigarette smokers show steeper discounting of both food and cigarettes than money. Drug and Alcohol Dependence, 91, 293-296.
79. Odum, A., Baumann, A., & Rimington, D. (2006). Discounting of delayed hypothetical money and food: Effects of amount. Behavioural Processes, 73, 278-284.
80. Odum, A., Madden, G., Badger, G., & Bickel, W. (2000). Needle sharing in opioid-dependent outpatients: Psychological processes underlying risk. Drug and Alcohol Dependence, 60, 259-266.
81. Odum, A., & Rainaud, C. (2003). Discounting of delayed hypothetical money, alcohol, and food. Behavioural Processes, 64, 305-313.
82. Olds, J., & Milner, P. (1954). Positive reinforcement produced by electrical stimulation of septal area and other regions of rat brain. Journal of Comparative and Physiological Psychology, 47, 419-427.
83. Olmstead, M. C. (2006). Animal models of drug addiction: Where do we go from here. Quarterly Journal of Experimental Psychology, 59, 625-653.
84. Paglieri, F. (2012). Ulysses' will: Self-control, external constraints, and games. In F. Paglieri (Ed.), Consciousness in interaction: The role of the natural and social context in shaping consciousness (pp. 179-206). Amsterdam: John Benjamins.
85. Paglieri, F. (2013). The costs of delay: Waiting versus postponing in intertemporal choice. Journal of the Experimental Analysis of Behavior, 99, 362-377.
86. Paglieri, F., Focaroli, V., Bramlett, J., Tierno, V., McIntyre, J., Addessi, E., ⋯ Beran, M. (2013). The hybrid delay task: Can capuchin monkeys (Cebus apella) sustain a delay after an initial choice to do so. Behavioural Processes, 94, 45-54.
87. Peters, J., & Büchel, C. (2011). The neural mechanisms of inter-temporal decision-making: Understanding variability. Trends in Cognitive Science, 15(5), 227-239.
88. Petry, N. (2001). Delay discounting of money and alcohol in actively using alcoholics, currently abstinent alcoholics, and controls. Psychopharmacology, 154, 243-250.
89. Pickens, R., & Harris, W. C. (1968). Self-administration of d-amphetamine by rats. Psychopharmacologia, 12, 158-163.
90. Pinel, J. P., Assanand, S., & Lehman, D. R. (2000). Hunger, eating, and ill health. American Psychologist, 55, 1105-1116.
91. Prelec, D., & Loewenstein, G. (1991). Decision making over time and under uncertainty: A common approach. Management Science, 37, 770-786.
92. Raineri, A., & Rachlin, H. (1993). The effect of temporal constraints on the value of money and other commodities. Journal of Behavioral Decision Making, 6, 77-94.
93. Rasmussen, E., Lawyer, S., & Reilly, W. (2010). Percent body fat is related to delay and probability discounting for food in humans. Behavioural Processes, 83, 23-30.
94. Reynolds, B. (2006). A review of delay-discounting research with humans: Relations to drug use and gambling. Behavioral Pharmacology, 17, 651-667.
95. Reynolds, B., de Wit, H., & Richards, J. (2002). Delay of gratification and delay discounting in rats. Behavioural Processes, 59, 157-168.
96. Reynolds, B., & Schiffbauer, R. (2005). Delay of gratification and delay discounting: A unifying feedback model of delay-related impulsive behavior. The Psychological Record, 55, 439-460.
97. Richards, J., Chock, M., & de Wit, H. (1998). Depletion of serotonin causes impairments in sustained inhibition in rats. Society for Neuroscience Abstracts, 24, 1183.
98. Rosati, A., Stevens, J., Hare, B., & Hauser, M. (2007). The evolutionary origins of human patience: temporal preferences in chimpanzees, bonobos, and human adults. Current Biology, 17, 1663-1668.
99. Rosati, A., Stevens, J., & Hauser, M. (2006). The effect of handling time on temporal discounting in two New World primates. Animal Behaviour, 71, 1379-1387.
100. Ross, D., Spurrett, D., Kincaid, H., & Stephens, L., (Eds.). (2007) Distributed cognition and the will: Individual volition and social context. Cambridge: MIT Press.
101. Russell, J., Mauthner, N., Sharpe, S., & Tidswell, T. (1991). The "windows task" as a measure of strategic deception in preschoolers and autistic subjects. British Journal of Developmental Psychology, 9, 101-119.
102. Schwarz, J., Schrager, J., & Lyons, A. (1983). Delay of gratification by preschoolers: Evidence for the validity of choice paradigm. Child Development, 54, 620-625.
103. Setlow, B., Mendez, I. A., Mitchell, M. R., & Simon, N. W. (2009). Effects of chronic administration of drugs of abuse on impulsive choice (delay discounting) in animal models. Behavioural Pharmacology, 20(5-6), 380-389.
104. Sigel, I.E. (1993) The centrality of a distancing model for the development of representational competence. In R. R. Cocking & K. A. Renninger (Eds.), The development and meaning of psychological distance (pp. 141-157). Hillsdale, NJ: Erlbaum.
105. Soman, D., Ainslie, G., Frederick, S., Li, X., Lynch, J., Moreau, P., . Wertenbroch, K. (2005). The psychology of intertemporal discounting: Why are distant events valued differently from proximal ones. Marketing Letters, 16, 347-360.
106. Stephens, D., & Anderson, D. (2001). The adaptive value of preference for immediacy: When shortsighted rules have farsighted consequences. Behavioural Ecology, 12, 330-339.
107. Stephens, D., Brown, J., & Ydenberg, R. (2007). Foraging: Behavior and ecology. Chicago: University of Chicago Press.
108. Stephens, D., & Krebs, J. (1986). Foraging theory. Princeton: Princeton University Press.
109. Stevens, J., Hallinan, E., & Hauser, M. (2005). The ecology and evolution of patience in two New World primates. Biology Letters, 1, 223-226.
110. Stevens, J., & Stephens, D. (2010). The adaptive nature of impulsivity. In G. Madden & W. Bickel (Eds.), Impulsivity: The behavioral and neurological science of discounting (pp. 361-387). Washington, DC: American Psychological Association.
111. Story, G., Vlaev, I., Seymour, B., Darzi, A., & Dolan, R. (2014). Does temporal discounting explain unhealthy behavior? A systematic review and reinforcement learning perspective. Frontiers in Behavioral Neuroscience, doi: 10.3389/fnbeh.2014.00076
112. Toner, I., & Smith, R. (1977). Age and overt verbalization in delay maintenance behavior in children. Journal of Experimental Child Psychology, 24, 123-128.
113. Van den Bergh, B., Dewitte, S., & Warlop, L. (2008). Bikinis instigate generalized impatience in intertemporal choice. Journal of Consumer Research, 35, 85-97.
114. Van den Bos, R., & de Ridder, D. (2006). Evolved to satisfy our immediate needs: Self-control and the rewarding properties of food. Appetite, 47, 24-29.
115. Vohs, K., Mead, N., & Goode, M. (2006). The psychological consequences of money. Science, 314, 1154-1156.
116. Vuchinich, R., & Simpson, C. (1998). Hyperbolic temporal discounting in social drinkers. Experimental Clinical Psychopharmacology, 6, 292-305.
117. Vygotsky, L. S. (1967). Play and its role in the mental development of the child. Soviet Psychology, 5, 6-18.
118. Werner, H. & Kaplan, B. (1963). Symbol formation: An organismic developmental approach to language and the expression of thought. New York: Wiley.
119. Wilson, M., & Daly, M. (2004). Do pretty women inspire men to discount the future. Proceedings of the Royal Society B, 271, S177-S179.
120. Yi, R., Mitchell, S., & Bickel, W. (2010). Delay discounting and substance abuse-dependence. In G. Madden & W. Bickel (Eds.), Impulsivity: The behavioral and neurological science of discounting (pp. 191-211). Washington, DC: American Psychological Association.