Opportunity costs of reward delays and the discounting of hypothetical money and cigarettes

Journal of the Experimental Analysis of Behavior

Volumn 103, Issue 1, 2015, Pages 87-107

  Johnson, Patrick S ^a   Herrmann, Evan S ^a   Johnson, Matthew W ^a  

^a JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

Cigarette; Crowdsourcing; Delay discounting; Human; Hypothetical; Money; Opportunity cost

Indexed keywords

ADULT; BEHAVIORAL ECONOMICS; COST; DELAY DISCOUNTING; ECONOMICS; FEMALE; HUMAN; MALE; PSYCHOLOGICAL MODEL; REWARD; TIME; TOBACCO;

ADULT; COSTS AND COST ANALYSIS; DELAY DISCOUNTING; ECONOMICS, BEHAVIORAL; FEMALE; HUMANS; MALE; MODELS, PSYCHOLOGICAL; REWARD; TIME FACTORS; TOBACCO PRODUCTS;

EID: 84920946031     PISSN: 00225002     EISSN: 19383711     Source Type: Journal    
DOI: 10.1002/jeab.110     Document Type: Article

References (101)

1. Ainslie, G. (1975). Specious reward: A behavioral theory of impulsiveness and impulse control. Psychological Bulletin, 82, 463-496. doi: 10.1037/h0076860
2. Amir, O., Rand, D. G., & Gal, Y. (2012). Economic games on the internet: The effect of $1 stakes. PloS One, 7, e31461. doi: 10.1371/journal.pone.0031461
3. Axon, R. N., Bradford, W. D., & Egan, B. M. (2009). The role of individual time preferences in health behaviors among hypertensive adults: A pilot study. Journal of the American Society of Hypertension, 3, 35-41. doi: 10.1016/j.jash.2008.08.005
4. Baker, F., Johnson, M. W., & Bickel, W. K. (2003). Delay discounting in current and never-before cigarette smokers: Similarities and differences across commodity, sign, and magnitude. Journal of Abnormal Psychology, 112, 382-392. doi: 10.1037/0021-843X.112.3.382
5. Beck, R. C., & Triplett, M. F. (2009). Test-retest reliability of a group-administered paper-pencil measure of delay discounting. Experimental and Clinical Psychopharmacology, 17, 345-355. doi: 10.1037/a0017078
6. Bell, R. A., McGlone, M. S., & Dragojevic, M. (2014). Bacteria as bullies: Effects of linguistic agency assignment in health message. Journal of Health Communication, 19, 340-358. doi: 10.1080/10810730.2013.798383
7. Berry, M. S., Sweeney, M. M., Morath, J., Odum, A. L., & Jordan, K. E. (2014). The nature of impulsivity: Visual exposure to natural environments decreases impulsive decision-making in a delay discounting task. PloS One, 9, e97915. doi: 10.1371/journal.pone.0097915
8. Bickel, W. K., Jarmolowicz, D. P., Mueller, E. T., Franck, C. T., Carrin, C., & Gatchalian, K. M. (2012). Altruism in time: Social temporal discounting differentiates smokers from problem drinkers. Psychopharmacology (Berl), 224, 109-120. doi: 10.1007/s00213-012-2745-6
9. Bickel, W. K., Johnson, M. W., Koffarnus, M. N., MacKillop, J., & Murphy, J. G. (2014). The behavioral economics of substance use disorders: Reinforcement pathologies and their repair. Annual Review of Clinical Psychology, 10, 641-677. doi: 10.1146/annurev-clinpsy-032813-153724
10. Bickel, W. K., Landes, R. D., Christensen, D. R., Jackson, L., Jones, B. A., Kurth-Nelson, Z., & Redish, A. D. (2011). Single- and cross-commodity discounting among cocaine addicts: The commodity and its temporal location determine discounting rate. Psychopharmacology (Berl), 217, 177-187. doi: 10.1007/s00213-011-2272-x
11. Bickel, W. K., Odum, A. L., & Madden, G. J. (1999). Impulsivity and cigarette smoking: Delay discounting in current, never, and ex-smokers. Psychopharmacology (Berl), 146, 447-454. doi: 10.1007/PL00005490
12. Bickel, W. K., Pitcock, J. A., Yi, R., & Angtuaco, E. J. (2009). Congruence of BOLD response across intertemporal choice conditions: Fictive and real money gains and losses. The Journal of Neuroscience, 29, 8839-8846. doi: 10.1523/JNEUROSCI.5319-08.2009
13. Bickel, W. K., George Wilson, A., Franck, C. T., Terry Mueller, E., Jarmolowicz, D. P., Koffarnus, M. N., & Fede, S. J. (2014). Using crowdsourcing to compare temporal, social temporal, and probability discounting among obese and non-obese individuals. Appetite, 75, 82-89. doi: 10.1016/j.appet.2013.12.018
14. Bradford, W. D. (2010). The association between individual time preferences and health maintenance habits. Medical Decision Making, 30, 99-112. doi: 10.1177/0272989X09342276
15. Buhrmester, M., Kwang, T., & Gosling, S. D. (2011). Amazon's Mechanical Turk: A new source of inexpensive, yet high-quality, data? Perspectives on Psychological Science, 6, 3-5. doi: 10.1177/1745691610393980
16. Carroll, M. E., Anker, J. J., Mach, J. L., Newman, J. L., & Perry, J. L. (2010). Delay discounting as a predictor of drug abuse. In G. J. Madden & W. K. Bickel (Eds.), Impulsivity: The behavioral and neurological science of discounting (pp. 243-271). Washington, DC: American Psychological Association.
17. Carter, R. R., DiFeo, A., Bogie, K., Zhang, G. Q., & Sun, J. (2014). Crowdsourcing awareness: Exploration of the ovarian cancer knowledge gap through Amazon Mechanical Turk. PloS One, 9, e85508. doi: 10.1371/journal.pone.0085508
18. Charlton, S. R., & Fantino, E. (2008). Commodity specific rates of temporal discounting: Does metabolic function underlie differences in rates of discounting? Behavioural Processes, 77, 334-342. doi: 10.1016/j.beproc.2007.08.002
19. Chen, C., White, L., Kowalewski, T., Aggarwal, R., Lintott, C., Comstock, B., ... Lendvay, T. (2014). Crowd-sourced assessment of technical skills: A novel method to evaluate surgical performance. Journal of Surgical Research, 187, 65-71. doi: 10.1016/j.jss.2013.09.024
20. Crump, M. J., McDonnell, J. V., & Gureckis, T. M. (2013). Evaluating Amazon's Mechanical Turk as a tool for experimental behavioral research. PloS One, 8, e57410. doi: 10.1371/journal.pone.0057410
21. Daugherty, J. R., & Brase, G. L. (2010). Taking time to be healthy: Predicting health behaviors with delay discounting and time perspective. Personality and Individual Differences, 48, 202-207. doi: 10.1523/JNEUROSCI.5169-12.2014
22. de Wit, H., Flory, J. D., Acheson, A., McCloskey, M., & Manuck, S. B. (2007). IQ and nonplanning impulsivity are independently associated with delay discounting in middle-aged adults. Personality and Individual Differences, 42, 111-121. doi: 10.1016/j.paid.2006.06.026
23. Diergaarde, L., Pattij, T., Poortvliet, I., Hogenboom, F., de Vries, W., Schoffelmeer, A. N., & De Vries, T. J. (2008). Impulsive choice and impulsive action predict vulnerability to distinct stages of nicotine seeking in rats. Biological Psychiatry, 63, 301-308. doi: 10.1016/j.biopsych.2007.07.011
24. Dixon, M. R., Marley, J., & Jacobs, E. A. (2003). Delay discounting by pathological gamblers. Journal of Applied Behavior Analysis, 36, 449-458. doi: 10.1901/jaba.2003.36-449
25. Epstein, L. H., Jankowiak, N., Lin, H., Paluch, R., Koffarnus, M. N., & Bickel, W. K. (2014). No food for thought: Moderating effects of delay discounting and future time perspective on the relation between income and food insecurity. The American Journal of Clinical Nutrition. Advance online publication. doi: 10.3945/ajcn.113.079772
26. Fagerström, K. (2012). Determinants of tobacco use and renaming the FTND to the Fagerström Test for Cigarette Dependence. Nicotine & Tobacco Research, 14, 75-78. doi: 10.1093/ntr/ntr137
27. Friedel, J. E., DeHart, W. B., Madden, G. J., & Odum, A. L. (2014). Impulsivity and cigarette smoking: Discounting of monetary and consumable outcomes in current and non-smokers. Psychopharmacology (Berl). Advance online publication. doi: 10.1007/s00213-014-3597-z
28. Gardner, R. M., Brown, D. L., & Boice, R. (2012). Using Amazon's Mechanical Turk website to measure accuracy of body size estimation and body dissatisfaction. Body Image, 9, 532-534. doi: 10.1016/j.bodyim.2012.06.006
29. Genty, E., Karpel, H., & Silberberg, A. (2012). Time preferences in long-tailed macaques (Macaca fascicularis) and humans (Homo sapiens). Animal Cognition, 15, 1161-1172. doi: 10.1007/s10071-012-0540-8
30. Green, L., Fry, A. F., & Myerson, J. (1994). Discounting of delayed rewards: A life-span comparison. Psychological Science, 5, 33-36. doi: 10.1016/S0376-6357(99)00021-2
31. Green, L., & Myerson, J. (2004). A discounting framework for choice with delayed and probabilistic rewards. Psychological Bulletin, 130, 769-792. doi: 10.1037/0033-2909.130.5.769
32. Green, L., Myerson, J., Lichtman, D., Rosen, S., & Fry, A. (1996). Temporal discounting in choice between delayed rewards: The role of age and income. Psychology and Aging, 11, 79-84. doi: 10.1037/0882-7974.11.1.79
33. Hao, T., Rusanov, A., Boland, M. R., & Weng, C. (2014). Clustering clinical trials with similar eligibility criteria features. Journal of Biomedical Informatics. Advance online publication. doi: 10.1016/j.jbi.2014.01.009
34. Heatherton, T. F., Kozlowski, L. T., Frecker, R. C., & Fagerström, K. O. (1991). The Fagerström test for nicotine dependence: A revision of the Fagerström Tolerance Questionnaire. British Journal of Addiction, 86, 1119-1127. doi: 10.1111/j.1360-0443.1991.tb01879.x
35. Heinz, A. J., Peters, E. N., Boden, M. T., & Bonn-Miller, M. O. (2013). A comprehensive examination of delay discounting in a clinical sample of Cannabis-dependent military veterans making a self-guided quit attempt. Experimental and Clinical Psychopharmacology, 21, 55-65. doi: 10.1037/a0031192
36. Heyman, G. M., & Gibb, S. P. (2006). Delay discounting in college cigarette chippers. Behavioural Pharmacology, 17, 669-679. doi: 10.1097/FBP.0b013e3280116cfe
37. Jackson, K., & Hackenberg, T. D. (1996). Token reinforcement, choice, and self-control in pigeons. Journal of the Experimental Analysis of Behavior, 66, 29-49. doi: 10.1901/jeab.1996.66-29
38. Jackson, J. D., Weinstein, Y., & Balota, D. A. (2013). Can mind-wandering be timeless? Atemporal focus and aging in mind-wandering paradigms. Frontiers in Psychology, 4, 742. doi: 10.3389/fpsyg.2013.00742
39. Jarmolowicz, D. P., Bickel, W. K., Carter, A. E., Franck, C. T., & Mueller, E. T. (2012). Using crowdsourcing to examine relations between delay and probability discounting. Behavioural Processes, 91, 308-312. doi: 10.1016/j.beproc.2012.09.001
40. Jaroni, J. L., Wright, S. M., Lerman, C., & Epstein, L. H. (2004). Relationship between education and delay discounting in smokers. Addictive Behaviors, 29, 1171-1175. doi: 10.1016/j.addbeh.2004.03.014
41. Jimura, K., Myerson, J., Hilgard, J., Braver, T. S., & Green, L. (2009). Are people really more patient than other animals? Evidence from human discounting of real liquid rewards. Psychonomic Bulletin & Review, 16, 1071-1075. doi: 10.3758/PBR.16.6.1071
42. Jimura, K., Myerson, J., Hilgard, J., Keighley, J., Braver, T. S., & Green, L. (2011). Domain independence and stability in young and older adults' discounting of delayed rewards. Behavioural Processes, 87, 253-259. doi: 10.1016/j.beproc.2011.04.006
43. Johnson, M. W. (2012). An efficient operant choice procedure for assessing delay discounting in humans: Initial validation in cocaine-dependent and control individuals. Experimental and Clinical Psychopharmacology, 20, 191-204. doi: 10.1037/a0027088
44. Johnson, M. W., & Bickel, W. K. (2002). Within-subject comparison of real and hypothetical money rewards in delay discounting. Journal of the Experimental Analysis of Behavior, 77, 129-146. doi: 10.1901/jeab.2002.77-129
45. Johnson, M. W., & Bickel, W. K. (2008). An algorithm for identifying nonsystematic delay-discounting data. Experimental and Clinical Psychopharmacology, 16, 264-274. doi: 10.1037/1064-1297.16.3.264
46. Johnson, M. W., Bickel, W. K., & Baker, F. (2007). Moderate drug use and delay discounting: A comparison of heavy, light, and never smokers. Experimental and Clinical Psychopharmacology, 15, 187-194. doi: 10.1037/1064-1297.15.2.187
47. Johnson, M. W., Bickel, W. K., Baker, F., Moore, B. A., Badger, G. J., & Budney, A. J. (2010). Delay discounting in current and former marijuana-dependent individuals. Experimental and Clinical Psychopharmacology, 18, 99-107. doi: 10.1037/a0018333
48. Johnson, M. W., & Bruner, N. R. (2012). The Sexual Discounting Task: HIV risk behavior and the discounting of delayed sexual rewards in cocaine dependence. Drug and Alcohol Dependence, 123, 15-21. doi: 10.1016/j.drugalcdep.2011.09.032
49. Kiefner-Burmeister, A. E., Hoffmann, D. A., Meers, M. R., Koball, A. M., & Musher-Eizenman, D. R. (2014). Food consumption by young children: A function of parental feeding goals and practices. Appetite, 74, 6-11. doi: 10.1016/j.appet.2013.11.011
50. Killeen, P. R. (2009). An additive-utility model of delay discounting. Psychological Review, 116, 602-619. doi: 10.1037/a0016414
51. Kirby, K. N., & Maraković, N. N. (1996). Delay-discounting probabilistic rewards: Rates decrease as amounts increase. Psychonomic Bulletin & Review, 3, 100-104. doi: 10.3758/BF03210748
52. Krishnan-Sarin, S., Reynolds, B., Duhig, A. M., Smith, A., Liss, T., McFetridge, A., ... Potenza, M. N. (2007). Behavioral impulsivity predicts treatment outcome in a smoking cessation program for adolescent smokers. Drug and Alcohol Dependence, 88, 79-82. doi: 10.1016/j.drugalcdep.2006.09.006
53. Lagorio, C. H., & Madden, G. J. (2005). Delay discounting of real and hypothetical rewards III: steady-state assessments, forced-choice trials, and all real rewards. Behavioural Processes, 69, 173-187. doi: 10.1016/j.beproc.2005.02.003
54. Lawyer, S. R., Williams, S. A., Prihodova, T., Rollins, J. D., & Lester, A. C. (2010). Probability and delay discounting of hypothetical sexual outcomes. Behavioural Processes, 84, 687-692. doi: 10.1016/j.beproc.2010.04.002
55. Loewenstein, G., & Thaler, R. H. (1989). Anomalies: Intertemporal choice. Journal of Economic Perspectives, 3, 181-193. doi: 10.1257/jep.3.4.181
56. MacKillop, J., Amlung, M. T., Few, L. R., Ray, L. A., Sweet, L. H., & Munafò, M. R. (2011). Delayed reward discounting and addictive behavior: A meta-analysis. Psychopharmacology (Berl), 216, 305-321. doi: 10.1007/s00213-011-2229-0
57. MacLean, D. L., & Heer, J. (2013). Identifying medical terms in patient-authored text: A crowdsourcing-based approach. Journal of the American Medical Informatics Association, 20, 1120-1127. doi: 10.1136/amiajnl-2012-001110
58. Madden, G. J., Begotka, A. M., Raiff, B. R., & Kastern, L. L. (2003). Delay discounting of real and hypothetical rewards. Experimental and Clinical Psychopharmacology, 11, 139-145. doi: 10.1037/1064-1297.11.2.139
59. Madden, G. J., & Bickel, W. K. (2010). Impulsivity: The behavioral and neurological science of discounting. Washington, DC: American Psychological Association.
60. Madden, G. J., Raiff, B. R., Lagorio, C. H., Begotka, A. M., Mueller, A. M., Hehli, D. J., & Wegener, A. A. (2004). Delay discounting of potentially real and hypothetical rewards: II. Between-and within-subject comparisons. Experimental and Clinical Psychopharmacology, 12, 251-261. doi: 10.1037/1064-1297.12.4.251
61. Mason, W., & Suri, S. (2012). Conducting behavioral research on Amazon's Mechanical Turk. Behavior Research Methods, 44, 1-23. doi: 10.3758/s13428-011-0124-6
62. Matusiewicz, A. K., Carter, A. E., Landes, R. D., & Yi, R. (2013). Statistical equivalence and test-retest reliability of delay and probability discounting using real and hypothetical rewards. Behavioural Processes, 100, 116-122. doi: 10.1016/j.beproc.2013.07.019
63. Mazur, J. E. (1987). An adjusting procedure for studying delayed reinforcement. In M. L. Commons, J. E. Mazur, J. A. Nevin, & H. Rachlin (Eds.), Quantitative analysis of behavior: Vol 5. The effect of delay and intervening events on reinforcement value (pp. 55-73). Hillsdale, NJ: Erlbaum.
64. McClure, S. M., Ericson, K. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2007). Time discounting for primary rewards. The Journal of Neuroscience, 27, 5796-5804. doi: 10.1523/JNEUROSCI.4246-06.2007
65. Mitchell, S. H. (1999). Measures of impulsivity in cigarette smokers and non-smokers. Psychopharmacology (Berl), 146, 455-464. doi: 10.1007/PL00005491
66. Mitchell, S. H., & Wilson, V. B. (2010). The subjective value of delayed and probabilistic outcomes: Outcome size matters for gains but not for losses. Behavioural Processes, 83, 36-40. doi: 10.1016/j.beproc.2009.09.003
67. Mitchell, S. H., & Wilson, V. B. (2012). Differences in delay discounting between smokers and nonsmokers remain when both rewards are delayed. Psychopharmacology (Berl), 219, 549-562. doi: 10.1007/s00213-011-2521-z
68. Odum, A. L. (2011). Delay discounting: Trait variable? Behavioural Processes, 87, 1-9. doi: 10.1016/j.beproc.2011.02.007
69. Odum, A. L., & Baumann, A. A. (2007). Cigarette smokers show steeper discounting of both food and cigarettes than money. Drug and Alcohol Dependence, 91, 293-296. doi: 10.1016/j.drugalcdep.2007.07.004
70. Odum, A. L., Baumann, A. A., & Rimington, D. D. (2006). Discounting of delayed hypothetical money and food: Effects of amount. Behavioural Processes, 73, 278-284. doi: 10.1016/j.beproc.2006.06.008
71. Odum, A. L., & Rainaud, C. P. (2003). Discounting of delayed hypothetical money, alcohol, and food. Behavioural Processes, 64, 305-313. doi: 10.1016/S0376-6357(03)00145-1
72. Olson, E. A., Hooper, C. J., Collins, P., & Luciana, M. (2007). Adolescents' performance on delay and probability discounting tasks: Contributions of age, intelligence, executive functioning, and self-reported externalizing behavior. Personality and Individual Differences, 43, 1886-1897. doi: 10.1016/j.paid.2007.06.016
73. Paglieri, F. (2013). The costs of delay: Waiting versus postponing in intertemporal choice. Journal of the Experimental Analysis of Behavior, 99, 362-377. doi: 10.1002/jeab.18
74. Paolacci, G., Chandler, J., & Ipeirotis, P. G. (2010). Running experiments on Amazon Mechanical Turk. Judgment and Decision making, 5, 411-419.
75. Peters, E. N., Petry, N. M., LaPaglia, D. M., Reynolds, B., & Carroll, K. M. (2013). Delay discounting in adults receiving treatment for marijuana dependence. Experimental and Clinical Psychopharmacology, 21, 46-54. doi: 10.1037/a0030943
76. Petry, N. M. (2001). Pathological gamblers, with and without substance use disorders, discount delayed rewards at high rates. Journal of Abnormal Psychology, 110, 482-487. doi: 10.1037/0021-843X.110.3.482
77. Rachlin, H. (2006). Notes on discounting. Journal of the Experimental Analysis of Behavior, 85, 425-435. doi: 10.1901/jeab.2006.85-05
78. Raihani, N. J., & Bshary, R. (2012). A positive effect of flowers rather than eye images in a large-scale, cross-cultural dictator game. Proceedings of the Royal Society B: Biological Sciences, 249, 3556-3564. doi: 10.1098/rspb.2012.0758
79. Raihani, N. J., Mace, R., & Lamba, S. (2013). The effect of $1, $5 and $10 stakes in an online dictator game. PloS One, 8, e73131. doi: 10.1371/journal.pone.0073131
80. Rand, D. G. (2012). The promise of Mechanical Turk: How online labor markets can help theorists run behavioral experiments. Journal of Theoretical Biology, 299, 172-179. doi: 10.1016/j.jtbi.2011.03.004
81. Reynolds, B. (2006). A review of delay-discounting research with humans: Relations to drug use and gambling. Behavioural Pharmacology, 17, 651-667. doi: 10.1097/FBP.0b013e3280115f99
82. Reynolds, B., & Schiffbauer, R. (2004). Measuring state changes in human delay discounting: An experiential discounting task. Behavioural Processes, 67, 343-356. doi: 10.1016/j.beproc.2004.06.003
83. Rosati, A. G., Stevens, J. R., Hare, B., & Hauser, M. D. (2007). The evolutionary origins of human patience: Temporal preferences in chimpanzees, bonobos, and human adults. Current Biology, 17, 1663-1668. doi: 10.1016/j.cub.2007.08.033
84. Samuelson, P. A. (1937). A note on measurement of utility. The Review of Economic Studies, 4, 155-161.
85. Scheres, A., Dijkstra, M., Ainslie, E., Balkan, J., Reynolds, B., Sonuga-Barke, E., & Castellanos, F. X. (2006). Temporal and probabilistic discounting of rewards in children and adolescents: Effects of age and ADHD symptoms. Neuropsychologia, 44, 2092-2103. doi: 10.1016/j.neuropsychologia.2005.10.012
86. Shapiro, D. N., Chandler, J., & Mueller, P. A. (2013). Using Mechanical Turk to study clinical populations. Clinical Psychological Science, 1, 213-220. doi: 10.1177/2167702612469015
87. Sheffer, C., MacKillop, J., McGeary, J., Landes, R., Carter, L., Yi, R., ... Bickel, W. (2012). Delay discounting, locus of control, and cognitive impulsiveness independently predict tobacco dependence treatment outcomes in a highly dependent, lower socioeconomic group of smokers. The American Journal on Addictions, 21, 221-232. doi: 10.1111/j.1521-0391.2012.00224.x
88. Simons, D. J., & Chabris, C. F. (2012). Common (mis)beliefs about memory: A replication and comparison of telephone and Mechanical Turk survey methods. PloS One, 7, e51876. doi: 10.1371/journal.pone.0051876
89. Sprouse, J. (2011). A validation of Amazon Mechanical Turk for the collection of acceptability judgments in linguistic theory. Behavior Research Methods, 43, 155-167. doi: 10.3758/s13428-010-0039-7
90. Stanger, C., Ryan, S. R., Fu, H., Landes, R. D., Jones, B. A., Bickel, W. K., & Budney, A. J. (2012). Delay discounting predicts adolescent substance abuse treatment outcome. Experimental and Clinical Psychopharmacology, 20, 205-212. doi: 10.1037/a0026543
91. Stein, J. S., & Madden, G. J. (2013). Delay discounting and drug abuse: Empirical, conceptual, and methodological considerations. In J. MacKillop & H. de Wit (Eds.), The Wiley-Blackwell handbook of addiction psychopharmacology (pp. 165-208). Oxford, UK: Wiley-Blackwell.
92. Stevens, J. R., & Stephens, D. W. (2010). The adaptive nature of impulsivity. In G. J. Madden & W. K. Bickel (Eds.), Impulsivity: The behavioral and neurological science of discounting (pp. 361-388). Washington, DC: American Psychological Association.
93. Summerville, A., & Chartier, C. R. (2013). Pseudo-dyadic "interaction" on Amazon's Mechanical Turk. Behavior Research Methods, 45, 116-124. doi: 10.3758/s13428-012-0250-9
94. Tobin, H., & Logue, A. W. (1994). Self-control across species. Journal of Comparative Psychology, 108, 126-133.
95. Turner, A. M., Kirchhoff, K., & Capurro, D. (2012). Using crowdsourcing technology for testing multilingual public health promotion materials. Journal of Medical Internet Research, 14, e79 . doi: 10.2196/jmir.2063
96. Washio, Y., Higgins, S. T., Heil, S. H., McKerchar, T. L., Badger, G. J., Skelly, J. M., & Dantona, R. L. (2011). Delay discounting is associated with treatment response among cocaine-dependent outpatients. Experimental and Clinical Psychopharmacology, 19, 243-248. doi: 10.1037/a0023617
97. Weatherly, J. N., Terrell, H. K., & Derenne, A. (2010). Delay discounting of different commodities. The Journal of General Psychology: Experimental, Psychological, and Comparative Psychology, 137, 273-286. doi: 10.1080/00221309.2010.484449
98. Weller, R. E., Cook III, E. W., Avsar, K. B., & Cox, J. E. (2008). Obese women show greater delay discounting than healthy-weight women. Appetite, 51, 563-569. doi: 10.1016/j.appet.2008.04.010
99. Wikenheiser, A. M., Stephens, D. W., & Redish, A. D. (2013). Subjective costs drive overly patient foraging strategies in rats on an intertemporal foraging task. Proceedings of the National Academy of Sciences, 110, 8308-8313. doi: 10.1073/pnas.1220738110
100. Yoon, J. H., Higgins, S. T., Heil, S. H., Sugarbaker, R. J., Thomas, C. S., & Badger, G. J. (2007). Delay discounting predicts postpartum relapse to cigarette smoking among pregnant women. Experimental and Clinical Psychopharmacology, 15, 176-186. doi: 10.1037/1064-1297.15.2.186
101. Yu, B., Willis, M., Sun, P., & Wang, J. (2013). Crowdsourcing participatory evaluation of medical pictograms using Amazon Mechanical Turk. Journal of Medical Internet Research, 15, e108. doi: 10.2196/jmir.2513