Reassessing intertemporal choice: Human decision-making is more optimal in a foraging task than in a self-control task

Frontiers in Psychology

Volumn 6, Issue FEB, 2015, Pages

  Carter, Evan C ^a,b   Pedersen, Eric J ^a   McCullough, Michael E ^a  

^a Department of Biology   (United States)

^b UNIVERSITY OF MINNESOTA   (United States)

Author keywords

Decision making; Delay discounting; Foraging; Impulsive choice; Impulsivity; Intertemporal choice; Self control

Indexed keywords

EID: 84926433042     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2015.00095     Document Type: Article

References (49)

1. Bateson, M., and Kacelnik, A. (1996). Rate currencies and the foraging starling: the fallacy of the averages revisited. Behav. Ecol. 7, 341-352. doi: 10.1093/beheco/7.3.341.
2. Bickel, W. K., Jarmolowicz, D. P., Mueller, E. T., Koffarnus, M. N., and Gatchalian, K. M. (2012). Excessive discounting of delayed reinforcers as a trans-disease process contributing to addiction and other disease-related vulnerabilities: emerging evidence. Pharmacol. Ther. 134, 287-297. doi: 10.1016/j.pharmthera.2012.02.004.
3. Blanchard, T. C., Pearson, J. M., and Hayden, B. Y. (2013). Postreward delays and systematic biases in measures of animal temporal discounting. Proc. Natl. Acad. Sci. U.S.A. 110, 15491-15496. doi: 10.1073/pnas.1310446110.
4. Carter, E. C., McCullough, M. E., Kim-Spoon, J., Corrales, C., and Blake, A. (2012). Religious people discount the future less. Evol. Hum. Behav. 33, 224-231. doi: 10.1016/j.evolhumbehav.2011.09.006.
5. Charnov, E. L. (1976). Optimal foraging, the marginal value theorem. Theor. Popul. Biol. 9, 129-136. doi: 10.1016/0040-5809(76)90040-X.
6. Cuthill, I. C. (1985). Experimental Studies of Optimal Foraging Theory. Ph.D. thesis, Oxford University, Oxford.
7. Flora, S. R., and Pavlik, W. B. (1992). Human self-control and the density of reinforcement. J. Exp. Anal. Behav. 57, 201-208. doi: 10.1901/jeab.1992.57-201.
8. Forzano, L. B., and Corry, R. J. (1998). Self-control and impulsiveness in adult human females: effects of visual food cues. Learn. Motiv. 29, 184-199. doi: 10.1006/lmot.1998.1001.
9. Hackenberg, T. D., and Axtell, A. A. M. (1993). Humans' choice in situations of time-based diminishing returns. J. Exp. Anal. Behav. 59, 445-470. doi: 10.1901/jeab.1993.59-445.
10. Hills, T. T., Jones, M. N., and Todd, P. M. (2012). Optimal foraging in semantic memory. Psychol. Rev. 119, 431-440. doi: 10.1037/a0027373.
11. Ito, M., and Nakamura, K. (1998). Humans' choice in a self-control choice situation: sensitivity to reinforcer amount, reinforcer delay, and overal reinforcement density. J. Exp. Anal. Behav. 69, 87-102. doi: 10.1901/jeab.1998.69-87.
12. Kacelnik, A. (1984). Central place foraging in starlings (Sturnus vulgaris). I. Patch residence time. J. Anim. Ecol. 53, 283-299. doi: 10.2307/4357.
13. Kirby, K. N., and Marakovic, N. N. (1996). Delay-discounting probabilistic rewards: rates decrease as amounts increase. Psychon. Bull. Rev. 3, 100-104. doi: 10.3758/BF03210748.
14. Kirk, J. M., and Logue, A. W. (1996). Self-control in adult humans: effects of counting and timing. Learn. Motiv. 27, 1-20. doi: 10.1006/lmot.1996.0001.
15. Koffarnus, M. N., Jarmolowicz, D. P., Mueller, E. T., and Bickel, W. K. (2013). Changing delay discounting in the light of the competing neurobehavioral decision systems theory: a review. J. Exp. Anal. Behav. 99, 32-57.
16. Kurzban, R., Duckworth, A. L., Kable, J. W., and Myers, J. (2013). An opportunity cost model of subjective effort and task performance. Behav. Brain Sci. 36, 661-679. doi: 10.1017/S0140525X12003196.
17. Lane, S. D., Cherek, D. R., Pietras, C. J., and Tcheremissine, O. V. (2003a). Measurement of delay discounting using trial-by-trial consequences. Behav. Process. 64, 287-303. doi: 10.1016/S0376-6357(03)00143-8.
18. Lane, S. D., Cherek, D. R., Rhoades, H. M., Pietras, C. J., and Tcheremissine, O. V. (2003b). Relationships among laboratory and psychometric measures of impulsivity: implications in substance abuse and dependence. Addict. Disord. Treat. 2, 33-40. doi: 10.1097/00132576-200302020-00001.
19. Logue, A. W. (1988). Research on self-control: an integrating framework. Behav. Brain Sci. 11, 665-679. doi: 10.1017/S0140525X00053978.
20. Logue, A. W., and King, G. R. (1991). Self-control and impulsiveness in adult humans when food is the reinforcer. Appetite 17, 105-120. doi: 10.1016/0195-6663(91)90066-2.
21. Logue, A. W., Pena-Correal, T. E., Rodriguez, M. L., and Kabela, E. (1986). Self-control in adult humans: variation in positive reinforcer amount and delay. J. Exp. Anal. Behav. 46, 159-173. doi: 10.1901/jeab.1986.46-159.
22. Logue, A. W., Smith, M. E., and Rachlin, H. (1985). Sensitivity of pigeons to prereinforcer and postreinforcer delay. Anim. Learn. Behav. 13, 181-186. doi: 10.3758/BF03199271.
23. Madden, G. J., and Bickel, W. K. (2010). Impulsivity: The Behavioral and Neurological Science of Discounting. Washington, DC: American Psychological Association. doi: 10.1037/12069-000.
24. Mazur, J. E. (1987). "An adjusting procedure for studying delayed reinforcement," in Quantitative Analyses of Behavior, Vol. 5, eds M. L. Commons, J. E. Mazur, J. A. Nevin, and H. Rachlin (Hillsdale, NJ: Erlbaum), 55-73.
25. Mazur, J. E., and Logue, A. W. (1978). Choice in a "Self-control" paradigm: effects of a fading procedure. J. Exp. Anal. Behav. 30, 11-17. doi: 10.1901/jeab.1978.30-11.
26. Mazur, J. E., Snyderman, M., and Coe, D. (1985). Influences of delay and rate of reinforcement on discrete-trial choice. J. Exp. Psychol. Anim. Behav. Process. 11, 565-575. doi: 10.1037/0097-7403.11.4.565.
27. Mellgren, R. L., Misasi, L., and Brown, S. W. (1984). Optimal foraging theory: prey density and travel requirements in Rattus norvegicus. J. Comp. Psychol. 98, 142-153. doi: 10.1037/0735-7036.98.2.142.
28. Navarick, D. J. (2004). Discounting of delayed reinforcers: measurement by questionnaires versus operant choice procedures. Psychol. Rec. 54, 85-94.
29. Nonacs, P. (2001). State dependent behavior and the marginal value theorem. Behav. Ecol. 12, 71-83. doi: 10.1093/oxfordjournals.beheco.a000381.
30. Odum, A. L., and Bauman, A. A. L. (2010). "Delay discounting: state and trait variable," in Impulsivity: The Behavioral and Neurological Science of Discounting, eds G. J. Madden and W. K. Bickel (Washington, DC: American Psychological Association).
31. Payne, S. J., and Duggan, G. B. (2011). Giving up problem solving. Mem. Cogn. 39, 902-913. doi: 10.3758/s13421-010-0068-6.
32. Pearson, J., Hayden, B., and Platt, M. (2010). Explicit information reduces discounting behavior in monkeys. Front. Psychol. 1:237. doi: 10.3389/fpsyg.2010.00237.
33. Peters, J., and Büchel, C. (2011). The neural mechanisms of inter-temporal decision-making: understanding variability. Trends Cogn. Sci. 15, 227-239. doi: 10.1016/j.tics.2011.03.002.
34. Pirolli, P. (2005). Rational analyses of information foraging on the web. Cogn. Sci. 29, 343-379. doi: 10.1207/s15516709cog0000_20.
35. Preacher, K. J., Curran, P. J., and Bauer, D. J. (2006). Computational tools for probing interaction effects in multiple linear regression, multilevel modeling, and latent curve analysis. J. Educ. Behav. Stat. 31, 437-448. doi: 10.3102/10769986031004437.
36. Raudenbush, S. W., and Bryk, A. S. (2001). Hierarchical Linear Models: Applications and Data Analysis Methods. Thousand Oaks, CA: Sage Publications.
37. Schafer, J. L., and Graham, J. W. (2002). Missing data: our view of the state of the art. Psychol. Methods 7, 147-177. doi: 10.1037/1082-989X.7.2.147.
38. Shenhav, A., Straccia, M. A., Cohen, J. D., and Botvinick, M. (2014). Anterior cingulate engagement in a foraging context reflects choice difficulty, not foraging value. Nat. Neurosci. 17, 1249-1254. doi: 10.1038/nn.3771.
39. Stephens, D. W. (2002). Discrimination, discounting and impulsivity: a role for informational constraint. Philos. Trans. R. Soc. B 357, 1527-1537. doi: 10.1098/rstb.2002.1062.
40. Stephens, D. W., and Anderson, D. (2001). The adaptive value of preference for immediacy: when shortsighted rules have farsighted consequences. Behav. Ecol. 12, 330-339. doi: 10.1093/beheco/12.3.330.
41. Stephens, D. W., and Dunlap, A. S. (2009). Why do animals make better choices in patch-leaving problems? Behav. Process. 80, 252-260. doi: 10.1016/j.beproc.2008.11.014.
42. Stephens, D. W., and Krebs, J. R. (1986). Foraging Theory. Princeton, NJ: Princeton University Press.
43. Stephens, D. W., and McLinn, C. M. (2003). Choice and context: testing a simple short-term choice rule. Anim. Behav. 66, 59-70. doi: 10.1006/anbe.2003.2177.
44. Stevens, J. R., and Stephens, D. W. (2010). "The adaptive nature of impulsivity," in Impulsivity: The Behavioral and Neurological Science of Discounting, eds G. J. Madden and W. K. Bickel (Washington, DC: American Psychological Association), 361-387. doi: 10.1037/12069-013.
45. Tobin, H., Chelonis, J. J., and Logue, A. W. (1993). Choice in self-control paradigms using rats. Psychol. Rec. 43, 441-453.
46. Tobin, H., and Logue, A. W. (1994). Self-control across species (Columba livia, Homo sapiens, and Rattus norvegicus). J. Comp. Psychol. 108, 126-133. doi: 10.1037/0735-7036.108.2.126.
47. van den Bos, W., and McClure, S. M. (2013). Towards a general model of temporal discounting. J. Exp. Anal. Behav. 99, 58-73.
48. Wilke, A., Hutchinson, J., Todd, P. M., and Czienskowski, U. (2009). Fishing for the right words: decision rules for human foraging behavior in internal search tasks. Cogn. Sci. 33, 497-529. doi: 10.1111/j.1551-6709.2009.01020.x.
49. Wolfe, J. M. (2013). When is it time to move to the next raspberry bush? Foraging rules in human visual search. J. Vis. 13:10. doi: 10.1167/13.3.10.