Adaptive intertemporal preferences in foraging-style environments

Frontiers in Neuroscience

Volumn , Issue 7 JUN, 2013, Pages

  Bixter, Michael T ^a   Luhmann, Christian C ^a  

^a STONY BROOK UNIVERSITY   (United States)

Author keywords

Discounting; Dynamic decision making; Foraging theory; Intertemporal choice; Optimality

Indexed keywords

ADAPTIVE BEHAVIOR; ADAPTIVE ENVIRONMENTAL MANAGEMENT; AREA UNDER THE CURVE; ARTICLE; CLINICAL ARTICLE; CONTROLLED STUDY; DECISION MAKING; ECOLOGICAL VALIDITY; FOOD PREFERENCE; HUMAN; OPTIMAL FORAGING; REWARD; SELF CONTROL;

EID: 84904886778     PISSN: 16624548     EISSN: 1662453X     Source Type: Journal    
DOI: 10.3389/fnins.2013.00093     Document Type: Article

References (64)

1. Adams, G. K., Watson, K. K., Pearson, J., and Platt, M. L. (2013). Neuroethology of decision making. Curr. Opin. Neurobiol. 22, 982-989. doi: 10.1016/j.conb.2012.07.009
2. Bateson, M., and Kacelnik, A. (1996). Rate currencies and the foraging starling: the fallacy of the averages revisited. Behav. Ecol. 7, 341-352.
3. Boivin, G., Fauvergue, X., and Wajnberg, E. (2004). Optimal patch residence time in egg parasitoids: innate versus learned estimate of patch quality. Oecologia 138, 640-647. doi: 10.1007/s00442-003-1469-z
4. Bourgeois-Gironde, S. (2012). Optimal short-sighted rules. Front. Neurosci. 6:129. doi: 10.3389/fnins.2012.00129
5. Carrascal, L. M., and Moreno, E. (1993). Food caching versus immediate consumption in the Nuthatch: the effect of social context. Ardea 81, 135-141.
6. Charnov, E. L. (1976). Optimal foraging, the marginal value theorem. Theor. Popul. Biol. 9, 129-136. doi: 10.1016/0040-5809(76)90040-X
7. Fawcett, T. W., McNamara, J. M., and Houston, A. I. (2012). When is it adaptive to be patient? A general framework for evaluating delayed rewards. Behav. Processes 89, 128-136. doi: 10.1016/j.beproc.2011.08.015
8. Frederick, S., Loewenstein, G., and O'Donoghue, T. (2002). Time discounting and time preference: a critical review. J. Econ. Lit. 40, 351-401. doi: 10.1257/002205102320161311
9. Green, L., Myerson, J., Holt, D. D., Slevin, J. R., and Estle, S. J. (2004). Discounting of delayed food rewards in pigeons and rats: is there a magnitude effect? J. Exp. Anal. Behav. 81, 39-50. doi: 10.1901/jeab.2004.81-39
10. Gureckis, T. M., and Love, B. C. (2009). Short term gains, long term pains: how cues about state aid learning in dynamic environments. Cognition 113, 293-313. doi: 10.1016/j.cognition.2009.03.013
11. Hastie, R. (2001). Problems for judgment and decision making. Annu. Rev. Psychol. 52, 653-683. doi: 10.1146/annurev.psych.52.1.653
12. Hausman, J. A. (1979). Individual discount rates and the purchase and utilization of energy-using durables. Bell J. Econ. 10, 33-54.
13. Hayden, B. Y., Pearson, J. M., and Platt, M. L. (2011). Neuronal basis of sequential foraging decisions in a patchy environment. Nat. Neurosci. 14, 933-939. doi: 10.1038/nn.2856
14. Herrnstein, R. J., Loewenstein, G. F., Prelec, D., and Vaughan, W. Jr. (1993). Utility maximization and melioration: internalities in individual choice. J. Behav. Decis. Making 6, 149-185. doi: 10.1038/nn.2856
15. Herrnstein, R. J., and Prelec, D. (1991). Melioration: a theory of distributed choice. J. Econ. Perspect. 5, 137-156.
16. Houston, A. I., and McNamara, J. M. (1985). A general theory of central place foraging for single-prey loaders. Theor. Popul. Biol. 28, 233-262.
17. Hutchinson, J. M. C., Wilke, A., and Todd, P. M. (2008). Patch leaving in humans: can a generalist adapt its rules to dispersal of items across patches? Anim. Behav. 75, 1331-1349. doi: 10.1016/j.anbehav.2007.09.006
18. Kacelnik, A., and Bateson, M. (1996). Risky theories-the effects of variance on foraging decisions. Am. Zool. 36, 402-434. doi: 10.1093/icb/36.4.402
19. Kacelnik, A., and Bateson, M. (1997). Risk-sensitivity: crossroads for theories of decision-making. Trends Cogn. Sci. 1, 304-309. doi: 10.1016/S1364-6613(97)01093-0
20. Kacelnik, A., and Todd, I. A. (1992). Psychological mechanisms and the marginal value theorem: effect of variability in travel time on patch exploitation. Anim. Behav. 43, 313-322. doi: 10.1016/S0003-3472(05)80226-X
21. Keren, G., and Roelofsma, P. (1995). Immediacy and certainty in intertemporal choice. Organ. Behav. Hum. Decis. Process. 63, 287-297. doi: 10.1006/obhd.1995.1080
22. Kirby, K. N. (1997). Bidding on the future: evidence against normative discounting of delayed rewards. J. Exp. Psychol. Gen. 126, 54-70. doi: 10.1037/0096-3445.126.1.54
23. Kirby, K. N., and Herrnstein, R. J. (1995). Preference reversals due to myopic discounting of delayed reward. Psychol. Sci. 6, 83-89. doi: 10.1111/j.1467-9280.1995.tb00311.x
24. Kolling, N., Behrens, T. E. J., Mars, R. B., and Rushworth, M. F. S. (2012). Neural mechanisms of foraging. Science 336, 95-98. doi: 10.1126/science.1216930
25. Koopmans, T. C. (1960). Stationary ordinal utility and impatience. Econmetrica, 47, 263-291.
26. Luhmann, C. C. (2009). Temporal decision-making: insights from cognitive neuroscience. Front. Behav. Neurosci. 3:39. doi: 10.3389/neuro.08.039.2009
27. Luhmann, C. C. (2013). Discounting of delayed rewards is not hyperbolic. J. Exp. Psychol. Learn. Mem. Cogn. doi: 10.1037/a0031170. [Epub ahead of print].
28. Luhmann, C. C., Ishida, K., and Hajcak, G. (2011). Intolerance of uncertainty and decisions about delayed, probabilistic rewards. Behav. Ther. 42, 378-386. doi: 10.1016/j.beth.2010.09.002
29. Madden, G. J., Begotka, A. M., Raiff, B. R., and Kastern, L. L. (2003). Delay discounting of real and hypothetical rewards. Exp. Clin. Psychopharmacol. 11, 139-145. doi: 10.1037/1064-1297.11.2.139
30. Mazur, J. E. (1984). Tests of an equivalence rule for fixed and variable reinforcer delays. J. Exp. Psychol. Anim. Behav. Process. 10, 426-436. doi: 10.1037/0097-7403.10.4.426
31. Mazur, J. E. (1987). "An adjusting procedure for studying delayed reinforcement," in Quantitative Analysis of Behavior: the Effect of Delay and of Intervening Events on Reinforcement Value, Vol. 5, eds M. L. Commons, J. E. Mazur, J. A. Nevin, and H. Rachlin (Hillsdale, NJ: Erlbaum), 55-73.
32. Mazur, J. E. (1989). Theories of probabilistic reinforcement. J. Exp. Anal. Behav. 51, 87-99. doi: 10.1901/jeab.1989.51-87
33. Mazur, J. E. (2007). Rats' choices between one and two delayed reinforcers. Learn. Behav. 35, 169-176. doi: 10.3758/BF03193052
34. Mazur, J. E., and Romano, A. (1992). Choice with delayed and probabilistic reinforcers: effects of variability, time between trials, and conditioned reinforcers. J. Exp. Anal. Behav. 58, 513-525. doi: 10.1901/jeab.1992.58-513
35. McDermott, R., Fowler, J. H., and Smirnov, O. (2008). On the evolutionary origin of prospect theory preferences. J. Polit. 70, 335-350. doi: 10.1017/S0022381608080341
36. McNamara, J. (1982). Optimal patch use in a stochastic environment. Theor. Popul. Biol. 21, 269-288. doi: 10.1016/0040-5809(82)90018-1
37. Mischel, W., and Grusec, J. (1967). Waiting for rewards and punishments: effects of time and probability on choice. J. Pers. Soc. Psychol. 5, 24-31.
38. Myerson, J., and Green, L. (1995). Discounting of delayed rewards: models of individual choice. J. Exp. Anal. Behav. 64, 263-276. doi: 10.1901/jeab.1995.64-263
39. Myerson, J., Green, L., Hanson, J. S., Holt, D. D., and Estle, S. J. (2003). Discounting delayed and probabilistic rewards: processes and traits. J. Econ. Psychol. 24, 619-635. doi: 10.1016/S0167-4870(03)00005-9
40. Nishimura, K. (1992). Foraging in an uncertain environment: patch exploitation. J. Theor. Biol. 156, 91-111. doi: 10.1016/S0022-5193(05)80658-7
41. Otto, A. R., Markman, A. B., Gureckis, T. M., and Love, B. C. (2010). Regulatory fit and systematic exploration in a dynamic decision-making environment. J. Exp. Psychol. Learn. 36, 797-804. doi: 10.1037/a0018999
42. Pearson, J. M., Hayden, B. Y., and Platt, M. L. (2010). Explicit information reduces discounting behavior in monkeys. Front. Psychol. 1:237. doi: 10.3389/fpsyg.2010.00237
43. Pyke, G. H. (1984). Optimal foraging theory: a critical review. Annu. Rev. Ecol. Syst. 15, 523-575.
44. Pyke, G. H., Pulliam, H. R., and Charnov, E. L. (1977). Optimal foraging: a selective review of theory and tests. Q. Rev. Biol. 52, 137-154. doi: 10.1086/409852
45. Rachlin, H., Rainer, A., and Cross, D. (1991). Subjective probability and delay. J. Exp. Anal. Behav. 55, 233-244. doi: 10.1901/jeab.1991.55-233
46. Reynolds, B., and Schiffbauer, R. (2004). Measuring state changes in human delay discounting: an experiential discounting task. Behav. Process. 67, 343-356. doi: 10.1016/j.beproc.2004.06.003
47. Rodriguez, M. L., and Logue, A. W. (1988). Adjusting delay to reinforcement: comparing choices in pigeons and humans. J. Exp. Psychol. Anim. Behav. Process. 14, 105-117. doi: 10.1037/0097-7403.14.1.105
48. Samuelson, P. A. (1937). A note on measurement of utility. Rev.Econ. Stud. 4, 155-161. doi: 10.2307/2967612
49. Scholten, M., and Read, D. (2010). The psychology of intertemporal tradeoffs. Psychol. Rev. 117, 925-944. doi: 10.1037/a0019619
50. Schweighofer, N., Bertin, M., Shishida, K., Okamoto, Y., Tanaka, S. C., Yamawaki, S., et al. (2008). Low-serotonin levels increase delayed reward discounting in humans. J. Neurosci. 28, 4528-4532. doi: 10.1523/JNEUROSCI.4982-07.2008
51. Schweighofer, N., Shishida, K., Han, C. E., Okamoto, Y., Tanaka, S. C., Yamawaki, S., et al. (2006). Humans can adopt optimal discounting strategy under real-time constraints. PLoS Comput. Biol. 2:e152. doi: 10.1371/journal.pcbi.0020152
52. Stephens, D. W. (2008). Decision ecology: foraging and the ecology of animal decision making. Cogn. Affect. Behav. Neurosci. 8, 475-484. doi: 10.3758/CABN.8.4.475
53. Stephens, D. W., and Anderson, D. (2001). The adaptive value of preference for immediacy: when shortsighted rules have farsighted consequences. Behav. Ecol. 12, 330-339.
54. Stephens, D. W., and Dunlap, A. S. (2009). Why do animals make better choices in patch-leaving problems? Behav.Process. 80, 252-260. doi: 10.1016/j.beproc.2008.11.014
55. Stephens, D. W., and Dunlap, A. S. (2011). Patch exploitation as choice: symmetric choice in an asymmetric situation? Anim. Behav. 81, 683-689. doi: 10.1016/j.anbehav.2010.12.007
56. Stephens, D. W., Kerr, B., and Fernández-Juricic, E. (2004). Impulsiveness without discounting: the ecological rationality hypothesis. Proc. Biol. Sci. 271, 2459-2465. doi: 10.1098/rspb.2004.2871
57. Stephens, D. W., and Krebs, J. R. (1986). Foraging Theory. Princeton, NJ: Princeton University Press.
58. Stephens, D. W., and McLinn, C. M. (2003). Choice and context: testing a simple short-term choice rule. Anim. Behav. 66, 59-70. doi: 10.1006/anbe.2003.2177
59. Stevens, J. R., and Stephens, D. W. (2008). Patience. Curr. Biol. 18, R11-R12. doi: 10.1016/j.cub.2007.11.021
60. Stillwell, D. J., and Tunney, R. J. (2009). Melioration behaviour in the Harvard game is reduced by simplifying decision outcomes. Q. J. Exp. Psychol. 62, 2252-2261. doi: 10.1080/17470210902765999
61. Strotz, R. H. (1955). Myopia and inconsistency in dynamic utility maximization. Rev. Econ. Stud. 23, 165-180. doi: 10.2307/2295722
62. Sugrue, L. P., Corrado, G. S., and Newsome, W. T. (2004). Matching behavior and the representation of value in the parietal cortex. Science 304, 1782-1787. doi: 10.1126/science.1094765
63. Tanaka, S. C., Schweighofer, N., Asahi, S., Shishida, K., Okamoto, Y., Yamawaki, S., et al. (2007). Serotonin differentially regulates short- and long-term prediction of rewards in the ventral and dorsal striatum. PLoS ONE 2:e1333. doi: 10.1371/journal.pone.0001333
64. Thaler, R. (1981). Some empirical evidence on dynamic inconsistency. Econ. Lett. 201-207.