Subjective costs drive overly patient foraging strategies in rats on an intertemporal foraging task

Proceedings of the National Academy of Sciences of the United States of America

Volumn 110, Issue 20, 2013, Pages 8308-8313

  Wikenheiser, Andrew M ^a   Stephens, David W ^a   Redish, A David ^a  

^a UNIVERSITY OF MINNESOTA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; DECISION MAKING; DRIVE; FOOD INTAKE; FOOD PREFERENCE; FORAGING; LEARNING; NONHUMAN; PREY SELECTION; PRIORITY JOURNAL; RAT; REINFORCEMENT; REWARD;

ANIMALS; APPETITIVE BEHAVIOR; CHOICE BEHAVIOR; DECISION MAKING; MALE; MODELS, STATISTICAL; RATS; RATS, INBRED F344; TIME FACTORS;

EID: 84877869318     PISSN: 00278424     EISSN: 10916490     Source Type: Journal    
DOI: 10.1073/pnas.1220738110     Document Type: Article

References (45)

1. Madden G, Bickel W, Critchfield T, eds (2009) Impulsivity: Theory, Science, and Neuroscience of Discounting (APA Books, Washington, DC).
2. Ainslie G (1975) Specious reward: A behavioral theory of impulsiveness and impulse control. Psychol Bull 82(4):463-496.
3. Herrnstein RJ, Prelec D (1991) Melioration: A theory of distributed choice. J Econ Perspect 5(3):137-156.
4. Frederick S, Loewenstein G, O'Donoghue T (2002) Time discounting and time preference: A critical review. J Econ Lit 40(4):351-401.
5. Heyman G (2009) Addiction: A Disorder of Choice (Harvard Univ Press, Cambridge, MA).
6. Stephens DW, Kerr B, Fernández-Juricic E (2004) Impulsiveness without discounting: The ecological rationality hypothesis. Proc Biol Sci 271(1556):2459-2465.
7. Kacelnik A (2003) The evolution of patience. Time and Decision: Economic and Psychological Perspectives on Intertemporal Choice, eds Loewenstein G, Read D, Baumeister R (Russell Sage Foundation, New York), pp 115-138.
8. Stevens JR, Hallinan EV, Hauser MD (2005) The ecology and evolution of patience in two New World monkeys. Biol Lett 1(2):223-226. (Pubitemid 41374937)
9. Hayden BY, Platt ML (2007) Animal cognition: Great apes wait for grapes. Curr Biol 17(21):R922-R923. (Pubitemid 350016912)
10. Samuelson PA (1937) A note on measurement of utility. Rev Econ Stud 4(2):155-161.
11. Ainslie G (1992) Picoeconomics (Cambridge Univ Press, Cambridge, UK).
12. Redish AD, Kurth-Nelson Z (2010) Neural models of temporal discounting. Impulsivity: The Behavioral and Neurological Science of Discounting, eds Madden G, Bickel W (APA Books, Washington, DC), pp 123-158.
13. Mazur J (1987) An adjusting procedure for studying delayed reinforcement. Quantitative Analyses of Behavior: The Effect of Delay and of Intervening Events, eds Commons M, Mazur J, Nevin J, Rachlin H (Erlbaum, Hillsdale, NJ), pp 55-73.
14. Cardinal RN, Daw N, Robbins TW, Everitt BJ (2002) Local analysis of behaviour in the adjusting-delay task for assessing choice of delayed reinforcement. Neural Netw 15(4-6):617-634. (Pubitemid 34951147)
15. Kacelnik A, Vasconcelos M, Monteiro T, Aw J (2011) Darwin's "tug of war" vs. starlings "horse-racing": How adaptations for sequential encounters drive simultaneous choice. Behav Ecol Sociobiol 65(3):547-558.
16. Stephens DW (2008) Decision ecology: Foraging and the ecology of animal decision making. Cogn Affect Behav Neurosci 8(4):475-484.
17. MacArthur R, Pianka E (1966) On optimal use of a patchy environment. Am Nat 100(916):603-609.
18. Charnov EL (1976) Optimal foraging, the marginal value theorem. Theor Popul Biol 9(2):129-136.
19. Stephens D, Krebs J (1986) Foraging Theory (Princeton Univ Press, Princeton).
20. Kalenscher T, Pennartz CMA (2008) Is a bird in the hand worth two in the future? The neuroeconomics of intertemporal decision-making. Prog Neurobiol 84(3):284-315.
21. Stevens J (2010) Intertemporal choice. Encyclopedia of Animal Behavior, eds Breed M, Moore J (Academic, London), pp 203-208.
22. Kacelnik A, Todd I (1992) Psychological mechanisms and the marginal value theorem: Effect of variability in travel time on patch exploitation. Anim Behav 43(2):313-322.
23. Pompilio L, Kacelnik A (2010) Context-dependent utility overrides absolute memory as a determinant of choice. Proc Natl Acad Sci USA 107(1):508-512.
24. Hayden BY, Pearson JM, Platt ML (2011) Neuronal basis of sequential foraging decisions in a patchy environment. Nat Neurosci 14(7):933-939.
25. Freidin E, Kacelnik A (2011) Rational choice, context dependence, and the value of information in European starlings (Sturnus vulgaris). Science 334(6058):1000-1002.
26. Kolling N, Behrens TE, Mars RB, Rushworth MF (2012) Neural mechanisms of foraging. Science 336(6077):95-98.
27. Charnov E (1976) Optimal foraging: Attack strategy of a mantid. Am Nat 110(971):141-151.
28. Herrnstein RJ (1970) On the law of effect. J Exp Anal Behav 13(2):243-266.
29. Gallistel CR, Mark TA, King AP, Latham PE (2001) The rat approximates an ideal detector of changes in rates of reward: Implications for the law of effect. J Exp Psychol Anim Behav Process 27(4):354-372. (Pubitemid 33778760)
30. Sutton RS, Barto AG (1998) Reinforcement Learning: An Introduction (MIT, Cambridge, MA).
31. Watkins C (1989) Learning from delayed rewards. PhD thesis (Cambridge University, Cambridge, UK).
32. Kurth-Nelson Z, Redish AD (2009) Temporal-difference reinforcement learning with distributed representations. PLoS One 4(10):e7362.
33. Roberts S, Pashler H (2000) How persuasive is a good fit? A comment on theory testing. Psychol Rev 107(2):358-367.
34. Niv Y, Daw ND, Joel D, Dayan P (2007) Tonic dopamine: Opportunity costs and the control of response vigor. Psychopharmacology (Berl) 191(3):507-520. (Pubitemid 46355878)
35. Niv Y, Joel D, Dayan P (2006) A normative perspective on motivation. Trends Cogn Sci 10(8):375-381. (Pubitemid 44093326)
36. Aronson E (1961) The effect of effort on the attractiveness of rewarded and unrewarded stimuli. J Abnorm Soc Psychol 63(2):375-380.
37. Arkes H, Blumer C (1985) The psychology of sunk cost. Organ Behav Hum Decis Process 35(1):124-140.
38. Arkes H, Ayton P (1999) The sunk cost and Concorde effects: Are humans less rational than lower animals? Psychol Bull 125(5):591-600.
39. Arkes H (1996) The psychology of waste. J Behav Decis Making 9(3):213-224.
40. Staw B (1976) Knee-deep in the big muddy: A study of escalating commitment to a chosen course of action. Organ Behav Hum Perform 16(1):27-44.
41. Staw B, Fox F (1977) Escalation: The determinants of commitment to a chosen course of action. Hum Relat 30(5):431-450.
42. Brockner J (1992) The escalation of commitment to a failing course of action: Toward theoretical progress. Acad Manage Rev 17(1):39-61.
43. Bromberg-Martin ES, Hikosaka O (2009) Midbrain dopamine neurons signal preference for advance information about upcoming rewards. Neuron 63(1):119-126.
44. Krebs J, Erichsen J, Webber M (1977) Optimal prey selection in the great tit (Parus major). Anim Behav 268(5616):30-38. (Pubitemid 8047390)
45. Stephens D, Anderson D (2001) The adaptive value of preference for immediacy: When shortsighted rules have farsighted consequences. Behav Ecol 12(3):330-339. (Pubitemid 32897109)