Postreward delays and systematic biases in measures of animal temporal discounting

Proceedings of the National Academy of Sciences of the United States of America

Volumn 110, Issue 38, 2013, Pages 15491-15496

  Blanchard, Tommy C ^a   Pearson, John M ^b   Hayden, Benjamin Y ^a  

^a UNIVERSITY OF ROCHESTER   (United States)

^b DUKE UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

Animal models; Delay discounting; Foraging; Patience; Rhesus macaque

Indexed keywords

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARTICLE; CONTROLLED STUDY; MALE; NONHUMAN; PRIORITY JOURNAL; REWARD; RHESUS MONKEY; TEMPORAL DISCOUNTING;

ANIMAL MODELS; DELAY DISCOUNTING; FORAGING; PATIENCE; RHESUS MACAQUE;

ANIMALS; BIAS (EPIDEMIOLOGY); DECISION MAKING; IMPULSIVE BEHAVIOR; MACACA MULATTA; MALE; MODELS, PSYCHOLOGICAL; REWARD; TIME FACTORS;

EID: 84884330118     PISSN: 00278424     EISSN: 10916490     Source Type: Journal    
DOI: 10.1073/pnas.1310446110     Document Type: Article

References (51)

1. Stevens JR, Stephens DN (2010) The adaptive nature of impulsivity. Impulsivity: The Behavioral and Neurological Science of Discounting, eds Madden GJ, Bickel WK (American Psychological Association, Washington, DC).
2. Ainslie G (1975) Specious reward: A behavioral theory of impulsiveness and impulse control. Psychol Bull 82(4):463-496.
3. Rachlin H (2000) The Science of Self-Control (Harvard Univ Press, Cambridge, MA).
4. Rachlin H, Green L (1972) Commitment, choice and self-control. J Exp Anal Behav 17(1):15-22.
5. Tobin H, Logue AW (1994) Self-control across species (Columba livia, Homo sapiens, and Rattus norvegicus). J Comp Psychol 108(2):126-133.
6. Stevens JR, Stephens DW (2008) Patience. Curr Biol 18(1):R11-R12.
7. Stephens DW, Anderson D (2001) The adaptive value of preference for immediacy: When shortsighted rules have farsighted consequences. Behav Ecol 12(3):330-339.
8. Bateson M, Kacelnik A (1996) Rate currencies and the foraging starling: The fallacy of the averages revisited. Behav Ecol 7(3):341-352.
9. Stephens DW (2002) Discrimination, discounting and impulsivity: A role for an informational constraint. Philos Trans R Soc Lond B Biol Sci 357(1427):1527-1537.
10. Stephens DW, Kerr B, Fernández-Juricic E (2004) Impulsiveness without discounting: The ecological rationality hypothesis. Proc Biol Sci 271(1556):2459-2465.
11. Pearson JM, Hayden BY, Platt ML (2010) Explicit information reduces discounting behavior in monkeys. Front Psychol 1:237.
12. Snyderman M (1983) Delay and amount of reward in a concurrent chain. J Exp Anal Behav 39(3):437-447.
13. Logue AW, Smith ME, Rachlin H (1985) Sensitivity of pigeons to pre-reinforcer and postreinforcer delays. Anim Learn Behav 13:181-186.
14. Goldshmidt JN, Lattal KM, Fantino E (1998) Context effects on choice. J Exp Anal Behav 70(3):301-320.
15. Mazur JE (1989) Theories of probabilistic reinforcement. J Exp Anal Behav 51(1): 87-99.
16. Mazur JE, Romano A (1992) Choice with delayed and probabilistic reinforcers: Effects of variability, time between trials, and conditioned reinforcers. J Exp Anal Behav 58(3):513-525.
17. Mackintosh NJ (1975) A theory of attention: Variations in the associablity of stimuli with reinforcement. Psychol Rev 82:276-298.
18. Mazur JE (1987) An adjusting procedure for studying delayed reinforcement. Quantitative Analyses of Behavior, Vol 5. The Effect of Delay and Intervening Events on Reinforcement Value, eds Commons ML, Mazur JE, Nevin JA, Rachlin H (Erlbaum, Mahwah, NJ).
19. Kacelnik A (2003) The evolution of patience. Time and Decision: Economic and Psychological Perspectives on Intertemporal Choice, eds Loewenstein G, Read D, Baumeister RF. (Russell Sage Foundation, New York).
20. Siegel E, Rachlin H (1995) Soft commitment: Self-control achieved by response persistence. J Exp Anal Behav 64(2):117-128.
21. Monterosso J, Ainslie G (1999) Beyond discounting: Possible experimental models of impulse control. Psychopharmacology (Berl) 146(4):339-347.
22. Calvert AL, Green L, Myerson J (2011) Discounting in pigeons when the choice is between two delayed rewards: Implications for species comparisons. Front Neurosci 5:96.
23. Fawcett TW, McNamara JM, Houston AI (2012) When is it adaptive to be patient? A general framework for evaluating delayed rewards. Behav Processes 89(2):128-136.
24. Pavlic TP, Passino KM (2010) When rate maximization is impulsive. Behav Ecol Sociobiol 64:1255-1265.
25. Stephens DW, McLinn CM (2003) Choice and context: Testing a simple short-term choice rule. Anim Behav 66:59-70.
26. Reynolds B, Schiffbauer R (2005) Delay of gratification and delay discounting: A unifying feedback model of delay-related impulsive behavior. Psychol Rec 55:439-460.
27. Reynolds B, de Wit H, Richards JB (2002) Delay of gratification and delay discounting in rats. Behav Processes 59(3):157.
28. Evans TA, Beran MJ (2007) Delay of gratification and delay maintenance by rhesus macaques (Macaca mulatta). J Gen Psychol 134(2):199-216.
29. Bramlett JL, Perdue BM, Evans TA, Beran MJ (2012) Capuchin monkeys (Cebus apella) let lesser rewards pass them by to get better rewards. Anim Cogn 15(5):963-969.
30. Namboodiri VMK, Mihalas S, Marton T, Shuler MGH (2013) A General Theory of Intertemporal Decision-Making and the Perception of Time. Available at http://arxiv. org/abs/1306.1200. Accessed July 19, 2013.
31. Simon H (1955) A behavioral model of rational choice. Q J Econ 69:99-118.
32. Gigerenzer G, Selten R (2002) Bounded rationality: The adaptive toolbox. The Adaptive Toolbox, eds Gigerenzer G, Selten R (MIT Press, Cambridge, MA).
33. Gigerenzer G, Todd PM, Group A (1999) Simple Heuristics That Make Us Smart (Oxford Univ Press, Oxford).
34. Stephens DW, Krebs JR (1986) Foraging Theory (Princeton Univ Press, Princeton, NJ).
35. Raby CR, Alexis DM, Dickinson A, Clayton NS (2007) Planning for the future by western scrub-jays. Nature 445(7130):919-921.
36. Winstanley CA, Theobald DEH, Cardinal RN, Robbins TW (2004) Contrasting roles of basolateral amygdala and orbitofrontal cortex in impulsive choice. J Neurosci 24(20): 4718-4722.
37. Rudebeck PH, Walton ME, Smyth AN, Bannerman DM, Rushworth MFS (2006) Separate neural pathways process different decision costs. Nat Neurosci 9(9):1161-1168.
38. Zeeb FD, Floresco SB, Winstanley CA (2010) Contributions of the orbitofrontal cortex to impulsive choice: Interactions with basal levels of impulsivity, dopamine signalling, and reward-related cues. Psychopharmacology (Berl) 211(1):87-98.
39. McClure SM, Ericson KM, Laibson DI, Loewenstein G, Cohen JD (2007) Time discounting for primary rewards. J Neurosci 27(21):5796-5804.
40. Luhmann CC, Chun MM, Yi DJ, Lee D, Wang XJ (2008) Neural dissociation of delay and uncertainty in intertemporal choice. J Neurosci 28(53):14459-14466.
41. Jimura K, Myerson J, Hilgard J, Braver TS, Green L (2009) Are people really more patient than other animals? Evidence from human discounting of real liquid rewards. Psychon Bull Rev 16(6):1071-1075.
42. Smith DV, et al. (2010) Distinct value signals in anterior and posterior ventromedial prefrontal cortex. J Neurosci 30(7):2490-2495.
43. Hayden BY, Parikh PC, Deaner RO, Platt ML (2007) Economic principles motivating social attention in humans. Proc Biol Sci 274(1619):1751-1756.
44. Sonuga-Barke EJ, Lea SEG, Webley P (1989) An account of human "impulsivity" on self-control tasks. Q J Exp Psychol B 41:161-179.
45. Schweighofer N, et al. (2006) Humans can adopt optimal discounting strategy under real-time constraints. PLOS Comput Biol 2(11):e152.
46. Evenden JL (1999) Varieties of impulsivity. Psychopharmacology (Berl) 146(4):348-361.
47. Winstanley CA, Eagle DM, Robbins TW (2006) Behavioral models of impulsivity in relation to ADHD: Translation between clinical and preclinical studies. Clin Psychol Rev 26(4):379-395.
48. Dalley JW, Everitt BJ, Robbins TW (2011) Impulsivity, compulsivity, and top-down cognitive control. Neuron 69(4):680-694.
49. Dalley JW, Mar AC, Economidou D, Robbins TW (2008) Neurobehavioral mechanisms of impulsivity: Fronto-striatal systems and functional neurochemistry. Pharmacol Biochem Behav 90(2):250-260.
50. Brainard DH (1997) The Psychophysics Toolbox. Spat Vis 10(4):433-436.
51. Cornelissen FW, Peters EM, Palmer J (2002) The Eyelink Toolbox: Eye tracking with MATLAB and the Psychophysics Toolbox. Behav Res Methods Instrum Comput 34(4): 613-617.