Measuring and modeling the interaction among reward size, delay to reward, and satiation level on motivation in monkeys

Journal of Neurophysiology

Volumn 101, Issue 1, 2009, Pages 437-447

  Minamimoto, Takafumi ^a,b   La Camera, Giancarlo ^a   Richmond, Barry J ^a  

^a NATIONAL INSTITUTE OF MENTAL HEALTH   (United States)

^b NATIONAL INSTITUTE OF RADIOLOGICAL SCIENCES   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARTICLE; ASSOCIATION; COLOR DISCRIMINATION; CONTROLLED STUDY; DECISION MAKING; DISCRIMINATIVE STIMULUS; ERROR; INSTRUMENTAL CONDITIONING; MACACA; MATHEMATICAL ANALYSIS; MOTIVATION; NONHUMAN; PRIORITY JOURNAL; RESPONSE TIME; REWARD; SATIETY; TASK PERFORMANCE; VISUAL STIMULATION;

ALGORITHMS; ANALYSIS OF VARIANCE; ANIMALS; CONDITIONING, OPERANT; CUES; DATA INTERPRETATION, STATISTICAL; MACACA MULATTA; MODELS, NEUROLOGICAL; MOTIVATION; PHOTIC STIMULATION; REINFORCEMENT (PSYCHOLOGY); REINFORCEMENT SCHEDULE; REWARD; SATIATION;

EID: 58849148655     PISSN: 00223077     EISSN: 15221598     Source Type: Journal    
DOI: 10.1152/jn.90959.2008     Document Type: Article

References (40)

1. Bowman EM, Aigner TG, Richmond BJ. Neural signals in the monkey ventral striatum related to motivation for juice and cocaine rewards. J Neurophysiol 75: 1061-1073, 1996.
2. Chudasama Y, Wright KS, Murray EA. Hippocampal lesions in rhesus monkeys disrupt emotional responses but not reinforcer devaluation effects. Biol Psychiatry 63: 1084-1091, 2008.
3. Critchley HD, Rolls ET. Hunger and satiety modify the responses of olfactory and visual neurons in the primate orbitofrontal cortex. J Neurophysiol 75: 1673-1686, 1996.
4. Cromwell HC, Schultz W. Effects of expectations for different reward magnitudes on neuronal activity in primate striatum. J Neurophysiol 89: 2823-2838, 2003.
5. Gibbs J, Maddison SP, Rolls ET. Satiety role of the small intestine examined in sham-feeding rhesus monkeys. J Comp Physiol Psychol 95: 1003-1015, 1981.
6. Green L, Myerson J. A discounting framework for choice with delayed and probabilistic rewards. Psychol Bull 130: 769-792, 2004.
7. Green L, Myerson J, Shah AK, Estle SJ, Holt DD. Do adjusting-amount and adjusting-delay procedures produce equivalent estimates of subjective value in pigeons? J Exp Anal Behav 87: 337-347, 2007.
8. Hollerman JR, Tremblay L, Schultz W. Influence of reward expectation on behavior-related neuronal activity in primate striatum. J Neurophysiol 80: 947-963, 1998.
9. Hull CL. A Behavior System : An Introduction to Behavior Theory Concerning the Individual Organism. New Haven, London: Yale University Press, 1952.
10. Kable JW, Glimcher PW. The neural correlates of subjective value during intertemporal choice. Nat Neurosci 10: 1625-1633, 2007.
11. Kagel JH, Green L, Caraco T. When foragers discount the future: constraints or adaptation? Anim Behav 34: 271-283, 1986.
12. Kahneman D, Tversky A. Choices, Values, and Frames. Cambridge, New York: Cambridge, 2000.
13. Killeen PR, Hall SS. The principal components of response strength. J Exp Anal Behav 75: 111-134, 2001.
14. Kim S, Hwang J, Lee D. Prefrontal coding of temporally discounted values during intertemporal choice. Neuron 59: 161-172, 2008.
15. La Camera G, Richmond BJ. Modeling the violation of reward maximization and invariance in reinforcement schedules. PLoS Comput Biol 4: e1000131, 2008.
16. Logue AW, Peña-Correal TE. The effect of food deprivation on self-control. Behav Processes 10: 355-368, 1985.
17. Machado CJ, Bachevalier J. The effects of selective amygdala, orbital frontal cortex or hippocampal formation lesions on reward assessment in nonhuman primates. Eur J Neurosci 25: 2885-2904, 2007a.
18. Machado CJ, Bachevalier J. Measuring reward assessment in a semi-naturalistic context: the effects of selective amygdala, orbital frontal or hippocampal lesions. Neuroscience 148: 599-611, 2007b.
19. Maddison S, Wood RJ, Rolls ET, Rolls BJ, Gibbs J. Drinking in the rhesus monkey: peripheral factors. J Comp Physiol Psychol 94: 365-374, 1980.
20. Matsumoto K, Suzuki W, Tanaka K. Neuronal correlates of goal-based motor selection in the prefrontal cortex. Science 301: 229-232, 2003.
21. Mazur JE. Tests of an equivalence rule for fixed and variable reinforcer delays. J Exp Psychol: Anim Behav Processes 10: 426-436, 1984.
22. Mazur JE. Hyperbolic value addition and general models of animal choice. Psychol Rev 108: 96-112, 2001.
23. Mazur JE. Learning and Behavior. Upper Saddle River, NJ: Prentice Hall, 2005.
24. Minamimoto T, Hori Y, Kimura M. Complementary process to response bias in the centromedian nucleus of the thalamus. Science 308: 1798-1801, 2005.
25. Mischel W, Grusec J, Masters JC. Effects of expected delay time on the subjective value of rewards and punishments. J Pers Soc Psychol 11: 363-373, 1969.
26. R Development Core Team. R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing, 2004.
27. Richards JB, Mitchell SH, de Wit H, Seiden LS. Determination of discount functions in rats with an adjusting-amount procedure. J Exp Anal Behav 67: 353-366, 1997.
28. Roesch MR, Olson CR. Neuronal activity related to reward value and motivation in primate frontal cortex. Science 304: 307-310, 2004.
29. Roesch MR, Olson CR. Neuronal activity dependent on anticipated and elapsed delay in macaque prefrontal cortex, frontal and supplementary eye fields, and premotor cortex. J Neurophysiol 94: 1469-1497, 2005.
30. Rolls BJ, Rolls ET. Thirst. Cambridge: Cambridge University Press, 1982.
31. Samuelson PA. A note on measurement of utility. Rev Econ Stud 4: 155-161, 1937.
32. Schultz W. Predictive reward signal of dopamine neurons. J Neurophysiol 80: 1-27, 1998.
33. Schweighofer N, Shishida K, Han CE, Okamoto Y, Tanaka SC, Yamawaki S, Doya K. Humans can adopt optimal discounting strategy under real-time constraints. PLoS Comput Biol 2: e152, 2006.
34. Shao J. Linear model selection by cross-validation. J Am Stat Assoc 88: 486-494, 1993.
35. Skinner BF. The Behavior of Organisms. New York: Appleton-Century-Crofts, 1966.
36. Spence KW. Behavior Theory and Conditioning. New Haven, CT: Yale University Press, 1956.
37. Stone M. Cross-validatory choice and assessment of statistical predictions. J R Stat Soc B 39: 111-147, 1974.
38. Toates FM. Motivational Systems. Cambridge: Cambridge University Press, 1986.
39. Tsujimoto S, Sawaguchi T. Prediction of relative and absolute time of reward in monkey prefrontal neurons. Neuroreport 18: 703-707, 2007.
40. Wood RJ, Maddison S, Rolls ET, Rolls BJ, Gibbs J. Drinking in rhesus monkeys: role of presystemic and systemic factors in control of drinking. J Comp Physiol Psychol 94: 1135-1148, 1980.