Effects of expectations for different reward magnitudes on neuronal activity in primate striatum

Journal of Neurophysiology

Volumn 89, Issue 5, 2003, Pages 2823-2838

  Cromwell, Howard C ^a,b   Schultz, Wolfram ^a,c  

^a UNIVERSITY OF FRIBOURG   (Switzerland)

^b WAKE FOREST SCHOOL OF MEDICINE   (United States)

^c UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL EXPERIMENT; ANTERIOR STRIATUM; ANTICIPATION; ARTICLE; BEHAVIORAL SCIENCE; BODY MOVEMENT; BRAIN NERVE CELL; CAUDATE NUCLEUS; CELL ACTIVITY; CONTROLLED STUDY; CORPUS STRIATUM; EXPECTATION; FRUIT JUICE; LINEAR REGRESSION ANALYSIS; MALE; MONKEY; NEUROPHYSIOLOGY; NONHUMAN; PRIORITY JOURNAL; PUTAMEN; REWARD; SPIKE; STIMULUS RESPONSE;

ANIMALS; BEHAVIOR, ANIMAL; DATABASES, FACTUAL; ELECTROMYOGRAPHY; ELECTROPHYSIOLOGY; FEMALE; MACACA FASCICULARIS; MALE; MICROELECTRODES; NEOSTRIATUM; NEURONS; NEURONS, AFFERENT; REACTION TIME; REGRESSION ANALYSIS; REWARD;

EID: 0038076019     PISSN: 00223077     EISSN: None     Source Type: Journal    
DOI: 10.1152/jn.01014.2002     Document Type: Article

References (96)

1. Albertin SV, Mulder AB, Tabuchi E, Zugaro MB, and Wiener SI. Lesions of the medial shell of the nucleus accumbens impair rats in finding larger rewards but spare reward-seeking behavior. Behav Brain Res 117: 173-183, 2000.
2. Alexander GE, Delong MR, and Strick PL. Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu Rev Neurosci 9: 357-381, 1986.
3. Aosaki T, Tsubokawa H, Ishida A, Watanabe K, Graybiel AM, and Kimura M. Responses of tonically active neurons in the primate's striatum undergo systematic changes during behavioral sensorimotor conditioning. J Neurosci 14: 3969-3984, 1994.
4. Apicella P, Legallet E, and Trouche E. Responses of tonically discharging neurons in the monkey striatum to primary rewards delivered during different behavioral states. Exp Brain Res 116: 456-466, 1997.
5. Apicella P, Ljungberg T, Scarnati E, and Schultz W. Responses to reward in monkey dorsal and ventral striatum. Exp Brain Res 85: 491-500, 1991.
6. Apicella P, Scarnati E, Ljungberg T, and Schultz W. Neuronal activity in monkey striatum related to the expectation of predictable events. J Neurophysiol 68: 945-960, 1992.
7. Berridge KC and Cromwell HC. Motivational-sensorimotor interaction produces aphagia and exaggerated treading following striatopallidal lesions in the rat. Behav Neurosci 104: 778-795, 1990.
8. Black RW. Shifts in magnitude of reward and contrast effects in instrumental and selective learning: a reinterpretation. Psych Rev 75: 114-126, 1968.
9. Bloomfield TM. Behavioral contrast and relative reinforcement frequency in two multiple schedules. J Exp Anal Behav 10: 151-158, 1967.
10. Blough PM. Overall and local contrast in multiple schedules: effects of stimulus similarity and discrimination performance. Anim Learn Behav 16: 395-403, 1988.
11. Boussaoud D. Attention versus intention in the primate premotor cortex. Neuroimage 14: S40-S45, 2001.
12. Boussaoud D, di Pellegrino G, and Wise SP. Frontal lobe mechanisms subserving vision for action versus vision for perception. Behav Brain Res 72: 1-15, 1995.
13. Bowman EM, Aigner TG, and Richmond BJ. Neural signals in the monkey ventral striatum related to motivation for juice and cocaine rewards. J Neurophysiol 75: 1061-1073, 1996.
14. Boysen ST, Berntson GG, and Mukobi KL. Size matters: impact of item size and quantity on array choice by chimpanzees (Pan troglodytes). J Comp Psych 115: 106-110, 2001.
15. Braver TS, Cohen JD, Nystrom LE, Jonides J, Smith EE, and Noll DD. A parametric study of prefrontal cortex involvement in human working memory. Neuroimage 5: 49-62, 1997.
16. Brown VJ and Bowman EM. Discriminative cues indicating reward magnitude continue to determine reaction time of rats following lesions to the nucleus accumbens. Eur J Neurosci 7: 2479-2485, 1995.
17. Campbell AB and Seiden LS. The effect of relative and absolute reinforcement magnitude on operant responding. Physiol Behav 12: 843-849, 1974.
18. Capaldi EJ, Alptekin S, and Birmingham K. Discriminating between reward-produced memories: effects of differences in reward magnitude. Anim Learn Behav 25: 171-176, 1997.
19. Capaldi EJ and Lynch D. Repeated shifts in reward magnitude: evidence in favor of an associational and absolute (noncontextual) interpretation. J Exp Psychol 75: 226-235, 1967.
20. Capaldi EJ and Lynch AD. Magnitude of partial reward and resistance to extinction. J Comp Physiol Psych 65: 179-181, 1968.
21. Cardinal RN, Pennicott DR, Sugathapala CL, Robbins TW, and Everitt BJ. Impulsive choice induced in rats by lesions of the nucleus accumbens core. Science 292: 2499-2501, 2001.
22. Catania AC. Concurrent performances: a baseline for the study of reinforcement magnitude. J Exp Anal Behav 6: 299-300, 1963.
23. Chang JY, Chen L, Luo F, Shi LH, and Woodward DJ. Neuronal and behavioral correlations in the medial prefrontal cortex and nucleus accumbens during cocaine self-administration by rats. Neuroscience 99: 433-443, 2000.
24. Collier GH. Determinants of choice. Nebr Symp Motiv 29: 69-127, 1982.
25. Crespi LP. Quantitative variation in incentive and performance in the white rat. Am J Psych 40: 467-517, 1942.
26. Critchley HG and Rolls ET. Hunger and satiety modify the responses of olfactory and visual neurons in the primate orbitofrontal cortex. J Neurophysiol 75: 1673-1686, 1996.
27. Cromwell HC, Azarov A, Anstrom K, and Woodward DJ. Neural responses in mesoamygdala circuits during associative learning. Soc Neurosci Abstr 27: 1588, 2001.
28. Cromwell HC and Berridge KC. Implementation of action sequences by a neostriatal site: a lesion mapping study of grooming syntax. J Neurosci 16: 3444-3458, 1996.
29. Cromwell HC and Schultz W. Reward discrimination in primate striatum II. Reward magnitude. Soc Neurosci Abstr 26: 1753, 2000.
30. DeCoteau WE, Kesner RP, and Williams JM. Short-term memory for food reward magnitude: the role of the prefrontal cortex. Behav Brain Res 88: 239-249, 1997.
31. Delong MR, Alexander GE, Mitchel SJ, and Richardson RT. The contribution of basal ganglia to limb control. Prog Brain Res 64: 161-174, 1986.
32. Dickinson A and Balleine B. Motivational control of goal-directed action. Anim Learn Behav 22: 1-18, 1994.
33. Everitt BJ, Parkinson JA, Olmstead MC, Arroyo MM, Robledo P, and Robbins TW. Associative processes in addiction and reward. The role of amygdala-ventral striatal subsystems. Ann NY Acad Sci 877: 412-438, 2000.
34. Flaherty AW and Graybiel AM. Two input systems for body representations in the primate striatal matrix: experimental evidence in the squirrel monkey. J Neurosci 13: 1120-1137, 1993.
35. Flaherty AW and Graybiel AM. Corticostriatal transformations in the primate somatosensory system: projections from physiologically mapped body part representations. J Neurophysiol 66: 1249-1263, 1991.
36. Flaherty CF. Incentive Relativity. New York: Cambridge University Press, 1996.
37. Flaherty CF and Mitchall C. Absolute ands relative rewarding properties of fructose, glucose and saccharin mixtures as reflected in anticipatory contrast. Physiol Behav 66: 841-853, 1999.
38. Funahashi S, Bruce CJ, and Goldman-Rakic PS. Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. J Neurophysiol 61: 331-349, 1989.
39. Fuster JM. Executive frontal functions. Exp Brain Res 133: 66-70, 2000.
40. Gallager M, McMahan R, and Schoenbaum G. Orbitofrontal cortex and representation of incentive value in associative learning. J Neurosci 19: 6610-6614, 1999.
41. Grigson PS, Kaplan JM, Roitman MF, Norgren R, and Grill HJ. Reward comparison in chronic decerebrate rats. Am J Physiol 273: R479-R486, 1997.
42. Haber SN, Fudge JL, and McFarland N. Striatonigrostriatal pathways in primates from an ascending spiral from the shell to the dorsolateral striatum. J Neurosci 20: 2369-2382, 2000.
43. Haber SN, Kunishio K, Mizobuchi M, and Lynd-Balta E. The orbital and medial prefrontal circuit through the primate basal ganglia. J Neurosci 15: 4851-4867, 1995.
44. Haber SN and McFarland NR. The place of the thalamus in frontal corticalbasal ganglia circuits. Neuroscientist 7: 326-335, 2001.
45. Hassani OK, Cromwell HC, and Schultz W. Influence of expectation of different rewards on behavior-related neuronal activity in the striatum. J Neurophysiol 85: 2477-2489, 2001.
46. Hauber W, Bohn I, and Giertler C. NMDA, but not dopamine D2 receptors in the rat nucleus accumbens are involved in guidance of instrumental behavior by stimuli predicting reward magnitude. J Neurosci 20: 6282-6288, 2000.
47. Hikosaka K and Watanabe M. Delay activity of orbital and lateral prefrontal neurons of the monkey varying with different rewards. Cereb Cortex 10: 263-271, 2000.
48. Hikosaka O, Sakamoto M, and Usui S. Functional properties of monkey caudate neurons I. Activities related to saccadic eye movements. J Neurophysiol 61: 780-798, 1989a.
49. Hikosaka O, Sakamoto M, and Usui S. Functional properties of monkey caudate neurons. III Activities related to expectation of target and reward. J Neurophysiol 61: 814-832, 1989b.
50. Hollerman JR, Tremblay L, and Schultz W. Influence of reward expectation on behavior-related neuronal activity in primate striatum. J Neurophysiol 80: 947-963, 1998.
51. Kawagoe R, Takikiawa Y, and Hikosaka O. Expectation of reward modulates cognitive signals in the basal ganglia. Nat Neurosci 1: 411-416, 1998.
52. Kim J and Shadlen MN. Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque. Nat Neurosci 2: 176-185, 1999.
53. Kimura M, Rajkowski J, and Evarts E. Tonically discharging putamen neurons exhibit set-dependent responses. Proc Natl Acad Sci USA 81: 4998-5001, 1984.
54. Kincaid AE, Zheng T, and Wilson CJ. Connectivity and convergence of single corticostriatal axons. J Neurosci 18: 4722-4733, 1998.
55. Kirshenbaum AP, Szalda-Petree AD, and Haddad NF. Risk-sensitive foraging in rats:effects of response-effort and reward-amount manipulations on choice behavior. Behav Processes 50: 9-17, 2000.
56. Knutson B, Adams CA, Fong GW, and Hommer D. Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J Neurosci 21: RC1591-RC1595, 2001.
57. Kunishio K and Haber SN. Primate cingulostriatal projection: limbic striatal versus sensorimotor striatal input. J Comp Neurol 350: 337-356, 1994.
58. Leon MI and Shadlen MN. Effect of expected reward magnitude on the response of neurons in the dorsolateral prefrontal cortex of the macaque. Neuron 24: 415-425, 1999.
59. Leszczuk MH and Flaherty CF. Lesions of the nucleus accumbens reduce instrumental but not consummatory negative contrast in rats. Behav Brain Res 116: 61-79, 2000.
60. Liu Z and Richmond BJ. Response differences in monkey TE and perirhinal cortex: stimulus association related to reward schedules. J Neurophysiol 83: 1677-1692, 2000.
61. Mackintosh NJ. The Psychology of Animal Learning. London: Academic Press, 1974.
62. Martin PD and Ono T. Effects of reward anticipation, reward presentation and spatial parameters of single neurons recorded in the subiculum and nucleus accumbens of freely moving rats. Behav Brain Res 116: 23-38, 2000.
63. McSweeney FK. Matching and contrast on several concurrent-press schedules. J Exp Anal Behav 23: 193-198, 1975.
64. Mellgren RL and Dyck DG. Reward magnitude in differential conditioning: effects of sequential variables in acquisition and extinction. J Comp Physiol Psych 86: 1141-1148, 1974.
65. Miller EK, Erickson CA, and Desimone R. Neural mechanisms of visual working memory in the prefrontal cortex of the monkey. J Neurosci 16: 5154-5167, 1996.
66. Mogenson GJ, Jones DL, and Yim CY. From motivation to action: functional interface between limbic system and motor system. Prog Neurobiol 14: 69-97, 1980.
67. Neuringer AJ. Effects of reinforcement magnitude on choice and rate of responding. J Exp Anal Behav 10: 417-424, 1967.
68. Nishijo H, Ono T, and Nishino H. Single neuron responses in the amygdala of alert monkey during complex sensory stimulation with affective significance. J Neurosci 8: 3570-3583, 1988.
69. O'Doherty J, Keringelbach ML, Rolls ET, Hornak J, and Andrews C. Abstract reward and punishment representations in the human orbitofrontal cortex. Nat Neurosci 4: 95-102, 2001.
70. Parkinson JA, Crofts HS, McGuigan M, Tomic DL, Everitt BJ, and Roberts AC. The role of the primate amygdala in conditioned reinforcement. J Neurosci 21: 7770-7780, 2001.
71. Platt ML and Glimcher PW. Neural correlates of decision variables in parietal cortex. Nature 400: 233-238, 1999.
72. Pratt WE and Mizumori SJY. Neurons in rat medial prefrontal cortex show anticipatory rate changes to predictable differential rewards in a spatial memory task. Behav Brain Res 123: 165-183, 2001.
73. Robbins TW and Everitt BJ. Functions of dopamine in the dorsal and ventral striatum. Semin Neurosci 4: 119-128, 1992.
74. Rolls ET. Neurophysiology and functions of the primate amygdala. In: The Amygdala: Neurobiological Aspects of Emotion, Memory and Mental Dysfunction, edited by Aggleton JP. New York: Wiley-Liss, 1992, p. 143-165.
75. Romo R, Brody CD, Hernandez A, and Lemus L. Neuronal correlates of parametric working memory in the prefrontal cortex. Nature 399: 470-472, 1999.
76. Russchen FT, Bakst I, Amaral DG, and Price JL. The amygdalostriatal projections in the monkey. An anterograde tracing study. Brain Res 329: 241-257, 1985.
77. Salinas JA and McGaugh JL. The amygdala modulates memory for changes in reward magnitude: involvement of the amygdaloid GABAergic system. Behav Brain Res 80: 87-98, 1996.
78. Salinas JA, Packard MG, and McGaugh JL. Amygdala modulates memory for changes in reward magnitude: reversible post-training inactivation with lidocaine attenuates the response to a reduction in reward. Behav Brain Res 59: 153-159, 1993.
79. Schoenbaum G, Chiba AA, and Gallagher M. Changes in functional connectivity in orbitofrontal cortex and basolateral amygdala during learning and reversal training. J Neurosci 20: 5179-5189, 2000.
80. Schultz W. Predictive reward signal of dopamine neurons. J Neurophysiol 80: 1-27, 1998.
81. Schultz W, Apicella P, Scarnati E, and Ljungberg T. Neuronal activity in monkey ventral striatum related to the expectation of reward. J Neurosci 12: 4595-4610, 1992.
82. Selemon LD and Goldman-Rakic PS. Longitudinal topography and interdigitation of corticostriatal projections in the rhesus monkey. J Neurosci 5: 776-794, 1985.
83. Shidara M, Aigner TG, and Richmond BJ. Neuronal signals in the monkey ventral striatum related to progress through a predictable series of trials. J Neurosci 18: 2613-2625, 1998.
84. Shidara M and Richmond BJ. Anterior cingulated: single neuronal signals related to degree of reward expectancy. Science 296: 1709-1711, 2002.
85. Shima K and Tanji J. Role for cingulate motor area cells in voluntary movement selection based on reward. Science 282: 1335-1338, 1998.
86. Spear NE and Spitzner JH. Simultaneous and successive contrast effects of reward magnitude in selective learning. Psychol Mongr 80: 1-31, 1966.
87. Thorpe SJ, Rolls ET, and Maddison S. The orbitofrontal cortex: neuronal activity in the behaving monkey. Exp Brain Res 49: 93-115, 1983.
88. Tinklepaugh OL. An experimental study of representative factors in monkeys. J Comp Psych 8: 197-236, 1928.
89. Tolman EC. Purposive Behavior in Animals and Man. New York: Century Press, 1932.
90. Tremblay L and Schultz W. Relative reward preference in primate orbitofrontal cortex. Nature 398: 704-708, 1999.
91. Uwano T, Nishijo H, Ono T, and Tamura R. Neuronal responsiveness to various sensory stimuli and associative learning in the rat amygdala. Neuroscience 68: 339-361, 1995.
92. Wallis JD, Anderson KC, and Miller EK. Single neurons in prefrontal cortex encode abstract rules. Nature 411: 953-956, 2001.
93. Watanabe M. Reward expectancy in primate prefrontal neurons. Nature 382: 629-632, 1996.
94. Watanabe M, Cromwell HC, Tremblay L, Hollerman JR, and Schultz W. Behavioral reactions reflecting differential expectations of outcomes in monkeys. Exp Brain Res 140: 511-518, 2001.
95. Williams BA. Another look at contrast in multiple schedules. J Exp Anal Behav 39: 345-384, 1983.
96. Woodward DJ, Kirillov AB, Myre CD, and Sawyer SF. Neostriatal circuitry as a scalar memory and ensemble neuron recording. In: Models of Information Processing in the Basal Ganglia. edited by Houk JC, Davis JL, and Beiser DG. Cambridge, MA: MIT Press, 1995, p. 315-336.