Impact of expected reward on neuronal activity in prefrontal cortex, frontal and supplementary eye fields and premotor cortex

Journal of Neurophysiology

Volumn 90, Issue 3, 2003, Pages 1766-1789

  Roesch, Matthew R ^a   Olson, Carl R ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; ASSOCIATION; EYE MOVEMENT; FRONTAL CORTEX; LIMBIC SYSTEM; MACACA; MALE; MEMORY; MOTIVATION; MOTOR CORTEX; MOTOR SYSTEM; NERVE CELL; NONHUMAN; PREFRONTAL CORTEX; PREMOTOR CORTEX; PRIORITY JOURNAL; REWARD; SACCADIC EYE MOVEMENT; STIMULUS RESPONSE; TASK PERFORMANCE;

ACTION POTENTIALS; ANIMALS; MACACA MULATTA; MALE; MOTOR CORTEX; NEURONS; PREFRONTAL CORTEX; REACTION TIME; REWARD; VISUAL FIELDS;

EID: 0141565150     PISSN: 00223077     EISSN: None     Source Type: Journal    
DOI: 10.1152/jn.00019.2003     Document Type: Article

References (93)

1. Aggleton JP and Passingham RE. Syndrome produced by lesions of the amygdala in monkeys (Macaca mulatta). J Comp Physiol Psychol 95: 961-977, 1981.
2. Amador N, Schlag-Rey M, and Schlag J. Reward-predicting and reward-detecting neuronal activity in the primate supplementary eye field. J Neurophysiol 84: 2166-2170, 2000.
3. Apicella P, Ljungberg T, Scarnati E, and Schultz W. Responses to reward in monkey dorsal and ventral striatum. Exp Brain Res 85: 491-500, 1991.
4. Basso MA and Wurtz RH. Modulation of neuronal activity by target uncertainty. Nature 389: 66-69, 1997.
5. Basso MA and Wurtz RH. Modulation of neuronal activity in superior colliculus by changes in target probability. J Neurosci 18: 7519-7534, 1998.
6. Baylis LL and Gaffan D. Amygdalectomy and ventromedial prefrontal ablation produce similar deficits in food choice and in simple object discrimination learning for an unseen reward. Exp Brain Res 86: 617-622, 1991.
7. Bowman EM, Aigner TG, and Richmond BJ, Neural signals in the monkey ventral striatum related to motivation for juice and cocaine rewards. J Neurophysiol 75: 1061-1073, 1996.
8. Brinkman C. Lesions in supplementary motor area interfere with a monkey's performance of a bimanual coordination task. Neurosci Lett 27: 267-270, 1981.
9. Burton MJ, Rolls ET, and Mora F. Effects of hunger on the responses of neurons in the lateral hypothalamus to the sight and taste of food. Exp Neurol 51: 668-677, 1976.
10. Butter CM, McDonald JA, and Snyder DR. Orality, preference behavior, and reinforcement value of nonfood object in monkeys with orbital frontal lesions. Science 164: 1306-1307, 1969.
11. Butter CM and Snyder DR. Alterations in aversive and aggressive behaviors following orbital frontal lesions in rhesus monkeys. Acta Neurobiol Exp (Warsz) 32: 525-565, 1972.
12. Butter CM, Snyder DR, and McDonald JA. Effects of orbital frontal lesions on aversive and aggressive behaviors in rhesus monkeys. J Comp Physiol Psychol 72: 132-144, 1970.
13. Coe B, Tomihara K, Matsuzawa M, and Hikosaka O. Visual and anticipatory bias in three cortical eye fields of the monkey during an adaptive decision-making task. J Neurosci 22: 5081-5090, 2002.
14. Colby CL, Duhamel J-R, and Goldberg ME. Visual, presaccadic and cognitive activation of single neurons in monkey lateral intraparietal area. J Neurophysiol 76: 2841-2852, 1996.
15. Crist CF, Yamasaki DSG, Komatsu H, and Wurtz RH. A grid system and a microsyringe for single cell recording. J Neurosci Methods 26: 117-122, 1988.
16. Critchley HD and Rolls ET. Hunger and satiety modify the responses of olfactory and visual neurons in the primate orbitofrontal cortex. J Neurophysiol 75: 1673-1686, 1996.
17. Dias EC and Segraves MA. Muscimol-induced inactivation of monkey frontal eye field: effects on visually and memory guided saccades. J Neurophysiol 81: 2191-2214, 1999.
18. Dickinson A and Balleine B. Motivational control of goal-directed action. Anim LearnBehav 22: 1-18, 1994.
19. Fujii N, Mushiake H, and Tanji J. An oculomotor representation area within the ventral premotor cortex. Proc Natl Acad Sci USA 95: 12034-12037, 1998.
20. Fujii N, Mushiake H, and Tanji J. Rostrocaudal distinction of the dorsal premotor area based on oculomotor involvement. J Neurophysiol 83: 1764-1769, 2000.
21. Fukuda M, Ono T, and Nakamura K. Functional relations among inferotemporal cortex, amygdala, and lateral hypothalamus in monkey operant feeding behavior. J Neurophysiol 57: 1060-1077, 1987.
22. Fukuda M, Ono T, Nishino H, and Sasaki K. Visual responses related to food discrimination in monkey lateral hypothalamus during operant feeding behavior. Brain Res 374: 249-259, 1986.
23. Gaffan D and Murray EA. Amygdalar interaction with the mediodorsal nucleus of the thalamuus and the ventromedial prefrontal cortex in stimulus-reward associative learning in the monkey. J Neurosci 10: 3479-3493, 1990.
24. Hassani OK, Cromwell HC, and Schultz W. Influence of expectation of different rewards on behavior-related neuronal activity in the striatum. J Neurophysiol 85: 2477-2489, 2001.
25. Hikosaka K and Watanabe M. Delay activity of orbital and lateral prefrontal neurons of the monkey varying with different rewards. Cereb Cortex 10: 263-271, 2000.
26. Hikosaka O, Sakamoto M, and Usui S. Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward. J Neurophysiol 61: 814-832, 1989.
27. Hikosaka O, Takikawa Y, and Kawagoe R. Role of the basal ganglia in the control of purposive saccadic eye movements. Physiol Rev 80: 953-978, 2000.
28. Hollerman JR, Tremblay L, and Schultz W. Influence of reward expectation on behavior-related neuronal activity in primate striatum. J Neurophysiol 80: 947-963, 1998.
29. Hollerman JR, Tremblay L, and Schultz W. Involvement of basal ganglia and orbitofrontal cortex in goal-directed behavior. Prog Brain Res 126: 193-215, 2000.
30. Horwitz GD and Newsome WT. Target selection for saccadic eye movements: prelude activity in the superior colliculus during a direction discrimination task. J Neurophysiol 86: 2543-2558, 2001.
31. Huang CS, Hiraba H, Murray GM, and Sessle BJ. Topographical distribution and functional properties of cortically induced rhythmical jaw movements in the monkey (Macaca fascicularis). J Neurophysiol 61: 635-650, 1989.
32. Ikeda T, Takikawa Y, and Hikosaka O. Visuo-motor and anticipatory activities of monkey superior colliculus neurons are modulated by reward. Soc Neurosci Abstr 27: 59.1, 2001.
33. Jones B and Mishkin M. Limbic lesions and the problem of stimulus-reinforcement associations. Exp Neurol 36: 362-377, 1972.
34. Kalivas PW and Nakamura M. Neural systems for behavioral activation and reward. Curr Opin Neurobiol 9: 223-227, 1999.
35. Kawagoe R, Takikawa Y, and Hikosaka O. Expectation of reward modulates cognitive signals in the basal ganglia. Nat Neurosci 1: 411-416, 1998.
36. Kim J-M and Shadlen MN. Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque. Nat Neurosci 12: 176-185, 1999.
37. Kobayashi S, Lauwereyns J, Koizumi M, Sakagami M, and Hikosaka O. Influence of reward expectation on visuospatial processing in macaque lateral prefrontal cortex. J Neurophysiol 87: 1488-1498, 2002.
38. Kurata K and Hoffman DS. Differential effects of muscimol microinjection into dorsal and ventral aspects of the premotor cortex of monkeys. J Neurophysiol 71: 1151-1164, 1994.
39. Lauwereyns J, Takikawa Y, Kawagoe R, Kobayashi S, Koizumi M, Coe B, Sakagami M, and Hikosaka O. Feature-based anticipation of cues that predict reward in monkey caudate nucleus. Neuron 33: 463-473, 2002a.
40. Lauwereyns J, Watanabe K, Coe B, and Hikosaka O. A neural correlate of response bias in monkey caudate nucleus. Nature 418: 413-417, 2002b.
41. Leon MI and Shadlen MN. Effect of expected reward magnitude on the response of neurons in the dorsolateral prefrontal cortex of the macaque. Neuron 24: 415-425, 1999.
42. Liu Z and Richmond BJ. Response differences in monkey TE and perirhinal cortex: stimulus association related to reward schedules. J Neurophysiol 83: 1677-1692, 2000.
43. Ljungberg T, Apicella P, and Schultz W. Responses of monkey midbrain dopamine neurons during delayed alternation performance. Brain Res 567: 337-341, 1991.
44. Ljungberg T, Apicella P, and Schultz W. Responses of monkey dopamine neurons during learning of behavioral reactions. J Neurophysiol 67: 145-163, 1992.
45. Málková L, Gaffan D, and Murray EA. Excitotoxic lesions of the amygdala fail to produce impairment in visual learning for auditory secondary reinforcement but interfere with reinforcer devaluation effects in rhesus monkeys. J Neurosci 17: 6011-6020, 1997.
46. Mirenowicz J and Schultz W. Importance of unpredictability for reward responses in primate dopamine neurons. J Neurophysiol 72: 1024-1027, 1994.
47. Mogenson GJ, Jones DL, and Yim CY. From motivation to action: functional interface between the limbic system and the motor system. Prog Neurobiol 14: 69-97, 1980.
48. Mora F, Rolls ET, and Burton MJ. Modulation during learning of the responses of neurons in the lateral hypothalamus to the sight of food. Exp Neurol 53: 508-519, 1976.
49. Murray EA, Gaffan EA, and Flint RW. Anterior rhinal cortex and amygdala: dissociation of their contributions to memory and food preference in rhesus monkeys. Behav Neurosci 110: 30-42, 1996.
50. Murray GM, Lin LD, Moustafa EM, and Sessle BJ. Effects of reversible inactivation by cooling of the primate face motor cortex on the performance of a trained tongue-protrusion task and a trained biting task. J Neurophysiol 65: 511-530, 1991.
51. Nakamura K, Mikami A, and Kubota K. Activity of single neurons in the monkey amygdala during performance of a visual discrimination task. J Neurophysiol 67: 1447-1463, 1992.
52. Nishijo H, Ono T, and Nishino H. Single neuron responses in amygdala of alert monkey during complex sensory stimulation with affective significance. J Neurosci 8: 3570-3583, 1988a.
53. Nishijo H, Ono T, and Nishino H. Topographic distribution of modality-specific amygdalar neurons in alert monkey. J Neurosci 8: 3556-3569, 1988b.
54. Ono T, Nishijo H, and Nishino H. Functional role of the limbic system and basal ganglia in motivated behaviors. J Neurol 247(Suppl 5): V23-V32, 2000.
55. Papez JW. A proposed mechanism of emotion. Arch Neurol Psychiatry, 38: 725-743, 1937.
56. Platt ML and Glimcher PW. Neural correlates of decision variables in parietal cortex. Nature 400: 233-238, 1999.
57. Robinson DA. A method of measuring eye movement using a scleral search coil in a magnetic field. IEEE Trans Biomed Eng 10: 137-145, 1963.
58. Roitman JD and Shadlen MN. Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task. J Neurosci 22: 9475-9489, 2002.
59. Rolls ET. The orbitofrontal cortex and reward. Cereb Cortex 10: 284-294, 2000.
60. Rolls ET and Baylis LL. Gustatory, olfactory, and visual convergence within the primate orbitofrontal cortex. J Neurosci 14: 5437-5452. 1994.
61. Rolls ET, Burton MJ, and Mora F. Hypothalamic neuronal responses associated with the sight of food. Brain Res 111: 53-66, 1976.
62. Rolls ET, Critchley HD, Mason R, and Wakeman EA. Orbitofrontal cortex neurons: role in olfactory and visual association learning. J Neurophysiol 75: 1970-1981, 1996.
63. Rolls ET, Murzi E, Yaxley S, Thorpe SJ, and Simpson SJ. Sensory-specific satiety: food-specific reduction in responsiveness of ventral forebrain neurons after feeding in the monkey. Brain Res 368: 79-86, 1986.
64. Rolls ET, Sanghera MK, and Roper-Hall A. The latency of activation of neurones in the lateral hypothalamus and substantia innominata during feeding in the monkey. Brain Res 164: 121-135, 1979.
65. Romo R and Schultz W. Dopamine neurons of the monkey midbrain: contingencies of responses to active touch during self-initiated arm movements. J Neurophysiol 63: 592-606, 1990.
66. Sanghera MK, Rolls ET, and Roper-Hall A. Visual responses of neurons in the dorsolateral amygdala of the alert monkey. Exp Neurol 63: 610-626, 1979.
67. Sato M and Hikosaka H. Role of primate substantia nigra pars reticulata in reward-oriented saccadic eye movement. J Neurosci 22: 2363-2373, 2002.
68. Schultz W. Multiple reward signals in the brain. Nat Rev Neurosci 1: 199-207, 2000.
69. Schultz W, Apicella P, and Ljungberg T. Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. J Neurosci 13: 900-913, 1993a.
70. Schultz W, Apicella P, Ljungberg T, Romo R, and Scarnati E. Reward-related activity in the monkey striatum and substantia nigra. Prog Brain Res 99: 227-235, 1993b.
71. Schultz W, Apicella P, Scarnati E, and Ljungberg T. Neuronal activity in monkey ventral striatum related to the expectation of reward. J Neurosci 12: 4595-4610, 1992.
72. Shadlen MN and Newsome WT. Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. J Neurophysiol 86: 1916-1936, 2001.
73. Shidara M, Aigner TG, and Richmond BJ. Neuronal signals in the monkey ventral striatum related to progress through a predictable series of trials. J Neurosci 18: 2613-2625, 1998.
74. Shidara M and Richmond BJ. Anterior cingulate: single neuronal signals related to degree of reward expectancy. Science 296: 1709-1711, 2002.
75. Sommer MA and Tehovnik EJ. Reversible inactivation of macaque frontal eye field. Exp Brain Res 116: 229-249, 1997.
76. Sommer MA and Tehovnik EJ. Reversible inactivation of macaque dorsomedial frontal cortex: effects on saccades and fixation. Exp Brain Res 124: 429-446, 1999.
77. Stellar E. Brain mechanisms in hedonic processes. In: The Physiological Mechanisms of Motivation, edited by Pfaff DW. New York: Springer-Verlag, 1982, p, 377-407.
78. Stellar JR and Stellar E. The Neurobiology of Motivation and Reward. New York: Springer-Verlag, 1985.
79. Stuphorn V, Taylor T, and Schall JD. Performance monitoring by the supplementary eye field. Nature 408: 857-860, 2000.
80. Takikawa Y, Kawagoe R, and Hikosaka O. Reward-dependent spatial selectivity of anticipatory activity in monkey caudate neurons. J Neurophysiol 87: 508-515, 2002a.
81. Takikawa Y, Kawagoe R, Itoh H, Nakahara H, and Hikosaka O. Modulation of saccadic eye movements by predicted reward outcome. Exp Brain Res 142: 284-291, 2002b.
82. Thorpe SJ, Rolls ET, and Maddison S. The orbitofrontal cortex: neuronal activity in the behaving monkey. Exp Brain Res 49: 93-115, 1983.
83. Tremblay L, Hollerman JR, and Schultz W. Modifications of reward expectation-related neuronal activity during learning in primate striatum. J Neurophysiol 80: 964-977, 1998.
84. Tremblay L and Schultz W. Relative reward preference in primate orbitofrontal cortex. Nature 398: 704-708, 1999.
85. Tremblay L and Schultz W. Reward-related neuronal activity during go-nogo task performance in primate orbitofrontal cortex. J Neurophysiol 83: 1864-1876, 2000a.
86. Tremblay L and Schultz W. Modifications of reward expectation-related neuronal activity during learning in primate orbitofrontal cortex. J Neurophysiol 83: 1877-1885, 2000b.
87. Umeno MM and Goldberg ME. Spatial processing in the monkey frontal eye field. II. memory responses. J. Neurophysiol 86: 2344-2352, 2001.
88. Watanabe M. Prefrontal unit activity during associative learning in the monkey. Exp Brain Res 80: 296-309, 1990.
89. Watanabe M. Frontal units of the monkey coding the associative significance of visual and auditory stimuli. Exp Brain Res 89: 233-247, 1992.
90. Watanabe M. Reward expectancy in primate prefrontal neurons. Nature 382: 629-632, 1996.
91. Watanabe M. Cognitive and motivational operations in primate prefrontal neurons. Rev Neurosci 9: 225-241, 1998.
92. Watanabe M, Cromwell HC, Tremblay L, Hollerman JR, Hikosaka K, and Schultz W. Behavioral reactions reflecting differential reward expectations in monkeys. Exp Brain Res 140: 511-518, 2001.
93. Watanabe M, Hikosaka K, Sakagami M, and Shirakawa S. Coding and monitoring of motivational context in the primate prefrontal cortex. J Neurosci 22: 2391-2400, 2002.