Reward prediction in primate basal ganglia and frontal cortex

Neuropharmacology

Volumn 37, Issue 4-5, 1998, Pages 421-429

  Schultz, Wolfram ^a   Tremblay, Léon ^a   Hollerman, Jeffrey R ^a  

^a UNIVERSITY OF FRIBOURG   (Switzerland)

Author keywords

Caudate nucleus; Dopamine; Expectation; Learning; Orbitofrontal cortex; Primate; Putamen; Striatum; Ventral striatum

Indexed keywords

ANIMAL EXPERIMENT; BASAL GANGLION; BEHAVIOR; CONFERENCE PAPER; CORPUS STRIATUM; DOPAMINERGIC NERVE CELL; EXPECTATION; FOOD INTAKE; HUMAN; LEARNING; ORBITAL CORTEX; PRIMATE; PRIORITY JOURNAL; REWARD;

ANIMALS; BASAL GANGLIA; CEREBRAL CORTEX; DISCRIMINATION LEARNING; FRONTAL LOBE; HUMANS; PRIMATES; REWARD;

EID: 0031748491     PISSN: 00283908     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0028-3908(98)00071-9     Document Type: Conference Paper

References (30)

1. Apicella P., Scarnati E., Ljungberg T., Schultz W. Neuronal activity in monkey striatum related to the expectation of predictable environmental events. J. Neurophysiol. 68:1992;945-960.
2. Dickinson, A., 1980. Contemporary animal learning theory. Cambridge University Press, Cambridge.
3. Dickinson A., Balleine B. Motivational control of goal-directed action. Anim. Learn. Behav. 22:1994;1-18.
4. Fibiger H.C., Phillips A.G. Reward, motivation, cognition: psychobiology of mesotelencephalic dopamine systems. Bloom F.E. Handbook of Physiology - The Nervous System IV. 1986;647-675 Williams and Wilkins, Baltimore, MD.
5. Funahashi S., Chafee M.V., Goldman-Rakic P.S. Prefrontal neuronal activity in rhesus monkeys performing a delayed anti-saccade task. Nature. 365:1993;753-756.
6. Fuster J.M. Unit activity of prefrontal cortex during delayed-response performance: neuronal correlates of transient memory. J. Neurophysiol. 36:1973;61-78.
7. Hikosaka O., Sakamoto M., Usui S. Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward. J. Neurophysiol. 61:1989;814-832.
8. Hollerman J.R., Tremblay L., Schultz W. Reward dependency of several types of neuronal activity in primate striatum. Soc. Neurosci. Abstr. 20:1994;780.
9. Hollerman J.R., Schultz W. Activity of dopamine neurons during learning in a familiar task context. Soc. Neurosci. Abstr. 22:1996;1388.
10. Horvitz J.C., Stewart T., Jacobs B.L. Burst activity of ventral tegmental dopamine neurons is elicited by sensory stimuli in the awake cat. Brain Res. 759:1997;251-258.
11. Kubota K., Iwamoto T., Suzuki H. Visuokinetic activities of primate prefrontal neurons during delayed-response performance. J. Neurophysiol. 37:1974;1197-1212.
12. Ljungberg T., Apicella P., Schultz W. Responses of monkey dopamine neurons during learning of behavioral reactions. J. Neurophysiol. 67:1992;145-163.
13. Miller E.K., Erickson C.A., Desimone R. Neural mechanisms of visual working memory in prefrontal cortex of the monkey. J. Neurosci. 16:1996;5154-5167.
14. Mirenowicz J., Schultz W. Importance of unpredictability for reward responses in primate dopamine neurons. J. Neurophysiol. 72:1994;1024-1027.
15. Mirenowicz J., Schultz W. Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature. 379:1996;449-451.
16. Rescorla R.A., Wagner A.R. A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. Black A.H., Prokasy W.F. Classical Conditioning II: Current Research and Theory. 1972;64-99 Appleton Century Crofts, New York.
17. Robbins T.W., Everitt B.J. Neurobehavioural mechanisms of reward and motivation. Cur. Op. Neurobiol. 6:1996;228-236.
18. Rolls E.T., Critchley H.D., Mason R., Wakeman E.A. Orbitofrontal cortex neurons: role in olfactory and visual association learning. J. Neurophysiol. 75:1996;1970-1981.
19. Romo R., Schultz W. Somatosensory input to dopamine neurons of the monkey midbrain: responses to pain pinch under anesthesia and to active touch in behavioral context. Progr. Brain Res. 80:1989;473-478.
20. Romo R., Schultz W. Dopamine neurons of the monkey midbrain: contingencies of responses to active touch during self-initiated arm movements. J. Neurophysiol. 63:1990;592-606.
21. Schultz W., Apicella P., Scarnati E., Ljungberg T. Neuronal activity in monkey ventral striatum related to the expectation of reward. J. Neurosci. 12:1992;4595-4610.
22. Schultz W., Apicella P., Ljungberg T. Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. J. Neurosci. 13:1993;900-913.
23. Schultz W., Apicella P., Romo R., Scarnati E. Context-dependent activity in primate striatum reflecting past and future behavioral events. Houk J.C., Davis J.L., Beiser D.G. Models of Information Processing in the Basal Ganglia. 1995;11-28 MIT Press, Cambridge, MA.
24. Schultz W., Dayan P., Montague R.R. A neural substrate of prediction and reward. Science. 275:1997;1593-1599.
25. Steinfels G.F., Heym J., Strecker R.E., Jacobs B.L. Behavioral correlates of dopaminergic unit activity in freely moving cats. Brain Res. 258:1983;217-228.
26. Thorpe S.J., Rolls E.T., Maddison S. The orbitofrontal cortex: neuronal activity in the behaving monkey. Exp. Brain Res. 49:1983;93-115.
27. Tremblay L., Hollerman J.R., Schultz W. Neuronal activity in primate striatum neurons during learning. Soc. Neurosci. Abstr. 20:1994;780.
28. Tremblay L., Schultz W. Processing of reward-related information in primate orbitofrontal neurons. Soc. Neurosci. Abstr. 21:1995;952.
29. Watanabe M. Reward expectany in primate prefrontal neurons. Nature. 382:1996;629-632.
30. Wilson F.A.W., O'Scalaidhe S.P., Goldman-Rakic P.S. Dissociation of object and spatial processing domains in primate prefrontal cortex. Science. 260:1993;1955-1958.