Modifications of reward expectation-related neuronal activity during learning in primate striatum

Journal of Neurophysiology

Volumn 80, Issue 2, 1998, Pages 964-977

  Tremblay, Léon ^a,b   Hollerman, Jeffrey R ^a,c   Schultz, Wolfram ^a  

^a UNIVERSITY OF FRIBOURG   (Switzerland)

^b PITIÉ SALPÊTRIÈRE HOSPITAL   (France)

^c ALLEGHENY COLLEGE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARTICLE; CONTROLLED STUDY; CORPUS STRIATUM; EXPECTATION; LEARNING; MACACA; MALE; NONHUMAN; PRIORITY JOURNAL; REINFORCEMENT; REWARD;

EID: 0031841387     PISSN: 00223077     EISSN: None     Source Type: Journal    
DOI: 10.1152/jn.1998.80.2.964     Document Type: Article

References (59)

1. AIZAWA, H., INASE, M., MUSHIAKE, H., SHIMA, K., AND TANJI, J. Reorganization of activity in the supplementary motor area associated with motor learning and functional recovery. Exp. Brain Res. 84: 668-671, 1991.
2. ALEXANDER, G. E. AND CRUTCHER, M. D. Preparation for movement: neural representations of intended direction in three motor areas of the monkey. J. Neurophysiol. 64: 133-150, 1990.
3. AOSAKI, T., TSUBOKAWA, H., ISHIDA, A., WATANABE, K., GRAYBIEL, A. M., AND KIMURA, M. Responses of tonically active neurons in the primate's striatum undergo systematic changes during behavioral sensorimotor conditioning. J. Neurosci. 14: 3969-3984, 1994.
4. APICELLA, P., SCARNATI, E., LJUNGBERG, T., AND SCHULTZ, W. Neuronal activity in monkey striatum related to the expectation of predictable environmental events. J. Neurophysiol. 68: 945-960, 1992.
5. BÄTTIG, K., ROSVOLD, H. E., AND MISHKIN, M. Comparison of the effects of frontal and caudate lesions on delayed response and alternation in monkeys. J. Comp. Physiol. Psychol. 53: 400-404, 1960.
6. BENINGER, R. J. The role of dopamine in locomotor activity and learning. Brain Res. Rev. 6: 173-196, 1983.
7. BOEIJINGA, P. H., MULDER, A. B., PENNARTZ, C.M.A., MANSHANDEN, I., AND LOPES DA SILVA, F. H. Responses of the nucleus accumbens following fornix/fimbria stimulation in the rat. Identification and long-term potentiation of mono- and polysynaptic pathways. Neuroscience 53: 1049-1058, 1993.
8. BROWN, V. J., DESIMONE, R., AND MISHKIN, M. Responses of cells in the caudate nucleus during visual discrimination learning. J. Neurophysiol. 74: 1083-1094, 1995.
9. BUSHNELL, M. C., GOLDBERG, M. E., AND ROBINSON, D. L. Behavioral enhancement of visual responses in monkey cerebral cortex. I. Modulation in posterior parietal cortex related to selective visual attention. J. Neurophysiol. 46: 755-772, 1981.
10. BUTTERS, N., WOLFE, J., MARTONE, M., GRANHOLM, E., AND CERMAK, L. S. Memory disorders associated with Huntington's disease: verbal recall, verbal recognition and procedural memory. Neuropsychologia 23: 729-743, 1985.
11. CAAN, W., PERRETT, D. I., AND ROLLS, E. T. Responses of striatal neurons in the behaving monkey. 2. Visual processing in the caudal neostriatum. Brain Res. 290: 53-65, 1984.
12. CAHUSAC, P.M.B., ROLLS, E. T., MIYASHITA, Y., AND NIKI, H. Modification of hippocampal neurons in the monkey during the learning of a conditional spatial response task. Hippocampus 3: 29-42, 1993.
13. CALABRESI, P., PISANI, A., MERCURI, N. B., AND BERNARDI, G. Long-term potentiation in the striatum is unmasked by removing the voltage-dependent magnesium block of NMDA receptor channels. Eur. J. Neurosci. 4: 929-935, 1992.
14. CANAVAN, A.G.M., PASSINGHAM, R. E., MARSDEN, C. D., QUINN, N., WYKE, M., AND POLKEY, C. E. The performance on learning tasks of patients in the early stages of Parkinson's disease. Neuropsychologia 27: 141-156, 1989.
15. CHEN, L. L. AND WISE, S. P. Neuronal activity in the supplementary eye field during acquisition of conditional oculomotor associations. J. Neurophysiol. 73: 1101-1121, 1995a.
16. CHEN, L. L. AND WISE, S. P. Supplementary eye field contrasted with the frontal eye field during acquisition of conditional oculomotor associations. J. Neurophysiol. 73: 1122-1134, 1995b.
17. CHEN, L. L. AND WISE, S. P. Evolution of directional preferences in the supplementary eye field during acquisition of conditional oculomotor associations. J. Neurosci. 16: 3067-3081, 1996.
18. DEADWYLER, S. A., BUNN, T., AND HAMPSON, R. E. Hippocampal ensemble activity during spatial delayed-nonmatch-to-sample performance in rats. J. Neurosci. 16: 354-372, 1996.
19. DICKINSON, A. Contemporary Animal Learning Theory. Cambridge, UK: Cambridge Univ. Press, 1980.
20. DIVAC, I., ROSVOLD, H. E., AND SZWARCBART, M. K. Behavioral effects of selective ablation of the caudate nucleus. J. Comp. Physiol. Psychol. 63: 184-190, 1967.
21. FIBIGER, H. C. AND PHILLIPS, A. G. Reward, motivation, cognition: psychobiology of mesotelencephalic dopamine systems. In: Handbook of Physiology. The Nervous System. Intrinsic Regulatory Systems of the Brain. Bethesda, MD: Am. Physiol. Soc., 1986, sect. 1, vol. IV, p. 647-675.
22. GAFFAN, D. Memory, action and the corpus striatum: current developments in the memory-habit distinction. Semin. Neurosci. 8: 33-38, 1996.
23. GAFFAN, E. A., GAFFAN, D., AND HARRISON, S. Disconnection of the amygdala from visual association cortex impairs visual reward association learning in monkeys. J. Neurosci. 8: 3144-3150, 1988.
24. GERMAIN, L. AND LAMARRE, Y. Neuronal activity in the motor and premotor cortices before and after learning the associations between auditory stimuli and motor responses. Brain Res. 611: 175-179, 1993.
25. GRAYBIEL, A. M. Building action repertoires: memory and learning functions of the basal ganglia. Curr. Opin. Neurobiol. 5: 733-741, 1995.
26. HARLOW, H. F. The formation of learning sets. Psychol. Rev. 56: 51-65, 1949.
27. HARRINGTON, D. L., HAALAND, K. Y., YEO, R. A., AND MARDER, E. Procedural memory in Parkinson's disease: impaired motor but not visuoperceptual learning. J. Clin. Exp. Neuropsychol. 12: 323-329, 1990.
28. HIKOSAKA, O., RAND, M. K., MIYACHI, S., AND MIYASHITA, K. Learning of sequential movements in the monkey: process of learning and retention of memory. J. Neurophysiol. 74: 1652-1661, 1995.
29. HIKOSAKA, O., SAKAMOTO, M., AND USUI, S. Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward. J. Neurophysiol. 61: 814-832, 1989.
30. HOLLERMAN, J. R., TREMBLAY, L., AND SCHULTZ, W. Influence of reward expectation on behavior-related neuronal activity in primate striatum. J. Neurophysiol. 80: 947-963, 1998.
31. KNOPMAN, D. AND NISSEN, M. J. Procedural learning is impaired in Huntington's disease: evidence from the serial reaction time task. Neuropsychologia 29: 245-254, 1991.
32. KUBOTA, K. AND KOMATSU, H. Neuron activities of monkey prefrontal cortex during the learning of visual discrimination tasks with go/no-go performances. Neurosci. Res. 3: 106-129, 1985.
33. LJUNGBERG, T., APICELLA, P., AND SCHULTZ, W. Responses of monkey dopamine neurons during learning of behavioral reactions. J. Neurophysiol. 67: 145-163, 1992.
34. MIRENOWICZ, J. AND SCHULTZ, W. Importance of unpredictability for reward responses in primate dopamine neurons. J. Neurophysiol. 72: 1024-1027, 1994.
35. MISHKIN, M. AND APPENZELLER, T. The anatomy of memory. Science 256: 80-89, 1987.
36. MITZ, A. R., GODSCHALK, M., AND WISE, S. P. Learning-dependent neuronal activity in the premotor cortex: activity during the acquisition of conditional motor associations. J. Neurosci. 11: 1855-1872, 1991.
37. MOUNTCASTLE, V. B., ANDERSON, R. A., AND MOTTER, B. C. The influence of selective attentive fixation upon the excitability of the light-sensitive neurons of the posterior parietal cortex. J. Neurosci. 1: 1218-1235, 1981.
38. NIKI, H., SUGITA, S., AND WATANABE, M. Modification of the activity of primate frontal neurons during learning of a go/no-go discrimination and its reversal. In: Vision, Memory and the Temporal Lobe, edited by E. Iwai and M. Mishkin. New York: Elsevier, 1990, p. 295-304.
39. PACKARD, M. G., HIRSH, R., AND WHITE, N. M. Differential effects of fornix and caudate lesions on two radial arm maze tasks: evidence for multiple memory systems. J. Neurosci. 9: 1465-1472, 1989.
40. PENNARTZ, C.M.A., AMEERUN, R. F., GROENEWEGEN, H. J., AND LOPES DA SILVA, F. H. Synaptic plasticity in an in vitro slice preparation of the rat nucleus accumbens. Eur. J. Neurosci. 5: 107-117, 1993.
41. PHILLIPS, A. G. AND CARR, G. D. Cognition and basal ganglia: a possible substrate for procedural knowledge. Can. J. Neurol. Sci. 14: 381-385, 1987.
42. RESCORLA, R. A. AND WAGNER, A. R. A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. In: Classical Conditioning. II. Current Research and Theory, edited by A. H. Black and W. F. Prokasy. New York: Appleton Century Crofts, 1972, p. 64-99.
43. ROBBINS, T. W. AND EVHRITT, B. J. Functions of dopamine in the dorsal and ventral striatum. Semin. Neurosci. 4: 119-128, 1992.
44. ROLLS, E. T., CRITCHLEY, H. D., MASON, R., AND WAKEMAN, E. A. Orbitofrontal cortex neurons: role in olfactory and visual association learning. J. Neurophysiol. 75: 1970-1981, 1996.
45. SAINT-CYR, J. A., TAYLOR, A. E., AND LANG, A. E. Procedural learning and neostriatal function in man. Brain 111: 941-959, 1988.
46. SAKATA, H., SHIBUTANI, H., AND KAWANO, K. Functional properties of visual tracking neurons in posterior parietal association cortex of the monkey. J. Neurophysiol. 49: 1364-1380, 1983.
47. SCHULTZ, W., APICELLA, P., AND LJUNGBERG, T. Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. J. Neurosci. 13: 900-913, 1993.
48. SCHULTZ, W., APICELLA, P., SCARNATI, E., AND LJUNGBERG, T. Neuronal activity in monkey ventral striatum related to the expectation of reward. J. Neurosci. 12: 4595-4610, 1992.
49. SCHULTZ, W., DAYAN, P., AND MONTAGUE, R. R. A neural substrate of prediction and reward. Science 275: 1593-1599, 1997.
50. SEITZ, R. J. AND ROLAND, P. Learning of sequential finger movements in man: a combined kinematic and positron emission tomography (PET) study. Eur. J. Neurosci. 4: 154-165, 1992.
51. THORPE, S. J., ROLLS, E. T., AND MADDISON, S. The orbitofrontal cortex: neuronal activity in the behaving monkey. Exp. Brain Res. 49: 93-115, 1983.
52. TREMBLAY, L., HOLLERMAN, J. R., AND SCHULTZ, W. Neuronal activity in primate striatum neurons during learning. Soc. Neurosci. Abstr. 20: 780, 1994.
53. TREMBLAY, L. AND SCHULTZ, W. Neuronal activity in primate orbitofrontal cortex during learning. Soc. Neurosci. Abstr. 22: 1388, 1996.
54. VRIEZEN, E. R. AND MOSCOVITCH, M. Memory for temporal order and conditional associative-learning in patients with Parkinson's disease. Neuropsychologia 28: 1283-1293, 1990.
55. WATANABE, M. Prefrontal unit activity during associative learning in the monkey. Exp. Brain Res. 80: 296-309, 1990.
56. WHISHAW, I. Q., MITTLEMAN, G., BUNCH, S. T., AND DUNNETT, S. B. Impairments in the acquisition, retention and selection of spatial navigation strategies after medial caudate-putamen lesions in rats. Behav. Brain Res. 24: 125-138, 1987.
57. WICKENS, J. R., BEGG, A. J., AND ARBUTHNOTT, G. W. Dopamine reverses the depression of rat corticostriatal synapses which normally follows high-frequency stimulation of cortex in vitro. Neuroscience 70: 1-5, 1996.
58. WISE, R. A. Neuroleptics and operant behavior: the anhedonia hypothesis. Behav. Brain Sci. 5: 39-87, 1982.
59. WISE, S. P. The role of the basal ganglia in procedural memory. Semin. Neurosci. 8: 39-46, 1996.