Modifications of reward expectation-related neuronal activity during learning in primate orbitofrontal cortex

Journal of Neurophysiology

Volumn 83, Issue 4, 2000, Pages 1877-1885

  Tremblay, Léon ^a,b   Schultz, Wolfram ^a  

^a UNIVERSITY OF FRIBOURG   (Switzerland)

^b INSERM   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARTICLE; BODY MOVEMENT; CONTROLLED STUDY; EXPECTATION; FEMALE; LEARNING; MACACA; MALE; NERVE CELL; NONHUMAN; ORBITAL CORTEX; PRIMATE; PRIORITY JOURNAL; REINFORCEMENT; REWARD;

EID: 0034117036     PISSN: 00223077     EISSN: None     Source Type: Journal    
DOI: 10.1152/jn.2000.83.4.1877     Document Type: Article

References (42)

1. ALEXANDER, G. E. AND CRUTCHER, M. D. Preparation for movement: neural representations of intended direction in three motor areas of the monkey. J. Neurophysiol. 64: 133-150, 1990.
2. APICELLA, P., SCARNATI, E., LJUNGBERG, T., AND SCHULTZ, W. Neuronal activity in monkey striatum related to the expectation of predictable environmental events. J. Neurophysiol. 68: 945-960, 1992.
3. BECHARA, A., DAMASIO, H., TRANEL, D., AND ANDERSON, S. W. Dissociation of working memory from decision making within the human prefrontal cortex. J. Neurosci. 18: 428-437, 1998.
4. BROWN, V. J., DESIMONE, R., AND MISHKIN, M. Responses of cells in the caudate nucleus during visual discrimination learning. J. Neurophysiol. 74: 1083-1094, 1995.
5. BUSHNELL, M. C., GOLDBERG, M. E., AND ROBINSON, D. L. Behavioral enhancement of visual responses in monkey cerebral cortex. I. Modulation in posterior parietal cortex related to selective visual attention. J. Neurophysiol. 46: 755-772, 1981.
6. CAHUSAC, P.M.B., ROLLS, E. T., MIYASHITA, Y., AND NIKI, H. Modification of hippocampal neurons in the monkey during the learning of a conditional spatial response task. Hippocampus 3: 29-42, 1993.
7. CHEN, L. L. AND WISE, S. P. Neuronal activity in the supplementary eye field during acquisition of conditional oculomotor associations. J. Neurophysiol. 73: 1101-1121, 1995a.
8. CHEN, L. L. AND WISE, S. P. Supplementary eye field contrasted with the frontal eye field during acquisition of conditional oculomotor associations. J. Neurophysiol. 73: 1122-1134, 1995b.
9. CHEN, L. L. AND WISE, S. P. Evolution of directional preferences in the supplementary eye field during acquisition of conditional oculomotor associations. J. Neurosci. 16: 3067-3081, 1996.
10. DAMASIO, A. R. Descartes' Error. New York: Putnam, 1994.
11. DIAS, R., ROBBINS, T. W., AND ROBERTS, A. C. Dissociation in prefrontal cortex of affective and attentional shifts. Nature 380: 69-72, 1996.
12. DICKINSON, A. AND BALLEINE, B. Motivational control of goal-directed action. Anim. Learn. Behav. 22: 1-18, 1994.
13. EBLEN, F. AND GRAYBIEL, A. M. Highly restricted origin of prefrontal cortical inputs to striosomes in the macaque monkey. J. Neurosci. 15: 5999-6013, 1995.
14. FUSTER, J. M. The Prefrontal Cortex. New York: Raven, 1989.
15. GAFFAN, E. A., GAFFAN, D., AND HARRISON, S. Disconnection of the amygdala from visual association cortex impairs visual reward association learning in monkeys. J. Neurosci. 8: 3144-3150, 1988.
16. HABER, S., KUNISHIO, K., MIZOBUCHI, M., AND LYND-BALTA, E. The orbital and medial prefrontal circuit through the primate basal ganglia. J. Neurosci. 15: 4851-4867, 1995.
17. HARLOW, H. F. The formation of learning sets. Psychol. Rev. 56: 51-65, 1949.
18. HIKOSAKA, O., SAKAMOTO, M., AND USUI, S. Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward. J. Neurophysiol. 61: 814-832, 1989.
19. HOLLERMAN, J. R., TREMBLAY, L., AND SCHULTZ, W. Influence of reward expectation on behavior-related neuronal activity in primate striatum. J. Neurophysiol. 80: 947-963, 1998.
20. IVERSEN, S. D. AND MISHKIN, M. Perseverative interference in monkeys following selective lesions of the inferior prefrontal convexity. Exp. Brain Res. 11: 376-386, 1970.
21. JACOBSEN, C. F. AND NISSEN, H. W. Studies of cerebral function in primates. IV. The effects of frontal lobe lesions on the delayed alternation habit in monkeys. J. Comp. Physiol. Psychol. 23: 101-112, 1937.
22. MITZ, A. R., GODSCHALK, M., AND WISE, S. P. Learning-dependent neuronal activity in the premotor cortex: activity during the acquisition of conditional motor associations. J. Neurosci. 11: 1855-1872, 1991.
23. MOUNTCASTLE, V. B., ANDERSON, R. A., AND MOTTER, B. C. The influence of selective attentive fixation upon the excitability of the light-sensitive neurons of the posterior parietal cortex. J. Neurosci. 1: 1218-1235, 1981.
24. NAKAMURA, K., SAKAI, K., AND HIKOSAKA, O. Neuronal activity in medial frontal cortex during learning of sequential procedures. J. Neurophysiol. 80: 2671-2687, 1998.
25. NIKI, H., SUGITA, S., AND WATANABE, M. Modification of the activity of primate frontal neurons during learning of a go/no-go discrimination and its reversal. In: Vision, Memory and the Temporal Lobe, edited by E. Iwai and M. Mishkin. New York: Elsevier, 1990, p. 295-304.
26. OTANI, S., BLOND, O., DESCE, J. M., AND CREPEL, F. Dopamine facilitates long-term depression of glutamatergic transmisssion in rat prefrontal cortex. Neuroscience 85: 669-676, 1998.
27. PASSINGHAM, R. E. The Frontal Lobes and Voluntary Action. Oxford, UK: Oxford Univ. Press, 1993.
28. RESCORLA, R. A. AND WAGNER, A. R. A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. In: Classical Conditioning II: Current Research and Theory, edited by A. H. Black and W. F. Prokasy. New York: Appleton Century Crofts, 1972, p. 64-99.
29. ROBERTS, A. C., ROBBINS, T. W., AND WEISKRANTZ, L. The Prefrontal Cortex. Executive and Cognitive Functions. Oxford, UK: Oxford Univ. Press, 1998.
30. ROLLS, E. T. The orbitofrontal cortex. Philos. Trans. Roy. Soc. B Biol. Sci. 351: 1433-1444, 1996.
31. ROLLS, E. T., CRITCHLEY, H. D., MASON, R., AND WAKEMAN, E. A. Orbitofrontal cortex neurons: role in olfactory and visual association learning. J. Neurophysiol. 75: 1970-1981, 1996.
32. SAKATA, H., SHIBUTANI, H., AND KAWANO, K. Functional properties of visual tracking neurons in posterior parietal association cortex of the monkey. J. Neurophysiol. 49: 1364-1380, 1983.
33. SCHOENBAUM, G., CHIBA, A. A., AND GALLAGHER, M. Orbitofrontal cortex and basolateral amygdala encode expected outcome during learning. Nat. Neurosci. 1: 155-159, 1998.
34. SCHULTZ, W. Predictive reward signal of dopamine neurons. J. Neurophysiol. 80: 1-27, 1998.
35. SCHULTZ, W., APICELLA, P., ROMO, R., AND SCARNATI, E. Context-dependent activity in primate striatum reflecting past and future behavioral events. In: Models of Information Processing in the Basal Ganglia, edited by J. C. Houk, J. L. Davis, and D. G. Beiser. Cambridge: MIT Press, 1995, p. 11-28.
36. SELEMON, L. D. AND GOLDMAN-RAKIC, P. S. Longitudinal topography and interdigitation of corticostriatal projections in the rhesus monkey. J. Neurosci. 5: 776-794, 1985.
37. THORPE, S. J., ROLLS, E. T., AND MADDISON, S. The orbitofrontal cortex: neuronal activity in the behaving monkey. Exp. Brain Res. 49: 93-115, 1983.
38. TREMBLAY, L., HOLLERMAN, J. R., AND SCHULTZ, W. Modifications of reward expectation-related neuronal activity during learning in primate striatum. J. Neurophysiol. 80: 964-977, 1998.
39. TREMBLAY, L. AND SCHULTZ, W. Neuronal activity in primate orbitofrontal cortex during learning. Soc. Neurosci. Abstr. 22: 1388, 1996.
40. TREMBLAY, L. AND SCHULTZ, W. Reward-related neuronal activity during go-nogo task performance in primate orbitofrontal cortex. J. Neurophysiol. 83: 1864-1876, 2000.
41. TREUE, S. AND MAUNSELL, J.H.R. Attentional modulation of visual motion processing in cortical areas MT and MST. Nature 382: 539-541, 1996.
42. WATANABE, M. Prefrontal unit activity during associative learning in the monkey. Exp. Brain Res. 80: 296-309, 1990.