Changes in behavior-related neuronal activity in the striatum during learning

Trends in Neurosciences

Volumn 26, Issue 6, 2003, Pages 321-328

  Schultz, Wolfram ^a   Tremblay, Léon ^a   Hollerman, Jeffrey R ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

BASAL GANGLION; BEHAVIOR; CELL ACTIVITY; CORPUS STRIATUM; ENVIRONMENT; FRONTAL CORTEX; LEARNING; MEMORY; MOTOR ACTIVITY; NERVE CELL; NONHUMAN; PRIORITY JOURNAL; REVIEW; STIMULUS RESPONSE;

EID: 0038547871     PISSN: 01662236     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0166-2236(03)00122-X     Document Type: Review

References (65)

1. Reynolds J.N.J., et al. A cellular mechanism of reward-related learning. Nature. 413:2001;67-70.
2. Wise S.P. The role of the basal ganglia in procedural memory. Semin. Neurosci. 8:1996;39-46.
3. Hikosaka O., et al. Parallel neural networks for learning sequential procedures. Trends Neurosci. 22:1999;464-471.
4. Malamut B.L., et al. Monkeys with combined amygdalo-hippocampal lesions succeed in object discrimination learning despite 24-hour intervals. Behav. Neurosci. 98:1984;759-769.
5. Packard M.G., Knowlton B.J. Learning and memory functions of the basal ganglia. Annu. Rev. Neurosci. 25:2002;563-593.
6. Gaffan D., Eacott M.J. Visual learning for an auditory secondary reinforcer by macaques is intact after uncinate fascicle section: indirect evidence for the involvement of the corpus striatum. Eur. J. Neurosci. 7:1995;1866-1871.
7. Linden A., et al. Slow cortical potentials in Parkinsonian patients during the course of an associative learning task. J. Psychophys. 4:1990;145-162.
8. Rescorla R.A., Wagner A.R. Black A.H., Prokasy W.F. Classical Conditioning II: Current Research and Theory. 1972;64-99 Appleton Century Crofts, NY, USA.
9. Pearce J.M., Hall G. A model for Pavlovian conditioning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychol. Rev. 87:1980;532-552.
10. Funahashi S., et al. Visuospatial coding in primate prefrontal neurons revealed by oculomotor paradigms. J. Neurophysiol. 63:1990;814-831.
11. Wilson F.A.W., et al. Dissociation of object and spatial processing domains in primate prefrontal cortex. Science. 260:1993;1955-1958.
12. Rao S.C., et al. Integration of what and where in the primate prefrontal cortex. Science. 276:1997;821-824.
13. Tremblay L., Schultz W. Relative reward preference in primate orbitofrontal cortex. Nature. 398:1999;704-708.
14. Hassani O.K., et al. Influence of expectation of different rewards on behavior-related neuronal activity in the striatum. J. Neurophysiol. 85:2001;2477-2489.
15. Jog M.S., et al. Building neural representations of habits. Science. 286:1999;1745-1749.
16. Aosaki T., et al. Responses of tonically active neurons in the primate's striatum undergo systematic changes during behavioral sensorimotor conditioning. J. Neurosci. 14:1994;3969-3984.
17. Aosaki T., et al. Effect of the nigrostriatal dopamine system on acquired neural responses in the striatum of behaving monkeys. Science. 265:1994;412-415.
18. Tremblay L., et al. Modifications of reward expectation-related neuronal activity during learning in primate striatum. J. Neurophysiol. 80:1998;964-977.
19. Mitz A.R., et al. Learning-dependent neuronal activity in the premotor cortex: activity during the acquisition of conditional motor associations. J. Neurosci. 11:1991;1855-1872.
20. Chen L.L., Wise S.P. Neuronal activity in the supplementary eye field during acquisition of conditional oculomotor associations. J. Neurophysiol. 73:1995;1101-1121.
21. Tremblay L., Schultz W. Modifications of reward expectation-related neuronal activity during learning in primate orbitofrontal cortex. J. Neurophysiol. 83:2000;1877-1885.
22. Brown V.J., et al. Responses of cells in the caudate nucleus during visual discrimination learning. J. Neurophysiol. 74:1995;1083-1094.
23. Kubota K., Komatsu H. Neuron activities of monkey prefrontal cortex during the learning of visual discrimination tasks with go/no-go performances. Neurosci. Res. 3:1985;106-129.
24. Germain L., Lamarre Y. Neuronal activity in the motor and premotor cortices before and after learning the associations between auditory stimuli and motor responses. Brain Res. 611:1993;175-179.
25. Schoenbaum G., et al. Neural encoding in orbitofrontal cortex and basolateral amygdala during olfactory discrimination learning. J. Neurosci. 19:1999;1876-1884.
26. Niki H., et al. Iwai E., Mishkin M. Vision, Memory and the Temporal Lobe. 1990;295-304 Elsevier.
27. Chen L.L., Wise S.P. Supplementary eye field contrasted with the frontal eye field during acquisition of conditional oculomotor associations. J. Neurophysiol. 73:1995;1122-1134.
28. Watanabe M. Prefrontal unit activity during associative learning in the monkey. Exp. Brain Res. 80:1990;296-309.
29. Rolls E.T., et al. Orbitofrontal cortex neurons: role in olfactory and visual association learning. J. Neurophysiol. 75:1996;1970-1981.
30. Honig W., Thompson R.K.R. Bower G.H. The Psychology of Learning and Motivation: Advances in Research and Theory. 1982;239-283 Academic Press.
31. Hikosaka O., et al. Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward. J. Neurophysiol. 61:1989;814-832.
32. Alexander G.E., Crutcher M.D. Neural representations of the target (goal) of visually guided arm movements in three motor areas of the monkey. J. Neurophysiol. 64:1990;164-178.
33. Apicella P., et al. Neuronal activity in monkey striatum related to the expectation of predictable environmental events. J. Neurophysiol. 68:1992;945-960.
34. Watanabe M. Reward expectancy in primate prefrontal neurons. Nature. 382:1996;629-632.
35. Hollerman J.R., et al. Influence of reward expectation on behavior-related neuronal activity in primate striatum. J. Neurophysiol. 80:1998;947-963.
36. Rainer G., et al. Prospective coding for objects in primate prefrontal cortex. J. Neurosci. 19:1999;5493-5505.
37. Lauwereyns J., et al. Feature-based anticipation of cues that predict reward in monkey caudate nucleus. Neuron. 33:2002;463-473.
38. Chen L.L., Wise S.P. Evolution of directional preferences in the supplementary eye field during acquisition of conditional oculomotor associations. J. Neurosci. 16:1996;3067-3081.
39. Chen L.L., Wise S.P. Conditional oculomotor learning: population vectors in the supplementary eye field. J. Neurophysiol. 78:1997;1166-1169.
40. Assad W.F., et al. Neural activity in the primate prefrontal cortex during associative learning. Neuron. 21:1998;1399-1407.
41. Miyachi S., et al. Differential activation of monkey striatal neurons in the early and late stages of procedural learning. Exp. Brain Res. 146:2002;122-126.
42. Nakamura K., et al. Neuronal activity in medial frontal cortex during learning of sequential procedures. J. Neurophysiol. 80:1998;2671-2687.
43. Aizawa H., et al. Reorganization of activity in the supplementary motor area associated with motor learning and functional recovery. Exp. Brain Res. 84:1991;668-671.
44. Rainer G., Miller E.K. Effects of visual experience on the representation of objects in the prefrontal cortex. Neuron. 27:2000;179-189.
45. Apicella P., et al. Responses of tonically discharging neurons in the monkey striatum to primary rewards delivered during different behavioral states. Exp. Brain Res. 116:1997;456-466.
46. Kimura M., et al. Physiological properties of projection neurons in the monkey striatum to the globus pallidus. Exp. Brain Res. 82:1990;672-676.
47. Niki H., Watanabe M. Prefrontal and cingulate unit activity during timing behavior in the monkey. Brain Res. 171:1979;213-224.
48. Rosenkilde C.E., et al. Single cell activity in ventral prefrontal cortex of behaving monkeys. Brain Res. 209:1981;375-394.
49. Thorpe S.J., et al. The orbitofrontal cortex: neuronal activity in the behaving monkey. Exp. Brain Res. 49:1983;93-115.
50. Tremblay L., Schultz W. Reward-related neuronal activity during go-nogo task performance in primate orbitofrontal cortex. J. Neurophysiol. 83:2000;1864-1876.
51. Schall J.D., et al. Monitoring and control of action by the frontal lobes. Neuron. 36:2002;309-322.
52. Watanabe M. The appropriateness of behavioral responses coded in post-trial activity of primate prefrontal units. Neurosci. Lett. 101:1989;113-117.
53. Flament D., et al. Distance- and error-related discharge of cells in premotor cortex of rhesus monkeys. Neurosci. Lett. 153:1993;144-148.
54. Stuphorn V., et al. Performance monitoring by the supplementary eye field. Nature. 408:2000;857-860,234.
55. Schultz W., Dickinson A. Neuronal coding of prediction errors. Annu. Rev. Neurosci. 23:2000;473-500.
56. Williams S.M., Goldman-Rakic P.S. Modulation of memory fields by dopamine D1 receptors in prefrontal cortex. Nature. 376:1995;572-575.
57. Inase M., et al. Dopaminergic modulation of neuronal activity in the monkey putamen through D1 and D2 receptors during a delayed go/nogo task. Exp. Brain Res. 117:1997;207-218.
58. Suri R., Schultz W. Temporal difference model reproduces anticipatory neural activity. Neural Comput. 13:2001;841-862.
59. Dreher J.-C., et al. A model of prefrontal cortex dopaminergic modulation during the delayed alternation task. J. Cogn. Neurosci. 14:2002;853-865.
60. Schultz W., Romo R. Role of primate basal ganglia and frontal cortex in the internal generation of movements: I. Preparatory activity in the anterior striatum. Exp. Brain Res. 91:1992;363-384.
61. Calabresi P., et al. Coactivation of D1 and D2 dopamine receptors is required for long-term synaptic depression in the striatum. Neurosci. Lett. 142:1992;95-99.
62. Reynolds J.N.J., et al. A cellular mechanism of reward-related learning. Nature. 413:2001;67-70.
63. Gurden H., et al. Essential role of D1 but not D2 receptors in the NMDA receptor-dependent long-term potentiation at hippocampal-prefrontal cortex synapses in vivo. J. Neurosci. 106:2000;1-5.
64. Bao S., et al. Cortical remodelling induced by activity of ventral tegmental dopamine neurons. Nature. 412:2001;79-83.
65. Kerr J.N., Wickens J.R. Dopamine D1/D5 receptor activation is required for long-term potentiation in the rat neostriatum in vitro. J. Neurophysiol. 85:2001;117-124.