Stimulus-response and response-outcome learning mechanisms in the striatum

Behavioural Brain Research

Volumn 199, Issue 1, 2009, Pages 129-140

  Horvitz, Jon C ^a  

^a CITY COLLEGE OF NEW YORK   (United States)

Author keywords

Cortex; Corticostriatal; Dopamine; LTP; Orbitofrontal; Plasticity; Reward; Striatal

Indexed keywords

DOPAMINE;

BEHAVIOR; BRAIN REGION; CELL ACTIVITY; CORPUS STRIATUM; DOPAMINE RELEASE; DOPAMINERGIC TRANSMISSION; INSTRUMENTAL CONDITIONING; LEARNING; MESENCEPHALON; MOTOR PERFORMANCE; NERVE CELL; NERVE CELL PLASTICITY; NERVE POTENTIAL; NERVOUS SYSTEM ELECTROPHYSIOLOGY; NONHUMAN; ORBITAL CORTEX; OUTCOME ASSESSMENT; PREFRONTAL CORTEX; PRIORITY JOURNAL; PUTAMEN; REVIEW; REWARD; SENSORIMOTOR CORTEX; SENSORY NERVE; SENSORY STIMULATION; SOMATOSENSORY SYSTEM; STIMULUS RESPONSE; SYNAPSE;

ANIMALS; CEREBRAL CORTEX; CORPUS STRIATUM; DOPAMINE; HUMANS; LEARNING; NEURAL PATHWAYS; NEURONS; REWARD; SYNAPSES;

EID: 61349149920     PISSN: 01664328     EISSN: 18727549     Source Type: Journal    
DOI: 10.1016/j.bbr.2008.12.014     Document Type: Review

References (167)

1. Akkal D., Dum R.P., and Strick P.L. Supplementary motor area and presupplementary motor area: targets of basal ganglia and cerebellar output. J Neurosci 27 40 (2007) 10659-10673
2. Akopian G., Musleh W., Smith R., and Walsh J.P. Functional state of corticostriatal synapses determines their expression of short- and long-term plasticity. Synapse 38 3 (2000) 271-280
3. Albin R.L., Young A.B., and Penney J.B. The functional anatomy of basal ganglia disorders. Trends Neurosci 12 10 (1989) 366-375
4. Alexander G.E. Selective neuronal discharge in monkey putamen reflects intended direction of planned limb movements. Exp Brain Res 67 3 (1987) 623-634
5. Alexander G.E. Basal ganglia-thalamocortical circuits: their role in control of movements. J Clin Neurophysiol 11 4 (1994) 420-431
6. Alexander G.E., and Crutcher M.D. Functional architecture of basal ganglia circuits: neural substrates of parallel processing. Trends Neurosci 13 7 (1990) 266-271
7. Alexander G.E., and Crutcher M.D. Neural representations of the target (goal) of visually guided arm movements in three motor areas of the monkey. J Neurophysiol 64 1 (1990) 164-178
8. Alexander G.E., and Crutcher M.D. Preparation for movement: neural representations of intended direction in three motor areas of the monkey. J Neurophysiol 64 1 (1990) 133-150
9. Alexander G.E., and DeLong M.R. Microstimulation of the primate neostriatum. II. Somatotopic organization of striatal microexcitable zones and their relation to neuronal response properties. J Neurophysiol 53 6 (1985) 1417-1430
10. Alexander G.E., DeLong M.R., and Strick P.L. Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu Rev Neurosci 9 (1986) 357-381
11. Amemori K., and Sawaguchi T. Contrasting effects of reward expectation on sensory and motor memories in primate prefrontal neurons. Cereb Cortex 16 7 (2006) 1002-1015
12. Aosaki T., Graybiel A.M., and Kimura M. Effect of the nigrostriatal dopamine system on acquired neural responses in the striatum of behaving monkeys. Science 265 5170 (1994) 412-415
13. Aosaki T., Kimura M., and Graybiel A.M. Temporal and spatial characteristics of tonically active neurons of the primate's striatum. J Neurophysiol 73 3 (1995) 1234-1252
14. Apicella P., Scarnati E., Ljungberg T., and Schultz W. Neuronal activity in monkey striatum related to the expectation of predictable environmental events. J Neurophysiol 68 3 (1992) 945-960
15. Ashby F.G., Ell S.W., Valentin V.V., and Casale M.B. FROST: a distributed neurocomputational model of working memory maintenance. J Cogn Neurosci 17 11 (2005) 1728-1743
16. Balleine B.W., and Dickinson A. Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37 4-5 (1998) 407-419
17. Balleine B.W., Killcross A.S., and Dickinson A. The effect of lesions of the basolateral amygdala on instrumental conditioning. J Neurosci 23 2 (2003) 666-675
18. Barnes T.D., Kubota Y., Hu D., Jin D.Z., and Graybiel A.M. Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories. Nature 437 7062 (2005) 1158-1161
19. Bauswein E., Fromm C., and Preuss A. Corticostriatal cells in comparison with pyramidal tract neurons: contrasting properties in the behaving monkey. Brain Res 493 1 (1989) 198-203
20. Beckstead R.M., Domesick V.B., and Nauta W.J. Efferent connections of the substantia nigra and ventral tegmental area in the rat. Brain Res 175 2 (1979) 191-217
21. Beninger R.J. The role of dopamine in locomotor activity and learning. Brain Res 287 2 (1983) 173-196
22. Beninger R.J., and Miller R. Dopamine D1-like receptors and reward-related incentive learning. Neurosci Biobehav Rev 22 2 (1998) 335-345
23. Berridge K.C. Food reward: brain substrates of wanting and liking. Neurosci Biobehav Rev 20 1 (1996) 1-25
24. Brotchie P., Iansek R., and Horne M.K. Motor function of the monkey globus pallidus. 2. Cognitive aspects of movement and phasic neuronal activity. Brain 114 Pt 4 (1991) 1685-1702
25. Brown L.L., and Sharp F.R. Metabolic mapping of rat striatum: somatotopic organization of sensorimotor activity. Brain Res 686 2 (1995) 207-222
26. Brunel N., and Wang X.J. Effects of neuromodulation in a cortical network model of object working memory dominated by recurrent inhibition. J Comput Neurosci 11 1 (2001) 63-85
27. Calabresi P., Gubellini P., Centonze D., Picconi B., Bernardi G., Chergui K., et al. Dopamine and cAMP-regulated phosphoprotein 32 kDa controls both striatal long-term depression and long-term potentiation, opposing forms of synaptic plasticity. J Neurosci 20 22 (2000) 8443-8451
28. Calabresi P., Maj R., Pisani A., Mercuri N.B., and Bernardi G. Long-term synaptic depression in the striatum: physiological and pharmacological characterization. J Neurosci 12 11 (1992) 4224-4233
29. Calabresi P., Picconi B., Tozzi A., and Di Filippo M. Dopamine-mediated regulation of corticostriatal synaptic plasticity. Trends Neurosci 30 5 (2007) 211-219
30. Calabresi P., Pisani A., Centonze D., and Bernardi G. Role of dopamine receptors in the short- and long-term regulation of corticostriatal transmission. Nihon Shinkei Seishin Yakurigaku Zasshi 17 2 (1997) 101-104
31. Carelli R.M., and West M.O. Representation of the body by single neurons in the dorsolateral striatum of the awake, unrestrained rat. J Comp Neurol 309 2 (1991) 231-249
32. Centonze D., Picconi B., Gubellini P., Bernardi G., and Calabresi P. Dopaminergic control of synaptic plasticity in the dorsal striatum. Eur J Neurosci 13 6 (2001) 1071-1077
33. Choi S., and Lovinger D.M. Decreased probability of neurotransmitter release underlies striatal long-term depression and postnatal development of corticostriatal synapses. Proc Natl Acad Sci U S A 94 6 (1997) 2665-2670
34. Christoph G.R., Leonzio R.J., and Wilcox K.S. Stimulation of the lateral habenula inhibits dopamine-containing neurons in the substantia nigra and ventral tegmental area of the rat. J Neurosci 6 3 (1986) 613-619
35. Coizet V., Comoli E., Westby G.W., and Redgrave P. Phasic activation of substantia nigra and the ventral tegmental area by chemical stimulation of the superior colliculus: an electrophysiological investigation in the rat. Eur J Neurosci 17 1 (2003) 28-40
36. Comoli E., Coizet V., Boyes J., Bolam J.P., Canteras N.S., Quirk R.H., et al. A direct projection from superior colliculus to substantia nigra for detecting salient visual events. Nat Neurosci 6 9 (2003) 974-980
37. Corbit L.H., and Balleine B.W. Double dissociation of basolateral and central amygdala lesions on the general and outcome-specific forms of pavlovian-instrumental transfer. J Neurosci 25 4 (2005) 962-970
38. Cromwell H.C., and Berridge K.C. Implementation of action sequences by a neostriatal site: a lesion mapping study of grooming syntax. J Neurosci 16 10 (1996) 3444-3458
39. Cromwell H.C., Hassani O.K., and Schultz W. Relative reward processing in primate striatum. Exp Brain Res 162 4 (2005) 520-525
40. Cromwell H.C., and Schultz W. Effects of expectations for different reward magnitudes on neuronal activity in primate striatum. J Neurophysiol 89 5 (2003) 2823-2838
41. Crutcher M.D., and DeLong M.R. Single cell studies of the primate putamen. I. Functional organization. Exp Brain Res 53 2 (1984) 233-243
42. DiCarlo J.J., and Johnson K.O. Receptive field structure in cortical area 3b of the alert monkey. Behav Brain Res 135 1-2 (2002) 167-178
43. Dickinson A., Campos J., Varga Z.I., and Balleine B. Bidirectional instrumental conditioning. Q J Exp Psychol B 49 4 (1996) 289-306
44. Fallon J.H., and Moore R.Y. Catecholamine innervation of the basal forebrain. IV. Topography of the dopamine projection to the basal forebrain and neostriatum. J Comp Neurol 180 3 (1978) 545-580
45. Fiorillo C.D., Tobler P.N., and Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299 5614 (2003) 1898-1902
46. Flaherty A.W., and Graybiel A.M. Corticostriatal transformations in the primate somatosensory system. Projections from physiologically mapped body-part representations. J Neurophysiol 66 4 (1991) 1249-1263
47. Flaherty A.W., and Graybiel A.M. Two input systems for body representations in the primate striatal matrix: experimental evidence in the squirrel monkey. J Neurosci 13 3 (1993) 1120-1137
48. Frank M.J., and Claus E.D. Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal. Psychol Rev 113 2 (2006) 300-326
49. Gallagher M., McMahan R.W., and Schoenbaum G. Orbitofrontal cortex and representation of incentive value in associative learning. J Neurosci 19 15 (1999) 6610-6614
50. Girault J.A., Spampinato U., Desban M., Glowinski J., and Besson M.J. Enhancement of glutamate release in the rat striatum following electrical stimulation of the nigrothalamic pathway. Brain Res 374 2 (1986) 362-366
51. Goldberg J.A., Boraud T., Maraton S., Haber S.N., Vaadia E., and Bergman H. Enhanced synchrony among primary motor cortex neurons in the 1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine primate model of Parkinson's disease. J Neurosci 22 11 (2002) 4639-4653
52. Gonon F. Prolonged and extrasynaptic excitatory action of dopamine mediated by D1 receptors in the rat striatum in vivo. J Neurosci 17 15 (1997) 5972-5978
53. Graybiel A.M. The basal ganglia and chunking of action repertoires. Neurobiol Learn Mem 70 1/2 (1998) 119-136
54. Graybiel A.M. Habits, rituals, and the evaluative brain. Annu Rev Neurosci 31 (2008) 359-387
55. Graziano M.S., and Gross C.G. A bimodal map of space: somatosensory receptive fields in the macaque putamen with corresponding visual receptive fields. Exp Brain Res 97 1 (1993) 96-109
56. Haber S.N. The primate basal ganglia: parallel and integrative networks. J Chem Neuroanat 26 4 (2003) 317-330
57. Hassani O.K., Cromwell H.C., and Schultz W. Influence of expectation of different rewards on behavior-related neuronal activity in the striatum. J Neurophysiol 85 6 (2001) 2477-2489
58. Hatfield T., Han J.S., Conley M., Gallagher M., and Holland P. Neurotoxic lesions of basolateral, but not central, amygdala interfere with Pavlovian second-order conditioning and reinforcer devaluation effects. J Neurosci 16 16 (1996) 5256-5265
59. Herkenham M., and Nauta W.J. Efferent connections of the habenular nuclei in the rat. J Comp Neurol 187 1 (1979) 19-47
60. Hikosaka O., Sakamoto M., and Usui S. Functional properties of monkey caudate neurons. I. Activities related to saccadic eye movements. J Neurophysiol 61 4 (1989) 780-798
61. Hollerman J.R., Tremblay L., and Schultz W. Influence of reward expectation on behavior-related neuronal activity in primate striatum. J Neurophysiol 80 2 (1998) 947-963
62. Hoover J.E., and Strick P.L. The organization of cerebellar and basal ganglia outputs to primary motor cortex as revealed by retrograde transneuronal transport of herpes simplex virus type 1. J Neurosci 19 4 (1999) 1446-1463
63. Horvitz J.C. Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events. Neuroscience 96 4 (2000) 651-656
64. Horvitz J.C. Dopamine gating of glutamatergic sensorimotor and incentive motivational input signals to the striatum. Behav Brain Res 137 1-2 (2002) 65-74
65. Horvitz J.C., Choi W.Y., Morvan C., Eyny Y., and Balsam P.D. A "good parent" function of dopamine: transient modulation of learning and performance during early stages of training. Ann N Y Acad Sci 1104 (2007) 270-288
66. Horvitz J.C., Stewart T., and Jacobs B.L. Burst activity of ventral tegmental dopamine neurons is elicited by sensory stimuli in the awake cat. Brain Res 759 2 (1997) 251-258
67. Houk J.C., Bastianen C., Fansler D., Fishbach A., Fraser D., Reber P.J., et al. Action selection and refinement in subcortical loops through basal ganglia and cerebellum. Philos Trans R Soc Lond B Biol Sci 362 1485 (2007) 1573-1583
68. Humphries M.D., Stewart R.D., and Gurney K.N. A physiologically plausible model of action selection and oscillatory activity in the basal ganglia. J Neurosci 26 50 (2006) 12921-12942
69. Itoh H., Nakahara H., Hikosaka O., Kawagoe R., Takikawa Y., and Aihara K. Correlation of primate caudate neural activity and saccade parameters in reward-oriented behavior. J Neurophysiol 89 4 (2003) 1774-1783
70. Izquierdo A., Suda R.K., and Murray E.A. Bilateral orbital prefrontal cortex lesions in rhesus monkeys disrupt choices guided by both reward value and reward contingency. J Neurosci 24 34 (2004) 7540-7548
71. Jaber M., Robinson S.W., Missale C., and Caron M.G. Dopamine receptors and brain function. Neuropharmacology 35 11 (1996) 1503-1519
72. Jaeger D., Gilman S., and Aldridge J.W. Neuronal activity in the striatum and pallidum of primates related to the execution of externally cued reaching movements. Brain Res 694 1-2 (1995) 111-127
73. Kakade S., and Dayan P. Dopamine: generalization and bonuses. Neural Netw 15 4-6 (2002) 549-559
74. Kamin, LJ. Selective association and conditioning. In: Mackintosh NJ, Honig WK, editor. Fundamental issues in associative learning. Dalhousie University Press. Halifax, Nova Scotia; 1969.
75. Kawagoe R., Takikawa Y., and Hikosaka O. Expectation of reward modulates cognitive signals in the basal ganglia. Nat Neurosci 1 5 (1998) 411-416
76. Kelley A.E., Domesick V.B., and Nauta W.J. The amygdalostriatal projection in the rat-an anatomical study by anterograde and retrograde tracing methods. Neuroscience 7 3 (1982) 615-630
77. Kemp J.M., and Powell T.P. The cortico-striate projection in the monkey. Brain 93 3 (1970) 525-546
78. Kerr J.N., and Wickens J.R. Dopamine D-1/D-5 receptor activation is required for long-term potentiation in the rat neostriatum in vitro. J Neurophysiol 85 1 (2001) 117-124
79. Kimura M. Behaviorally contingent property of movement-related activity of the primate putamen. J Neurophysiol 63 6 (1990) 1277-1296
80. Kimura M. Role of basal ganglia in behavioral learning. Neurosci Res 22 4 (1995) 353-358
81. Kimura M., Kato M., Shimazaki H., Watanabe K., and Matsumoto N. Neural information transferred from the putamen to the globus pallidus during learned movement in the monkey. J Neurophysiol 76 6 (1996) 3771-3786
82. Kimura M., Matsumoto N., Okahashi K., Ueda Y., Satoh T., Minamimoto T., et al. Goal-directed, serial and synchronous activation of neurons in the primate striatum. Neuroreport 14 6 (2003) 799-802
83. Kimura M., Satoh T., and Matsumoto N. What does the habenula tell dopamine neurons?. Nat Neurosci 10 6 (2007) 677-678
84. Koos T., Tepper J.M., and Wilson C.J. Comparison of IPSCs evoked by spiny and fast-spiking neurons in the neostriatum. J Neurosci 24 36 (2004) 7916-7922
85. Kunzle H. Bilateral projections from precentral motor cortex to the putamen and other parts of the basal ganglia. An autoradiographic study in Macaca fascicularis. Brain Res 88 2 (1975) 195-209
86. Lau B., and Glimcher P.W. Action and outcome encoding in the primate caudate nucleus. J Neurosci 27 52 (2007) 14502-14514
87. Lidsky T.I., Manetto C., and Schneider J.S. A consideration of sensory factors involved in motor functions of the basal ganglia. Brain Res 356 2 (1985) 133-146
88. Liles S.L. Cortico-striatal evoked potentials in the monkey (Macaca mulatta). Electroencephalogr Clin Neurophysiol 38 2 (1975) 121-129
89. Ljungberg T., Apicella P., and Schultz W. Responses of monkey midbrain dopamine neurons during delayed alternation performance. Brain Res 567 2 (1991) 337-341
90. Ljungberg T., Apicella P., and Schultz W. Responses of monkey dopamine neurons during learning of behavioral reactions. J Neurophysiol 67 1 (1992) 145-163
91. Mackintosh N.J. A theory of attention: variations in the associability of stimlus with reinforcement. Psychol Rev 82 (1975) 276-298
92. Matsumoto M., and Hikosaka O. Lateral habenula as a source of negative reward signals in dopamine neurons. Nature 447 7148 (2007) 1111-1115
93. Matsumoto N., Hanakawa T., Maki S., Graybiel A.M., and Kimura M. Role of the nigrostriatal dopamine system in learning to perform sequential motor tasks in a predictive manner. J Neurophysiol 82 2 (1999) 978-998
94. McGeer P.L., McGeer E.G., Scherer U., and Singh K. A glutamatergic corticostriatal path?. Brain Res 128 2 (1977) 369-373
95. McGeorge A.J., and Faull R.L. The organization of the projection from the cerebral cortex to the striatum in the rat. Neuroscience 29 3 (1989) 503-537
96. McHaffie J.G., Jiang H., May P.J., Coizet V., Overton P.G., Stein B.E., et al. A direct projection from superior colliculus to substantia nigra pars compacta in the cat. Neuroscience 138 1 (2006) 221-234
97. Mink J.W. The basal ganglia: focused selection and inhibition of competing motor programs. Prog Neurobiol 50 4 (1996) 381-425
98. Mink J.W. The basal ganglia and involuntary movements: impaired inhibition of competing motor patterns. Arch Neurol 60 10 (2003) 1365-1368
99. Montague P.R., Dayan P., and Sejnowski T.J. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16 5 (1996) 1936-1947
100. Morishima M., and Kawaguchi Y. Recurrent connection patterns of corticostriatal pyramidal cells in frontal cortex. J Neurosci 26 16 (2006) 4394-4405
101. Murray E.A. The amygdala, reward and emotion. Trends Cogn Sci 11 11 (2007) 489-497
102. Nicola S.M., Taha S.A., Kim S.W., and Fields H.L. Nucleus accumbens dopamine release is necessary and sufficient to promote the behavioral response to reward-predictive cues. Neuroscience 135 4 (2005) 1025-1033
103. Nishijo H., Ono T., and Nishino H. Single neuron responses in amygdala of alert monkey during complex sensory stimulation with affective significance. J Neurosci 8 10 (1988) 3570-3583
104. Nishijo H., Uwano T., Tamura R., and Ono T. Gustatory and multimodal neuronal responses in the amygdala during licking and discrimination of sensory stimuli in awake rats. J Neurophysiol 79 1 (1998) 21-36
105. O'Donnell P. Dopamine gating of forebrain neural ensembles. Eur J Neurosci 17 3 (2003) 429-435
106. Oades R.D., and Halliday G.M. Ventral tegmental (A10) system: neurobiology. 1. Anatomy and connectivity. Brain Res 434 2 (1987) 117-165 [Review] [440 refs]
107. Ostlund S.B., and Balleine B.W. Lesions of medial prefrontal cortex disrupt the acquisition but not the expression of goal-directed learning. J Neurosci 25 34 (2005) 7763-7770
108. Ostlund S.B., and Balleine B.W. Orbitofrontal cortex mediates outcome encoding in Pavlovian but not instrumental conditioning. J Neurosci 27 18 (2007) 4819-4825
109. Ostlund S.B., and Balleine B.W. Differential involvement of the basolateral amygdala and mediodorsal thalamus in instrumental action selection. J Neurosci 28 17 (2008) 4398-4405
110. Packard M.G. Glutamate infused posttraining into the hippocampus or caudate-putamen differentially strengthens place and response learning. Proc Natl Acad Sci U S A 96 22 (1999) 12881-12886
111. Packard M.G., and McGaugh J.L. Inactivation of hippocampus or caudate nucleus with lidocaine differentially affects expression of place and response learning. Neurobiol Learn Mem 65 1 (1996) 65-72
112. Parent M., and Parent A. Single-axon tracing study of corticostriatal projections arising from primary motor cortex in primates. J Comp Neurol 496 2 (2006) 202-213
113. Pasquereau B., Nadjar A., Arkadir D., Bezard E., Goillandeau M., Bioulac B., et al. Shaping of motor responses by incentive values through the basal ganglia. J Neurosci 27 5 (2007) 1176-1183
114. Paton J.J., Belova M.A., Morrison S.E., and Salzman C.D. The primate amygdala represents the positive and negative value of visual stimuli during learning. Nature 439 7078 (2006) 865-870
115. Pickens C.L., Saddoris M.P., Gallagher M., and Holland P.C. Orbitofrontal lesions impair use of cue-outcome associations in a devaluation task. Behav Neurosci 119 1 (2005) 317-322
116. Pickens C.L., Saddoris M.P., Setlow B., Gallagher M., Holland P.C., and Schoenbaum G. Different roles for orbitofrontal cortex and basolateral amygdala in a reinforcer devaluation task. J Neurosci 23 35 (2003) 11078-11084
117. Pratt W.E., and Mizumori S.J. Characteristics of basolateral amygdala neuronal firing on a spatial memory task involving differential reward. Behav Neurosci 112 3 (1998) 554-570
118. Redgrave P., and Gurney K. The short-latency dopamine signal: a role in discovering novel actions?. Nat Rev Neurosci 7 12 (2006) 967-975
119. Redgrave P., Gurney K., and Reynolds J. What is reinforced by phasic dopamine signals?. Brain Res Rev 58 2 (2008) 322-339
120. Redgrave P., Prescott T.J., and Gurney K. Is the short-latency dopamine response too short to signal reward error?. Trends Neurosci 22 4 (1999) 146-151
121. Reynolds J.N., Hyland B.I., and Wickens J.R. A cellular mechanism of reward-related learning. Nature 413 6851 (2001) 67-70
122. Richfield E.K., Penney J.B., and Young A.B. Anatomical and affinity state comparisons between dopamine D1 and D2 receptors in the rat central nervous system. Neuroscience 30 3 (1989) 767-777
123. Roesch M.R., and Olson C.R. Neuronal activity related to reward value and motivation in primate frontal cortex. Science 304 5668 (2004) 307-310
124. Sakai S.T., Inase M., and Tanji J. Pallidal and cerebellar inputs to thalamocortical neurons projecting to the supplementary motor area in Macaca fuscata: a triple-labeling light microscopic study. Anat Embryol (Berl) 199 1 (1999) 9-19
125. Salamone J.D., and Correa M. Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine. Behav Brain Res 137 1-2 (2002) 3-25
126. Samejima K., Ueda Y., Doya K., and Kimura M. Representation of action-specific reward values in the striatum. Science 310 5752 (2005) 1337-1340
127. Schiff N.D. Central thalamic contributions to arousal regulation and neurological disorders of consciousness. Ann N Y Acad Sci 1129 (2008) 105-118
128. Schilman E.A., Uylings H.B., Galis-de Graaf Y., Joel D., and Groenewegen H.J. The orbital cortex in rats topographically projects to central parts of the caudate-putamen complex. Neurosci Lett 432 1 (2008) 40-45
129. Schoenbaum G., and Roesch M. Orbitofrontal cortex, associative learning, and expectancies. Neuron 47 5 (2005) 633-636
130. Schultz W. Responses of midbrain dopamine neurons to behavioral trigger stimuli in the monkey. J Neurophysiol 56 (1986) 1439-1461
131. Schultz W. Predictive reward signal of dopamine neurons. J Neurophysiol 80 1 (1998) 1-27
132. Schultz W. Getting formal with dopamine and reward. Neuron 36 2 (2002) 241-263
133. Schultz W. Behavioral theories and the neurophysiology of reward. Annu Rev Psychol 57 (2006) 87-115
134. Schultz W. Behavioral dopamine signals. Trends Neurosci 30 5 (2007) 203-210
135. Schultz W., Apicella P., and Ljungberg T. Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. J Neurosci 13 3 (1993) 900-913
136. Schultz W., and Romo R. Neuronal activity in the monkey striatum during the initiation of movements. Exp Brain Res 71 2 (1988) 431-436
137. Schultz W., Tremblay L., and Hollerman J.R. Reward processing in primate orbitofrontal cortex and basal ganglia. Cereb Cortex 10 3 (2000) 272-284
138. Selemon L.D., and Goldman-Rakic P.S. Longitudinal topography and interdigitation of corticostriatal projections in the rhesus monkey. J Neurosci 5 3 (1985) 776-794
139. Shen W., Flajolet M., Greengard P., and Surmeier D.J. Dichotomous dopaminergic control of striatal synaptic plasticity. Science 321 5890 (2008) 848-851
140. Somogyi P., Bolam J.P., and Smith A.D. Monosynaptic cortical input and local axon collaterals of identified striatonigral neurons. A light and electron microscopic study using the golgi-peroxidase transport-degeneration procedure. J Comp Neurol 195 4 (1981) 567-584
141. Strecker R.E., and Jacobs B.L. Substantia nigra dopaminergic unit activity in behaving cats: effect of arousal on spontaneous discharge and sensory evoked activity. Brain Res 361 1-2 (1985) 339-350
142. Suaud-Chagny M.F., Chergui K., Chouvet G., and Gonon F. Relationship between dopamine release in the rat nucleus accumbens and the discharge activity of dopaminergic neurons during local in vivo application of amino acids in the ventral tegmental area. Neuroscience 49 1 (1992) 63-72
143. Taha S.A., Nicola S.M., and Fields H.L. Cue-evoked encoding of movement planning and execution in the rat nucleus accumbens. J Physiol 584 Pt 3 (2007) 801-818
144. Takada M., Tokuno H., Nambu A., and Inase M. Corticostriatal projections from the somatic motor areas of the frontal cortex in the macaque monkey: segregation versus overlap of input zones from the primary motor cortex, the supplementary motor area, and the premotor cortex. Exp Brain Res 120 1 (1998) 114-128
145. Thorpe S.J., Rolls E.T., and Maddison S. The orbitofrontal cortex: neuronal activity in the behaving monkey. Exp Brain Res 49 1 (1983) 93-115
146. Tobler P.N., Fiorillo C.D., and Schultz W. Adaptive coding of reward value by dopamine neurons. Science 307 5715 (2005) 1642-1645
147. Tremblay L., Hollerman J.R., and Schultz W. Modifications of reward expectation-related neuronal activity during learning in primate striatum. J Neurophysiol 80 2 (1998) 964-977
148. Tremblay L., and Schultz W. Relative reward preference in primate orbitofrontal cortex. Nature 398 6729 (1999) 704-708
149. Tremblay L., and Schultz W. Reward-related neuronal activity during go-nogo task performance in primate orbitofrontal cortex. J Neurophysiol 83 4 (2000) 1864-1876
150. Tunstall M.J., Oorschot D.E., Kean A., and Wickens J.R. Inhibitory interactions between spiny projection neurons in the rat striatum. J Neurophysiol 88 3 (2002) 1263-1269
151. Ueda Y., and Kimura M. Encoding of direction and combination of movements by primate putamen neurons. Eur J Neurosci 18 4 (2003) 980-994
152. Ungerstedt U. Stereotaxic mapping of the monoamine pathways in the rat brain. Acta Physiol Scand Suppl 367 (1971) 1-48
153. Watanabe M. Reward expectancy in primate prefrontal neurons. Nature 382 6592 (1996) 629-632
154. Watanabe M., Hikosaka K., Sakagami M., and Shirakawa S. Functional significance of delay-period activity of primate prefrontal neurons in relation to spatial working memory and reward/omission-of-reward expectancy. Exp Brain Res 166 2 (2005) 263-276
155. Wellman L.L., Gale K., and Malkova L. GABAA-mediated inhibition of basolateral amygdala blocks reward devaluation in macaques. J Neurosci 25 18 (2005) 4577-4586
156. Wickens J. Striatal dopamine in motor activation and reward-mediated learning: steps towards a unifying model. J Neural Transm Gen Sect 80 1 (1990) 9-31
157. Wickens J.R., Begg A.J., and Arbuthnott G.W. Dopamine reverses the depression of rat corticostriatal synapses which normally follows high-frequency stimulation of cortex in vitro. Neuroscience 70 1 (1996) 1-5
158. Wickens J.R., Budd C.S., Hyland B.I., and Arbuthnott G.W. Striatal contributions to reward and decision making: making sense of regional variations in a reiterated processing matrix. Ann N Y Acad Sci 1104 (2007) 192-212
159. Wickens J.R., Reynolds J.N., and Hyland B.I. Neural mechanisms of reward-related motor learning. Curr Opin Neurobiol 13 6 (2003) 685-690
160. Wilson C.J., Chang H.T., and Kitai S.T. Firing patterns and synaptic potentials of identified giant aspiny interneurons in the rat neostriatum. J Neurosci 10 2 (1990) 508-519
161. Wilson C.J., and Kawaguchi Y. The origins of two-state spontaneous membrane potential fluctuations of neostriatal spiny neurons. J Neurosci 16 7 (1996) 2397-2410
162. Wise R. Neuroleptics and operant behavior: The anhedonia hypothesis. Behav Brain Sci 5 (1982) 39-87
163. Wyder M.T., Massoglia D.P., and Stanford T.R. Quantitative assessment of the timing and tuning of visual-related, saccade-related, and delay period activity in primate central thalamus. J Neurophysiol 90 3 (2003) 2029-2052
164. Yin H.H., Knowlton B.J., and Balleine B.W. Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. Eur J Neurosci 19 1 (2004) 181-189
165. Yin H.H., Ostlund S.B., Knowlton B.J., and Balleine B.W. The role of the dorsomedial striatum in instrumental conditioning. Eur J Neurosci 22 2 (2005) 513-523
166. Yung K.K., Smith A.D., Levey A.I., and Bolam J.P. Synaptic connections between spiny neurons of the direct and indirect pathways in the neostriatum of the rat: evidence from dopamine receptor and neuropeptide immunostaining. Eur J Neurosci 8 5 (1996) 861-869
167. Zarzecki P., Shinoda Y., and Asanuma H. Projection from area 3a to the motor cortex by neurons activated from group I muscle afferents. Exp Brain Res 33 2 (1978) 269-282