Basal ganglia orient eyes to reward

Journal of Neurophysiology

Volumn 95, Issue 2, 2006, Pages 567-584

  Hikosaka, Okihide ^a   Nakamura, Kae ^a   Nakahara, Hiroyuki ^b  

^a NATIONAL EYE INSTITUTE   (United States)

^b RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

BASAL GANGLION; BEHAVIOR; BRAIN STEM; CAUDATE NUCLEUS; COGNITION; DOPAMINERGIC ACTIVITY; EYE MOVEMENT; HUMAN; LABORATORY TEST; NERVE CELL; NERVE CONDUCTION; NERVE EXCITABILITY; NONHUMAN; PRIORITY JOURNAL; REVIEW; SENSORIMOTOR FUNCTION; SIGNAL TRANSDUCTION; SUBSTANTIA NIGRA; THALAMOCORTICAL TRACT; ANIMAL; ANIMAL BEHAVIOR; BIOLOGICAL MODEL; MEMORY; MOTIVATION; MOTOR ACTIVITY; PHYSIOLOGY; REWARD; SACCADIC EYE MOVEMENT; VISION; VISUAL SYSTEM;

ANIMALS; BASAL GANGLIA; BEHAVIOR, ANIMAL; MEMORY; MODELS, NEUROLOGICAL; MOTIVATION; MOTOR ACTIVITY; REWARD; SACCADES; VISUAL PATHWAYS; VISUAL PERCEPTION;

EID: 33644865763     PISSN: 00223077     EISSN: None     Source Type: Journal    
DOI: 10.1152/jn.00458.2005     Document Type: Review

References (205)

1. Alexander GE, DeLong MR, and Strick PL. Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Ann Rev Neurosci 9: 357-381, 1986.
2. Balleine BW and Dickinson A. Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37: 407-419, 1998.
3. Barraclough DJ, Conroy ML, and Lee D. Prefrontal cortex and decision making in a mixed-strategy game. Nat Neurosci 7: 404-410, 2004.
4. Barto AG. Reinforcement learning control. Curr Opin Neurobiol 4: 888-893, 1994.
5. Barto AG. Adaptive critics and the basal ganglia. In: Models of Information Processing in the Basal Ganglia, edited by Houk JC, Davis JL, and Beiser DG. Cambridge, MA: MIT Press, 1995, p. 215-232.
6. Baxter MG and Murray EA. The amygdala and reward. Nat Rev Neurosci 3: 563-573, 2002.
7. Beckstead RM, Edwards SB, and Frankfurter A. A comparison of the intranigral distribution of nigrotectal neurons labeled with horseradish peroxidase in the monkey, cat, and rat. J Neurosci 1: 121-125, 1981.
8. Berke JD and Hyman SE. Addiction, dopamine, and the molecular mechanisms of memory. Neuron 25: 515-532, 2000.
9. Bowman EM, Aigner TG, and Richmond BJ. Neural signals in the monkey ventral striatum related to motivation for juice and cocaine rewards. J Neurophysiol 75: 1061-1073, 1996.
10. Brown LL, Schneider JS, and Lidsky TI. Sensory and cognitive functions of the basal ganglia. Curr Opin Neurobiol 7: 157-163, 1997.
11. Brown RG and Pluck G. Negative symptoms: the "pathology" of motivation and goal-directed behaviour. Trends Neurosci 23: 412-417, 2000.
12. Calabresi P, Maj R, Pisani A, Mercuri NB, and Bernardi G. Long-term synaptic depression in the striatum: physiological and pharmacological characterization. J Neurosci 12: 4224-4233, 1992.
13. Calabresi P, Pisani A, Mercuri NB, and Bernardi G. The corticostriatal projection: from synaptic plasticity to dysfunctions of the basal ganglia. Trends Neurosci 19: 19-24, 1996.
14. Carr GD and White NM. Conditioned place preference from intra-accumbens but not intra-caudate amphetamine injections. Life Sci 33: 2551-2557, 1983.
15. Charpier S and Deniau JM. In vivo activity-dependent plasticity at corticostriatal connections: evidence for physiological long-term potentiation. Proc Natl Acad Sci USA 94: 7036-7040, 1997.
16. Chevalier G and Deniau JM. Disinhibition as a basic process in the expression of striatal functions. Trends Neurosci 13: 277-280, 1990.
17. Chevalier G, Vacher S, and Deniau JM. Inhibitory nigral influence on tectospinal neurons, a possible implication of basal ganglia in orienting behavior. Exp Brain Res 53: 320-326, 1984.
18. Chevalier G, Vacher S, Deniau JM, and Desban M. Disinhibition as a basic process in the expression of striatal functions. I. The striato-nigral influence on tecto-spino/tecto-diencephalic neurons. Brain Res 334: 215-226, 1985.
19. Chiara GD, Morelli M, and Consolo S. Modulatory functions of neurotransmitters in the striatum: ACh/dopamine/NMDA interactions. Trends Neurosci 17: 228-233, 1994.
20. Christoph GR, Leonzio RJ, and Wilcox KS. Stimulation of the lateral habenula inhibits dopamine-containing neurons in the substantia nigra and ventral tegmental area of the rat. J Neurosci 6: 613-619, 1986.
21. Corbett D and Wise RA. Intracranial self-stimulation in relation to the ascending dopaminergic systems of the midbrain: a moveable electrode mapping study. Brain Res 185: 1-15, 1980.
22. Cromwell HC and Schultz W. Effects of expectations for different reward magnitudes on neuronal activity in primate striatum. J Neurophysiol 89: 2823-2838, 2003.
23. Dayan P and Balleine B. Reward, motivation, and reinforcement learning. Neuron 36: 285-298, 2002.
24. Delgado MR, Nystrom LE, Fissell C, Noll DC, and Fiez JA. Tracking the hemodynamic responses to reward and punishment in the striatum. J Neurophysiol 84: 3072-3077, 2000.
25. DeLong MR and Georgopoulos AP. Motor functions of the basal ganglia. In: Handbook of Physiology. The Nervous System. Motor Control. Bethesda, MD: Am. Physiol. Soc., 1981, sect. 1, vol. II, pt. 2, p. 1017-1061.
26. Denny-Brown D. The Basal Ganglia and Their Relation to Disorders of Movement. London: Oxford Univ. Press, 1962.
27. Denny-Brown D. Clinical symptomatology of diseases of the basal ganglia. In: Diseases of the Basal Ganglia, edited by Vinken PJ and Bruyn GW. Amsterdam: North-Holland, 1968, p. 133-172.
28. Dommett E, Coizet V, Blaha CD, Martindale J, Lefebvre V, Walton N, Mayhew JE, Overton PG, and Redgrave P. How visual stimuli activate dopaminergic neurons at short latency. Science 307: 1476-1479, 2005.
29. Elliott R, Friston KJ, and Dolan RJ. Dissociable neural responses in human reward systems. J Neurosci 20: 6159-6165, 2000.
30. Everitt BJ, Morris KA, O'Brien A, and Robbins TW. The basolateral amygdala-ventral striatal system and conditioned place preference: further evidence of limbic-striatal interactions underlying reward-related process. Neuroscience 42: 1-18, 1991.
31. Everitt BJ, Parkinson JA, Olmstead MC, Arroyo M, Robledo P, and Robbins TW. Associative processes in addiction and reward. The role of amygdala-ventral striatal subsystems. Ann NY Acad Sci 877: 412-438, 1999.
32. Ewert J-P. Neuroethology. Berlin: Springer-Verlag, 1980.
33. Fadel J and Deutch AY. Anatomical substrates of orexin-dopamine interactions: lateral hypothalamic projections to the ventral tegmental area. Neuroscience 111: 379-387, 2002.
34. Flaherty AW and Graybiel AM. Motor and somatosensory corticostriatal projection magnifications in the squirrel monkey. J Neurophysiol 74: 2638-2648, 1995.
35. Fonnum F, Gottesfeld Z, and Grofova I. Distribution of glutamate decarboxylase, choline acetyltransferase and aromatic amino acid decarboxylase in the basal ganglia of normal and operated rats. Evidence for striatopallidal, striatopeduncular and striatonigral GABAergic fibres. Brain Res 143: 125-138, 1978.
36. François C, Yelnik J, Percheron G, and Fénelon G. Topographic distribution of the axonal endings from the sensorimotor and associative striatum in the macaque pallidum and substantia nigra. Exp Brain Res 102: 305-318, 1994.
37. Fudge JL and Haber SN. The central nucleus of the amygdala projection to dopamine subpopulations in primates. Neuroscience 97: 479-494, 2000.
38. Fudge JL and Haber SN. Bed nucleus of the stria terminalis and extended amygdala inputs to dopamine subpopulations in primates. Neuroscience 104: 807-827, 2001.
39. Fudge JL, Kunishio K, Walsh P, Richard C, and Haber SN. Amygdaloid projections to ventromedial striatal subterritories in the primate. Neuroscience 110: 257-275, 2002.
40. Funahashi S, Bruce CJ, and Goldman-Rakic PS. Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. J Neurophysiol 61: 331-349, 1989.
41. Georges F and Aston-Jones G. Potent regulation of midbrain dopamine neurons by the bed nucleus of the stria terminalis. J Neurosci 21(RC160): 161-166, 2001.
42. Gerfen CR, Engber TM, Mahan LC, Susel Z, Chase TN, Monsma JFJ, and Sibley DR. D1 and D2 dopamine receptor-regulated gene expression of striatonigral and striatopallidal neurons. Science 250: 1429-1432, 1990.
43. Glimcher PW. Making choices: the neurophysiology of visual-saccadic decision making. Trends Neurosci 4: 654-659, 2001.
44. Glimcher PW and Rustichini A. Neuroeconomics: the consilience of brain and decision. Science 306: 447-452, 2004.
45. Grantyn A, Grantyn R, Robiné K-P, and Berthoz A. Electroanatomy of tectal efferent connections related to eye movements in the horizontal plane. Exp Brain Res 37: 149-172, 1979.
46. Graybiel AM. Organization of the nigrotectal connection: an experimental tracer study in the cat. Brain Res 143: 339-348, 1978.
47. Graybiel AM. Neurotransmitters and neuromodulators in the basal ganglia. Trends Neurosci 13: 244-254, 1990.
48. Graybiel AM. The basal ganglia and chunking of action repertoires. Neurobiol Learn Mem 70: 119-136, 1998.
49. Grillner S, Hellgren J, Menard A, Saitoh K, and Wikstrom MA. Mechanisms for selection of basic motor programs - roles for the striatum and pallidum. Trends Neurosci 28: 364-370, 2005.
50. Haber SN, Fudge JL, and McFarland NR. Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. J Neurosci 20: 2369-2382, 2000.
51. Haber SN, Kunishio K, Mizobuchi M, and Lynd-Balta E. The orbital and medial prefrontal circuit through the primate basal ganglia. J Neurosci 15: 4851-4867, 1995.
52. Haber SN and McFarland NR. The concept of the ventral striatum in nonhuman primates. Ann NY Acad Sci 877: 33-48, 1999.
53. Haruno M, Kuroda T, Doya K, Toyama K, Kimura M, Samejima K, Imamizu H, and Kawato M. A neural correlate of reward-based behavioral learning in caudate nucleus: a functional magnetic resonance imaging study of a stochastic decision task. J Neurosci 24: 1660-1665, 2004.
54. Hayhoe M and Ballard D. Eye movements in natural behavior. Trends Cogn Sci 9: 188-194, 2005.
55. Hedreen JC and DeLong MR. Organization of striatopallidal, striatonigral, and nigrostriatal projections in the macaque. J Comp Neurol 304: 569-595, 1991.
56. Hikosaka O, Matsumura M, Kojima J, and Gardiner TW. Role of basal ganglia in initiation and suppression of saccadic eye movements. In: Role of the Cerebellum and Basal Ganglia in Voluntary Movement, edited by Mano N, Hamada I, and DeLong MR. Amsterdam: Elsevier, 1993a, p. 213-219.
57. Hikosaka O, Sakamoto M, and Miyashita N. Effects of caudate nucleus stimulation on substantia nigra cell activity in monkey. Exp Brain Res 95: 457-472, 1993b.
58. Hikosaka O, Sakamoto M, and Usui S. Functional properties of monkey caudate neurons. I. Activities related to saccadic eye movements. J Neurophysiol 61: 780-798, 1989a.
59. Hikosaka O, Sakamoto M, and Usui S. Functional properties of monkey caudate neurons. II. Visual and auditory responses. J Neurophysiol 61: 799-813, 1989b.
60. Hikosaka O, Sakamoto M, and Usui S. Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward. J Neurophysiol 61: 814-832, 1989c.
61. Hikosaka O, Takikawa Y, and Kawagoe R. Role of the basal ganglia in the control of purposive saccadic eye movements. Physiol Rev 80: 953-978, 2000.
62. Hikosaka O and Wurtz RH. Visual and oculomotor functions of monkey substantia nigra pars reticulata. III. Memory-contingent visual and saccade responses. J Neurophysiol 49: 1268-1284, 1983a.
63. Hikosaka O and Wurtz RH. Visual and oculomotor functions of monkey substantia nigra pars reticulata. IV. Relation of substantia nigra to superior colliculus. J Neurophysiol 49: 1285-1301, 1983b.
64. Hollerman JR and Schultz W. Dopamine neurons report an error in the temporal prediction of reward during learning. Nat Neurosci 1: 304-309, 1998.
65. Hollerman JR, Tremblay L, and Schultz W. Influence of reward expectation on behavior-related neuronal activity in primate striatum. J Neurophysiol 80: 947-963, 1998.
66. Hoover JE and Strick PL. The organization of cerebellar and basal ganglia outputs to primary motor cortex as revealed by retrograde transneuronal transport of herpes simplex virus type 1. J Neurosci 19: 1446-1463, 1999.
67. Hotson JR, Langston EB, and Langston JW. Saccade responses to dopamine in human MPTP-induced parkinsonism. Ann Neurol 20: 456-463, 1986.
68. Houk JC. Information processing in modular circuits linking basal ganglia and cerebral cortex. In: Models of Information Processing in the Basal Ganglia, edited by Houk JC, Davis JL, and Beiser DG. Cambridge, MA: MIT Press, 1995, p. 3-9.
69. Houk JC, Adams JL, and Barto A. A model of how the basal ganglia generate and use neural signals that predict reinforcement. In: Models of Information Processing in the Basal Ganglia, edited by Houk JC, Davis JL, and Beiser DG. Cambridge, MA: MIT Press, 1995, p. 249-270.
70. Ikeda T and Hikosaka O. Reward-dependent gain and bias of visual responses in primate superior colliculus. Neuron 39: 693-700, 2003.
71. Inoue M, Oomura Y, Aou S, Nishino H, and Sikdar SK. Reward related neuronal activity in monkey dorsolateral prefrontal cortex during feeding behavior. Brain Res 326: 307-312, 1985.
72. Iribe Y, Moore K, Pang KCH, and Tepper JM. Subthalamic stimulation-induced synaptic responses in substantia nigra pars compacta dopaminergic neurons in vitro. J Neurophysiol 82: 925-933, 1999.
73. Itoh H, Nakahara H, Hikosaka O, Kawagoe R, Takikawa Y, and Aihara K. Correlation of primate caudate neural activity and saccade parameters in reward-oriented behavior. J Neurophysiol 89: 1774-1783, 2003.
74. Jayaraman A, Batton RRI, and Carpenter MB. Nigrotectal projections in the monkey: an autoradiographic study. Brain Res 135: 147-152, 1977.
75. Johansson RS, Westling G, Bäckström A, and Flanagan JR. Eye-hand coordination in object manipulation. J Neurosci 21: 6917-6932, 2001.
76. Joseph JP and Boussaoud D. Role of the cat substantia nigra pars reticulata in eye and head movements. I. Neural activity. Exp Brain Res 57: 286-296, 1985.
77. Karabelas AB and Moschovakis AK. Nigral inhibitory termination on efferent neurons of the superior colliculus: an intracellular horseradish peroxidase study in the cat. J Comp Neurol 239: 309-329, 1985.
78. Kato M, Miyashita N, Hikosaka O, Matsumura M, Usui S, and Kori A. Eye movements in monkeys with local dopamine depletion in the caudate nucleus. I. Deficits in spontaneous saccades. J Neurosci 15: 912-927, 1995.
79. Kawagoe R, Takikawa Y, and Hikosaka O. Expectation of reward modulates cognitive signals in the basal ganglia. Nat Neurosci 1: 411-416, 1998.
80. Kawagoe R, Takikawa Y, and Hikosaka O. Reward-predicting activity of dopamine and caudate neurons: a possible mechanism of motivational control of saccadic eye movement. J Neurophysiol 91: 1013-1024, 2004.
81. Kelley AE. Ventral striatal control of appetitive motivation: role in ingestive behavior and reward-related learning. Neurosci Biobehav Rev 27: 765-776, 2004.
82. Kimura M, Kato M, and Shimazaki H. Physiological properties of projection neurons in the monkey striatum to the globus pallidus. Exp Brain Res 82: 672-676, 1990.
83. Kita H. GABAergic circuits of the striatum. In: Chemical Signalling in the Basal Ganglia, edited by Arbuthnott GW and Emson PC. Amsterdam: Elsevier, 1993, p. 51-72.
84. Knutson B, Adams CM, Fong GW, and Hommer D. Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J Neurosci 21(RC159): 151-155, 2001.
85. Kobayashi S, Lauwereyns J, Koizumi M, Sakagami M, and Hikosaka O. Influence of reward expectation on visuospatial processing in macaque lateral prefrontal cortex. J Neurophysiol 87: 1488-1498, 2002a.
86. Kobayashi Y, Inoue Y, Yamamoto M, Isa T, and Aizawa H. Contribution of pedunculopontine tegmental nucleus neurons to performance of visually guided saccade tasks in monkeys. J Neurophysiol 88: 715-731, 2002b.
87. Künzle H. Bilateral projections from the precentral motor cortex to the putamen and other parts of the basal ganglia. An autoradiographic study in Macaca fascicularis. Brain Res 88: 195-209, 1975.
88. Lauwereyns J, Takikawa Y, Kawagoe R, Kobayashi S, Koizumi M, Coe B, Sakagami M, and Hikosaka O. Feature-based anticipation of cues that predict reward in monkey caudate nucleus. Neuron 33: 463-473, 2002a.
89. Lauwereyns J, Watanabe K, Coe B, and Hikosaka O. A neural correlate of response bias in monkey caudate nucleus. Nature 418: 413-417, 2002b.
90. Lavoie B and Parent A. Pedunculopontine nucleus in the squirrel monkey: cholinergic and glutamatergic projections to the substantia nigra. J Comp Neurol 344: 232-241, 1994.
91. Lee HJ, Groshek F, Petrovich GD, Cantalini JP, Gallagher M, and Holland PC. Role of amygdalo-nigral circuitry in conditioning of a visual stimulus paired with food. J Neurosci 25: 3881-3888, 2005.
92. Leon MI and Shadlen MN. Effect of expected reward magnitude on the response of neurons in the dorsolateral prefrontal cortex of the macaque. Neuron 24: 415-425, 1999.
93. Liu Z and Richmond BJ. Response differences in monkey TE and perirhinal cortex: stimulus association related to reward schedules. J Neurophysiol 83: 1677-1692, 2000.
94. Lovinger DM, Partridge JG, and Tang KC. Plastic control of striatal glutamatergic transmission by ensemble actions of several neurotransmitters and targets for drugs of abuse. Ann NY Acad Sci 1003: 226-240, 2003.
95. Lynd-Balta E and Haber SN. The organization of midbrain projections to the striatum in the primate: sensorimotor-related striatum versus ventral striatum. Neuroscience 59: 625-640, 1994a.
96. Lynd-Balta E and Haber SN. Primate striatonigral projections: a comparison of the sensorimotor-related striatum and the ventral striatum. J Comp Neurol 345: 562-578, 1994b.
97. Mahon S, Deniau JM, and Charpier S. Corticostriatal plasticity: life after the depression. Trends Neurosci 27: 460-467, 2004.
98. Maunsell JH. Neuronal representations of cognitive state: reward or attention? Trends Cogn Sci 8: 261-265, 2004.
99. May PJ and Hall WC. Relationships between the nigrotectal pathway and the cells of origin of the predorsal bundle. J Comp Neurol 226: 357-376, 1984.
100. McClure SM, Laibson DI, Loewenstein G, and Cohen JD. Separate neural systems value immediate and delayed monetary rewards. Science 306: 503-507, 2004a.
101. McClure SM, York MK, and Montague PR. The neural substrates of reward processing in humans: the modern role of fMRI. Neuroscientist 10: 260-268, 2004b.
102. Middleton FA and Strick PL. Anatomical evidence for cerebellar and basal ganglia involvement in higher cognitive functions. Science 266: 458-461, 1994.
103. Middleton FA and Strick PL. Basal ganglia and cerebellar loops: motor and cognitive circuits. Brain Res Rev 31: 236-250, 2000.
104. Minamimoto T, Hori Y, and Kimura M. Complementary process to response bias in the centromedian nucleus of the thalamus. Science 308: 1798-1801, 2005.
105. Mink JW. The basal ganglia: focused selection and inhibition of competing motor programs. Prog Neurobiol 50: 381-425, 1996.
106. Mirenowicz J and Schultz W. Importance of unpredictability for reward responses in primate dopamine neurons. J Neurophysiol 72: 1024-1027, 1994.
107. Miyashita K, Rand MK, Miyachi S, and Hikosaka O. Anticipatory saccades in sequential procedural learning in monkeys. J Neurophysiol 76: 1361-1366, 1996.
108. Miyashita N, Hikosaka O, and Kato M. Visual hemineglect induced by unilateral striatal dopamine dificiency in monkeys. Neuroreport 6: 1257-1260, 1995.
109. Miyazaki K, Mogi E, Araki N, and Matsumoto G. Reward-quality dependent anticipation in rat nucleus accumbens. Neuroreport 9: 3943-3948, 1998.
110. Mogenson GJ, Jones DL, and Yim CY. From motivation to action: functional interface between the limbic system and the motor system. Prog Neurobiol 14: 69-97, 1980.
111. Montague P and Berns G. Neural economics and the biological substrates of valuation. Neuron 36: 265-284, 2002.
112. Montague PR, Dayan P, and Sejnowski TJ. A framework for mesencephalic dopamine systems based on predictive hebbian learning. J Neurosci 16: 1936-1947, 1996.
113. Montague PR, Hyman SE, and Cohen JD. Computational roles for dopamine in behavioural control. Nature 431: 760-767, 2004.
114. Mora F, Rolls ET, Burton MJ, and Shaw GS. Effects of dopamine-receptor blockade on self-stimulation in the monkey. Pharmacol Biochem Behav 4: 211-216, 1976.
115. Nakahara H, Amari S, and Hikosaka O. Self-organization in the basal ganglia with modulation of reinforcement signals. Neural Comput 14: 819-844, 2002.
116. Nakahara H, Doya K, and Hikosaka O. Parallel cortico-basal ganglia mechanisms for acquisition and execution of visuomotor sequences - a computational approach. J Cogn Neurosci 13: 626-647, 2001.
117. Nakahara H, Itoh H, Kawagoe R, Takikawa Y, and Hikosaka O. Dopamine neurons can represent context-dependent prediction error. Neuron 41: 269-280, 2004.
118. Nakamura K and Hikosaka O. Electrical stimulation in the primate caudate nucleus reinforces saccadic eye movement. 2003 Abstract Viewer and Itinerary Planner. Washington, DC: Society for Neuroscience, Online, 2003.
119. Nakamura K and Hikosaka O. Reward-dependent saccade bias is attenuated by local application of dopamine antagonist in the primate caudate nucleus. 2004 Abstract Viewer and Itinerary Planner. Washington, DC: Society for Neuroscience, Online, 2004.
120. Nakano K, Hasegawa Y, Tokushige A, Nakagawa S, Kayahara T, and Mizuno N. Topographical projections from the thalamus, subthalamic nucleus and pedunculopontine tegmental nucleus to the striatum in the japanese monkey, Macaca fuscata. Brain Res 537: 54-68, 1990.
121. Nambu A, Kaneda K, Tokuno H, and Takada M. Organization of corticostriatal motor inputs in monkey putamen. J Neurophysiol 88: 1830-1842, 2002.
122. Nicola SM, Surmeier DJ, and Malenka RC. Dopaminergic modulation of neuronal excitability in the striatum and nucleus accumbens. Annu Rev Neurosci 23: 185-215, 2000.
123. Nicola SM, Yun IA, Wakabayashi KT, and Fields HL. Cue-evoked firing of nucleus accumbens neurons encodes motivational significance during a discriminative stimulus task. J Neurophysiol 91: 1840-1865, 2004.
124. Nishino H, Ono T, Sasaki K, Fukuda M, and Muramoto K-I. Caudate unit activity during operant feeding behavior in monkeys and modulation by cooling prefrontal cortex. Behav Brain Res 11: 21-33, 1984.
125. O'Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, and Dolan RJ. Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304: 452-454, 2004.
126. O'Doherty JP, Deichmann R, Critchley HD, and Dolan RJ. Neural responses during anticipation of a primary taste reward. Neuron 33: 815-826, 2002.
127. Olds J and Milner P. Positive reinforcement produced by electrical stimulation of septal area and other regions of rat brain. J Comp Physiol Psychol 47: 419-427, 1954.
128. Packard MG and Knowlton BJ. Learning and memory functions of the basal ganglia. Annu Rev Neurosci 25: 563-593, 2002.
129. Pan WX and Hyland BI. Pedunculopontine tegmental nucleus controls conditioned responses of midbrain dopamine neurons in behaving rats. J Neurosci 25: 4725-4732, 2005.
130. Paré M and Wurtz RH. Progression in neuronal processing for saccadic eye movements from parietal cortex area LIP to superior colliculus. J Neurophysiol 85: 2545-2562, 2001.
131. Parent A and Hazrati L-N. Multiple striatal representation in primate substantia nigra. J Comp Neurol 344: 305-320, 1994.
132. Parent A and Hazrati L-N. Functional anatomy of the basal ganglia. I. The cortico-basal ganglia-thalamo-cortical loop. Brain Res Rev 20: 91-127, 1995.
133. Parent A, Mackey A, and De Bellefeuille L. The subcortical afferents to caudate nucleus and putamen in primate: a fluorescence retrograde double labeling study. Neuroscience 10: 1137-1150, 1983.
134. Parthasarathy HB, Schall JD, and Graybiel AM. Distributed but convergent ordering of corticostriatal projections: analysis of the frontal eye field and the supplementary eye field in the macaque monkey. J Neurosci 12: 4468-4488, 1992.
135. Pasupathy A and Miller EK. Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature 433: 873-876, 2005.
136. Phillips AG, Carter DA, and Fibiger HC. Dopaminergic substrates of intracranial self-stimulation in the caudate-putamen. Brain Res 104: 221-232, 1976.
137. Platt ML and Glimcher PW. Neural correlates of decision variables in parietal cortex. Nature 400: 233-238, 1999.
138. Preston RJ, Bishop GA, and Kitai ST. Medium spiny neuron projection from the rat striatum: an intracellular horseradish peroxidase study. Brain Res 183: 253-263, 1980.
139. Ragsdale CW and Graybiel AM. Fibers from the basolateral nucleus of the amygdala selectively innervate striosomes in the caudate nucleus of the cat. J Comp Neurol 269: 506-522, 1988.
140. Rescorla RA and Wagner AR. A theory of pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. In: Classical Conditioning II: Current Research and Theory, edited by Black AH and Prokasy WF. New York: Appleton-Century-Croft, 1972, p. 64-99.
141. Reynolds JN and Wickens JR. Dopamine-dependent plasticity of corticostriatal synapses. Neural Netw 15: 507-521, 2002.
142. Reynolds JNJ and Wickens JR. Substantia nigra dopamine regulates synaptic plasticity and membrane potential fluctuations in the rat neostriatum, in vivo. Neuroscience 99: 199-203, 2000.
143. Reynolds JNR, Hyland BI, and Wickens JR. A cellular mechanism of reward-related learning. Nature 413: 67-70, 2001.
144. Roesch MR and Olson CR. Impact of expected reward on neuronal activity in prefrontal cortex, frontal and supplementary eye fields and premotor cortex. J Neurophysiol 90: 1766-1789, 2003.
145. Roesch MR and Olson CR. Neuronal activity related to reward value and motivation in primate frontal cortex. Science 304: 307-310, 2004.
146. Rolls ET, Thorpe SJ, and Maddison SP. Responses of striatal neurons in the behaving monkey. I. Head of the caudate nucleus. Behav Brain Res 7: 179-210, 1983.
147. Sachs OW. Awakenings. New York: Dutton, 1983.
148. Sadikot AF, Parent A, and François C. Efferent connections of the centromedian and parafascicular thalamic nuclei in the squirrel monkey: a PHA-L study of subcortical projections. J Comp Neurol 315: 137-159, 1992.
149. Salmon DP and Butters N. Neurobiology of skill and habit learning. Curr Opin Neurobiol 5: 184-190, 1995.
150. Sato M and Hikosaka O. Role of primate substantia nigra pars reticulata in reward-oriented saccadic eye movement. J Neurosci 22: 2363-2373, 2002.
151. Schultz W. Predictive reward signal of dopamine neurons. J Neurophysiol 80: 1-27, 1998.
152. Schultz W, Apicella P, and Ljungberg T. Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. J Neurosci 13: 900-913, 1993.
153. Schultz W, Apicella P, Scarnati E, and Ljungberg T. Neuronal activity in monkey ventral striatum related to the expectation of reward. J Neurosci 12: 4595-4610, 1992.
154. Schultz W, Dayan P, and Montague PR. A neural substrate of prediction and reward. Science 275: 1593-1599, 1997.
155. Schultz W and Dickinson A. Neuronal coding of prediction errors. Annu Rev Neurosci 23: 473-500, 2000.
156. Segraves MA and Goldberg ME. Functional properties of corticotectal neurons in the monkey's frontal eye field. J Neurophysiol 58: 1387-1419, 1987.
157. Selby G. Parkinson's Disease, edited by Vinken PJ and Bruyn GW. Amsterdam: North-Holland, 1968, p. 173-211.
158. Selemon LD and Goldman-Rakic PS. Longitudinal topography and interdigitation of corticostriatal projections in the rhesus monkey. J Neurosci 5: 776-794, 1985.
159. Setlow B, Schoenbaum G, and Gallagher M. Neural encoding in ventral striatum during olfactory discrimination learning. Neuron 38: 625-636, 2003.
160. Shidara M, Aigner TG, and Richmond BJ. Neuronal signals in the monkey ventral striatum related to progress through a predictable series of trials. J Neurosci 18: 2613-2625, 1998.
161. Shook BL, Schlag-Rey M, and Schlag J. Primate supplementary eye field. II. Comparative aspects of connections with the thalamus, corpus striatum, and related forebrain nuclei. J Comp Neurol 307: 562-583, 1991.
162. Smith Y, Bevan MD, Shink E, and Bolam JP. Microcircuitry of the direct and indirect pathways of the basal ganglia. Neuroscience 86: 353-387, 1998.
163. Sommer MA and Wurtz RH. Composition and topographic organization of signals sent from the frontal eye field to the superior colliculus. J Neurophysiol 83: 1979-2001, 2000.
164. Sparks DL. Translation of sensory signals into commands for control of saccadic eye movements: role of primate superior colliculus. Physiol Rev 66: 118-171, 1986.
165. Sparks DL. The brainstem control of saccadic eye movements. Nat Rev Neurosci 3: 952-964, 2002.
166. Sparks DL, Holland R, and Guthrie BL. Size and distribution of movement fields in the monkey superior colliculus. Brain Res 113: 21-34, 1976.
167. Spyraki C, Fibiger HC, and Phillips AG. Dopaminergic substrates of amphetamine-induced place preference conditioning. Brain Res 253: 185-193, 1982.
168. Stanton GB, Goldberg ME, and Bruce CJ. Frontal eye field efferents in the macaque monkey: I. Subcortical pathways and topography of striatal and thalamic terminal fields. J Comp Neurol 271: 473-492, 1988.
169. Sugrue LP, Corrado GS, and Newsome WT. Matching behavior and the representation of value in the parietal cortex. Science 304: 1782-1787, 2004.
170. Sugrue LP, Corrado GS, and Newsome WT. Choosing the greater of two goods: neural currencies for valuation and decision making. Nat Rev Neurosci 6: 363-375, 2005.
171. Suri RE and Schultz W. Learning of sequential movements by neural network model with dopamine-like reinforcement signal. Exp Brain Res 121: 350-354, 1998.
172. Surmeier DJ, Song W-J, and Yan Z. Coordinated expression of dopamine receptors in neostriatal medium spiny neurons. J Neurosci 16: 6579-6591, 1996.
173. Sutton RS and Barto AG. Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press/Bradford, 1998.
174. Swanson LW. Cerebral hemisphere regulation of motivated behavior. Brain Res 886: 113-164, 2000.
175. Takada M, Itoh K, Yasui Y, Sugimoto T, and Mizuno N. Topographical projections from the posterior thalamic regions to the striatum in the cat, with reference to possible tecto-thalamo-striatal connections. Exp Brain Res 60: 385-396, 1985.
176. Takada M, Tokuno H, Nambu A, and Inase M. Corticostriatal projections from the somatic motor areas of the frontal cortex in the macaque monkey: segregation versus overlap of input zones from the primary motor cortex, the supplementary motor area, and the premotor cortex. Exp Brain Res 120: 114-128, 1998.
177. Takakusaki K, Saitoh K, Harada H, and Kashiwayanagi M. Role of basal ganglia-brainstem pathways in the control of motor behaviors. Neurosci Res 50: 137-151, 2004.
178. Takikawa Y, Kawagoe R, and Hikosaka O. Reward-dependent spatial selectivity of anticipatory activity in monkey caudate neurons. J Neurophysiol 87: 508-515, 2002a.
179. Takikawa Y, Kawagoe R, and Hikosaka O. A possible role of midbrain dopamine neurons in short- and long-term adaptation of saccades to position-reward mapping. J Neurophysiol 92: 2520-2529, 2004.
180. Takikawa Y, Kawagoe R, Itoh H, Nakahara H, and Hikosaka O. Modulation of saccadic eye movements by predicted reward outcome. Exp Brain Res 142: 284-291, 2002b.
181. Tanaka SC, Doya K, Okada G, Ueda K, Okamoto Y, and Yamawaki S. Prediction of immediate and future rewards differentially recruits corticobasal ganglia loops. Nat Neurosci 7: 887-893, 2004.
182. A receptor-mediated inhibition of rat substantia nigra dopaminergic neurons by pars reticulata projection neurons. J Neurosci 15: 3092-3103, 1995.
183. Tobler PN, Dickinson A, and Schultz W. Coding of predicted reward omission by dopamine neurons in a conditioned inhibition paradigm. J Neurosci 23: 10402-10410, 2003.
184. Tobler PN, Fiorillo CD, and Schultz W. Adaptive coding of reward value by dopamine neurons. Science 307: 1642-1645, 2005.
185. Tremblay L, Hollerman JR, and Schultz W. Modifications of reward expectation-related neuronal activity during learning in primate striatum. J Neurophysiol 80: 964-977, 1998.
186. Tricomi EM, Delgado MR, and Fiez JA. Modulation of caudate activity by action contingency. Neuron 41: 281-292, 2004.
187. Triesch J, Ballard DH, Hayhoe MM, and Sullivan BT. What you see is what you need. J Vis 3: 86-94, 2003.
188. Tulloch IF, Arbuthnott GW, and Wright AK. Topographical organization of the striatonigral pathway revealed by anterograde and retrograde neuroanatomical tracing techniques. J Anat 127: 425-441, 1978.
189. Ullsperger M and von Cramon DY. Error monitoring using external feedback: specific roles of the habenular complex, the reward system, and the cingulate motor area revealed by functional magnetic resonance imaging. J Neurosci 23: 4308-4314, 2003.
190. Uno M and Ozawa N. Long-term potentiation of the amygdalo-striatal synaptic transmission in the course of development of amygdaloid kindling in cats. Neurosci Res 12: 251-262, 1991.
191. Van den Pol AN, Smith AD, and Powell JF. GABA axons in synaptic contact with dopamine neurons in the substantia nigra: double immunocytochemistry with biotin-peroxidase and protein A-colloidal gold. Brain Res 348: 146-154, 1985.
192. Waelti P, Dickinson A, and Schultz W. Dopamine responses comply with basic assumptions of formal learning theory. Nature 412: 43-48, 2001.
193. Watanabe K and Hikosaka O. Immediate changes in anticipatory activity of caudate neurons associated with reversal of position-reward contingency. J Neurophysiol 94: 1879-1887, 2005.
194. Watanabe K, Lauwereyns J, and Hikosaka O. Neural correlates of rewarded and unrewarded eye movements in the primate caudate nucleus. J Neurosci 23: 10052-10057, 2003.
195. Watanabe M. Reward expectancy in primate prefrontal neurons. Nature 382: 629-632, 1996.
196. Watanabe M, Hikosaka K, Sakagami M, and Shirakawa S. Coding and monitoring of motivational context in the primate prefrontal cortex. J Neurosci 22: 2391-2400, 2002.
197. Wickens J and Kötter R. Cellular models of reinforcement. In: Models of Information Processing in the Basal Ganglia, edited by Houk JC, Davis JL, and Beiser DG. Cambridge, MA: MIT Press, 1995, p. 187-214.
198. Williams GV and Goldman-Rakic PS. Modulation of memory fields by dopamine D1 receptors in prefrontal cortex. Nature 376: 572-575, 1995.
199. Wilson CJ and Kawaguchi Y. The origins of two-state spontaneous membrane potential fluctuations of neostriatal spiny neurons. J Neurosci 16: 2397-2410, 1996.
200. Wise RA. Neurobiology of addiction. Curr Opin Neurobiol 6: 243-251, 1996.
201. Wurtz RH and Goldberg ME. Activity of superior colliculus in behaving monkey. III. Cells discharging before eye movements. J Neurophysiol 35: 575-586, 1972.
202. Wurtz RH, Sommer MA, Paré M, and Ferraina S. Signal transformations from cerebral cortex to superior colliculus for the generation of saccades. Vision Res 41: 3399-3412, 2001.
203. Yeterian EH and Pandya DN. Prefrontostriatal connections in relation to cortical architectonic organization in rhesus monkeys. J Comp Neurol 312: 43-67, 1991.
204. Yoshida M and Precht W. Monosynaptic inhibition of neurons in the substantia nigra by caudate-nigral fibers. Brain Res 32: 225-228, 1971.
205. Zheng T and Wilson CJ. Corticostriatal combinatorics: the implications of corticostriatal axonal arborizations. J Neurophysiol 87: 1007-1017, 2002.