Striatal mechanisms underlying movement, reinforcement, and punishment

Physiology

Volumn 27, Issue 3, 2012, Pages 167-177

  Kravitz, Alexxai V ^a   Kreitzer, Anatol C ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL; BRAIN CORTEX; CORPUS STRIATUM; HUMAN; MOVEMENT (PHYSIOLOGY); NERVE CELL; PHYSIOLOGY; PUNISHMENT; REINFORCEMENT; REVIEW;

ANIMALS; CEREBRAL CORTEX; CORPUS STRIATUM; HUMANS; MOVEMENT; NEURONS; PUNISHMENT; REINFORCEMENT (PSYCHOLOGY);

EID: 84862203483     PISSN: 15489213     EISSN: 15489221     Source Type: Journal    
DOI: 10.1152/physiol.00004.2012     Document Type: Review

References (198)

1. Abe M, Schambra H, Wassermann EM, Luckenbaugh D, Schweighofer N, Cohen LG. Reward improves long-term retention of a motor memory through induction of offline memory gains. Curr Biol 21: 557-562, 2011.
2. Adamantidis AR, Tsai HC, Boutrel B, Zhang F, Stuber GD, Budygin EA, Tourino C, Bonci A, Deisseroth K, de Lecea L. Optogenetic interrogation of dopaminergic modulation of the multiple phases of reward-seeking behavior. J Neurosci 31: 10829-10835, 2011.
3. Aizman O, Brismar H, Uhlen P, Zettergren E, Levey AI, Forssberg H, Greengard P, Aperia A. Anatomical and physiological evidence for D1 and D2 dopamine receptor co-localization in neostriatal neurons. Nat Neurosci 3: 226-230, 2000.
4. Albin RL, Young AB, Penney JB. The functional anatomy of basal ganglia disorders. Trends Neurosci 12: 366-375, 1989.
5. Aldridge JW, Anderson RJ, Murphy JT. The role of the basal ganglia in controlling a movement initiated by a visually presented cue. Brain Res 192: 3-16, 1980.
6. Alexander GE, Crutcher MD. Functional architecture of basal ganglia circuits: neural substrates of parallel processing. Trends Neurosci 13: 266-271, 1990.
7. Alexander GE, DeLong MR. Microstimulation of the primate neostriatum. I. Physiological properties of striatal microexcit-able zones. J Neurophysiol 53: 1401-1416, 1985.
8. Allain H, Pollak P, Neukirch HC. Symptomatic effect of selegiline in de novo Parkinsonian patients. The French Selegiline Multicenter Trial. Mov Disord 8, Suppl 1: S36-S40, 1993.
9. American Psychiatric Association. Diagnostic criteria from DSM-IV-TR2000. Washington, DC: American Psychiatric Association, vol. 7, p. 370.
10. Arushanyan EB, Dutov AA. Character and origin of rotatory movements evoked by electrical stimulation of the caudate nucleus in cats. Neurosci Behav Physiol 8: 254-262, 1977.
11. Azrin NH, Holz WC. Punishment, in Operant Behavior: Areas of Research and Application, edited by Honig WK. New York: Appleton-Century-Crofts, 1966, p. 865.
12. Baker KB, Lee JY, Mavinkurve G, Russo GS, Walter B, DeLong MR, Bakay RA, Vitek JL. Somatotopic organization in the internal segment of the globus pallidus in Parkinson's disease. Exp Neurol 222: 219-225, 2010.
13. Baron MS, Wichmann T, Ma D, DeLong MR. Effects of transient focal inactivation of the basal ganglia in parkinsonian primates. J Neurosci 22: 592-599, 2002.
14. Bass CE, Grinevich VP, Vance ZB, Sullivan RP, Bonin KD, Budygin EA. Optogenetic control of striatal dopamine release in rats. J Neurochem 114: 1344-1352, 2010.
15. Bermanzohn PC, Siris SG. Akinesia: a syndrome common to parkinsonism, retarded depression, and negative symptoms of schizophrenia. Comprehensive Psychiatry 33: 221-232, 1992.
16. Bertler A, Rosengren E. On the distribution in brain of mono-amines and of enzymes responsible for their formation. Ex-perientia 15: 382-384, 1959.
17. Bertran-Gonzalez J, Bosch C, Maroteaux M, Matamales M, Herve D, Valjent E, Girault JA. Opposing patterns of signaling activation in dopamine D1 and D2 receptor-expressing striatal neurons in response to cocaine and haloperidol. J Neurosci 28: 5671-5685, 2008.
18. Bertran-Gonzalez J, Herve D, Girault JA, Valjent E. What is the degree of segregation between striatonigral and striato-pallidal projections? Front Neuroanat 4: 136, 2010.
19. Brasted PJ, Dobrossy MD, Robbins TW, Dunnett SB. Striatal lesions produce distinctive impairments in reaction time performance in two different operant chambers. Brain Res Bull 46: 487-493, 1998.
20. Brasted PJ, Robbins TW, Dunnett SB. Distinct roles for striatal subregions in mediating response processing revealed by focal excitotoxic lesions. Behav Neurosci 113: 253-264, 1999.
21. Bromberg-Martin ES, Matsumoto M, Hikosaka O. Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 68: 815-834, 2010.
22. Bruner A. Self-stimulation in the rabbit: an anatomical map of stimulation effects. J Comp Neurol 131: 615-630, 1967.
23. Buchwald NA, Ervin FR. Evoked potentials and behavior; a study of responses to subcortical stimulation in the awake, unrestrained animal. Electroencephalogr Clin Neurophysiol 9: 477-496, 1957.
24. Burk JA, Mair RG. Effects of dorsal and ventral striatal lesions on delayed matching trained with retractable levers. Behav Brain Res 122: 67-78, 2001.
25. Buyukdura JS, McClintock SM, Croarkin PE. Psychomotor retardation in depression: biological underpinnings, measurement, and treatment. Prog Neuropsychopharmacol Biol Psychiatry 35: 395-409, 2011.
26. Castane A, Theobald DE, Robbins TW. Selective lesions of the dorsomedial striatum impair serial spatial reversal learning in rats. Behav Brain Res 210: 74-83, 2010.
27. Chandler WF, Crosby EC. Motor effects of stimulation and ablation of the caudate nucleus of the monkey. Neurology 25: 1160-1163, 1975.
28. Clarke HF, Robbins TW, Roberts AC. Lesions of the medial striatum in monkeys produce perseverative impairments during reversal learning similar to those produced by lesions of the orbitofrontal cortex. J Neurosci 28: 10972-10982, 2008.
29. Cohen JY, Haesler S, Vong L, Lowell BB, Uchida N. Neuron-type-specific signals for reward and punishment in the ventral tegmental area. Nature 482: 85-88, 2012.
30. Conklin BR, Hsiao EC, Claeysen S, Dumuis A, Srinivasan S, Forsayeth JR, Guettier JM, Chang WC, Pei Y, McCarthy KD, Nissenson RA, Wess J, Bockaert J, Roth BL. Engineering GPCR signaling pathways with RASSLs. Nat Methods 5: 673-678, 2008.
31. Cools AR. Chemical and electrical stimulation of the caudate nucleus in freely moving cats: the role of dopamine. Brain Res 58: 437-451, 1973.
32. Corbit LH, Janak PH. Posterior dorsomedial stria-tum is critical for both selective instrumental and Pavlovian reward learning. Eur J Neurosci 31: 1312-1321, 2010.
33. Crutcher MD, DeLong MR. Single cell studies of the primate putamen. II Relations to direction of movement and pattern of muscular activity. Exp Brain Res 53: 244-258, 1984.
34. Delgado JM, Delgado-Garcia JM, Conde M, Rob-les SS. Fatigability of caudate nucleus stimulation in cats. Neuropsychologia 14: 11-21, 1976.
35. DeLong MR. Primate models of movement disorders of basal ganglia origin. Trends Neurosci 13: 281-285, 1990.
36. Delong MR, Georgopoulos AP, Crutcher MD, Mitchell SJ, Richardson RT, Alexander GE. Functional organization of the basal ganglia: contributions of single-cell recording studies. Ciba Found Symp 107: 64-82, 1984.
37. DeLong M, Georgopoulos AP. Motor functions of the basal ganglia. In: Handbook of Physiology. The Nervous System. Motor Control. Bethesda, MD: Am. Physiol. Soc., 1981, sect. 1, vol. 2, pt.2, chapt. 21, p. 101764-101061.
38. Deniau JM, Menetrey A, Charpier S. The lamellar organization of the rat substantia nigra pars re-ticulata: segregated patterns of striatal afferents and relationship to the topography of corticostriatal projections. Neuroscience 73: 761-781, 1996.
39. Deniau JM, Menetrey A, Thierry AM. Indirect nucleus accumbens input to the prefrontal cortex via the substantia nigra pars reticulata: a combined anatomical and electrophysiological study in the rat. Neuroscience 61: 533-545, 1994.
40. Denny-Brown D. The Basal Ganglia and Their Relation to Disorders of Movement. London: Oxford Univ. Press, 1962.
41. Denny-Brown D, Yanagisawa N. The role of the basal ganglia in the initiation of movement. Res Publ Assoc Res Nerv Ment Dis 55: 115-149, 1976.
42. Dobrossy MD, Svendsen CN, Dunnett SB. The effects of bilateral striatal lesions on the acquisition of an operant test of short term memory. Neuroreport 6: 2049-2053, 1995.
43. Dong S, Rogan SC, Roth BL. Directed molecular evolution of DREADDs: a generic approach to creating next-generation RASSLs. Nat Protoc 5: 561-573, 2010.
44. Dostrovsky JO, Levy R, Wu JP, Hutchison WD, Tasker RR, Lozano AM. Microstimulation-induced inhibition of neuronal firing in human globus pallidus. J Neurophysiol 84: 570-574, 2000.
45. Durieux PF, Bearzatto B, Guiducci S, Buch T, Waisman A, Zoli M, Schiffmann SN, de Kerchove d'Exaerde A. D2R striatopallidal neurons inhibit both locomotor and drug reward processes. Nat Neurosci 12: 393-395, 2009.
46. Eagle DM, Humby T, Dunnett SB, Robbins TW. Effects of regional striatal lesions on motor, motivational, and executive aspects of progressive-ratio performance in rats. Behav Neurosci 113: 718-731, 1999.
47. Ehringer H, Hornykiewicz O. Verteilung Von Nor-adrenalin Und Dopamin (3-Hydroxytyramin) Im Gehirn Des Menschen Und Ihr Verhalten Bei Er-krankungen Des Extrapyramidalen Systems. Klin Wochenschr 38: 1236-1239, 1960.
48. Ehringer H, Hornykiewicz O. Distribution of nor-adrenaline and dopamine (3-hydroxytyramine) in the human brain and their behavior in diseases of the extrapyramidal system. Parkinsonism Relat Disord 4: 53-57, 1998.
49. Ehrt U, Aarsland D. Psychiatric aspects of Parkinson's disease. Curr Opin Psychiatry 18: 335-341, 2005.
50. Featherstone RE, McDonald RJ. Dorsal striatum and stimulus-response learning: lesions of the dorsolateral, but not dorsomedial, striatum impair acquisition of a stimulus-response-based instrumental discrimination task, while sparing conditioned place preference learning. Neurosci-ence 124: 23-31, 2004.
51. Featherstone RE, McDonald RJ. Lesions of the dorsolateral striatum impair the acquisition of a simplified stimulus-response dependent conditional discrimination task. Neuroscience 136: 387-395, 2005.
52. Ferguson SM, Eskenazi D, Ishikawa M, Wanat MJ, Phillips PE, Dong Y, Roth BL, Neumaier JF. Transient neuronal inhibition reveals opposing roles of indirect and direct pathways in sensitiza-tion. Nat Neurosci 14: 22-24, 2011.
53. Ferreira TL, Moreira KM, Ikeda DC, Bueno OF, Oliveira MG. Effects of dorsal striatum lesions in tone fear conditioning and contextual fear conditioning. Brain Res 987: 17-24, 2003.
54. Ferreira TL, Shammah-Lagnado SJ, Bueno OF, Moreira KM, Fornari RV, Oliveira MG. The indirect amygdala-dorsal striatum pathway mediates conditioned freezing: insights on emotional memory networks. Neuroscience 153: 84-94, 2008.
55. Ferrier D,. The Functions of the Brain (2nd edition). New York: G. P. Putnam's Sons, 1876.
56. Filion M, Tremblay L, Bedard PJ. Effects of dopamine agonists on the spontaneous activity of globus pallidus neurons in monkeys with MPTP-induced parkinsonism. Brain Res 547: 152-161, 1991.
57. Fiorillo CD, Tobler PN, Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299: 1898-1902, 2003.
58. Forman D, Ward JW. Responses to electrical stimulation of caudate nucleus in cats in chronic experiments. J Neurophysiol 20: 230-244, 1957.
59. Gardiner TW, Nelson RJ. Striatal neuronal activity during the initiation and execution of hand movements made in response to visual and vibratory cues. Exp Brain Res 92: 15-26, 1992.
60. Gerardin E, Lehericy S, Pochon JB, Tezenas du Montcel S, Mangin JF, Poupon F, Agid Y, Le Bihan D, Marsault C. Foot, hand, face and eye representation in the human striatum. Cereb Cortex 13: 162-169, 2003.
61. Gerfen CR. Molecular effects of dopamine on striatal-projection pathways. Trends Neurosci 23, Suppl 10: S64-S70, 2000.
62. Gerfen CR, Engber TM, Mahan LC, Susel Z, Chase TN, Monsma FJ Jr, Sibley DR. D1 and D2 dopamine receptor-regulated gene expression of striatonigral and striatopallidal neurons. Science 250: 1429-1432, 1990.
63. German DC, Bowden DM. Catecholamine systems as the neural substrate for intracranial self-stimulation: a hypothesis. Brain Res 73: 381-419, 1974.
64. Graybiel AM, Aosaki T, Flaherty AW, Kimura M. The basal ganglia and adaptive motor control. Science 265: 1826-1831, 1994.
65. Graybiel AM, Canales JJ, Capper-Loup C. Levodopa-induced dyskinesias and dopamine-dependent stereotypies: a new hypothesis. Trends Neurosci 23, Suppl 10: S71-S77, 2000.
66. Guarraci FA, Kapp BS. An electrophysiological characterization of ventral tegmental area dopa-minergic neurons during differential pavlovian fear conditioning in the awake rabbit. Behav Brain Res 99: 169-179, 1999.
67. Gybels J, Meulders M, Callens M, Colle J. Disturbances of visuo-motor integration in cats with small lesions of the caudate nucleus. Arch Int Physiol Biochim Biophys 75: 283-302, 1967.
68. Heath R. Electrical self-stimulation of the brain in man. In: 119th Annual Meeting of the American Psychiatric Association. St. Louis, MO: Am. Psychiatric Association, 1963.
69. Heiman M, Schaefer A, Gong S, Peterson JD, Day M, Ramsey KE, Suarez-Farinas M, Schwarz C, Stephan DA, Surmeier DJ, Greengard P, Heintz N. A translational profiling approach for the molecular characterization of CNS cell types. Cell 135: 738-748, 2008.
70. Heinonen EH, Rinne UK. Selegiline in the treatment of Parkinson's disease. Acta Neurol Scand Suppl 126: 103-111, 1989.
71. Hikida T, Kimura K, Wada N, Funabiki K, Nakani-shi S. Distinct roles of synaptic transmission in direct and indirect striatal pathways to reward and aversive behavior. Neuron 66: 896-907, 2010.
72. Hikosaka O. Neural systems for control of voluntary action-a hypothesis. Adv Biophys 35: 81-102, 1998.
73. Hikosaka O, Sakamoto M, Usui S. Functional properties of monkey caudate neurons. I. Activities related to saccadic eye movements. J Neu-rophysiol 61: 780-798, 1989.
74. Hikosaka O, Sakamoto M, Usui S. Functional properties of monkey caudate neurons. II. Visual and auditory responses. J Neurophysiol 61: 799-813, 1989.
75. Hikosaka O, Sakamoto M, Usui S. Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward. J Neurophysiol 61: 814-832, 1989.
76. Himwich HE, White RP. Circus movements and excitation of striatal and mesodiencephalic centers in rabbits. J Neurophysiol 20: 81-90, 1957.
77. Hollerman JR, Tremblay L, Schultz W. Influence of reward expectation on behavior-related neuronal activity in primate striatum. J Neurophysiol 80: 947-963, 1998.
78. Homayoun H, Moghaddam B. Differential representation of Pavlovian-instrumental transfer by prefrontal cortex subregions and striatum. Eur J Neurosci 29: 1461-1476, 2009.
79. Humphries MD, Prescott TJ. The ventral basal ganglia, a selection mechanism at the crossroads of space, strategy, and reward. Prog Neurobiol 90: 385-417, 2010.
80. Imamura K, Okayasu N, Nagatsu T. The relationship between depression and regional cerebral blood flow in Parkinson's disease and the effect of selegiline treatment. Acta Neurol Scand 124: 28-39, 2011.
81. Jacques S. Brain stimulation and reward: "pleasure centers" after twenty-five years. Neurosur-gery 5: 277-283, 1979.
82. Jenner P. A2A antagonists as novel non-dopaminergic therapy for motor dysfunction in PD. Neurology 61, Suppl 6: S32-S38, 2003.
83. Jones JL, Wheeler RA, Carelli RM. Behavioral responding and nucleus accumbens cell firing are unaltered following periods of abstinence from sucrose. Synapse 62: 219-228, 2008.
84. Jung R, Hassler R. The exptrapyramidal motor system. In: Handbook of Physiology. Neurophysiology. Washington, DC: Am. Physiol. Soc., 1960, sect. 1, vol. 2, chapt. 35, p. 863219-863928.
85. Kanda T, Jackson MJ, Smith LA, Pearce RK, Na-kamura J, Kase H, Kuwana Y, Jenner P. Adenosine A2A antagonist: a novel antiparkinsonian agent that does not provoke dyskinesia in par-kinsonian monkeys. Ann Neurol 43: 507-513, 1998.
86. Kawagoe R, Takikawa Y, Hikosaka O. Expectation of reward modulates cognitive signals in the basal ganglia. Nat Neurosci 1: 411-416.
87. Kawagoe R, Takikawa Y, Hikosaka O. Reward-predicting activity of dopamine and caudate neurons-a possible mechanism of motivational control of saccadic eye movement. J Neuro-physiol 91: 1013-1024, 2004.
88. Kebabian JW, Calne DB. Multiple receptors for dopamine. Nature 277: 93-96, 1979.
89. Kennard MA. Experimental analysis of the functions of the basal ganglia in monkeys and chimpanzees. J Neurophysiol 7: 127-148, 1944.
90. Kilpatrick MR, Rooney MB, Michael DJ, Wight-man RM. Extracellular dopamine dynamics in rat caudate-putamen during experimenter-delivered and intracranial self-stimulation. Neuroscience 96: 697-706, 2000.
91. Kimchi EY, Laubach M. Dynamic encoding of action selection by the medial striatum. J Neurosci 29: 3148-3159, 2009.
92. Kimchi EY, Torregrossa MM, Taylor JR, Laubach M. Neuronal correlates of instrumental learning in the dorsal striatum. J Neurophysiol 102: 475-489, 2009.
93. Kimura M, Aosaki T, Hu Y, Ishida A, Watanabe K. Activity of primate putamen neurons is selective to the mode of voluntary movement: visually guided, self-initiated or memory-guided. Exp Brain Res 89: 473-477, 1992.
94. Kitsikis A. The suppression of arm movements in monkeys: threshold variations of caudate nucleus stimulation. Brain Res 10: 460-462, 1968.
95. Kitsikis A, Rougel A. The effect of caudate stimulation on conditioned motor behavior in monkeys. Physiol Behav 3: 831-837, 1968.
96. Klemm WR,. Behavioral arrest: in search of the neural control system. Prog Neurobiol 65: 453-471, 2001.
97. Kravitz AV, Freeze BS, Parker PR, Kay K, Thwin MT, Deisseroth K, Kreitzer AC. Regulation of par-kinsonian motor behaviours by optogenetic control of basal ganglia circuitry. Nature 466: 622-626, 2010.
98. Kravitz AV, Kreitzer AC. Optogenetic manipulation of neural circuitry in vivo. Curr Opin Neuro-biol 21: 433-439, 2011.
99. Kravitz AV, Moorman DE, Simpson A, Peoples LL. Session-long modulations of accumbal firing during sucrose-reinforced operant behavior. Synapse 60: 420-428, 2006.
100. Kravitz AV, Tye LD, Kreitzer AC. Distinct roles for direct and indirect pathway striatal neurons in reinforcement. Nature Neuroscience. In press.
101. Kreitzer AC, Malenka RC. Striatal plasticity and basal ganglia circuit function. Neuron 60: 543-554, 2008.
102. Kwak R, Sakamoto T, Suzuki J. Arrest reaction in man: motor arrest response by electrical stimulation of the deep structure of the cerebrum. Tohoku J Exp Med 127: 237-246, 1979.
103. Laursen AM. Movements evoked from the region of the caudate nucleus in cats. Acta Physiol Scand 54: 175-184, 1962.
104. Le Moine C, Bloch B. D1 and D2 dopamine receptor gene expression in the rat striatum: sensitive cRNA probes demonstrate prominent segregation of D1 and D2 mRNAs in distinct neuronal populations of the dorsal and ventral striatum. J Comp Neurol 355: 418-426, 1995.
105. Lebedev MA, Nelson RJ. Rhythmically firing neostriatal neurons in monkey: activity patterns during reaction-time hand movements. J Neuro-physiol 82: 1832-1842, 1999.
106. Lee IH, Assad JA. Putaminal activity for simple reactions or self-timed movements. J Neuro-physiol 89: 2528-2537, 2003.
107. Levy R, Lang AE, Dostrovsky JO, Pahapill P, Romas J, Saint-Cyr J, Hutchison WD, Lozano AM. Lidocaine and muscimol microinjections in sub-thalamic nucleus reverse Parkinsonian symptoms. Brain 124: 2105-2118, 2001.
108. Lilly JC. The psychophysiological basis for two kinds of instincts. Implications for psychoanalytic theory. J Am Psychoanal Assoc 8: 659-670, 1960.
109. Lobo MK, Covington HE, 3rd Chaudhury D, Friedman AK, Sun H, Damez-Werno D, Dietz DM, Zaman S, Koo JW, Kennedy PJ, Mouzon E, Mogri M, Neve RL, Deisseroth K, Han MH, Nestler EJ. Cell type-specific loss of BDNF signaling mimics optogenetic control of cocaine reward. Science 330: 385-390, 2010.
110. Lobo MK, Karsten SL, Gray M, Geschwind DH, Yang XW. FACS-array profiling of striatal projection neuron subtypes in juvenile and adult mouse brains. Nat Neurosci 9: 443-452, 2006.
111. Lobo MK, Nestler EJ. The striatal balancing act in drug addiction: distinct roles of direct and indirect pathway medium spiny neurons. Front Neu-roanat 5: 41, 2011.
112. Lu XY, Ghasemzadeh MB, Kalivas PW. Expression of D1 receptor, D2 receptor, substance P and enkephalin messenger RNAs in the neurons projecting from the nucleus accumbens. Neuro-science 82: 767-780, 1998.
113. Magendie F. Lecons sur les Fonctions et les Maladies du Système Nerveux, edited by Constantin J. Charlestown, SC: Nabu, 2012.
114. Martin JP. The caudate nuclei and locomotion. Ann R Coll Surg Engl 38: 166-175, 1966.
115. Matamales M, Bertran-Gonzalez J, Salomon L, Degos B, Deniau JM, Valjent E, Herve D, Girault JA. Striatal medium-sized spiny neurons: identification by nuclear staining and study of neuronal subpopulations in BAC transgenic mice. PLos One 4: e4770, 2009.
116. Matsubara E, Shoji M, Abe K. The treatment of Parkinson's disease-adenosine A2A receptor antagonists. Nippon Rinsho 60: 112-116, 2002.
117. Matsumoto M, Hikosaka O. Two types of dopa-mine neuron distinctly convey positive and negative motivational signals. Nature 459: 837-841, 2009.
118. Maurice N, Deniau JM, Menetrey A, Glowinski J, Thierry AM. Position of the ventral pallidum in the rat prefrontal cortex-basal ganglia circuit. Neuroscience 80: 523-534, 1997.
119. Mayeux R, Stern Y, Williams JB, Cote L, Frantz A, Dyrenfurth I. Clinical and biochemical features of depression in Parkinson's disease. Am J Psychiatry 143: 756-759, 1986.
120. McLennan H, Emmons PR, Plummer PM. Some behavioral effects of stimulation of the caudate nucleus in unrestrained cats. Can J Physiol Pharmacol 42: 329-339, 1964.
121. Mettler FA. Relation between pyramidal and ex-trapyramidal function. Assn Res Nervous Mental Dis 21: 150-227, 1942.
122. Mettler FA. Effects of bilateral simultaneous sub-cortical lesions in the primate. J Neuropathol Exp Neurol 4: 99-122, 1945.
123. Mettler FA, Mettler CC. Labyrinthine disregard after removal of the caudate. Proc Soc Exp Biol Med 45: 473-475, 1940.
124. Mettler FA, Mettler CC. The effects of striatal injury. Brain 65: 242-255, 1942.
125. Miyachi S, Lu X, Imanishi M, Sawada K, Nambu A, Takada M. Somatotopically arranged inputs from putamen and subthalamic nucleus to primary motor cortex. Neurosci Res 56: 300-308, 2006.
126. Montgomery, EB Jr, Buchholz SR. The striatum and motor cortex in motor initiation and execution. Brain Res 549: 222-229, 1991.
127. Mora F, Rolls ET, Burton MJ, Shaw GS. Effects of dopamine-receptor blockade on self-stimulation in the monkey. Pharmacol Biochem Behav 4: 211-216, 1976.
128. Murer MG, Pazo JH. Behavioral responses induced by electrical stimulation of the caudate nucleus in freely moving cats. Behav Brain Res 57: 9-19, 1993.
129. Nakatani Y, Matsumoto Y, Mori Y, Hirashima D, Nishino H, Arikawa K, Mizunami M. Why the carrot is more effective than the stick: different dynamics of punishment memory and reward memory and its possible biological basis. Neuro-biol Learn Mem 92: 370-380, 2009.
130. Nambu A. Somatotopic organization of the primate basal ganglia. Front Neuroanat 5: 26, 2011.
131. Nelson JC, Charney DS. The symptoms of major depressive illness. Am J Psychiatry 138: 1-13, 1981.
132. Ng J, Rashid AJ, So CH, O'Dowd BF, George SR. Activation of calcium/calmodulin-dependent protein kinase IIalpha in the striatum by the hetero-meric D1-D2 dopamine receptor complex. Neuroscience 165: 535-541, 2010.
133. Nicola SM, Yun IA, Wakabayashi KT, Fields HL. Firing of nucleus accumbens neurons during the consummatory phase of a discriminative stimulus task depends on previous reward predictive cues. J Neurophysiol 91: 1866-1882, 2004.
134. Nothnagel H. Experimented Untersuchungen ue-ber die Functionen des Gehirns. Virchows Archiv fur Pathologische Anatomie und Physiologie und fur Klinische Medizin 57: 184-214, 1873.
135. Obeso JA, Marin C, Rodriguez-Oroz C, Blesa J, Benitez-Temino B, Mena-Segovia J, Rodriguez M, Olanow CW. The basal ganglia in Parkinson's disease: current concepts and unexplained observations. Ann Neurol 64, Suppl 2: S30-S46, 2008.
136. Obeso JA, Rodriguez-Oroz MC, Rodriguez M, Lanciego JL, Artieda J, Gonzalo N, Olanow CW. Pathophysiology of the basal ganglia in Parkinson's disease. Trends Neurosci 23, Suppl: S8-S19, 2000.
137. Ohno T, Tsubokawa H. Regional differences in the cat caudate nucleus as to the effectiveness in inducing contraversive head-turning by electrical stimulation. Neurosci Res 4: 497-516, 1987.
138. Olds J, Milner P. Positive reinforcement produced by electrical stimulation of septal area and other regions of rat brain. J Comp Physiol Psy-chol 47: 419-427, 1954.
139. Olmstead CE, Villablanca JR, Marcus RJ, Avery DL. Effects of caudate nuclei or frontal cortex ablations in cats. IV. Bar pressing, maze learning, and performance. Exp Neurol 53: 670-693, 1976.
140. Olmstead CE, Villablanca JR, Stabenfeldt GH. Effect of caudate nuclei and frontal cortical ablations in cats: testosterone and 17 beta-estradiol concentrations. Exp Neurol 75: 149-157, 1982.
141. Parkinson J. An Essay on the Shaking Palsy. London: Sherwood, Neely, and Jones, 1817.
142. Parkinson J. An essay on the shaking palsy. 1817. J Neuropsychiatry Clin Neurosci 14:; discussion 222, 223-236, 2002.
143. Pezze MA, Feldon J. Mesolimbic dopaminergic pathways in fear conditioning. Prog Neurobiol 74: 301-320, 2004.
144. Phillips AG, Carter DA, Fibiger HC. Dopaminer-gic substrates of intracranial self-stimulation in the caudate-putamen. Brain Res 104: 221-232, 1976.
145. Phillips AG, Mora F, Rolls ET. Intracranial self-stimulation in orbitofrontal cortex and caudate nucleus of rhesus monkey: effects of apomor-phine, pimozide, and spiroperidol. Psychophar-macology (Berl) 62: 79-82, 1979.
146. Plotnik R, Mir D, Delgado JMR. Map of reinforcing sites in the rhesus monkey brain. Int J Psy-chobiol 2: 1-21, 1972.
147. Ragozzino ME, Jih J, Tzavos A. Involvement of the dorsomedial striatum in behavioral flexibility: role of muscarinic cholinergic receptors. Brain Res 953: 205-214, 2002.
148. Ragozzino ME, Ragozzino KE, Mizumori SJ, Kes-ner RP. Role of the dorsomedial striatum in behavioral flexibility for response and visual cue discrimination learning. Behav Neurosci 116: 105-115, 2002.
149. Rashid AJ, So CH, Kong MM, Furtak T, El-Ghundi M, Cheng R, O'Dowd BF, George SR. D1-D2 dopamine receptor heterooligomers with unique pharmacology are coupled to rapid activation of Gq/11 in the striatum. Proc Natl Acad Sci USA 104: 654-659, 2007.
150. Redgrave P. Modulation of intracranial self-stimulation behaviour by local perfusions of dopa-mine, noradrenaline and serotonin within the caudate nucleus and nucleus accumbens. Brain Res 155: 277-295, 1978.
151. Redgrave P, Dean P. Intracranial self-stimulation. Br Med Bull 37: 141-146, 1981.
152. Rogers MA, Bradshaw JL, Phillips JG, Chiu E, Vaddadi K, Presnel I, Mileshkin C. Parkinsonian motor characteristics in unipolar major depression. J Clin Exp Neuropsychol 22: 232-244, 2000.
153. Roitman MF, Wheeler RA, Carelli RM. Nucleus accumbens neurons are innately tuned for rewarding and aversive taste stimuli, encode their predictors, and are linked to motor output. Neuron 45: 587-597, 2005.
154. Rolls ET, Thorpe SJ, Boytim M, Szabo I, Perrett DI. Responses of striatal neurons in the behaving monkey. 3. Effects of iontophoretically applied dopamine on normal responsiveness. Neurosci-ence 12: 1201-1212, 1984.
155. Rolls ET, Thorpe SJ, Maddison SP. Responses of striatal neurons in the behaving monkey. 1. Head of the caudate nucleus. Behav Brain Res 7: 179-210, 1983.
156. Romo R, Scarnati E, Schultz W. Role of primate basal ganglia and frontal cortex in the internal generation of movements. II. Movement-related activity in the anterior striatum. Exp Brain Res 91: 385-395, 1992.
157. Romo R, Schultz W. Role of primate basal ganglia and frontal cortex in the internal generation of movements. III. Neuronal activity in the supplementary motor area. Exp Brain Res 91: 396-407, 1992.
158. Roop RG, Hollander JA, Carelli RM. Accumbens activity during a multiple schedule for water and sucrose reinforcement in rats. Synapse 43: 223-226, 2002.
159. Rose S, Ramsay Croft N, Jenner P. The novel adenosine A2a antagonist ST1535 potentiates the effects of a threshold dose of l-dopa in unilaterally 6-OHDA-lesioned rats. Brain Res 1133: 110-114, 2007.
160. Salamone JD. The involvement of nucleus accum-bens dopamine in appetitive and aversive motivation. Behav Brain Res 61: 117-133, 1994.
161. Sano H, Yasoshima Y, Matsushita N, Kaneko T, Kohno K, Pastan I, Kobayashi K. Conditional ablation of striatal neuronal types containing dopa-mine D2 receptor disturbs coordination of basal ganglia function. J Neurosci 23: 9078-9088, 2003.
162. Schrag A, Jahanshahi M, Quinn NP. What contributes to depression in Parkinson's disease? Psychological Medicine 31: 65-73, 2001.
163. Schultz W. Predictive reward signal of dopamine neurons. J Neurophysiol 80: 1-27, 1998.
164. Schultz W, Dickinson A. Neuronal coding of prediction errors. Annu Rev Neurosci 23: 473-500, 2000.
165. Schultz W, Romo R. Neuronal activity in the monkey striatum during the initiation of movements. Exp Brain Res 71: 431-436, 1988.
166. Schultz W, Romo R. Role of primate basal ganglia and frontal cortex in the internal generation of movements. I. Preparatory activity in the anterior striatum. Exp Brain Res 91: 363-384, 1992.
167. Schultz W, Tremblay L, Hollerman JR. Reward processing in primate orbitofrontal cortex and basal ganglia. Cereb Cortex 10: 272-284, 2000.
168. Schultz W, Tremblay L, Hollerman JR. Changes in behavior-related neuronal activity in the striatum during learning. Trends Neurosci 26: 321-328, 2003.
169. Shi LH, Luo F, Woodward DJ, Chang JY. Neural responses in multiple basal ganglia regions during spontaneous and treadmill locomotion tasks in rats. Exp Brain Res 157: 303-314, 2004.
170. Simuni T, Sethi K. Nonmotor manifestations of Parkinson's disease. Ann Neurol 64, Suppl 2: S65-S80, 2008.
171. Skinner BF. Science And Human Behavior. New York: Macmillan, 1953.
172. Skinner BF. Contingencies of Reinforcement: A Theoretical Analysis. New York: Appleton-Century-Crofts, 1969.
173. Smith Y, Villalba R. Striatal and extrastriatal do-pamine in the basal ganglia: an overview of its anatomical organization in normal and Parkinso-nian brains. Mov Disord 23, Suppl 3: S534-S547, 2008.
174. Starkstein SE, Preziosi TJ, Berthier ML, Bolduc PL, Mayberg HS, Robinson RG. Depression and cognitive impairment in Parkinson's disease. Brain 112: 1141-1153, 1989.
175. Steur EN, Ballering LA. Moclobemide and selegeline in the treatment of depression in Parkinson's disease. J Neurol Neurosurg Psychiatry 63: 547, 1997.
176. Stoof JC, Kebabian JW. Opposing roles for D-1 and D-2 dopamine receptors in efflux of cyclic AMP from rat neostriatum. Nature 294: 366-368, 1981.
177. Surmeier DJ, Plotkin J, Shen W. Dopamine and synaptic plasticity in dorsal striatal circuits controlling action selection. Curr Opin Neurobiol 19: 621-628, 2009.
178. Surmeier DJ, Song WJ, Yan Z. Coordinated expression of dopamine receptors in neostriatal medium spiny neurons. J Neurosci 16: 6579-6591, 1996.
179. Taha SA, Fields HL. Encoding of palatability and appetitive behaviors by distinct neuronal populations in the nucleus accumbens. J Neurosci 25: 1193-1202, 2005.
180. Takigawa M, Mogenson GJ. Intracranial self-stimulation of the nucleus accumbens of the rat and its associated behavior (author's transl). No To Shinkei 32: 299-304, 1980.
181. Tempel BL, Bonini N, Dawson DR, Quinn WG. Reward learning in normal and mutant Drosoph-ila. Proc Natl Acad Sci USA 80: 1482-1486, 1983.
182. Tom T, Cummings JL. Depression in Parkinson's disease. Pharmacological characteristics and treatment. Drugs Aging 12: 55-74, 1998.
183. Tsai HC, Zhang F, Adamantidis A, Stuber GD, Bonci A, de Lecea L, Deisseroth K. Phasic firing in dopaminergic neurons is sufficient for behavioral conditioning. Science 324: 1080-1084, 2009.
184. Unoki S, Matsumoto Y, Mizunami M. Participation of octopaminergic reward system and dopaminergic punishment system in insect olfactory learning revealed by pharmacological study. Eur J Neurosci 22: 1409-1416, 2005.
185. Unoki S, Matsumoto Y, Mizunami M. Roles of octopaminergic and dopaminergic neurons in mediating reward and punishment signals in insect visual learning. Eur J Neurosci 24: 2031-2038, 2006.
186. Veiga BA, Borges V, Silva SM, Goulart Fde O, Cendoroglo MS, Ferraz HB. Depression in Parkinson's disease: clinical-epidemiological correlates and comparison with a controlled group of non-parkinsonian geriatric patients. Rev Bras Psiquiatr 31: 39-42, 2009.
187. Villablanca JR. Why do we have a caudate nucleus? Acta Neurobiol Exp (Warsz) 70: 95-105, 2010.
188. Villablanca JR, Marcus RJ, Olmstead CE. Effects of caudate nuclei or frontal cortical ablations in cats. I. Neurology and gross behavior. Exp Neu-rol 52: 389-420, 1976.
189. Villablanca JR, Olmstead CE. The striatum: a fine tuner of the brain. Acta Neurobiol Exp (Warsz) 42: 227-299, 1982.
190. West MO, Carelli RM, Pomerantz M, Cohen SM, Gardner JP, Chapin JK, Woodward DJ. A region in the dorsolateral striatum of the rat exhibiting single-unit correlations with specific locomotor limb movements. J Neurophysiol 64: 1233-1246, 1990.
191. White NM, Salinas JA. Mnemonic functions of dorsal striatum and hippocampus in aversive conditioning. Behav Brain Res 142: 99-107, 2003.
192. Wilkinson HA, Peele TL. Intracranial self-stimulation in cats. J Comp Neurol 121: 425-440, 1963.
193. Wilson SAK. An experimental research into the anatomy and physiology of the corpus striatum. Brain 36: 427-492, 1914.
194. Witten IB, Steinberg EE, Lee SY, Davidson TJ, Zalocusky KA, Brodsky M, Yizhar O, Cho SL, Gong S, Ramakrishnan C, Stuber GD, Tye KM, Janak PH, Deisseroth K. Recombinase-driver rat lines: tools, techniques, and optogenetic application to dopamine-mediated reinforcement. Neuron 72: 721-733, 2011.
195. Youdim MB, Bakhle YS. Monoamine oxidase: iso-forms and inhibitors in Parkinson's disease and depressive illness. Br J Pharmacol 147, Suppl 1: S287-S296, 2006.
196. Young SD, Michael AC. Voltammetry of extracellular dopamine in rat striatum during ICSS-like electrical stimulation of the medial forebrain bundle. Brain Res 600: 305-307, 1993.
197. Zhou L, Furuta T, Kaneko T. Chemical organization of projection neurons in the rat accumbens nucleus and olfactory tubercle. Neuroscience 120: 783-798, 2003.
198. Zimmerberg B, Glick SD. Rotation and stereotypy during electrical stimulation of the caudate nucleus. Res Commun Chem Pathol Pharmacol 8: 195, 1974.