Modulation of striatal single units by expected reward: A spiny neuron model displaying dopamine-induced bistability

Journal of Neurophysiology

Volumn 90, Issue 2, 2003, Pages 1095-1114

  Gruber, Aaron J ^a   Solla, Sara A ^a   Surmeier, D James ^a   Houk, James C ^a  

^a NORTHWESTERN UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CALCIUM CHANNEL L TYPE; DOPAMINE; DOPAMINE 1 RECEPTOR; INWARDLY RECTIFYING POTASSIUM CHANNEL;

ARTICLE; DOPAMINERGIC SYSTEM; MEMBRANE MODEL; MEMORY; NERVE CELL; NEUROMODULATION; PRIORITY JOURNAL; REINFORCEMENT; REWARD; SIGNAL PROCESSING; SPINY NEURON; SUBSTANTIA NIGRA; SYNAPTIC TRANSMISSION;

ACTION POTENTIALS; ANIMALS; CALCIUM CHANNELS, L-TYPE; CORPUS STRIATUM; DOPAMINE; HUMANS; MODELS, NEUROLOGICAL; NEURONS; POTASSIUM CHANNELS; RECEPTORS, DOPAMINE D1; REWARD;

EID: 0041315448     PISSN: 00223077     EISSN: None     Source Type: Journal    
DOI: 10.1152/jn.00618.2002     Document Type: Article

References (101)

1. Akaike A, Ohno Y, Sasa M, and Takaori S. Excitatory and inhibitory effects of dopamine on neuronal activity of the caudate nucleus neurons in vitro. Brain Res 418: 262-272, 1987.
2. Alexander GE, DeLong MR, and Strick PL. Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu Rev Neurosci 9: 357-381, 1986.
3. 2+ currents in acutley isolated, adult rat neostraial neurons. J Neurosci 14: 6667-6686, 1994.
4. Barto AG. Adaptive critics and the basal ganglia. In: Models of Information Processing in the Basal Ganglia, edited by Houk JC, Davis JL, and Beiser DG. Cambridge, MA: MIT Press, 1995, p. 215-232.
5. Beiser DG and Houk JC. Model of cortical-basal ganglionic processing: encoding the serial order of senory events. J Neurophysiol 79: 3168-3188, 1998.
6. Bender CM and Orszag SA. Multiple-scale analysis. In: Advanced Mathematical Methods for Scientists and Engineers. New York: McGraw-Hill, 1978, p. 544-568.
7. Brown LL, Schneider JS, and Lidsky TI. Sensory and cognitive functions of the basal ganglia. Curr Opin Neurobiol 7: 157-163, 1997.
8. Calabresi P, Maj R, Pisani A, Mercuri NB, and Bernardi G. Long-term synaptic depression in the striatum: physiological and pharmacological characterization. J Neurosci 12: 4224-4233, 1992.
9. Calabresi P, Mercuri N, Stanzione P, Stefani A, and Bernardi G. Intracellullar studies on the dopamine-induced firing inhibition of neostriatal neurons in vitro: evidence for D1 receptor involvement. Neuroscience 20: 757-771, 1987
10. Calabresi P, Pisani A, Centonze D, and Bernardi G. Synaptic plasticity and physiological interactions between dopamine and glutamate in the striatum. Neurosci Biobehav Rev 21: 519-523, 1997.
11. Calabresi P, Pisani A, Mercuri NB, Gattoni G, Tolu M, and Bernardi G. Long-term changes of corticostriatal synaptic transmission: possible implication for motor memory. In: Functions of the Cortico-Basal Ganglia Loop, edited by Kimura M and Graybiel AM. Tokyo, Japan: Springer-Verlag, 1995, p. 89-103.
12. Camperi M and Wang XJ. A model of visuospatial working memory in prefrontal cortex: recurrent network and cellular bistability. J Comput Neurosci 5: 383-405, 1998.
13. Cepeda C, Colwell CS, Itri JN, Chandler SH, and Levine MS. Dopaminergic modulation of nmda-induced whole cell currents in neostriatal neurons in slices: contribution of calcium conductances. J Neurophysiol 79: 82-94, 1998.
14. Charpier S and Deniau JM. In vivo activity-dependent plasticity at cortico-striatal connections: evidence for physiological long-term potentiation. Proc Natl Acad Sci USA 94: 7036-7040, 1997.
15. Colby CL, Duhamel JR, and Goldberg ME. Visual, presaccadic, and cognitive activation of single neurons in monkey lateral intraparietal area. J Neurophysiol 76: 2841-2852, 1996.
16. Cooper DC and White FJ. L-type calcium channels modulate glutamate-driven bursting activity in the nucleus accumbens in vivo. Brain Res 880: 212-218, 2000.
17. Dugast C, Suaud-Chagny MF, and Gonon F. Continuous in vivo monitoring of evoked dopamine release in the rat nucleus accumbens by amperometry. Neuroscience 62: 647-654, 1994.
18. Durstewitz D, Seamans JK, and Sejnowski TJ. Dopamine-mediated stabilization of delay-period activity in a network model of prefrontal cortex. J Neurophysiol 83: 1733-1750, 2000.
19. A receptor currents in neostriatal neurons through a pka/darpp-32/pp1 signaling cascade. J Neurophysiol 83: 2996-3004, 2000.
20. Funahashi S, Bruce CJ, and Goldman-Rakic PS. Visuospatial coding in primate prefrontal neurons revealed by oculomotor paradigms. J Neurophysiol 63: 814-831, 1990.
21. Fuster JM. The Prefrontal Cortex: Anatomy, Physiology, and Neuropsychology of the Frontal Lobe. New York: Raven, 1989.
22. 2+ conductance. Neuroreport 8: 2183-2186, 1997.
23. 2 dopamine receptors-regulated gene expression of striatonigral and striatopallidal neurons. Science 250: 1429-1432, 1990.
24. Goldman-Rakic PS. Circuitry of the frontal association cortex and its relevance to dementia. Arch Gerontol Geriatr 6: 299-309, 1987.
25. Gonon F. Prolonged and extrasynaptic excitatory action of dopamine mediated by D1 receptors in the rat striatum in vivo. J Neurosci 17: 5972-5978, 1997.
26. Grace AA. Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: a hypothesis for the etiology of schizophrenia. Neuroscience 41: 1-24, 1991.
27. Graybiel AM. The basal ganglia and cognitive pattern generators. Schizophr Bull 23: 459-469, 1997.
28. Gruber AJ and Houk JC. A computational study of D1 induced modulation of medium spiny neuron response properties. Soc Neurosci Abstr, 26: 555.15, 2000.
29. Hahn PJ and Durand DM. Bistability dynamics in simulations of neural activity in high-extracellular-potassium conditions. J Comput Neurosci 11: 5-18, 2001.
30. Hassani OK, Cromwell HC, and Schultz W. Influence of expectation of different rewards on behavior-related neuronal activity in the striatum. J Neurophysiol 85: 2477-2489, 2001.
31. Hell JW, Westenbroek RE, Warner C, Ahlijanian MK, Prystay W, Gilbert MM, Snutch TP, and Catterall WA. Identification and differential subcellular localization of the neuronal class c and class d L-type calcium channel alpha 1 subunits. J Cell Biol 123: 949-962, 1993.
32. Hernandez SL, Bargas J, and Surmeier DJ. Activation of D1 dopamine receptors promotes up-state transitions in striatal medium spiny neurons. Soc Neurosci Abstr 28: 164.8, 2002.
33. 2+ conductance. J Neurosci 17: 3334-3342, 1997.
34. 2+ currents and excitability via a novel PLCβ1-IP3-calcineurin-signaling cascade. J Neurosci 20: 8987-8995, 2000.
35. Herrera-Marschitz M, You ZB, Goiny M, Meana JJ, Silveira R, Godukhin OV, Chen Y, Espinoza S, Pettersson E, Loidl CF, Lubec G, Andersson K, Nylander I, Terenius L, and Ungerstedt U. On the origin of extracellular glutamate levels monitored in the basal ganglia of the rat by in vivo microdialysis. J Neurochem 66: 1726-1735, 1996.
36. Hikosaka O, Takikawa Y, and Kawagoe R. Role of the basal ganglia in the control of purposive saccadic eye movements. Physiol Rev 80: 953-978, 2000.
37. Hille B. Ionic Channels of Excitable Membranes. Sunderland, MA: Sinauer, 1992.
38. Hollerman JR, Tremblay L, and Schultz W. Influence of reward expectation on behavior-related neuronal activity in primate striatum. J Neurophysiol 80: 947-963, 1998.
39. Houk JC, Adams JL, and Barto AG. A model of how the basal ganglia generate and use neural signals that predict reinforcement. In: Models of Information Processing in the Basal Ganglia, edited by Houk JC, Davis JL, and Beiser DG. Cambridge, MA: MIT Press, 1995 p. 249-270.
40. Houk JC and Wise SP. Distributed modular architectures linking basal ganglia, cerebellum and cerebral cortex: their role in planning and controlling action. Cereb Cortex 5: 95-110, 1995.
41. Hu XT and Wang RY. Comparison of effects of d-1 and d-2 dopamine receptor agonists on neurons in the rat caudate putamen: an electrophysiological study. J Neurosci 8: 4340-4348, 1988.
42. Kawagoe R, Takikawa Y, and Hikosaka O. Expectation of reward modulates cognitive signals in the basal ganglia. Nat Neurosci 1: 411-416, 1998.
43. Kawagoe R, Takikawa Y, and Hikosaka O. Change in reward-predicting activity of monkey dopamine neurons: short term plasticity. Soc Neurosci Abstr 25: 470.12, 1999.
44. Kemp JM. The cortico-striate projection in the monkey. Brain 93: 525-546, 1970.
45. Kerr JN and Wickens JR. Dopamine d-1/d-5 receptor activation is required for long-term potentiation in the rat neostriatum in vitro. J Neurophysiol 85: 117-124, 2001.
46. Kitai ST. Monosynaptic inputs to caudate neurons identified by intracellular injection of horseradish peroxidase. Brain Res 109: 601-606, 1976.
47. Kitano K, Cateau H, Kaneda K, Nambu A, Takada M, and Fukai T. Two-state membrane potential transitions of striatal spiny neurons as evidenced by numerical simulations and electrophysiological recordings in awake monkeys. J Neurosci 22: 1-6, 2002.
48. Kiyatkin EA and Rebec GV. Dopaminergic modulation of glutamate-induced excitations of neurons in the neostriatum and nucleus accumbens of awake, unrestrained rats. J Neurophysiol 75: 142-153, 1996.
49. Kiyatkin EA and Rebec GV. Striatal neuronal activity and responsiveness to dopamine and glutamate after selective blockade of D1 and D2 dopamine receptors in freely moving rats. J Neurosci 19: 3594-3609, 1999.
50. Kobayashi S, Lauwereyns J, Koizumi M, Sakagami M, and Hikosaka O. Influence of reward expectation on visuospatial processing in macaque lateral prefrontal cortex. J Neurophysiol 87: 1488-1498, 2002.
51. Ljungberg T, Apicella P, and Schultz W. Responses of monkey midbrain dopamine neurons during delayed alternation performance. Brain Res 567: 337-341, 1991.
52. Ljungberg T, Apicella P, and Schultz W. Responses of monkey dopamine neurons during learning of behavioral reactions. J Neurophysiol 67: 145-163, 1992.
53. Matsumoto N, Hanakawa T, Maki S, Graybiel AM, and Kimura M. Nigrostriatal dopamine system in learning to perform sequential motor tasks in a predictive manner. J Neurophysiol 82: 978-998, 1999.
54. Maurice N. D1/D5 dopamine receptor activation differendally modulates rapidly inactivating and persistent sodium currents in prefrontal cortex pyramidal neurons. J Neurosci 21: 2268-2277, 2001.
55. Maurice N, Tkatch T, Burnell K, and Surmeier DJ. D2 dopamine receptors decrease rapidly inactivating and persistent sodium currents via a PLC/pkc cascade in mouse striatal medium spiny neurons. Soc Neurosci Abstr 27: 67.9, 2001.
56. Mermelstein PG, Song W-J, Tkatch T, Yan Z, and Surmeier DJ. Inwardly rectifying potassium currents are correlated with irk subunit expression in rat nucleus accumbens medium spiny neurons. J Neurosci 18: 6650-6661, 1998.
57. Middleton FA and Strick PL. New concepts about the organization of basal ganglia output. Adv Neurol 74: 57-68, 1997.
58. Middleton FA and Strick PL. Basal-ganglia "projections" to the prefrontal cortex of the primate. Cereb Cortex 12: 926-935, 2002.
59. Mirenowiez J and Schultz W. Importance of unpredictability for reward responses in primate dopamine neurons. J Neurophysiol 72: 1024-1027, 1994.
60. Mirenowicz J and Schultz W. Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 379: 449-451, 1996.
61. Montague PR, Dayan P, and Sejnowski TJ. A framework for mesencephalic dopamine systems based on predictive hebbian learning. J Neurosci 16: 1936-1947, 1996.
62. Nakahara H, Amari S, and Hikosaka O. Self-organization in the basal ganglia with modulation of reinforcement signals. Neural Comp 14: 819-844, 2002.
63. Nicola SM, Surmeier J, and Malenka RC. Dopaminergic modulation of neuronal excitability in the striatum and nucleus accumbens. Annu Rev Neurosci 23: 185-215, 2000.
64. Nisenbaum ES and Wilson CJ. Potassium currents responsible for inward and outward rectification in rat neostriatal spiny projection neurons. J Neurosci 15: 4449-4463, 1995.
65. Nisenbaum ES, Wilson CJ, Foehring RC, and Surmeier DJ. Isolation and characterization of a persistent potassium current in neostriatal neurons. J Neurophysiol 76: 1180-1194, 1996.
66. Olson PA and Surmeier DJ. M1 muscarinic receptors modulate Cav 1.3 L-type calcium channels in medium spiny neurons in the nucleus accumbens shell. Soc Neurosci Abstr 28: 164.6, 2002.
67. +-sensitive conductance in neostriatal neurons. Exp Brain Res 110: 205-211, 1996.
68. Partridge JG, Tang KC, and Lovinger DM. Regional and postnatal heterogeneity of activity-dependent long-term changes in synaptic efficacy in the dorsal striatum. J Neurophysiol 84: 1422-1429, 2000.
69. Pierce RC and Rebec GV. Iontophoresis in the neostriatum of awake, unrestrained rats: differential effects of dopamine, glutamate and ascorbate on motor- and nonmotor-related neurons. Neuroscience 67: 313-324, 1995.
70. Rebec GV. Real-time assessments of dopamine function during behavior: single-unit recording, iontophoresis, and fast-scan cyclic voltammetry in awake, unrestrained rats. Alcohol Clin Exp Res 22: 32-40, 1998.
71. Redgrave P, Prescott TJ, and Gurney K. Is the short-latency dopamine response too short to signal reward error? Trends Neurosci 22: 146-151, 1999.
72. Reynolds JN and Wickens JR. Substantia nigra dopamine regulates synaptic plasticity and membrane potential fluctuations in the rat neostriatum, in vivo. Neuroscience 99: 199-203, 2000.
73. Richfield EK, Penney JB, and Young AB. Anatomical and affinity state comparisons between dopamine D1 and D2 receptors in the rat central nervous system. Neuroscience 30: 767-777, 1989.
74. Rinzel J and Ermentrout GB. Analysis of neural excitability and oscillations. In: Methods in Neuronal Modeling, edited by Koch C and Segev I. Cambridge, MA: MIT Press, 1989, p. 135-169.
75. Schultz W, Apicella P, and Ljungberg T. Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. J Neurosci 13: 900-913. 1993.
76. Schultz W, Apicella P, Romo R, and Scarnati E. Context-dependent activity in primate striatum reflecting past and future behavioral events. In: Models of Information Processing in the Basal Ganglia, edited by Houk JC, Davis JL, and Beiser DG. Cambridge, MA: MIT Press, 1995, p. 11-27.
77. Schultz W. Predictive reward signal of dopamine neurons. J Neurophysiol 80: 1-27, 1998.
78. Selemon LD. Longitudinal topography and interdigitation of corticostriatal projections in the rhesus monkey. J Neurosci 5: 776-794, 1985.
79. Servan-Schreiber D, Printz H, and Cohen JD. A network model of catecholamine effects: gain, signal-to-noise ratio, and behavior. Science 249: 892-895, 1990.
80. Song WJ and Surmeier DJ. Voltage-dependent facilitation of calcium channels in rat neostriatal neurons. J Neurophysiol 76: 2290-2306, 1996.
81. Stern EA, Kincaid AC, and Wilson CJ. Spontaneous subthreshold membrane potential fluctuations and action potential variability of rat cortico-striatal and striatal neurons in vivo. J Neurophysiol 77: 1697-1715, 1997.
82. 1 dopaminergic protein kinase/phosphatase cascade in rat neostriatal neurons. Neuron 14: 385-397, 1995.
83. Surmeier DJ, Eberwine J, Wilson CJ, Cao Y, Stefani A, and Kitai ST. Dopamine receptor subtypes colocalize in rat striatonigral neurons. Proc Natl Acad Sci USA 89: 10178-10182, 1992a.
84. Surmeier DJ and Kitai ST. D1 and D2 receptor modulaiton of sodium and potassium currents in rat neostriatal neurons. In: Progress in Brain Research edited by Arbuthnott GW and Emson PC. Amsterdam: Elsevier, 1993, vol. 99, p. 309-324.
85. Surmeier DJ, Song W-J, and Yan Z. Coordinated expression of dopamine receptors in neostriatal medium spiny neurons. J Neurosci 16: 6579-6591, 1996.
86. Surmeier DJ, Stefani A, Foehring RC, and Kitai ST. Developmental regulation of a slowly-inactivating potassium conductance in rat neostriatal neurons. Neurosci Lett 122: 41-46, 1991
87. Surmeier DJ, Xu ZC, Wilson CJ, Stefani, A, and Kitai ST. Grafted neostriatal neurons express a late-developing transient potassium current. Neuroscience 48: 849-856, 1992b.
88. Takikawa Y, Kawagoe R, Itoh H, Nakahara H, and Hikosaka O. Modulation of saccadic eye movements by predicted reward outcome. Exp Brain Res 142: 284-291, 2002.
89. Tremblay L and Schultz W. Reward-related neuronal activity during go-nogo task performance in primate orbitofrontal cortex. J Neurophysiol 83: 1864-1876, 2000.
90. Umemiya M and Raymond LA. Dopammergic modulation of excitatory postsynaptic currents in rat neostriatal neurons. J Neurophysiol 78: 1248-1255, 1997.
91. + currents in neostriatal neurons. Neuroscience 95: 745-752, 2000.
92. Watanabe M. Reward expectancy in primate prefrontal neurons. Nature 382: 629-632, 1996.
93. Watanabe M. Cognitive and motivational operations in primate prefrontal neurons. Rev Neurosci 9: 225-241, 1998.
94. Watanabe M, Hikosaka K, Sakagami M, and Shirakawa S. Coding and monitoring of motivational context in the primate prefrontal cortex. J Neurosci 22: 2391-2400, 2002.
95. Wickens JR and Arbuthnott GW. The corticostriatal system on computer simulation: an intermediate mechanism for sequencing of actions. In: Progress in Brain Research, Chemical Signalling in the Basal Ganglia, edited by Arbuthnott GW and Emson PC. Amsterdam: Elsevier, 1993, vol. 99, p. 325-339.
96. Williams GV and Millar J. Concentration-dependent actions of stimulated dopamine release on neuronal activity in rat striatum. Neuroscience 39: 1-16, 1990.
97. Wilson CJ and Groves PM. Spontaneous firing patterns of identified spiny neurons in the rat neostriatum. Brain Res 220: 67-80, 1981.
98. Wilson CJ. Basal ganglia. In: The Synaptic Organization of the Brain, edited by Shepherd GM. New York: Oxford Univ. Press, 1990, p. 279-316.
99. Wilson CJ. The generation of natural firing patterns in neostriatal neurons. In: Progress in Brain Research, Chemical Signalling in the Basal Ganglia, edited by Arbuthnott GW and Emson PC. Amsterdam: Elsevier, 1993, vol. 99, p. 277-297.
100. Wilson CJ and Kawaguchi Y. The origins of two-state spontaneous membrane potential fluctuations of neostriatal spiny neurons. J Neurosci 16: 2397-2410, 1996.
101. Yuen GL, Hockberger PE, and Houk JC. Bistability in cerebellar purkinje cell dendrites modelled with high-threshold calcium and delayed-rectifier potassium channels. Biol Cybern 73: 375-388, 1995.