Neurons in the ventral striatum exhibit cell-type-specific representations of outcome during learning

Neuron

Volumn 82, Issue 5, 2014, Pages 1145-1156

  Atallah, Hisham E ^a   McCool, Andrew D ^a   Howe, Mark W ^a   Graybiel, Ann M ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AFFECT; ANIMAL EXPERIMENT; ARTICLE; BEHAVIOR CHANGE; BRAIN CELL; BRAIN FUNCTION; CELL SPECIFICITY; CHOLINERGIC INTERNEURON; CONTROLLED STUDY; CORPUS STRIATUM; EVOKED AUDITORY RESPONSE; EVOKED CORTICAL RESPONSE; EVOKED SOMATOSENSORY RESPONSE; HIGH FIRING INTERNEURON; INTERNEURON; INTRACELLULAR SIGNALING; LEARNING; MOTIVATION; NERVE CELL MEMBRANE POTENTIAL; NERVE CONDUCTION; NONHUMAN; PRIORITY JOURNAL; RAT; REINFORCEMENT; REWARD; SPINY PROJECTION NEURON; T-MAZE TEST; TASK PERFORMANCE; TONICALLY ACTIVE NEURON;

ACTION POTENTIALS; ANIMALS; BASAL GANGLIA; CHOLINERGIC NEURONS; LEARNING; MAZE LEARNING; NEURONS; RATS; RATS, LONG-EVANS; REINFORCEMENT (PSYCHOLOGY); REWARD;

EID: 84901758385     PISSN: 08966273     EISSN: 10974199     Source Type: Journal    
DOI: 10.1016/j.neuron.2014.04.021     Document Type: Article

References (88)

1. Alexander B., Warner-Schmidt J., Eriksson T., Tamminga C., Arango-Lievano M., Ghose S., Vernov M., Stavarache M., Musatov S., Flajolet M., et al. Reversal of depressed behaviors in mice by p11 gene therapy in the nucleus accumbens. Sci. Transl. Med. 2010, 2:54ra76.
2. Aosaki T., Graybiel A.M., Kimura M. Effect of the nigrostriatal dopamine system on acquired neural responses in the striatum of behaving monkeys. Science 1994, 265:412-415.
3. Aosaki T., Kimura M., Graybiel A.M. Temporal and spatial characteristics of tonically active neurons of the primate's striatum. J.Neurophysiol. 1995, 73:1234-1252.
4. Apicella P. Leading tonically active neurons of the striatum from reward detection to context recognition. Trends Neurosci. 2007, 30:299-306.
5. Apicella P., Ljungberg T., Scarnati E., Schultz W. Responses to reward in monkey dorsal and ventral striatum. Exp. Brain Res. 1991, 85:491-500.
6. Atallah H.E., Lopez-Paniagua D., Rudy J.W., O'Reilly R.C. Separate neural substrates for skill learning and performance in the ventral and dorsal striatum. Nat. Neurosci. 2007, 10:126-131.
7. Balleine B.W., Dickinson A. Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 1998, 37:407-419.
8. Barnes T.D., Kubota Y., Hu D., Jin D.Z., Graybiel A.M. Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories. Nature 2005, 437:1158-1161.
9. Beatty J.A., Sullivan M.A., Morikawa H., Wilson C.J. Complex autonomous firing patterns of striatal low-threshold spike interneurons. J.Neurophysiol. 2012, 108:771-781.
10. Belin D., Everitt B.J. Cocaine seeking habits depend upon dopamine-dependent serial connectivity linking the ventral with the dorsal striatum. Neuron 2008, 57:432-441.
11. Belin D., Jonkman S., Dickinson A., Robbins T.W., Everitt B.J. Parallel and interactive learning processes within the basal ganglia: relevance for the understanding of addiction. Behav. Brain Res. 2009, 199:89-102.
12. Belin D., Belin-Rauscent A., Murray J.E., Everitt B.J. Addiction: failure of control over maladaptive incentive habits. Curr. Opin. Neurobiol. 2013, 23:564-572.
13. Berke J.D. Uncoordinated firing rate changes of striatal fast-spiking interneurons during behavioral task performance. J.Neurosci. 2008, 28:10075-10080.
14. Berridge K.C., Ho C.Y., Richard J.M., DiFeliceantonio A.G. The tempted brain eats: pleasure and desire circuits in obesity and eating disorders. Brain Res. 2010, 1350:43-64.
15. Blazquez P.M., Fujii N., Kojima J., Graybiel A.M. A network representation of response probability in the striatum. Neuron 2002, 33:973-982.
16. Bradfield L.A., Bertran-Gonzalez J., Chieng B., Balleine B.W. The thalamostriatal pathway and cholinergic control of goal-directed action: interlacing new with existing learning in the striatum. Neuron 2013, 79:153-166.
17. Bromberg-Martin E.S., Matsumoto M., Hikosaka O. Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 2010, 68:815-834.
18. Brown M.T., Tan K.R., O'Connor E.C., Nikonenko I., Muller D., Lüscher C. Ventral tegmental area GABA projections pause accumbal cholinergic interneurons to enhance associative learning. Nature 2012, 492:452-456.
19. Carelli R.M., Deadwyler S.A. A comparison of nucleus accumbens neuronal firing patterns during cocaine self-administration and water reinforcement in rats. J.Neurosci. 1994, 14:7735-7746.
20. Centonze D., Gubellini P., Pisani A., Bernardi G., Calabresi P. Dopamine, acetylcholine and nitric oxide systems interact to induce corticostriatal synaptic plasticity. Rev. Neurosci. 2003, 14:207-216.
21. Chang S.E., Wheeler D.S., Holland P.C. Roles of nucleus accumbens and basolateral amygdala in autoshaped lever pressing. Neurobiol. Learn. Mem. 2012, 97:441-451.
22. Cohen J.Y., Haesler S., Vong L., Lowell B.B., Uchida N. Neuron-type-specific signals for reward and punishment in the ventral tegmental area. Nature 2012, 482:85-88.
23. Cragg S.J. Meaningful silences: how dopamine listens to the ACh pause. Trends Neurosci. 2006, 29:125-131.
24. Der-Avakian A., Markou A. The neurobiology of anhedonia and other reward-related deficits. Trends Neurosci. 2012, 35:68-77.
25. Dezfouli A., Balleine B.W. Habits, action sequences and reinforcement learning. Eur. J. Neurosci. 2012, 35:1036-1051.
26. English D.F., Ibanez-Sandoval O., Stark E., Tecuapetla F., Buzsáki G., Deisseroth K., Tepper J.M., Koos T. GABAergic circuits mediate the reinforcement-related signals of striatal cholinergic interneurons. Nat. Neurosci. 2012, 15:123-130.
27. Everitt B.J., Robbins T.W. Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nat. Neurosci. 2005, 8:1481-1489.
28. Fujii N., Graybiel A.M. Time-varying covariance of neural activities recorded in striatum and frontal cortex as monkeys perform sequential-saccade tasks. Proc. Natl. Acad. Sci. USA 2005, 102:9032-9037.
29. Gill T.M., Castaneda P.J., Janak P.H. Dissociable roles of the medial prefrontal cortex and nucleus accumbens core in goal-directed actions for differential reward magnitude. Cereb. Cortex 2010, 20:2884-2899.
30. Gittis A.H., Kreitzer A.C. Striatal microcircuitry and movement disorders. Trends Neurosci. 2012, 35:557-564.
31. Gläscher J., Daw N., Dayan P., O'Doherty J.P. States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 2010, 66:585-595.
32. Goldberg J.A., Reynolds J.N. Spontaneous firing and evoked pauses in the tonically active cholinergic interneurons of the striatum. Neuroscience 2011, 198:27-43.
33. Gong S., Doughty M., Harbaugh C.R., Cummins A., Hatten M.E., Heintz N., Gerfen C.R. Targeting Cre recombinase to specific neuron populations with bacterial artificial chromosome constructs. J.Neurosci. 2007, 27:9817-9823.
34. Graybiel A.M. Habits, rituals, and the evaluative brain. Annu. Rev. Neurosci. 2008, 31:359-387.
35. Graybiel A.M., Aosaki T., Flaherty A.W., Kimura M. The basal ganglia and adaptive motor control. Science 1994, 265:1826-1831.
36. Greening S.G., Osuch E.A., Williamson P.C., Mitchell D.G. The neural correlates of regulating positive and negative emotions in medication-free major depression. Soc. Cogn. Affect. Neurosci. 2013, 10.1093/scan/nst027.
37. Hernandez P.J., Sadeghian K., Kelley A.E. Early consolidation of instrumental learning requires protein synthesis in the nucleus accumbens. Nat. Neurosci. 2002, 5:1327-1331.
38. Humphries M.D., Prescott T.J. The ventral basal ganglia, a selection mechanism at the crossroads of space, strategy, and reward. Prog. Neurobiol. 2010, 90:385-417.
39. Hyman S.E., Malenka R.C., Nestler E.J. Neural mechanisms of addiction: the role of reward-related learning and memory. Annu. Rev. Neurosci. 2006, 29:565-598.
40. Jog M.S., Kubota Y., Connolly C.I., Hillegaart V., Graybiel A.M. Building neural representations of habits. Science 1999, 286:1745-1749.
41. Kawaguchi Y., Wilson C.J., Augood S.J., Emson P.C. Striatal interneurones: chemical, physiological and morphological characterization. Trends Neurosci. 1995, 18:527-535.
42. Keedwell P.A., Andrew C., Williams S.C., Brammer M.J., Phillips M.L. The neural correlates of anhedonia in major depressive disorder. Biol. Psychiatry 2005, 58:843-853.
43. Kita H., Kita T., Kitai S.T. Regenerative potentials in rat neostriatal neurons in an invitro slice preparation. Exp. Brain Res. 1985, 60:63-70.
44. Kreitzer A.C. Physiology and pharmacology of striatal neurons. Annu. Rev. Neurosci. 2009, 32:127-147.
45. Kreitzer A.C., Malenka R.C. Striatal plasticity and basal ganglia circuit function. Neuron 2008, 60:543-554.
46. Kubota Y., Liu J., Hu D., DeCoteau W.E., Eden U.T., Smith A.C., Graybiel A.M. Stable encoding of task structure coexists with flexible coding of task events in sensorimotor striatum. J.Neurophysiol. 2009, 102:2142-2160.
47. Lansink C.S., Goltstein P.M., Lankelma J.V., Pennartz C.M. Fast-spiking interneurons of the rat ventral striatum: temporal coordination of activity with principal cells and responsiveness to reward. Eur. J. Neurosci. 2010, 32:494-508.
48. Li J., Daw N.D. Signals in human striatum are appropriate for policy update rather than value prediction. J.Neurosci. 2011, 31:5504-5511.
49. Liljeholm M., O'Doherty J.P. Contributions of the striatum to learning, motivation, and performance: an associative account. Trends Cogn. Sci. 2012, 16:467-475.
50. Matsumoto M., Hikosaka O. Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 2009, 459:837-841.
51. McClure S.M., Berns G.S., Montague P.R. Temporal prediction errors in a passive learning task activate human striatum. Neuron 2003, 38:339-346.
52. Morris G., Arkadir D., Nevet A., Vaadia E., Bergman H. Coincident but distinct messages of midbrain dopamine and striatal tonically active neurons. Neuron 2004, 43:133-143.
53. Nakahara H., Itoh H., Kawagoe R., Takikawa Y., Hikosaka O. Dopamine neurons can represent context-dependent prediction error. Neuron 2004, 41:269-280.
54. Nestler E.J., Carlezon W.A. The mesolimbic dopamine reward circuit in depression. Biol. Psychiatry 2006, 59:1151-1159.
55. Pan W.X., Schmidt R., Wickens J.R., Hyland B.I. Dopamine cells respond to predicted events during classical conditioning: evidence for eligibility traces in the reward-learning network. J.Neurosci. 2005, 25:6235-6242.
56. Pratt W.E., Kelley A.E. Nucleus accumbens acetylcholine regulates appetitive learning and motivation for food via activation of muscarinic receptors. Behav. Neurosci. 2004, 118:730-739.
57. Pratt W.E., Spencer R.C., Kelley A.E. Muscarinic receptor antagonism of the nucleus accumbens core causes avoidance to flavor and spatial cues. Behav. Neurosci. 2007, 121:1215-1223.
58. Price J.L., Drevets W.C. Neurocircuitry of mood disorders. Neuropsychopharmacology 2010, 35:192-216.
59. Ravel S., Legallet E., Apicella P. Responses of tonically active neurons in the monkey striatum discriminate between motivationally opposing stimuli. J.Neurosci. 2003, 23:8489-8497.
60. Roesch M.R., Calu D.J., Schoenbaum G. Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards. Nat. Neurosci. 2007, 10:1615-1624.
61. Schmitzer-Torbert N.C., Redish A.D. Task-dependent encoding of space and events by striatal neurons is dependent on neural subtype. Neuroscience 2008, 153:349-360.
62. Schultz W. Getting formal with dopamine and reward. Neuron 2002, 36:241-263.
63. Schultz W., Apicella P., Ljungberg T., Romo R., Scarnati E. Reward-related activity in the monkey striatum and substantia nigra. Prog. Brain Res. 1993, 99:227-235.
64. Schultz W., Dayan P., Montague P.R. A neural substrate of prediction and reward. Science 1997, 275:1593-1599.
65. Setlow B., Schoenbaum G., Gallagher M. Neural encoding in ventral striatum during olfactory discrimination learning. Neuron 2003, 38:625-636.
66. Shabel S.J., Proulx C.D., Trias A., Murphy R.T., Malinow R. Input to the lateral habenula from the basal ganglia is excitatory, aversive, and suppressed by serotonin. Neuron 2012, 74:475-481.
67. Smith K.S., Virkud A., Deisseroth K., Graybiel A.M. Reversible online control of habitual behavior by optogenetic perturbation of medial prefrontal cortex. Proc. Natl. Acad. Sci. USA 2012, 109:18932-18937.
68. Stamatakis A.M., Stuber G.D. Activation of lateral habenula inputs to the ventral midbrain promotes behavioral avoidance. Nat. Neurosci. 2012, 15:1105-1107.
69. Svenningsson P., Chergui K., Rachleff I., Flajolet M., Zhang X., El Yacoubi M., Vaugeois J.M., Nomikos G.G., Greengard P. Alterations in 5-HT1B receptor function by p11 in depression-like states. Science 2006, 311:77-80.
70. Taha S.A., Fields H.L. Encoding of palatability and appetitive behaviors by distinct neuronal populations in the nucleus accumbens. J.Neurosci. 2005, 25:1193-1202.
71. Tan K.R., Yvon C., Turiault M., Mirzabekov J.J., Doehner J., Labouèbe G., Deisseroth K., Tye K.M., Lüscher C. GABA neurons of the VTA drive conditioned place aversion. Neuron 2012, 73:1173-1183.
72. Tepper J.M., Bolam J.P. Functional diversity and specificity of neostriatal interneurons. Curr. Opin. Neurobiol. 2004, 14:685-692.
73. Thorn C.A., Atallah H., Howe M., Graybiel A.M. Differential dynamics of activity changes in dorsolateral and dorsomedial striatal loops during learning. Neuron 2010, 66:781-795.
74. Threlfell S., Cragg S.J. Dopamine signaling in dorsal versus ventral striatum: the dynamic role of cholinergic interneurons. Front. Syst. Neurosci. 2011, 5:11.
75. Tobler P.N., Dickinson A., Schultz W. Coding of predicted reward omission by dopamine neurons in a conditioned inhibition paradigm. J.Neurosci. 2003, 23:10402-10410.
76. Tye K.M., Mirzabekov J.J., Warden M.R., Ferenczi E.A., Tsai H.C., Finkelstein J., Kim S.Y., Adhikari A., Thompson K.R., Andalman A.S., et al. Dopamine neurons modulate neural encoding and expression of depression-related behaviour. Nature 2013, 493:537-541.
77. van der Meer M.A., Redish A.D. Ventral striatum: a critical look at models of learning and evaluation. Curr. Opin. Neurobiol. 2011, 21:387-392.
78. van der Meer M.A., Johnson A., Schmitzer-Torbert N.C., Redish A.D. Triple dissociation of information processing in dorsal striatum, ventral striatum, and hippocampus on a learned spatial decision task. Neuron 2010, 67:25-32.
79. Voorn P., Vanderschuren L.J., Groenewegen H.J., Robbins T.W., Pennartz C.M. Putting a spin on the dorsal-ventral divide of the striatum. Trends Neurosci. 2004, 27:468-474.
80. Wacker J., Dillon D.G., Pizzagalli D.A. The role of the nucleus accumbens and rostral anterior cingulate cortex in anhedonia: integration of resting EEG, fMRI, and volumetric techniques. Neuroimage 2009, 46:327-337.
81. Wang Z., Kai L., Day M., Ronesi J., Yin H.H., Ding J., Tkatch T., Lovinger D.M., Surmeier D.J. Dopaminergic control of corticostriatal long-term synaptic depression in medium spiny neurons is mediated by cholinergic interneurons. Neuron 2006, 50:443-452.
82. Warner-Schmidt J.L., Schmidt E.F., Marshall J.J., Rubin A.J., Arango-Lievano M., Kaplitt M.G., Ibañez-Tallon I., Heintz N., Greengard P. Cholinergic interneurons in the nucleus accumbens regulate depression-like behavior. Proc. Natl. Acad. Sci. USA 2012, 109:11360-11365.
83. Wickens J.R., Horvitz J.C., Costa R.M., Killcross S. Dopaminergic mechanisms in actions and habits. J.Neurosci. 2007, 27:8181-8183.
84. Wilson C.J., Chang H.T., Kitai S.T. Firing patterns and synaptic potentials of identified giant aspiny interneurons in the rat neostriatum. J.Neurosci. 1990, 10:508-519.
85. Witten I.B., Lin S.C., Brodsky M., Prakash R., Diester I., Anikeeva P., Gradinaru V., Ramakrishnan C., Deisseroth K. Cholinergic interneurons control local circuit activity and cocaine conditioning. Science 2010, 330:1677-1681.
86. Yin H.H., Knowlton B.J. The role of the basal ganglia in habit formation. Nat. Rev. Neurosci. 2006, 7:464-476.
87. Yin H.H., Ostlund S.B., Knowlton B.J., Balleine B.W. The role of the dorsomedial striatum in instrumental conditioning. Eur. J. Neurosci. 2005, 22:513-523.
88. Yin H.H., Ostlund S.B., Balleine B.W. Reward-guided learning beyond dopamine in the nucleus accumbens: the integrative functions of cortico-basal ganglia networks. Eur. J. Neurosci. 2008, 28:1437-1448.