Distributed and Mixed Information in Monosynaptic Inputs to Dopamine Neurons

Neuron

Volumn 91, Issue 6, 2016, Pages 1374-1389

  Tian, Ju ^a   Huang, Ryan ^a   Cohen, Jeremiah Y ^a,b   Osakada, Fumitaka ^c,d   Kobak, Dmitry ^e   Machens, Christian K ^e   Callaway, Edward M ^c   Uchida, Naoshige ^a   Watabe Uchida, Mitsuko ^a  

^a HARVARD UNIVERSITY   (United States)

^b JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE   (United States)

^c SALK INSTITUTE FOR BIOLOGICAL STUDIES   (United States)

^d NAGOYA UNIVERSITY   (Japan)

^e CHAMPALIMAUD CENTRE FOR THE UNKNOWN   (Portugal)

Author keywords

[No Author keywords available]

Indexed keywords

CHANNELRHODOPSIN 2; ION CHANNEL; UNCLASSIFIED DRUG;

ADULT; ANIMAL CELL; ANIMAL EXPERIMENT; ARTICLE; AVERSIVE BEHAVIOR; BRAIN ELECTROPHYSIOLOGY; CELLULAR DISTRIBUTION; CONNECTOME; CONTROLLED STUDY; CORPUS STRIATUM; DOPAMINERGIC NERVE CELL; ELECTROENCEPHALOGRAM; FIRING RATE; MALE; MONOSYNAPTIC PATHWAY; MOUSE; NERVE CELL STIMULATION; NONHUMAN; PRIORITY JOURNAL; PROTEIN EXPRESSION; REWARD; REWARD PREDICTION ERROR; SUBTHALAMIC NUCLEUS; SYNAPTIC TRANSMISSION; VENTRAL TEGMENTUM; ANIMAL; BRAIN MAPPING; CONDITIONED REFLEX; CYTOLOGY; NERVE TRACT; PHYSIOLOGY; PSYCHOLOGY; SYNAPSE;

ANIMALS; BRAIN MAPPING; CONDITIONING, CLASSICAL; CORPUS STRIATUM; DOPAMINERGIC NEURONS; MALE; MICE; NEURAL PATHWAYS; REWARD; SYNAPSES;

EID: 84991227609     PISSN: 08966273     EISSN: 10974199     Source Type: Journal    
DOI: 10.1016/j.neuron.2016.08.018     Document Type: Article

References (90)

1. Aggarwal, M., Hyland, B.I., Wickens, J.R., Neural control of dopamine neurotransmission: implications for reinforcement learning. Eur. J. Neurosci. 35 (2012), 1115–1123.
2. Asaad, W.F., Eskandar, E.N., Encoding of both positive and negative reward prediction errors by neurons of the primate lateral prefrontal cortex and caudate nucleus. J. Neurosci. 31 (2011), 17772–17787.
3. Bäckman, C.M., Malik, N., Zhang, Y., Shan, L., Grinberg, A., Hoffer, B.J., Westphal, H., Tomac, A.C., Characterization of a mouse strain expressing Cre recombinase from the 3′ untranslated region of the dopamine transporter locus. Genesis 44 (2006), 383–390.
4. Barrot, M., Sesack, S.R., Georges, F., Pistis, M., Hong, S., Jhou, T.C., Braking dopamine systems: a new GABA master structure for mesolimbic and nigrostriatal functions. J. Neurosci. 32 (2012), 14094–14101.
5. Barry, J.M., Axonal activity in vivo: technical considerations and implications for the exploration of neural circuits in freely moving animals. Front. Neurosci., 9, 2015, 153.
6. Bayer, H.M., Glimcher, P.W., Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47 (2005), 129–141.
7. Beier, K.T., Steinberg, E.E., DeLoach, K.E., Xie, S., Miyamichi, K., Schwarz, L., Gao, X.J., Kremer, E.J., Malenka, R.C., Luo, L., Circuit architecture of VTA dopamine neurons revealed by systematic input-output mapping. Cell 162 (2015), 622–634.
8. Bell, C.C., Han, V., Sawtell, N.B., Cerebellum-like structures and their implications for cerebellar function. Annu. Rev. Neurosci. 31 (2008), 1–24.
9. Bocklisch, C., Pascoli, V., Wong, J.C.Y., House, D.R.C., Yvon, C., de Roo, M., Tan, K.R., Lüscher, C., Cocaine disinhibits dopamine neurons by potentiation of GABA transmission in the ventral tegmental area. Science 341 (2013), 1521–1525.
10. Boyden, E.S., Zhang, F., Bamberg, E., Nagel, G., Deisseroth, K., Millisecond-timescale, genetically targeted optical control of neural activity. Nat. Neurosci. 8 (2005), 1263–1268.
11. Bromberg-Martin, E.S., Hikosaka, O., Lateral habenula neurons signal errors in the prediction of reward information. Nat. Neurosci. 14 (2011), 1209–1216.
12. Bromberg-Martin, E.S., Matsumoto, M., Hikosaka, O., Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 68 (2010), 815–834.
13. Brown, J., Bullock, D., Grossberg, S., How the basal ganglia use parallel excitatory and inhibitory learning pathways to selectively respond to unexpected rewarding cues. J. Neurosci. 19 (1999), 10502–10511.
14. Brown, H.D., McCutcheon, J.E., Cone, J.J., Ragozzino, M.E., Roitman, M.F., Primary food reward and reward-predictive stimuli evoke different patterns of phasic dopamine signaling throughout the striatum. Eur. J. Neurosci. 34 (2011), 1997–2006.
15. Carandini, M., Heeger, D.J., Normalization as a canonical neural computation. Nat. Rev. Neurosci. 13 (2011), 51–62.
16. Chance, F.S., Abbott, L.F., Reyes, A.D., Gain modulation from background synaptic input. Neuron 35 (2002), 773–782.
17. Chuhma, N., Tanaka, K.F., Hen, R., Rayport, S., Functional connectome of the striatal medium spiny neuron. J. Neurosci. 31 (2011), 1183–1192.
18. Cohen, J.Y., Haesler, S., Vong, L., Lowell, B.B., Uchida, N., Neuron-type-specific signals for reward and punishment in the ventral tegmental area. Nature 482 (2012), 85–88.
19. Cohen, J.Y., Amoroso, M.W., Uchida, N., Serotonergic neurons signal reward and punishment on multiple timescales. eLife, 4, 2015, e06346.
20. Daw, N.D., Courville, A.C., Touretzky, D.S., Representation and timing in theories of the dopamine system. Neural Comput. 18 (2006), 1637–1677.
21. den Ouden, H.E., Kok, P., de Lange, F.P., How prediction errors shape perception, attention, and motivation. Front. Psychol., 3, 2012, 548.
22. Doya, K., Complementary roles of basal ganglia and cerebellum in learning and motor control. Curr. Opin. Neurobiol. 10 (2000), 732–739.
23. Doya, K., Modulators of decision making. Nat. Neurosci. 11 (2008), 410–416.
24. Eshel, N., Bukwich, M., Rao, V., Hemmelder, V., Tian, J., Uchida, N., Arithmetic and local circuitry underlying dopamine prediction errors. Nature 525 (2015), 243–246.
25. Eshel, N., Tian, J., Bukwich, M., Uchida, N., Dopamine neurons share common response function for reward prediction error. Nat. Neurosci. 19 (2016), 479–486.
26. Fiorillo, C.D., Yun, S.R., Song, M.R., Diversity and homogeneity in responses of midbrain dopamine neurons. J. Neurosci. 33 (2013), 4693–4709.
27. Fusi, S., Miller, E.K., Rigotti, M., Why neurons mix: high dimensionality for higher cognition. Curr. Opin. Neurobiol. 37 (2016), 66–74.
28. Gale, S.D., Perkel, D.J., A basal ganglia pathway drives selective auditory responses in songbird dopaminergic neurons via disinhibition. J. Neurosci. 30 (2010), 1027–1037.
29. Geisler, S., Zahm, D.S., Afferents of the ventral tegmental area in the rat-anatomical substratum for integrative functions. J. Comp. Neurol. 490 (2005), 270–294.
30. Geisler, S., Derst, C., Veh, R.W., Zahm, D.S., Glutamatergic afferents of the ventral tegmental area in the rat. J. Neurosci. 27 (2007), 5730–5743.
31. Hart, A.S., Rutledge, R.B., Glimcher, P.W., Phillips, P.E.M., Phasic dopamine release in the rat nucleus accumbens symmetrically encodes a reward prediction error term. J. Neurosci. 34 (2014), 698–704.
32. Heimer, L., Zahm, D.S., Churchill, L., Kalivas, P.W., Wohltmann, C., Specificity in the projection patterns of accumbal core and shell in the rat. Neuroscience 41 (1991), 89–125.
33. Holt, G.R., Koch, C., Shunting inhibition does not have a divisive effect on firing rates. Neural Comput. 9 (1997), 1001–1013.
34. Hong, S., Hikosaka, O., The globus pallidus sends reward-related signals to the lateral habenula. Neuron 60 (2008), 720–729.
35. Hong, S., Hikosaka, O., Pedunculopontine tegmental nucleus neurons provide reward, sensorimotor, and alerting signals to midbrain dopamine neurons. Neuroscience 282 (2014), 139–155.
36. Hong, S., Jhou, T.C., Smith, M., Saleem, K.S., Hikosaka, O., Negative reward signals from the lateral habenula to dopamine neurons are mediated by rostromedial tegmental nucleus in primates. J. Neurosci. 31 (2011), 11457–11471.
37. Houk, J.C., Adams, J.L., Barto, A.G., A model of how the basal ganglia generate and use neural signals that predict reinforcement. Houk, J.C., Davis, J.L., Beiser, D.G., (eds.) Models of Information Processing in the Basal Ganglia, 1995, MIT Press, 249–270.
38. Jennings, J.H., Stuber, G.D., Tools for resolving functional activity and connectivity within intact neural circuits. Curr. Biol. 24 (2014), R41–R50.
39. Jennings, J.H., Sparta, D.R., Stamatakis, A.M., Ung, R.L., Pleil, K.E., Kash, T.L., Stuber, G.D., Distinct extended amygdala circuits for divergent motivational states. Nature 496 (2013), 224–228.
40. Jhou, T.C., Fields, H.L., Baxter, M.G., Saper, C.B., Holland, P.C., The rostromedial tegmental nucleus (RMTg), a GABAergic afferent to midbrain dopamine neurons, encodes aversive stimuli and inhibits motor responses. Neuron 61 (2009), 786–800.
41. Jhou, T.C., Geisler, S., Marinelli, M., Degarmo, B.A., Zahm, D.S., The mesopontine rostromedial tegmental nucleus: a structure targeted by the lateral habenula that projects to the ventral tegmental area of Tsai and substantia nigra compacta. J. Comp. Neurol. 513 (2009), 566–596.
42. Joel, D., Niv, Y., Ruppin, E., Actor-critic models of the basal ganglia: new anatomical and computational perspectives. Neural Netw. 15 (2002), 535–547.
43. Johansen, J.P., Tarpley, J.W., LeDoux, J.E., Blair, H.T., Neural substrates for expectation-modulated fear learning in the amygdala and periaqueductal gray. Nat. Neurosci. 13 (2010), 979–986.
44. Kawato, M., Samejima, K., Efficient reinforcement learning: computational theories, neuroscience and robotics. Curr. Opin. Neurobiol. 17 (2007), 205–212.
45. Keiflin, R., Janak, P.H., Dopamine prediction errors in reward learning and addiction: from theory to neural circuitry. Neuron 88 (2015), 247–263.
46. Kim, E.J., Jacobs, M.W., Ito-Cole, T., Callaway, E.M., Improved monosynaptic neural circuit tracing using engineered rabies virus glycoproteins. Cell Rep. 15 (2016), 692–699.
47. Kobayashi, Y., Okada, K., Reward prediction error computation in the pedunculopontine tegmental nucleus neurons. Ann. N Y Acad. Sci. 1104 (2007), 310–323.
48. Kvitsiani, D., Ranade, S., Hangya, B., Taniguchi, H., Huang, J.Z., Kepecs, A., Distinct behavioural and network correlates of two interneuron types in prefrontal cortex. Nature 498 (2013), 363–366.
49. Lammel, S., Lim, B.K., Malenka, R.C., Reward and aversion in a heterogeneous midbrain dopamine system. Neuropharmacology 76:Pt B (2014), 351–359.
50. Lee, D., Seo, H., Jung, M.W., Neural basis of reinforcement learning and decision making. Annu. Rev. Neurosci. 35 (2012), 287–308.
51. Lerner, T.N., Shilyansky, C., Davidson, T.J., Evans, K.E., Beier, K.T., Zalocusky, K.A., Crow, A.K., Malenka, R.C., Luo, L., Tomer, R., Deisseroth, K., Intact-brain analyses reveal distinct information carried by SNc dopamine subcircuits. Cell 162 (2015), 635–647.
52. Lima, S.Q., Hromádka, T., Znamenskiy, P., Zador, A.M., PINP: a new method of tagging neuronal populations for identification during in vivo electrophysiological recording. PLoS ONE, 4, 2009, e6099.
53. Lobb, C.J., Wilson, C.J., Paladini, C.A., A dynamic role for GABA receptors on the firing pattern of midbrain dopaminergic neurons. J. Neurophysiol. 104 (2010), 403–413.
54. Lobb, C.J., Wilson, C.J., Paladini, C.A., High-frequency, short-latency disinhibition bursting of midbrain dopaminergic neurons. J. Neurophysiol. 105 (2011), 2501–2511.
55. Matsumoto, M., Hikosaka, O., Lateral habenula as a source of negative reward signals in dopamine neurons. Nature 447 (2007), 1111–1115.
56. Matsumoto, M., Hikosaka, O., Representation of negative motivational value in the primate lateral habenula. Nat. Neurosci. 12 (2009), 77–84.
57. Matsumoto, M., Hikosaka, O., Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459 (2009), 837–841.
58. Menegas, W., Bergan, J.F., Ogawa, S.K., Isogai, Y., Umadevi Venkataraju, K., Osten, P., Uchida, N., Watabe-Uchida, M., Dopamine neurons projecting to the posterior striatum form an anatomically distinct subclass. eLife, 4, 2015, e10032.
59. Mirenowicz, J., Schultz, W., Importance of unpredictability for reward responses in primate dopamine neurons. J. Neurophysiol. 72 (1994), 1024–1027.
60. Morita, K., Morishima, M., Sakai, K., Kawaguchi, Y., Reinforcement learning: computing the temporal difference of values via distinct corticostriatal pathways. Trends Neurosci. 35 (2012), 457–467.
61. Nair-Roberts, R.G., Chatelain-Badie, S.D., Benson, E., White-Cooper, H., Bolam, J.P., Ungless, M.A., Stereological estimates of dopaminergic, GABAergic and glutamatergic neurons in the ventral tegmental area, substantia nigra and retrorubral field in the rat. Neuroscience 152 (2008), 1024–1031.
62. Nakamura, K., Ono, T., Lateral hypothalamus neuron involvement in integration of natural and artificial rewards and cue signals. J. Neurophysiol. 55 (1986), 163–181.
63. Nieh, E.H., Matthews, G.A., Allsop, S.A., Presbrey, K.N., Leppla, C.A., Wichmann, R., Neve, R., Wildes, C.P., Tye, K.M., Decoding neural circuits that control compulsive sucrose seeking. Cell 160 (2015), 528–541.
64. O'Reilly, R.C., Frank, M.J., Hazy, T.E., Watz, B., PVLV: the primary value and learned value Pavlovian learning algorithm. Behav. Neurosci. 121 (2007), 31–49.
65. Ohmae, S., Medina, J.F., Climbing fibers encode a temporal-difference prediction error during cerebellar learning in mice. Nat. Neurosci. 18 (2015), 1798–1803.
66. Okada, K., Toyama, K., Inoue, Y., Isa, T., Kobayashi, Y., Different pedunculopontine tegmental neurons signal predicted and actual task rewards. J. Neurosci. 29 (2009), 4858–4870.
67. Olsen, S.R., Bhandawat, V., Wilson, R.I., Divisive normalization in olfactory population codes. Neuron 66 (2010), 287–299.
68. Osakada, F., Mori, T., Cetin, A.H., Marshel, J.H., Virgen, B., Callaway, E.M., New rabies virus variants for monitoring and manipulating activity and gene expression in defined neural circuits. Neuron 71 (2011), 617–631.
69. Oyama, K., Tateyama, Y., Hernádi, I., Tobler, P.N., Iijima, T., Tsutsui, K., Discrete coding of stimulus value, reward expectation, and reward prediction error in the dorsal striatum. J. Neurophysiol. 114 (2015), 2600–2615.
70. Pan, W.-X., Hyland, B.I., Pedunculopontine tegmental nucleus controls conditioned responses of midbrain dopamine neurons in behaving rats. J. Neurosci. 25 (2005), 4725–4732.
71. Reardon, T.R., Murray, A.J., Turi, G.F., Wirblich, C., Croce, K.R., Schnell, M.J., Jessell, T.M., Losonczy, A., Rabies virus CVS-N2c(ΔG) strain enhances retrograde synaptic transfer and neuronal viability. Neuron 89 (2016), 711–724.
72. Rigotti, M., Barak, O., Warden, M.R., Wang, X.-J., Daw, N.D., Miller, E.K., Fusi, S., The importance of mixed selectivity in complex cognitive tasks. Nature 497 (2013), 585–590.
73. Saddoris, M.P., Cacciapaglia, F., Wightman, R.M., Carelli, R.M., Differential dopamine release dynamics in the nucleus accumbens core and shell reveal complementary signals for error prediction and incentive motivation. J. Neurosci. 35 (2015), 11572–11582.
74. Schultz, W., Neuronal reward and decision signals: from theories to data. Physiol. Rev. 95 (2015), 853–951.
75. Schultz, W., Dickinson, A., Neuronal coding of prediction errors. Annu. Rev. Neurosci. 23 (2000), 473–500.
76. Schultz, W., Dayan, P., Montague, P.R., A neural substrate of prediction and reward. Science 275 (1997), 1593–1599.
77. Sesack, S.R., Grace, A.A., Cortico-basal ganglia reward network: microcircuitry. Neuropsychopharmacology 35 (2010), 27–47.
78. Silver, R.A., Neuronal arithmetic. Nat. Rev. Neurosci. 11 (2010), 474–489.
79. Swanson, L.W., Cerebral hemisphere regulation of motivated behavior. Brain Res. 886 (2000), 113–164.
80. Tachibana, Y., Hikosaka, O., The primate ventral pallidum encodes expected reward value and regulates motor action. Neuron 76 (2012), 826–837.
81. Tepper, J.M., Lee, C.R., GABAergic control of substantia nigra dopaminergic neurons. Prog. Brain Res. 160 (2007), 189–208.
82. Tian, J., Uchida, N., Habenula lesions reveal that multiple mechanisms underlie dopamine prediction errors. Neuron 87 (2015), 1304–1316.
83. Uchida, N., Bilingual neurons release glutamate and GABA. Nat. Neurosci. 17 (2014), 1432–1434.
84. Uchida, N., Eshel, N., Watabe-Uchida, M., Division of labor for division: inhibitory interneurons with different spatial landscapes in the olfactory system. Neuron 80 (2013), 1106–1109.
85. Watabe-Uchida, M., Zhu, L., Ogawa, S.K., Vamanrao, A., Uchida, N., Whole-brain mapping of direct inputs to midbrain dopamine neurons. Neuron 74 (2012), 858–873.
86. Wertz, A., Trenholm, S., Yonehara, K., Hillier, D., Raics, Z., Leinweber, M., Szalay, G., Ghanem, A., Keller, G., Rózsa, B., et al. Presynaptic networks. Single-cell-initiated monosynaptic tracing reveals layer-specific cortical network modules. Science 349 (2015), 70–74.
87. Wickersham, I.R., Lyon, D.C., Barnard, R.J.O., Mori, T., Finke, S., Conzelmann, K.-K., Young, J.A.T., Callaway, E.M., Monosynaptic restriction of transsynaptic tracing from single, genetically targeted neurons. Neuron 53 (2007), 639–647.
88. Wickersham, I.R., Finke, S., Conzelmann, K.-K., Callaway, E.M., Retrograde neuronal tracing with a deletion-mutant rabies virus. Nat. Methods 4 (2007), 47–49.
89. Williford, T., Maunsell, J.H.R., Effects of spatial attention on contrast response functions in macaque area V4. J. Neurophysiol. 96 (2006), 40–54.
90. Xia, Y., Driscoll, J.R., Wilbrecht, L., Margolis, E.B., Fields, H.L., Hjelmstad, G.O., Nucleus accumbens medium spiny neurons target non-dopaminergic neurons in the ventral tegmental area. J. Neurosci. 31 (2011), 7811–7816.