Dopamine neurons share common response function for reward prediction error

Nature Neuroscience

Volumn 19, Issue 3, 2016, Pages 479-486

  Eshel, Neir ^a,b   Tian, Ju ^a   Bukwich, Michael ^a   Uchida, Naoshige ^a  

^a HARVARD UNIVERSITY   (United States)

^b HARVARD MEDICAL SCHOOL   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CODING; CONDITIONING; DOPAMINERGIC NERVE CELL; FIRING RATE; MOUSE; NERVE POTENTIAL; NONHUMAN; PREDICTION; PRIORITY JOURNAL; REWARD; VENTRAL TEGMENTUM; ANIMAL; CONDITIONED REFLEX; FORECASTING; OPTOGENETICS; PHYSIOLOGY;

ANIMALS; CONDITIONING, CLASSICAL; DOPAMINERGIC NEURONS; FORECASTING; MICE; OPTOGENETICS; REWARD; VENTRAL TEGMENTAL AREA;

EID: 84959096722     PISSN: 10976256     EISSN: 15461726     Source Type: Journal    
DOI: 10.1038/nn.4239     Document Type: Article

References (59)

1. Wise, R.A. Dopamine, learning and motivation. Nat. Rev. Neurosci. 5, 483-494 (2004).
2. Salamone, J.D. & Correa, M. The mysterious motivational functions of mesolimbic dopamine. Neuron 76, 470-485 (2012).
3. Bromberg-Martin, E.S., Matsumoto, M. & Hikosaka, O. Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 68, 815-834 (2010).
4. Matsuda, W. et al. Single nigrostriatal dopaminergic neurons form widely spread and highly dense axonal arborizations in the neostriatum. J. Neurosci. 29, 444-453 (2009).
5. Fuxe, K. et al. The discovery of central monoamine neurons gave volume transmission to the wired brain. Prog. Neurobiol. 90, 82-100 (2010).
6. Grace, A.A. & Bunney, B.S. Intracellular and extracellular electrophysiology of nigral dopaminergic neurons. 1. Identifcation and characterization. Neuroscience 10, 301-315 (1983).
7. Vandecasteele, M., Glowinski, J. & Venance, L. Electrical synapses between dopaminergic neurons of the substantia nigra pars compacta. J. Neurosci. 25, 291-298 (2005).
8. Joshua, M. et al. Synchronization of midbrain dopaminergic neurons is enhanced by rewarding events. Neuron 62, 695-704 (2009).
9. Morris, G., Arkadir, D., Nevet, A., Vaadia, E. & Bergman, H. Coincident but distinct messages of midbrain dopamine and striatal tonically active neurons. Neuron 43, 133-143 (2004).
10. Kim, Y., Wood, J. & Moghaddam, B. Coordinated activity of ventral tegmental neurons adapts to appetitive and aversive learning. PLoS One 7, e29766 (2012).
11. Schultz, W. Predictive reward signal of dopamine neurons. J. Neurophysiol. 80, 1-27 (1998).
12. Schultz, W. Updating dopamine reward signals. Curr. Opin. Neurobiol. 23, 229-238 (2013).
13. Roeper, J. Dissecting the diversity of midbrain dopamine neurons. Trends Neurosci. 36, 336-342 (2013).
14. Blaess, S. et al. Temporal-spatial changes in Sonic Hedgehog expression and signaling reveal different potentials of ventral mesencephalic progenitors to populate distinct ventral midbrain nuclei. Neural Dev. 6, 29 (2011).
15. Margolis, E.B., Lock, H., Hjelmstad, G.O. & Fields, H.L. The ventral tegmental area revisited: is there an electrophysiological marker for dopaminergic neurons? J. Physiol. (Lond.) 577, 907-924 (2006).
16. Neuhoff, H., Neu, A., Liss, B. & Roeper, J. I(h) channels contribute to the different functional properties of identifed dopaminergic subpopulations in the midbrain. J. Neurosci. 22, 1290-1302 (2002).
17. Lammel, S. et al. Input-specifc control of reward and aversion in the ventral tegmental area. Nature 491, 212-217 (2012).
18. Watabe-Uchida, M., Zhu, L., Ogawa, S.K., Vamanrao, A. & Uchida, N. Whole-brain mapping of direct inputs to midbrain dopamine neurons. Neuron 74, 858-873 (2012).
19. Lammel, S. et al. Unique properties of mesoprefrontal neurons within a dual mesocorticolimbic dopamine system. Neuron 57, 760-773 (2008).
20. Fiorillo, C.D., Yun, S.R. & Song, M.R. Diversity and homogeneity in responses of midbrain dopamine neurons. J. Neurosci. 33, 4693-4709 (2013).
21. Matsumoto, M. & Hikosaka, O. Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459, 837-841 (2009).
22. Bayer, H.M. & Glimcher, P.W. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47, 129-141 (2005).
23. Cohen, J.Y., Haesler, S., Vong, L., Lowell, B.B. & Uchida, N. Neuron-type-specifc signals for reward and punishment in the ventral tegmental area. Nature 482, 85-88 (2012).
24. Pan, W.-X., Schmidt, R., Wickens, J.R. & Hyland, B.I. Dopamine cells respond to predicted events during classical conditioning: evidence for eligibility traces in the reward-learning network. J. Neurosci. 25, 6235-6242 (2005).
25. D'Ardenne, K., McClure, S.M., Nystrom, L.E. & Cohen, J.D. BOLD responses refecting dopaminergic signals in the human ventral tegmental area. Science 319, 1264-1267 (2008).
26. Waelti, P., Dickinson, A. & Schultz, W. Dopamine responses comply with basic assumptions of formal learning theory. Nature 412, 43-48 (2001).
27. Schultz, W., Dayan, P. & Montague, P.R. A neural substrate of prediction and reward. Science 275, 1593-1599 (1997).
28. Eshel, N. et al. Arithmetic and local circuitry underlying dopamine prediction errors. Nature 525, 243-246 (2015).
29. Tobler, P.N., Fiorillo, C.D. & Schultz, W. Adaptive coding of reward value by dopamine neurons. Science 307, 1642-1645 (2005).
30. Averbeck, B.B., Latham, P.E. & Pouget, A. Neural correlations, population coding and computation. Nat. Rev. Neurosci. 7, 358-366 (2006).
31. Cohen, M.R. & Kohn, A. Measuring and interpreting neuronal correlations. Nat. Neurosci. 14, 811-819 (2011).
32. Dayan, P. Twenty-fve lessons from computational neuromodulation. Neuron 76, 240-256 (2012).
33. Abbott, L.F. & Dayan, P. The effect of correlated variability on the accuracy of a population code. Neural Comput. 11, 91-101 (1999).
34. Freund, T.F., Powell, J.F. & Smith, A.D. Tyrosine hydroxylase-immunoreactive boutons in synaptic contact with identifed striatonigral neurons, with particular reference to dendritic spines. Neuroscience 13, 1189-1215 (1984).
35. Zahm, D.S. An electron microscopic morphometric comparison of tyrosine hydroxylase immunoreactive innervation in the neostriatum and the nucleus accumbens core and shell. Brain Res. 575, 341-346 (1992).
36. Turrigiano, G. Homeostatic signaling: the positive side of negative feedback. Curr. Opin. Neurobiol. 17, 318-324 (2007).
37. Davis, G.W. Homeostatic control of neural activity: from phenomenology to molecular design. Annu. Rev. Neurosci. 29, 307-323 (2006).
38. Fiorillo, C.D., Song, M.R. & Yun, S.R. Multiphasic temporal dynamics in responses of midbrain dopamine neurons to appetitive and aversive stimuli. J. Neurosci. 33, 4710-4725 (2013).
39. Fiorillo, C.D. Towards a general theory of neural computation based on prediction by single neurons. PLoS One 3, e3298 (2008).
40. Ganguli, S. et al. One-dimensional dynamics of attention and decision making in LIP. Neuron 58, 15-25 (2008).
41. Fitzgerald, J.K. et al. Biased associative representations in parietal cortex. Neuron 77, 180-191 (2013).
42. Matsumoto, M. & Takada, M. Distinct representations of cognitive and motivational signals in midbrain dopamine neurons. Neuron 79, 1011-1024 (2013).
43. Zweifel, L.S. et al. Activation of dopamine neurons is critical for aversive conditioning and prevention of generalized anxiety. Nat. Neurosci. 14, 620-626 (2011).
44. Grace, A.A., Floresco, S.B., Goto, Y. & Lodge, D.J. Regulation of fring of dopaminergic neurons and control of goal-directed behaviors. Trends Neurosci. 30, 220-227 (2007).
45. Menegas, W. et al. Dopamine neurons projecting to the posterior striatum form an anatomically distinct subclass. eLife 4, e10032 (2015).
46. Lerner, T.N. et al. Intact-brain analyses reveal distinct information carried by SNc dopamine subcircuits. Cell 162, 635-647 (2015).
47. Beier, K.T. et al. Circuit architecture of VTA dopamine neurons revealed by systematic input-output mapping. Cell 162, 622-634 (2015).
48. Zhang, L., Doyon, W.M., Clark, J.J., Phillips, P.E.M. & Dani, J.A. Controls of tonic and phasic dopamine transmission in the dorsal and ventral striatum. Mol. Pharmacol. 76, 396-404 (2009).
49. Tritsch, N.X., Ding, J.B. & Sabatini, B.L. Dopaminergic neurons inhibit striatal output through non-canonical release of GABA. Nature 490, 262-266 (2012).
50. Stuber, G.D., Hnasko, T.S., Britt, J.P., Edwards, R.H. & Bonci, A. Dopaminergic terminals in the nucleus accumbens but not the dorsal striatum corelease glutamate. J. Neurosci. 30, 8229-8233 (2010).
51. Bäckman, C.M. et al. Characterization of a mouse strain expressing Cre recombinase from the 3′ untranslated region of the dopamine transporter locus. Genesis 44, 383-390 (2006).
52. Boyden, E.S., Zhang, F., Bamberg, E., Nagel, G. & Deisseroth, K. Millisecond-timescale, genetically targeted optical control of neural activity. Nat. Neurosci. 8, 1263-1268 (2005).
53. Atasoy, D., Aponte, Y., Su, H.H. & Sternson, S.M. A FLEX switch targets Channelrhodopsin-2 to multiple cell types for imaging and long-range circuit mapping. J. Neurosci. 28, 7025-7030 (2008).
54. Uchida, N. & Mainen, Z.F. Speed and accuracy of olfactory discrimination in the rat. Nat. Neurosci. 6, 1224-1229 (2003).
55. Tian, J. & Uchida, N. Habenula lesions reveal that multiple mechanisms underlie dopamine prediction errors. Neuron 87, 1304-1316 (2015).
56. Schmitzer-Torbert, N. & Redish, A.D. Neuronal activity in the rodent dorsal striatum in sequential navigation: separation of spatial and reward responses on the multiple T task. J. Neurophysiol. 91, 2259-2272 (2004).
57. Lima, S.Q., Hromádka, T., Znamenskiy, P. & Zador, A.M. PINP: a new method of tagging neuronal populations for identifcation during in vivo electrophysiological recording. PLoS One 4, e6099 (2009).
58. Kvitsiani, D. et al. Distinct behavioural and network correlates of two interneuron types in prefrontal cortex. Nature 498, 363-366 (2013).
59. Olsen, S.R., Bhandawat, V. & Wilson, R.I. Divisive normalization in olfactory population codes. Neuron 66, 287-299 (2010).