Prolonged dopamine signalling in striatum signals proximity and value of distant rewards

Nature

Volumn 500, Issue 7464, 2013, Pages 575-579

  Howe, Mark W ^a   Tierney, Patrick L ^a   Sandberg, Stefan G ^b   Phillips, Paul E M ^b   Graybiel, Ann M ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b UNIVERSITY OF WASHINGTON SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DOPAMINE;

BIOCHEMISTRY; LEARNING; NEUROLOGY; PHYSIOLOGY; PREDICTION; RODENT; SIGNALING;

ANIMAL CELL; ANIMAL EXPERIMENT; ANIMAL TISSUE; ARTICLE; CORPUS STRIATUM; DOPAMINE RELEASE; ELECTROSTIMULATION; LEARNING; MALE; MOTIVATION; NONHUMAN; PRIORITY JOURNAL; RAT; REGULATORY MECHANISM; REWARD; SIGNAL TRANSDUCTION;

ACTION POTENTIALS; ANIMALS; DOPAMINE; DOPAMINERGIC NEURONS; GOALS; MALE; MAZE LEARNING; MODELS, NEUROLOGICAL; MODELS, PSYCHOLOGICAL; MOTIVATION; NEOSTRIATUM; RATS; RATS, LONG-EVANS; REWARD; SIGNAL TRANSDUCTION; TIME FACTORS;

ANIMALIA; RATTUS;

EID: 84883065020     PISSN: 00280836     EISSN: 14764687     Source Type: Journal    
DOI: 10.1038/nature12475     Document Type: Article

References (28)

1. Cohen, J. Y., Haesler, S., Vong, L., Lowell, B. B.&Uchida, N. Neuron-type-specific signals for reward and punishment in the ventral tegmental area. Nature 482, 85-88 (2012).
2. Matsumoto, M. & Hikosaka, O. Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459, 837-841 (2009).
3. Schultz, W., Dayan, P. & Montague, P. R. A neural substrate of prediction and reward. Science 275, 1593-1599 (1997)
4. Waelti, P., Dickinson, A. & Schultz, W. Dopamine responses comply with basic assumptions of formal learning theory. Nature 412, 43-48 (2001)
5. Bayer, H. M. & Glimcher, P. W. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47, 129-141 (2005)
6. Schultz, W. Getting formal with dopamine and reward. Neuron 36, 241-263 (2002)
7. Redgrave, P. & Gurney, K. The short-latency dopamine signal: a role in discovering novel actions? Nature Rev. Neurosci. 7, 967-975 (2006)
8. Zweifel, L. S. et al. Disruption of NMDAR-dependent burst firing by dopamine neurons provides selective assessment of phasic dopamine-dependent behavior. Proc. Natl Acad. Sci. USA 106, 7281-7288 (2009).
9. Wang, L. P. et al. NMDA receptors in dopaminergic neurons are crucial for habit learning. Neuron 72, 1055-1066 (2011)
10. Day, J. J., Jones, J. L., Wightman, R. M. & Carelli, R. M. Phasic nucleus accumbens dopamine release encodes effort- and delay-related costs. Biol. Psychiatry 68, 306-309 (2010)
11. Day, J. J., Roitman, M. F., Wightman, R. M. & Carelli, R. M. Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens.Nature Neurosci. 10, 1020-1028 (2007)
12. Gan, J. O., Walton, M. E. & Phillips, P. E. Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine. Nature Neurosci. 13, 25-27 (2010)
13. Phillips, P. E., Stuber, G. D., Heien, M. L., Wightman, R. M. & Carelli, R. M. Subsecond dopamine release promotes cocaine seeking. Nature 422, 614-618 (2003)
14. Braun, A. A., Graham, D. L., Schaefer, T. L., Vorhees, C. V. & Williams, M. T. Dorsal striatal dopamine depletion impairs both allocentric and egocentric navigation in rats. Neurobiol. Learn. Mem. 97, 402-408 (2012).
15. Salamone, J. D., Correa, M., Farrar, A. & Mingote, S. M. Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology (Berl.) 191, 461-482 (2007)
16. Whishaw, I. Q. & Dunnett, S. B. Dopamine depletion, stimulation or blockade in the rat disrupts spatial navigation and locomotion dependent upon beacon or distal cues. Behav. Brain Res. 18, 11-29 (1985)
17. Salamone, J. D.& Correa, M. Themysteriousmotivational functions ofmesolimbic dopamine. Neuron 76, 470-485 (2012)
18. Niv, Y., Daw, N. D., Joel, D. & Dayan, P. Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology (Berl.) 191, 507-520 (2007)
19. Barnes, T. D., Kubota, Y., Hu, D., Jin, D. Z. and Graybiel, A. M. Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories. Nature 437, 1158-1161 (2005)
20. Niv, Y., Duff, M. O.& Dayan, P. Dopamine, uncertainty and TD learning. Behav. Brain Funct. 1, 6 (2005)
21. Tobler, P. N., Fiorillo, C. D. & Schultz, W. Adaptive coding of reward value by dopamine neurons. Science 307, 1642-1645 (2005)
22. Fiorillo, C. D., Tobler, P. N. & Schultz, W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299, 1898-1902 (2003).
23. Hikosaka, O., Sakamoto, M. & Usui, S. Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward. J. Neurophysiol. 61, 814-832 (1989)
24. Derdikman, D. & Moser, E. I. A manifold of spatial maps in the brain. Trends Cogn. Sci. 14, 561-569 (2010)
25. Flagel, S. B. et al. A selective role for dopamine in stimulus-reward learning. Nature 469, 53-57 (2011)
26. Berridge, K. C. The debate over dopamines role in reward: the case for incentive salience. Psychopharmacology (Berl.) 191, 391-431 (2007).
27. Clark, J. J. et al. Chronic microsensors for longitudinal, subsecond dopamine detection in behaving animals. Nature Methods 7, 126-129 (2010).
28. Keithley, R. B., Heien, M. L. & Wightman, R. M. Multivariate concentration determination using principal component regression with residual analysis. Trends Analyt. Chem. 28, 1127-1136 (2009).