The dorsomedial striatum encodes net expected return, critical for energizing performance vigor

Nature Neuroscience

Volumn 16, Issue 5, 2013, Pages 639-647

  Wang, Alice Y ^a,d   Miura, Keiji ^a,b,c   Uchida, Naoshige ^a  

^a HARVARD UNIVERSITY   (United States)

^b JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

^c TOHOKU UNIVERSITY   (Japan)

^d HARVARD MEDICAL SCHOOL   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL CELL; ANIMAL EXPERIMENT; ANIMAL MODEL; ARTICLE; BRAIN FUNCTION; BRAIN REGION; CONTROLLED STUDY; CORPUS STRIATUM; DECISION MAKING; DORSOMEDIAL STRIATUM; MALE; MOTIVATION; NERVE CELL; NONHUMAN; ODOR; OLFACTORY DISCRIMINATION; PRIORITY JOURNAL; PSYCHOMETRY; RAT; REWARD; TASK PERFORMANCE;

ACTION POTENTIALS; ANIMALS; COMPUTER SIMULATION; CONDITIONING, OPERANT; CORPUS STRIATUM; DECISION MAKING; DISCRIMINATION (PSYCHOLOGY); LOGISTIC MODELS; MALE; MODELS, NEUROLOGICAL; MOTIVATION; NEURONS; ODORS; PSYCHOMETRICS; RATS; RATS, LONG-EVANS; REACTION TIME; REGRESSION ANALYSIS; REWARD;

EID: 84876917913     PISSN: 10976256     EISSN: 15461726     Source Type: Journal    
DOI: 10.1038/nn.3377     Document Type: Article

References (44)

1. Kable, J.W. & Glimcher, P.W. The neurobiology of decision: consensus and controversy. Neuron 63, 733-745 (2009).
2. Lee, D., Seo, H. & Jung, M.W. Neural basis of reinforcement learning and decision making. Annu. Rev. Neurosci. 35, 287-308 (2012).
3. Niv, Y., Joel, D. & Dayan, P. A normative perspective on motivation. Trends Cogn. Sci. 10, 375-381 (2006). (Pubitemid 44093326)
4. Niv, Y., Daw, N.D., Joel, D. & Dayan, P. Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology (Berl.) 191, 507-520 (2007). (Pubitemid 46355878)
5. Guitart-Masip, M., Beierholm, U.R., Dolan, R., Duzel, E. & Dayan, P. Vigor in the face of fluctuating rates of reward: an experimental examination. J. Cogn. Neurosci. 23, 3933-3938 (2011).
6. Hebb, D.O. Drives and the C.N.S. (conceptual nervous system). Psychol. Rev. 62, 243-254 (1955).
7. Hull, C.L. Principles of Behavior: An Introduction to Behavior Theory (D. Appleton-Century Company, Inc., Oxford, England, 1943).
8. Ferster, C.B. & Skinner, B.F. Schedules of Reinforcement (D. Appleton-Century Company, Inc., Oxford, England, 1957).
9. Nakamura, K. & Hikosaka, O. Role of dopamine in the primate caudate nucleus in reward modulation of saccades. J. Neurosci. 26, 5360-5369 (2006). (Pubitemid 44318388)
10. Ding, L. & Gold, J.I. Separate, causal roles of the caudate in saccadic choice and execution in a perceptual decision task. Neuron 75, 865-874 (2012).
11. Roesch, M.R. & Olson, C.R. Neuronal activity related to reward value and motivation in primate frontal cortex. Science 304, 307-310 (2004). (Pubitemid 38452186)
12. Gurney, K., Prescott, T.J. & Redgrave, P. A computational model of action selection in the basal ganglia. I. A new functional anatomy. Biol. Cybern. 84, 401-410 (2001). (Pubitemid 33605190)
13. Hikosaka, O., Nakamura, K. & Nakahara, H. Basal ganglia orient eyes to reward. J. Neurophysiol. 95, 567-584 (2006). (Pubitemid 44699062)
14. Turner, R.S. & Desmurget, M. Basal ganglia contributions to motor control: a vigorous tutor. Curr. Opin. Neurobiol. 20, 704-716 (2010).
15. Lau, B. & Glimcher, P.W. Value representations in the primate striatum during matching behavior. Neuron 58, 451-463 (2008). (Pubitemid 351615183)
16. Samejima, K., Ueda, Y., Doya, K. & Kimura, M. Representation of action-specific reward values in the striatum. Science 310, 1337-1340 (2005). (Pubitemid 41698867)
17. Cai, X., Kim, S. & Lee, D. Heterogeneous coding of temporally discounted values in the dorsal and ventral striatum during intertemporal choice. Neuron 69, 170-182 (2011).
18. Kelley, A.E. Ventral striatal control of appetitive motivation: role in ingestive behavior and reward-related learning. Neurosci. Biobehav. Rev. 27, 765-776 (2004). (Pubitemid 38202248)
19. Mogenson, G.J., Jones, D.L. & Yim, C.Y. From motivation to action: functional interface between the limbic system and the motor system. Prog. Neurobiol. 14, 69-97 (1980). (Pubitemid 10053405)
20. Palmiter, R.D. Dopamine signaling in the dorsal striatum is essential for motivated behaviors: lessons from dopamine-deficient mice. Ann. NY Acad. Sci. 1129, 35-46 (2008). (Pubitemid 351990274)
21. Amalric, M. & Koob, G.F. Depletion of dopamine in the caudate nucleus but not in nucleus accumbens impairs reaction-time performance in rats. J. Neurosci. 7, 2129-2134 (1987). (Pubitemid 17114928)
22. Hauber, W. & Schmidt, W.J. Differential effects of lesions of the dorsomedial and dorsolateral caudate-putamen on reaction time performance in rats. Behav. Brain Res. 60, 211-215 (1994). (Pubitemid 24087401)
23. Uchida, N. & Mainen, Z.F. Speed and accuracy of olfactory discrimination in the rat. Nat. Neurosci. 6, 1224-1229 (2003). (Pubitemid 37346044)
24. Rorie, A.E., Gao, J., McClelland, J.L. & Newsome, W.T. Integration of sensory and reward information during perceptual decision-making in lateral intraparietal cortex (LIP) of the macaque monkey. PLoS ONE 5, e9308 (2010).
25. Skinner, B.F. The Behavior of Organisms: An Experimental Analysis (D. Appleton-Century Company, Inc., Oxford, England, 1938).
26. Tai, L.H., Lee, A.M., Benavidez, N., Bonci, A. & Wilbrecht, L. Transient stimulation of distinct subpopulations of striatal neurons mimics changes in action value. Nat. Neurosci. 15, 1281-1289 (2012).
27. Mogenson, G.J., Takigawa, M., Robertson, A. & Wu, M. Self-stimulation of the nucleus accumbens and ventral tegmental area of Tsai attenuated by microinjections of spiroperidol into the nucleus accumbens. Brain Res. 171, 247-259 (1979). (Pubitemid 10246668)
28. Imperato, A. & Di Chiara, G. Preferential stimulation of dopamine release in the nucleus accumbens of freely moving rats by ethanol. J. Pharmacol. Exp. Ther. 239, 219-228 (1986). (Pubitemid 16006360)
29. Salamone, J.D., Correa, M., Farrar, A.M., Nunes, E.J. & Pardo, M. Dopamine, behavioral economics, and effort. Front. Behav. Neurosci. 3, 13 (2009).
30. Newman, R. & Winans, S.S. An experimental study of the ventral striatum of the golden hamster. I. Neuronal connections of the nucleus accumbens. J. Comp. Neurol. 191, 167-192 (1980). (Pubitemid 10076661)
31. Delgado, M.R., Stenger, V.A. & Fiez, J.A. Motivation-dependent responses in the human caudate nucleus. Cereb. Cortex 14, 1022-1030 (2004). (Pubitemid 39121363)
32. Volkow, N.D. et al. "Nonhedonic" food motivation in humans involves dopamine in the dorsal striatum and methylphenidate amplifies this effect. Synapse 44, 175-180 (2002). (Pubitemid 34303915)
33. Brown, V.J. & Robbins, T.W. Elementary processes of response selection mediated by distinct regions of the striatum. J. Neurosci. 9, 3760-3765 (1989). (Pubitemid 20004871)
34. Bailey, K.R. & Mair, R.G. The role of striatum in initiation and execution of learned action sequences in rats. J. Neurosci. 26, 1016-1025 (2006). (Pubitemid 43237093)
35. Thorn, C.A., Atallah, H., Howe, M. & Graybiel, A.M. Differential dynamics of activity changes in dorsolateral and dorsomedial striatal loops during learning. Neuron 66, 781-795 (2010).
36. Kimchi, E.Y. & Laubach, M. Dynamic encoding of action selection by the medial striatum. J. Neurosci. 29, 3148-3159 (2009).
37. Balleine, B.W. & O'Doherty, J.P. Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology 35, 48-69 (2010).
38. Yin, H.H., Knowlton, B.J. & Balleine, B.W. Blockade of NMDA receptors in the dorsomedial striatum prevents action-outcome learning in instrumental conditioning. Eur. J. Neurosci. 22, 505-512 (2005). (Pubitemid 41097623)
39. Yin, H.H., Ostlund, S.B., Knowlton, B.J. & Balleine, B.W. The role of the dorsomedial striatum in instrumental conditioning. Eur. J. Neurosci. 22, 513-523 (2005). (Pubitemid 41097624)
40. Cury, K.M. & Uchida, N. Robust odor coding via inhalation-coupled transient activity in the mammalian olfactory bulb. Neuron 68, 570-585 (2010).
41. Jongen-Relo, A.L. & Feldon, J. Specific neuronal protein: a new tool for histological evaluation of excitotoxic lesions. Physiol. Behav. 76, 449-456 (2002). (Pubitemid 34786668)
42. Draper, N.R. & Smith, H. Applied Regression Analysis (John Wiley & Sons, Inc., New York, 1966).
43. Ito, M. & Doya, K. Validation of decision-making models and analysis of decision variables in the rat basal ganglia. J. Neurosci. 29, 9861-9874 (2009).
44. Seo, H. & Lee, D. Temporal filtering of reward signals in the dorsal anterior cingulate cortex during a mixed-strategy game. J. Neurosci. 27, 8366-8377 (2007). (Pubitemid 47219624)