Distinct Representations of Cognitive and Motivational Signals in Midbrain Dopamine Neurons

Neuron

Volumn 79, Issue 5, 2013, Pages 1011-1024

  Matsumoto, Masayuki ^a,b   Takada, Masahiko ^a  

^a KYOTO UNIVERSITY   (Japan)

^b UNIVERSITY OF TSUKUBA   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

DOPAMINE;

ADULT ANIMAL; ANIMAL EXPERIMENT; ANIMAL TISSUE; ARTICLE; COGNITION; CONTROLLED STUDY; DECISION MAKING; DOPAMINERGIC NERVE CELL; ELECTROPHYSIOLOGY; MALE; MESENCEPHALON; MOTIVATION; NEUROANATOMY; NONHUMAN; PERFORMANCE; PRIORITY JOURNAL; REWARD; RHESUS MONKEY; SUBSTANTIA NIGRA PARS COMPACTA; VENTRAL TEGMENTUM; VISION; VISUAL STIMULATION; WORKING MEMORY;

ACTION POTENTIALS; ANIMALS; COGNITION; DOPAMINERGIC NEURONS; MACACA MULATTA; MALE; MEMORY, SHORT-TERM; MOTIVATION; REINFORCEMENT (PSYCHOLOGY); SUBSTANTIA NIGRA; VENTRAL TEGMENTAL AREA;

EID: 84884190234     PISSN: 08966273     EISSN: 10974199     Source Type: Journal    
DOI: 10.1016/j.neuron.2013.07.002     Document Type: Article

References (62)

1. Bayer H.M., Glimcher P.W. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 2005, 47:129-141.
2. Berridge K.C., Robinson T.E. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?. Brain Res. Brain Res. Rev. 1998, 28:309-369.
3. Brischoux F., Chakraborty S., Brierley D.I., Ungless M.A. Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli. Proc. Natl. Acad. Sci. USA 2009, 106:4894-4899.
4. Bromberg-Martin E.S., Matsumoto M., Hikosaka O. Distinct tonic and phasic anticipatory activity in lateral habenula and dopamine neurons. Neuron 2010, 67:144-155.
5. Bromberg-Martin E.S., Matsumoto M., Hikosaka O. Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 2010, 68:815-834.
6. Cohen J.D., Braver T.S., Brown J.W. Computational perspectives on dopamine function in prefrontal cortex. Curr. Opin. Neurobiol. 2002, 12:223-229.
7. Cools R. Dopaminergic control of the striatum for high-level cognition. Curr. Opin. Neurobiol. 2011, 21:402-407.
8. Crofts H.S., Dalley J.W., Collins P., Van Denderen J.C., Everitt B.J., Robbins T.W., Roberts A.C. Differential effects of 6-OHDA lesions of the frontal cortex and caudate nucleus on the ability to acquire an attentional set. Cereb. Cortex 2001, 11:1015-1026.
9. de Lafuente V., Romo R. Dopamine neurons code subjective sensory experience and uncertainty of perceptual decisions. Proc. Natl. Acad. Sci. USA 2011, 108:19767-19771.
10. Doya K. Metalearning and neuromodulation. Neural Netw. 2002, 15:495-506.
11. Durstewitz D., Seamans J.K., Sejnowski T.J. Dopamine-mediated stabilization of delay-period activity in a network model of prefrontal cortex. J.Neurophysiol. 2000, 83:1733-1750.
12. Faure A., Reynolds S.M., Richard J.M., Berridge K.C. Mesolimbic dopamine in desire and dread: enabling motivation to be generated by localized glutamate disruptions in nucleus accumbens. J.Neurosci. 2008, 28:7184-7192.
13. Fiorillo C.D., Tobler P.N., Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 2003, 299:1898-1902.
14. Fiorillo C.D., Newsome W.T., Schultz W. The temporal precision of reward prediction in dopamine neurons. Nat. Neurosci. 2008, 11:966-973.
15. Gläscher J., Hampton A.N., O'Doherty J.P. Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making. Cereb. Cortex 2009, 19:483-495.
16. Guarraci F.A., Kapp B.S. An electrophysiological characterization of ventral tegmental area dopaminergic neurons during differential pavlovian fear conditioning in the awake rabbit. Behav. Brain Res. 1999, 99:169-179.
17. Haber S.N., Fudge J.L., McFarland N.R. Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. J.Neurosci. 2000, 20:2369-2382.
18. Hikosaka O., Nakamura K., Nakahara H. Basal ganglia orient eyes to reward. J.Neurophysiol. 2006, 95:567-584.
19. Horvitz J.C. Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events. Neuroscience 2000, 96:651-656.
20. Horvitz J.C., Stewart T., Jacobs B.L. Burst activity of ventral tegmental dopamine neurons is elicited by sensory stimuli in the awake cat. Brain Res. 1997, 759:251-258.
21. Kastner S., Ungerleider L.G. Mechanisms of visual attention in the human cortex. Annu. Rev. Neurosci. 2000, 23:315-341.
22. Kennerley S.W., Behrens T.E., Wallis J.D. Double dissociation of value computations in orbitofrontal and anterior cingulate neurons. Nat. Neurosci. 2011, 14:1581-1589.
23. Kobayashi S., Schultz W. Influence of reward delays on responses of dopamine neurons. J.Neurosci. 2008, 28:7837-7846.
24. Landau S.M., Lal R., O'Neil J.P., Baker S., Jagust W.J. Striatal dopamine and working memory. Cereb. Cortex 2009, 19:445-454.
25. Li B.M., Mei Z.T. Delayed-response deficit induced by local injection of the alpha 2-adrenergic antagonist yohimbine into the dorsolateral prefrontal cortex in young adult monkeys. Behav. Neural Biol. 1994, 62:134-139.
26. Lynd-Balta E., Haber S.N. The organization of midbrain projections to the striatum in the primate: sensorimotor-related striatum versus ventral striatum. Neuroscience 1994, 59:625-640.
27. Matsumoto M., Hikosaka O. Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 2009, 459:837-841.
28. Montague P.R., Dayan P., Sejnowski T.J. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J.Neurosci. 1996, 16:1936-1947.
29. Morris G., Arkadir D., Nevet A., Vaadia E., Bergman H. Coincident but distinct messages of midbrain dopamine and striatal tonically active neurons. Neuron 2004, 43:133-143.
30. Morrison S.E., Salzman C.D. The convergence of information about rewarding and aversive stimuli in single neurons. J.Neurosci. 2009, 29:11471-11483.
31. Nakahara H., Itoh H., Kawagoe R., Takikawa Y., Hikosaka O. Dopamine neurons can represent context-dependent prediction error. Neuron 2004, 41:269-280.
32. Nieoullon A. Dopamine and the regulation of cognition and attention. Prog. Neurobiol. 2002, 67:53-83.
33. Nomoto K., Schultz W., Watanabe T., Sakagami M. Temporally extended dopamine responses to perceptually demanding reward-predictive stimuli. J.Neurosci. 2010, 30:10692-10702.
34. Noudoost B., Moore T. Control of visual cortical signals by prefrontal dopamine. Nature 2011, 474:372-375.
35. Porrino L.J., Goldman-Rakic P.S. Brainstem innervation of prefrontal and anterior cingulate cortex in the rhesus monkey revealed by retrograde transport of HRP. J.Comp. Neurol. 1982, 205:63-76.
36. Rao S.C., Rainer G., Miller E.K. Integration of what and where in the primate prefrontal cortex. Science 1997, 276:821-824.
37. Redgrave P., Gurney K. The short-latency dopamine signal: a role in discovering novel actions?. Nat. Rev. Neurosci. 2006, 7:967-975.
38. Ridderinkhof K.R., van den Wildenberg W.P., Segalowitz S.J., Carter C.S. Neurocognitive mechanisms of cognitive control: the role of prefrontal cortex in action selection, response inhibition, performance monitoring, and reward-based learning. Brain Cogn. 2004, 56:129-140.
39. Robbins T.W., Arnsten A.F. The neuropsychopharmacology of fronto-executive function: monoaminergic modulation. Annu. Rev. Neurosci. 2009, 32:267-287.
40. Robbins T.W., Roberts A.C. Differential regulation of fronto-executive function by the monoamines and acetylcholine. Cereb. Cortex 2007, 17(Suppl 1):i151-i160.
41. Roesch M.R., Olson C.R. Neuronal activity related to reward value and motivation in primate frontal cortex. Science 2004, 304:307-310.
42. Sarter M., Givens B., Bruno J.P. The cognitive neuroscience of sustained attention: where top-down meets bottom-up. Brain Res. Brain Res. Rev. 2001, 35:146-160.
43. Satoh T., Nakai S., Sato T., Kimura M. Correlated coding of motivation and outcome of decision by dopamine neurons. J.Neurosci. 2003, 23:9913-9923.
44. Sawaguchi T., Goldman-Rakic P.S. D1 dopamine receptors in prefrontal cortex: involvement in working memory. Science 1991, 251:947-950.
45. Sawaguchi T., Goldman-Rakic P.S. The role of D1-dopamine receptor in working memory: local injections of dopamine antagonists into the prefrontal cortex of rhesus monkeys performing an oculomotor delayed-response task. J.Neurophysiol. 1994, 71:515-528.
46. Schultz W. Predictive reward signal of dopamine neurons. J.Neurophysiol. 1998, 80:1-27.
47. Schultz W. Updating dopamine reward signals. Curr. Opin. Neurobiol. 2013, 23:229-238.
48. Schultz W., Apicella P., Ljungberg T. Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. J.Neurosci. 1993, 13:900-913.
49. Schultz W., Dayan P., Montague P.R. A neural substrate of prediction and reward. Science 1997, 275:1593-1599.
50. Steinfels G.F., Heym J., Strecker R.E., Jacobs B.L. Behavioral correlates of dopaminergic unit activity in freely moving cats. Brain Res. 1983, 258:217-228.
51. Takikawa Y., Kawagoe R., Hikosaka O. A possible role of midbrain dopamine neurons in short- and long-term adaptation of saccades to position-reward mapping. J.Neurophysiol. 2004, 92:2520-2529.
52. Tobler P.N., Fiorillo C.D., Schultz W. Adaptive coding of reward value by dopamine neurons. Science 2005, 307:1642-1645.
53. Treue S. Neural correlates of attention in primate visual cortex. Trends Neurosci. 2001, 24:295-300.
54. Ullsperger M. Genetic association studies of performance monitoring and learning from feedback: the role of dopamine and serotonin. Neurosci. Biobehav. Rev. 2010, 34:649-659.
55. Ungless M.A. Dopamine: the salient issue. Trends Neurosci. 2004, 27:702-706.
56. Vezoli J., Procyk E. Frontal feedback-related potentials in nonhuman primates: modulation during learning and under haloperidol. J.Neurosci. 2009, 29:15675-15683.
57. Watanabe M., Kodama T., Hikosaka K. Increase of extracellular dopamine in primate prefrontal cortex during a working memory task. J.Neurophysiol. 1997, 78:2795-2798.
58. Williams S.M., Goldman-Rakic P.S. Characterization of the dopaminergic innervation of the primate frontal cortex using a dopamine-specific antibody. Cereb. Cortex 1993, 3:199-222.
59. Williams G.V., Goldman-Rakic P.S. Modulation of memory fields by dopamine D1 receptors in prefrontal cortex. Nature 1995, 376:572-575.
60. Williams S.M., Goldman-Rakic P.S. Widespread origin of the primate mesofrontal dopamine system. Cereb. Cortex 1998, 8:321-345.
61. Wilson F.A., Scalaidhe S.P., Goldman-Rakic P.S. Dissociation of object and spatial processing domains in primate prefrontal cortex. Science 1993, 260:1955-1958.
62. Wise R.A. Dopamine, learning and motivation. Nat. Rev. Neurosci. 2004, 5:483-494.