Dopamine and reward seeking: The role of ventral tegmental area

Reviews in the Neurosciences

Volumn 25, Issue 5, 2014, Pages 621-630

  Ranaldi, Robert ^a  

^a CITY UNIVERSITY OF NEW YORK   (United States)

Author keywords

acetylcholine; dopamine; glutamate; learning; motivation; neural plasticity; reward

Indexed keywords

ACETYLCHOLINE; COCAINE; DOPAMINE; GLUTAMIC ACID; MUSCARINIC RECEPTOR; N METHYL DEXTRO ASPARTIC ACID RECEPTOR;

ARTICLE; BRAIN NERVE CELL; CONDITIONED PLACE PREFERENCE TEST; DOPAMINERGIC TRANSMISSION; HUMAN; INSTRUMENTAL CONDITIONING; LEARNING; LONG TERM POTENTIATION; MESOLIMBIC DOPAMINERGIC SYSTEM; MODEL; MOTIVATION; NERVE CELL PLASTICITY; NEUROBIOLOGY; NONHUMAN; NUCLEUS ACCUMBENS; PREDICTION; REINFORCEMENT; REWARD; STATE DEPENDENT LEARNING; STIMULUS RESPONSE; SYNAPSE; VENTRAL TEGMENTUM; ANIMAL; METABOLISM; PHYSIOLOGY;

ANIMALS; DOPAMINE; HUMANS; NEURONAL PLASTICITY; REWARD; SYNAPSES; VENTRAL TEGMENTAL AREA;

EID: 84904900259     PISSN: 03341763     EISSN: 21910200     Source Type: Journal    
DOI: 10.1515/revneuro-2014-0019     Document Type: Article

References (101)

1. Albin, R.L., Makowiec, R.L., Hollingsworth, Z.R., Dure, L.S.T., Penney, J.B., and Young, A.B. (1992). Excitatory amino acid binding sites in the basal ganglia of the rat: a quantitative autoradiographic study. Neuroscience 46, 35-48.
2. Alleweireldt, A.T., Weber, S.M., Kirschner, K.F., Bullock, B.L., and Neisewander, J.L. (2002). Blockade or stimulation of D1 dopamine receptors attenuates cue reinstatement of extinguished cocaine-seeking behavior in rats. Psychopharmacology 159, 284-293.
3. Bassareo, V. and Di Chiara, G. (1999). Modulation of feedinginduced activation of mesolimbic dopamine transmission by appetitive stimuli and its relation to motivational state. Eur. J. Neurosci. 11, 4389-4397.
4. Bassareo, V., De Luca, M.A., and Di Chiara, G. (2007). Differential impact of pavlovian drug conditioned stimuli on in vivo dopamine transmission in the rat accumbens shell and core and in the prefrontal cortex. Psychopharmacology (Berl) 191, 689-703.
5. Baxter, M.G. and Murray, E.A. (2002). The amygdala and reward. Nat. Rev. Neurosci. 3, 563-573.
6. Beninger, R.J. (1983). The role of dopamine in locomotor activity and learning. Brain Res. Rev. 6, 173-196.
7. Beninger, R.J. and Ranaldi, R. (1994). Dopaminergic Agents with Different Mechanisms of Action Differentially Affect Responding for Conditioned Reward. In: Strategies for Studying Brain Disorders, Vol. 1: Depressive, Anxiety and Drug Abuse Disorders. T. Palomo and T. Archer, eds. (London: Farrand Press), pp. 411-428.
8. Berridge, K.C. (1995). Food reward: brain substrates of wanting and liking. Neurosci. Biobehav. Rev. 20, 1-25.
9. Berridge, K.C. and Robinson, T.E. (1998). What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res. Rev. 28, 309-369.
10. Bindra, D. (1974). A motivational view of learning, performance, and behavior modification. Psychol. Rev. 81, 199-213.
11. Blackburn, J.R. and Phillips, A.G. (1989). Dopamine and preparatory behavior: II. A neurochemical analysis. Behav. Neurosci. 103, 15-23.
12. Bonci, A. and Malenka, R.C. (1999). Properties and plasticity of excitatory synapses on dopaminergic and GABAergic cells in the ventral tegmental area. J. Neurosci. 19, 3723-3730.
13. Bossert, J.M., Liu, S.Y., and Shaham, Y. (2004). A role of ventral tegmental area glutamate in contextual cue-induced relapse to heroin seeking. J. Neurosci. 24, 10726-10730.
14. Bozarth, M.A. and Wise, R.A. (1986). Involvement of the Ventral Tegmental Dopamine System in Opioid and Psychomotor Stimulant Reinforcement. In: Problems of Drug Dependence 1985. L.S. Harris, ed. NIDA Res. Monogr. 67 (Washington, DC: USGPO), pp. 190-196.
15. Carlisle, H.J. and Kennedy, M.B. (2005). Spine architecture and synaptic plasticity. Trends Neurosci. 28, 182-187.
16. Charara, A., Smith, Y., and Parent, A. (1996). Glutamatergic inputs from the pedunculopontine nucleus to midbrain dopaminergic neurons in primates: Phaseolus vulgaris-leucoagglutinin anterograde labeling combined with postembedding glutamate and GABA immunohistochemistry. J. Compar. Neurol. 364, 254-266.
17. Christoffersen, C.L. and Meltzer, L.T. (1995). Evidence for N-methyld-aspartate and AMPA subtypes of the glutamate receptor on substantia nigra dopamine neurons: possible preferential role for N-methyl-d-aspartate receptors. Neuroscience 67, 373-381.
18. Ciccocioppo, R., Sanna, P.P., and Weiss, F. (2001). Cocaine-predictive stimulus induces drug-seeking behavior and neural activation in limbic brain regions after multiple months of abstinence: reversal by D(1) antagonists. Proc. Natl. Acad. Sci. USA 98, 1976-1981.
19. Comoli, E., Coizet, V., Boyes, J., Bolam, J.P., Canteras, N.S., Quirk, R.H., Overton, P.G., and Redgrave, P. (2003). A direct projection from superior colliculus to substantia nigra for detecting salient visual events. Nat. Neurosci. 6, 974-980.
20. Di Chiara, G. (1999). Drug addiction as dopamine-dependent associative learning disorder. Eur. J. Pharmacol. 375, 13-30.
21. Di Ciano, P., Cardinal, R.N., Cowell, R.A., Little, S.J., and Everitt, B.J. (2001). Differential involvement of NMDA, AMPA/kainate, and dopamine receptors in the nucleus accumbens core in the acquisition and performance of pavlovian approach behavior. J. Neurosci. 21, 9471-9477.
22. Dommett, E., Coizet, V., Blaha, C.D., Martindale, J., Lefebvre, V., Walton, N., Mayhew, J.E., Overton, P., and Redgrave, P. (2005). How visual stimuli activate dopaminergic neurons at short latency. Science 307, 1476-1479.
23. Fallon, S., Shearman, E., Sershen, H., and Lajtha, A. (2007). Food reward-induced neurotransmitter changes in cognitive brain regions. Neurochem. Res. 32, 1772-1782.
24. Fletcher, P.J., Chintoh, A.F., Sinyard, J., and Higgins, G.A. (2004). Injection of the 5-HT2C receptor agonist Ro60-0175 into the ventral tegmental area reduces cocaine-induced locomotor activity and cocaine self-administration. Neuropsychopharmacology 29, 308-318.
25. Garzon, M., Vaughan, R.A., Uhl, G.R., Kuhar, M.J., and Pickel, V.M. (1999). Cholinergic axon terminals in the ventral tegmental area target a subpopulation of neurons expressing low levels of the dopamine transporter. J. Compar. Neurol. 410, 197-210.
26. Gronier, B. and Rasmussen, K. (1998). Activation of midbrain presumed dopaminergic neurones by muscarinic cholinergic receptors: an in vivo electrophysiological study in the rat. Br. J. Pharmacol. 124, 455-465.
27. Harris, G.C. and Aston-Jones, G. (2003). Critical role for ventral tegmental glutamate in preference for a cocaine-conditioned environment. Neuropsychopharmacology 28, 73-76.
28. Harris, G.C., Wimmer, M., Byrne, R. and Aston-Jones, G. (2004). Glutamate-associated plasticity in the ventral tegmental area is necessary for conditioning environmental stimuli with morphine. Neuroscience 129, 841-847.
29. Henderson, Z. and Sherriff, F.E. (1991). Distribution of choline acetyltransferase immunoreactive axons and terminals in the rat and ferret brainstem. J. Compar. Neurol. 314, 147-163.
30. Hernandez, L. and Hoebel, B.G. (1988). Food reward and cocaine increase extracellular dopamine in the nucleus accumbens as measured by microdialysis. Life Sci. 42, 1705-1712.
31. Hopkins, D.A. and Holstege, G. (1978). Amygdaloid projections to the mesencephalon, pons and medulla oblongata in the cat. Exp. Brain Res. 32, 529-547.
32. Horvitz, J.C. (2000). Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events. Neuroscience 96, 651-655.
33. Horvitz, J.C., Choi, W.Y., Morvan, C., Eyny, Y. and Balsam, P.D. (2007). A "good parent" function of dopamine: transient modulation of learning and performance during early stages of training. Ann. NY Acad. Sci. 1104, 270-288.
34. Ikemoto, S. and Panksepp, J. (1996). Dissociations between appetitive and consummatory responses by pharmacological manipulations of reward-relevant brain regions. Behav. Neurosci. 110, 331-345.
35. Ikemoto, S. and Panksepp, J. (1999). The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretations with special reference to reward-seeking. Brain Res. Rev. 31, 6-41.
36. Ito, R., Robbins, T.W., and Everitt, B.J. (2004). Differential control over cocaine-seeking behavior by nucleus accumbens core and shell. Nat. Neurosci. 7, 389-397.
37. Johnson, S.W., Seutin, V., and North, R.A. (1992). Burst firing in dopamine neurons induced by N-methyl-d-aspartate: role of electrogenic sodium pump. Science 258, 665-667.
38. Kalivas, P.W. (1993). Neurotransmitter regulation of dopamine neurons in the ventral tegmental area. Brain Res. Rev. 18, 75-113.
39. Kelley, A.E. (1999). Neural integrative activities of nucleus accumbens subregions in relation to learning and motivation. Psychobiology 27, 198-213.
40. Kessels, H.W. and Malinow, R. (2009). Synaptic AMPA receptor plasticity and behavior. Neuron 61, 340-350.
41. Kest, K., Cruz, I., Chen, D.H., Galaj, E. and Ranaldi, R. (2012). A foodassociated CS activates c-Fos in VTA DA neurons and elicits conditioned approach. Behav. Brain Res. 235, 150-157.
42. Khroyan, T.V., Barrett-Larimore, R.L., Rowlett, J.K., and Spealman, R.D. (2000). Dopamine D1-and D2-like receptor mechanisms in relapse to cocaine-seeking behavior: effects of selective antagonists and agonists. J. Pharmacol. Exp. Ther. 294, 680-687.
43. Kiyatkin, E.A. and Rebec, G.V. (1998). Heterogeneity of ventral tegmental area neurons: single-unit recording and iontophoresis in awake, unrestrained rats. Neuroscience 85, 1285-1309.
44. Kiyatkin, E.A. and Stein, E.A. (1996). Conditioned changes in nucleus accumbens dopamine signal established by intravenous cocaine in rats. Neurosci. Lett. 211, 73-76.
45. Kobayashi, Y., Inoue, Y., Yamamoto, M., Isa, T. and Aizawa, H. (2002). Contribution of pedunculopontine tegmental nucleus neurons to performance of visually guided saccade tasks in monkeys. J. Neurophysiol. 88, 715-731.
46. Kofman, O. and Yeomans, J.S. (1988). Cholinergic antagonists in ventral tegmentum elevate thresholds for lateral hypothalamic and brainstem self-stimulation. Pharmacol. Biochem. Behav. 31, 547-559.
47. Lacey, M.G., Calabresi, P., and North, R.A. (1990). Muscarine depolarizes rat substantia nigra zona compacta and ventral tegmen tal neurons in vitro through M1-like receptors. J. Pharmacol. Exp. Ther. 253, 395-400.
48. Lisman, J. and Raghavachari, S. (2006). A unified model of the presynaptic and postsynaptic changes during LTP at CA1 synapses. Sci. STKE 2006, re11.
49. Ljungberg, T., Apicella, P., and Schultz, W. (1992). Responses of monkey dopamine neurons during learning of behavioral reactions. J. Neurophysiol. 67, 145-163.
50. Miller, A.D. and Blaha, C.D. (2005). Midbrain muscarinic receptor mechanisms underlying regulation of mesoaccumbens and nigrostriatal dopaminergic transmission in the rat. Eur. J. Neurosci. 21, 1837-1846.
51. Miller, J.D., Sanghera, M.K., and German, D.C. (1981). Mesencephalic dopaminergic unit activity in the behaviorally conditioned rat. Life Sci. 29, 1255-1263.
52. Muller, D., Joly, M., and Lynch, G. (1988). Contributions of quisqualate and NMDA receptors to the induction and expression of LTP. Science 242, 1694-1697.
53. Nicola, S.M., Taha, S.A., Kim, S.W., and Fields, H.L. (2005). Nucleus accumbens dopamine release is necessary and sufficient to promote the behavioral response to reward-predictive cues. Neuroscience 135, 1025-1033.
54. Nicoll, R.A. (2003). Expression mechanisms underlying long-term potentiation: a postsynaptic view. Phil. Trans. R. Soc. Lond. B 358, 721-726.
55. Oakman, S.A., Faris, P.L., Kerr, P.E., Cozzari, C., and Hartman, B.K. (1995). Distribution of pontomesencephalic cholinergic neurons projecting to substantia nigra differs significantly from those projecting to ventral tegmental area. J. Neurosci. 15, 5859-5869.
56. Omelchenko, N. and Sesack, S.R. (2010). Periaqueductal gray afferents synapse onto dopamine and GABA neurons in the rat ventral tegmental area. J. Neurosci. Res. 88, 981-991.
57. Overton, P. and Clark, D. (1992). Iontophoretically administered drugs acting at the N-methyl-d-aspartate receptor modulate burst firing in A9 dopamine neurons in the rat. Synapse 10, 131-140.
58. Pan, W.X. and Hyland, B.I. (2005). Pedunculopontine tegmental nucleus controls conditioned responses of midbrain dopamine neurons in behaving rats. J. Neurosci. 25, 4725-4732.
59. Pan, W.X., Schmidt, R., Wickens, J.R. and Hyland, B.I. (2005). Dopamine cells respond to predicted events during classical conditioning: evidence for eligibility traces in the reward-learning network. J. Neurosci. 25, 6235-6242.
60. Parkinson, J.A., Olmstead, M.C., Burns, L.H., Robbins, T.W., and Everitt, B.J. (1999). Dissociation in effects of lesions of the nucleus accumbens core and shell on appetitive pavlovian approach behavior and the potentiation of conditioned reinforcement and locomotor activity by d-amphetamine. J. Neurosci. 19, 2401-2411.
61. Pert, A. (1998). Neurobiological substrates underlying conditioned effects of cocaine. Adv. Pharmacol. 42, 991-995.
62. Phillips, A.G., Atkinson, L.J., Blackburn, J.R., and Blaha, C.D. (1993). Increased extracellular dopamine in the nucleus accumbens of the rat elicited by a conditional stimulus for food: an electrochemical study. Can. J. Physiol. Pharmacol. 71, 387-393.
63. Phillipson, O.T. (1979). Afferent projections to the ventral tegmental area of Tsai and interfascicular nucleus: a horseradish peroxidase study in the rat. J. Compar. Neurol. 187, 117-143.
64. Rada, P.V., Mark, G.P., Yeomans, J.S., and Hoebel, B.G. (2000). Acetylcholine release in ventral tegmental area by hypothalamic self-stimulation, eating, and drinking. Pharmacol. Biochem. Behav. 65, 375-379.
65. Radhakishun, F.S., van Ree, J.M., and Westerink, B.H.C. (1988). Scheduled eating increases dopamine release in the nucleus accumbens of food-deprived rats as assessed with on-line brain dialysis. Neurosci. Lett. 85, 351-356.
66. Ranaldi, R., Pocock, D., Zereik, R., and Wise, R.A. (1999). Dopamine fluctuations in the nucleus accumbens during maintenance, extinction, and reinstatement of intravenous d-amphetamine self-administration. J. Neurosci. 19, 4102-4109.
67. Ranaldi, R., Kest, K., Zellner, M.R., Lubelski, D., Muller, J., Cruz, Y., and Saliba, M. (2011). The effects of VTA NMDA receptor antagonism on reward-related learning and associated c-fos expression in forebrain. Behav. Brain Res. 216, 424-432.
68. Richardson, N.R. and Gratton, A. (1996). Behavior-relevant changes in nucleus accumbens dopamine transmission elicited by food reinforcement: an electrochemical study in rat. J. Neurosci. 16, 8160-8169.
69. Robbins, T.W. and Everitt, B.J. (1996). Neurobehavioural mechanisms of reward and motivation. Curr. Opin. Neurobiol. 6, 228-236.
70. Salamone, J.D. (1991). Behavioral Pharmacology of Dopamine Systems: A New Synthesis. In: The Mesolimbic Dopamine System: From Motivation to Action, P. Willner and J. Scheel-Kruger, eds. (Hoboken, NJ: John Wiley & Sons), pp. 599-613.
71. Salamone, J.D. and Correa, M. (2002). Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine. Behav. Brain Res. 137, 3-25.
72. Schultz, W. (1997). A neural substrate of prediction and reward. Science 275, 1593-1599.
73. Schultz, W. (1998). Predictive reward signal of dopamine neurons. J. Neurophysiol. 80, 1-27.
74. Schultz, W., Apicella, P., and Ljungberg, T. (1993). Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. J. Neurosci. 13, 900-913.
75. Sesack, S.R. and Pickel, V.M. (1992). Prefrontal cortical efferents in the rat synapse on unlableled neuronal targets of catecholamine terminals in the nucleus accumbens septi and on dopamine neurons in the ventral tegmental area. J. Compar. Neurol. 320, 145-160.
76. Seutin, V., Verbanck, P., Massotte, L., and Dresse, A. (1990). Evidence for the presence of N-methyl-d-aspartate receptors in the ventral tegmental area of the rat: an electrophysiological in vitro study. Brain Res. 514, 147-150.
77. Sharf, R. and Ranaldi, R. (2006). Blockade of muscarinic acetylcholine receptors in the ventral tegmental area disrupts foodrelated learning in rats. Psychopharmacology 184, 87-94.
78. Sharf, R., McKelvey, J., and Ranaldi, R. (2006). Blockade of muscarinic acetylcholine receptors in the ventral tegmental area prevents acquisition of food-rewarded operant responding in rats. Psychopharmacology (Berl) 186, 113-121.
79. Shinohara, F., Kihara, Y., Ide, S., Minami, M., and Kaneda, K. (2014). Critical role of cholinergic transmission from the laterodorsal tegmental nucleus to the ventral tegmental area in cocaine-induced place preference. Neuropharmacology 79C, 573-579.
80. Smith, Y., Charara, A., and Parent, A. (1996). Synaptic innervation of midbrain dopaminergic neurons by glutamate-enriched terminals in the squirrel monkey. J. Compar. Neurol. 364, 231-253.
81. Steidl, S., Wang, H., and Wise, R.A. (2014). Lesions of cholinergic pedunculopontine tegmental nucleus neurons fail to affect cocaine or heroin self-administration or conditioned place preference in rats. PLoS One 9, e84412.
82. Stewart, J. (1984). Reinstatement of heroin and cocaine self-administration behavior in the rat by intracerebral application of morphine in the ventral tegmental area. Pharmacol. Biochem. Behav. 20, 917-923.
83. Stuber, G.D., Klanker, M., de Ridder, B., Bowers, M.S., Joosten, R.N., Feenstra, M.G., and Bonci, A. (2008). Reward-predictive cues enhance excitatory synaptic strength onto midbrain dopamine neurons. Science 321, 1690-1692.
84. Wakabayashi, K.T., Fields, H.L., and Nicola, S.M. (2004). Dissociation of the role of nucleus accumbens dopamine in responding to reward-predictive cues and waiting for reward. Behav. Brain Res. 15, 19-30.
85. Westerink, B.H.C., Enrico, P., Feimann, J., and De Vries, J.B. (1998). The pharmacology of mesocortical dopamine neurons: a dualprobe microdialysis study in the ventral tegmental area and prefrontal cortex of the rat brain. J. Pharmacol. Exp. Ther. 285, 143-154.
86. White, N.M. (1989). Reward or reinforcement: what's the difference? Neurosci. Biobehav. Rev. 13, 181-186.
87. White, N.M. and Milner, P.M. (1992). The psychobiology of reinforcers. Annu. Rev. Psychol. 43, 443-471.
88. Wightman, R.M. and Robinson, D.L. (2002). Transient changes in mesolimbic dopamine and their association with 'reward'. J. Neurochem. 82, 721-735.
89. Wilson, C., Nomikos, G.G., Collu, M., and Fibiger, H.C. (1995). Dopaminergic correlates of motivated behavior: importance of drive. J. Neurosci. 15, 5169-5178.
90. Wise, R.A. (2004). Dopamine, learning and motivation. Nat. Rev. Neurosci. 5, 483-494.
91. Wise, R.A. and Bozarth, M.A. (1987). A psychomotor stimulant theory of addiction. Psychol. Rev. 94, 469-492.
92. Wise, R.A., Spindler, J., deWit, H., and Gerber, G.J. (1978). Neuroleptic-induced "anhedonia" in rats: pimozide blocks reward quality of food. Science 201, 262-264.
93. Yeomans, J.S., Kofman, O., and McFarlane, V. (1985). Cholinergic involvement in lateral hypothalamic rewarding brain stimulation. Brain Res. 329, 19-26.
94. Yeomans, J.S., Mathur, A., and Tampakeras, M. (1993). Rewarding brain stimulation: role of tegmental cholinergic neurons that activate dopamine neurons. Behav. Neurosci. 107, 1077.
95. You, Z.B., Wang, B., Zitzman, D., Azari, S., and Wise, R.A. (2007). A role for conditioned ventral tegmental glutamate release in cocaine seeking. J. Neurosci. 27, 10546-10555.
96. You, Z.B., Wang, B., Zitzman, D., and Wise, R.A. (2008). Acetylcholine release in the mesocorticolimbic dopamine system during cocaine seeking: conditioned and unconditioned contributions to reward and motivation. J. Neurosci. 28, 9021-9029.
97. Yun, I.A., Nicola, S.M., and Fields, H.L. (2004a). Contrasting effects of dopamine and glutamate receptor antagonist injection in the nucleus accumbens suggest a neural mechanism underlying cueevoked goal-directed behavior. Eur. J. Neurosci. 20, 249-263.
98. Yun, I.A., Wakabayashi, K.T., Fields, H.L., and Nicola, S.M. (2004b). The ventral tegmental area is required for the behavioral and nucleus accumbens neuronal firing responses to incentive cues. J. Neurosci. 24, 2923-2933.
99. Zellner, M.R. and Ranaldi, R. (2010). How conditioned stimuli acquire the ability to activate VTA dopamine cells: a proposed neurobiological component of reward-related learning. Neurosci. Biobehav. Rev. 34, 769-780.
100. Zellner, M.R., Kest, K., and Ranaldi, R. (2009). NMDA receptor antagonism in the ventral tegmental area impairs acquisition of reward-related learning. Behav. Brain Res. 197, 442-449.
101. Zhang, J., Chiodo, L.A., and Freeman, A.S. (1994). Influence of excitatory amino acid receptor subtypes on the electrophysiological activity of dopaminergic and nondopaminergic neurons in rat substantia nigra. J. Pharmacol. Exp. Ther. 269, 313-321.