Ventral tegmental area neurons in learned appetitive behavior and positive reinforcement

Annual Review of Neuroscience

Volumn 30, Issue , 2007, Pages 289-316

  Fields, Howard L ^a   Hjelmstad, Gregory O ^a   Margolis, Elyssa B ^a   Nicola, Saleem M ^a  

^a UNIVERSITY OF CALIFORNIA SAN FRANCISCO   (United States)

Author keywords

Dopamine; Nucleus accumbens; Opioids; Prefrontal cortex; Reward

Indexed keywords

4 AMINOBUTYRIC ACID; DOPAMINE; GLUTAMIC ACID; NEUROTRANSMITTER;

APPETITE; CONDITIONING; CORPUS STRIATUM; DOPAMINE RELEASE; DOPAMINERGIC SYSTEM; FOREBRAIN; GABAERGIC SYSTEM; HUMAN; LIMBIC CORTEX; NEUROANATOMY; NEUROPHYSIOLOGY; NONHUMAN; NUCLEUS ACCUMBENS; PREFRONTAL CORTEX; PRIORITY JOURNAL; REINFORCEMENT; REVIEW; SUBSTANTIA NIGRA; VENTRAL TEGMENTUM;

ANIMALS; APPETITIVE BEHAVIOR; DOPAMINE; HUMANS; LEARNING; LIMBIC SYSTEM; NEURAL PATHWAYS; NEURONS; REINFORCEMENT (PSYCHOLOGY); SYNAPTIC TRANSMISSION; VENTRAL TEGMENTAL AREA;

EID: 34547681422     PISSN: 0147006X     EISSN: None     Source Type: Book Series    
DOI: 10.1146/annurev.neuro.30.051606.094341     Document Type: Review

References (194)

1. Aberman JE, Salamone JD. 1999. Nucleus accumbens dopamine depletions make rats more sensitive to high ratio requirements but do not impair primary food reinforcement. Neuroscience 92:545-52
2. Anstrom KK, Woodward DJ. 2005. Restraint increases dopaminergic burst firing in awake rats. Neuropsychopharmacology 30:1832-40
3. Ashby CRJ, Paul M, Gardner EL, Heidbreder CA, Hagan JJ. 2003. Acute administration of the selective D3 receptor antagonist SB-277011A blocks the acquisition and expression of the conditioned place preference response to heroin in male rats. Synapse 48:154-56
4. Balcita-Pedicino JJ, Sesack SR. 2005. Projections from the lateral hypothalamus to the ventral tegmental area in the rat: synapses onto mesoaccumbens and mesopreffontal cell populations. Soc. Neurosci. Abstr. 605.8
5. Bayer HM, Glimcher PW. 2005. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47:129-41
6. Bayer VE, Pickel VM. 1990. Ultrastructural localization of tyrosine hydroxylase in the rat ventral tegmental area: relationship between immunolabeling density and neuronal associations. J. Neurosci. 10:2996-3013
7. Beckstead MJ, Grandy DK, Wickman K, Williams JT. 2004. Vesicular dopamine release elicits an inhibitory postsynaptic current in midbrain dopamine neurons. Neuron 42:939-46
8. Beckstead RM, Domesick VB, Nauta WJ. 1979. Efferent connections of the substantia nigra and ventral tegmental area in the rat. Brain Res. 175:191-217
9. Berger B, Tassin JP, Blanc G, Moyne MA, Thierry AM. 1974. Histochemical confirmation for dopaminergic innervation of the rat cerebral cortex after destruction of the noradrenergic ascending pathways. Brain Res. 81:332-37
10. Bissiere S, Humeau Y, Luthi A. 2003. Dopamine gates LTP induction in lateral amygdala by suppressing feedforward inhibition. Nat. Neurosci. 6:587-92
11. Blaha CD, Allen LF, Das S, Inglis WL, Latimer MP, et al. 1996. Modulation of dopamine efflux in the nucleus accumbens after cholinergic stimulation of the ventral tegmental area in intact, pedunculopontine tegmental nucleus-lesioned, and laterodorsal tegmental nucleus-lesioned rats. J. Neurosci. 16:714-22
12. Bunney BS, Walters JR, Roth RH, Aghajanian GK. 1973. Dopaminergic neurons: effect of antipsychotic drugs and amphetamine on single cell activity. J. Pharmacol. Exp. Ther. 185:560-71
13. Carelli RM. 2002. Nucleus accumbens cell firing during goal-directed behaviors for cocaine vs. "natural" reinforcement. Physiol. Behav. 76:379-87
14. Carr DB, Sesack SR. 2000. GABA-containing neurons in the rat ventral tegmental area project to the prefrontal cortex. Synapse 38:114-23
15. Cass WA, Gerhardt GA. 1995. In vivo assessment of dopamine uptake in rat medial prefrontal cortex: comparison with dorsal striatum and nucleus accumbens. J. Neurochem. 65:201-7
16. Chefer VI, Margolis EB, Lock H, Hjelmstad GO, Fields HL, Shippenberg TS. 2005. Differential control of ventral tegmental area outputs by opioid receptors. Soc. Neurosci. Abstr. 802.22
17. Chou TC, Lee CE, Lu J, Elmquist JK, Hara J, et al. 2001. Orexin (hypocretin) neurons contain dynorphin. J. Neurosci. 21:RC168
18. Chuhma N, Zhang H, Masson J, Zhuang X, Sulzer D, et al. 2004. Dopamine neurons mediate a fast excitatory signal via their glutamatergic synapses. J. Neurosci. 24:972-81
19. Clements JD. 1996. Transmitter timecourse in the synaptic cleft: its role in central synaptic function. Trends Neurosci. 19:163-71
20. Conrad LCA, Pfaff DW. 1976. Autoradiographic tracing of nucleus Accumbens efferents in rat. Brain Res. 113:589-96
21. Cornwall J, Cooper JD, Phillipson OT. 1990. Afferent and efferent connections of the laterodorsal tegmental nucleus in the rat. Brain Res. Bull. 25:271-84
22. Dahlstroem A, Fuxe K. 1964. Evidence for the existence of monoamine-containing neurons in the central nervous system. I. Demonstration of monoamines in the cell bodies of brain stem neurons. Acta Physiol. Scand. Suppl. 232:1-55
23. Dalley JW, Laane K, Theobald DE, Armstrong HC, Corlett PR, et al. 2005. Time-limited modulation of appetitive Pavlovian memory by D1 and NMDA receptors in the nucleus accumbens. Proc. Natl. Acad. Sci. USA 102:6189-94
24. Day JJ, Wheeler RA, Roitman MF, Carelli RM. 2006. Nucleus accumbens neurons encode Pavlovian approach behaviors: evidence from an autoshaping paradigm. Eur. J. Neurosci. 23:1341-51
25. Devine DP, Leone P, Pocock D, Wise RA. 1993. Differential involvement of ventral tegmental mu, delta and kappa opioid receptors in modulation of basal mesolimbic dopamine release: in vivo microdialysis studies. J. Pharmacol. Exp. Then 266:1236-46
26. Di Chiara G, Imperato A. 1988. Opposite effects of mu and kappa opiate agonists on dopamine release in the nucleus accumbens and in the dorsal caudate of freely moving rats. J. Pharmacol. Exp. Ther. 244:1067-80
27. Di Ciano P, Cardinal RN, Cowell RA, Little SJ, Everitt BJ. 2001. Differential involvement of NMDA, AMPA/kainate, and dopamine receptors in the nucleus accumbens core in the acquisition and performance of pavlovian approach behavior. J. Neurosci. 21:9471-77
28. Dickinson A, Smith J, Mirenowicz J. 2000. Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists. Behav. Neurosci. 114:468-83
29. Everitt BJ, Robbins TW. 2005. Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nat. Neurosci. 8:1481-89
30. Fadel J, Deutch AY. 2002. Anatomical substrates of orexin-dopamine interactions: lateral hypothalamic projections to the ventral tegmental area. Neuroscience 111:379-87
31. Fallon JH, Leslie FM, Cone RI. 1985. Dynorphin-containing pathways in the substantia nigra and ventral tegmentum: a double labeling study using combined immunofluorescence and retrograde tracing. Neuropeptides 5:457-60
32. Fallon JH, Moore RY. 1978. Catecholamine innervation of the basal forebrain. IV. Topography of the dopamine projection to the basal forebrain and neostriatum. J. Comp. Neurol. 180:545-80
33. Fallon JH, Schmued LC, Wang C, Miller R, Banales G. 1984. Neurons in the ventral tegmentum have separate populations projecting to telencephalon and inferior olive, are histochemically different, and may receive direct visual input. Brain Res. 321:332-36
34. Fenu S, Spina L, Rivas E, Longoni R, Di Chiara G. 2006. Morphine-conditioned single-trial place preference: role of nucleus accumbens shell dopamine receptors in acquisition, but not expression. Psychopharmacology 187:143-53
35. Fiorillo CD, Tobler PN, Schultz W. 2003. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299:1898-902
36. Fuxe K, Hokfelt T, Johansso O, Jonsson G, Lidbrink P, Ljungdah A. 1974. Origin of dopamine nerve-terminals in limbic and frontal cortex - evidence for meso-cortico dopamine neurons. Brain Res. 82:349-55
37. Garris PA, Ciolkowski EL, Pastore P, Wightman RM. 1994. Efflux of dopamine from the synaptic cleft in the nucleus accumbens of the rat brain. J. Neurosci. 14:6084-93
38. Gasbarri A, Verney C, Innocenzi R, Campana E, Pacitti C. 1994. Mesolimbic dopaminergic neurons innervating the hippocampal formation in the rat: a combined retrograde tracing and immunohistochemical study. Brain Res. 668:71-79
39. Geisler S, Zahm DS. 2005. Afferents of the ventral tegmental area in the rat-anatomical substratum for integrative functions. J. Comp. Neurol. 490:270-94
40. Georges F, Aston-Jones G. 2002. Activation of ventral tegmental area cells by the bed nucleus of the stria terminalis: a novel excitatory amino acid input to midbrain dopamine neurons. J. Neurosci. 22:5173-87
41. Ghitza UE, Fabbricatore AT, Prokopenko V, Pawlak AP, West MO. 2003. Persistent cue-evoked activity of accumbens neurons after prolonged abstinence from self-administered cocaine. J. Neurosci. 23:7239-45
42. Grace AA, Bunney BS. 1980. Nigral dopamine neurons: intracellular recording and identification with L-dopa injection and histofluorescence. Science 210:654-56
43. Grace AA, Bunney BS. 1983. Intracellular and extracellular electrophysiology of nigral dopaminergic neurons-1. Identification and characterization. Neuroscience 10:301-15
44. Gracy KN, Pickel VM. 1996. Ultrastructural immunocytochemical localization of the N-methyl-D-aspartate receptor and tyrosine hydroxylase in the shell of the rat nucleus accumbens. Brain Res. 739:169-81
45. Guyenet PG, Aghajanian GK. 1978. Antidromic identification of dopaminergic and other output neurons of the rat substantia nigra. Brain Res. 150:69-84
46. Gysling K, Wang RY. 1983. Morphine-induced activation of A10 dopamine neurons in the rat. Brain Res. 277:119-27
47. Hand TH, Stinus L, Le Moal M. 1989. Differential mechanisms in the acquisition and expression of heroin-induced place preference. Psychopharmacology 98:61-67
48. Harvey J, Lacey MG. 1996. Endogenous and exogenous dopamine depress EPSCs in ratnucleus accumbens in vitro via D1 receptors activation. J. Physiol. 492(Pt. 1):143-54
49. Hernandez PJ, Andrzejewski ME, Sadeghian K, Panksepp JB, Kelley AE. 2005. AMPA/kainate, NMDA, and dopamine D1 receptor function in the nucleus accumbens core: a context-limited role in the encoding and consolidation of instrumental memory. Learn. Mem. 12:285-95
50. Hjelmstad GO. 2004. Dopamine excites nucleus accumbens neurons through the differential modulation of glutamate and GABA release. J. Neurosci. 24:8621-28
51. Hnasko TS, Sotak BN, Palmiter RD. 2005. Morphine reward in dopamine-deficient mice. Nature 438:854-57
52. Hollerman JR, Schultz W. 1998. Dopamine neurons report an error in the temporal prediction of reward during learning. Nat. Neurosci. 1:304-9
53. Hopf FW, Cascini MG, Gordon AS, Diamond I, Bonci A. 2003. Cooperative activation of dopamine D1 and D2 receptors increases spike firing of nucleus accumbens neurons via G-protein βγ subunits. J. Neurosci. 23:5079-87
54. Horvitz JC. 2000. Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events. Neuroscience 96:651-56
55. Howland JG, Taepavarapruk P, Phillips AG. 2002. Glutamate receptor-dependent modulation of dopamine efflux in the nucleus accumbens by basolateral, but not central, nucleus of the amygdala in rats. J. Neurosci. 22:1137-45
56. Huang YY, Simpson E, Kellendonk C, Kandel ER. 2004. Genetic evidence for the bidirectional modulation of synaptic plasticity in the prefrontal cortex by D1 receptors. Proc. Natl. Acad. Sci. USA 101:3236-41
57. Hyland BI, Reynolds JN, Hay J, Perk CG, Miller R. 2002. Firing modes of midbrain dopamine cells in the freely moving rat. Neuroscience 114:475-92
58. Ikemoto S, Panksepp J. 1999. The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking. Brain Res. Brain Res. Rev. 31:6-41
59. Imperato A, Scrocco MG, Bacchi S, Angelucci L. 1990. NMDA receptors and in vivo dopamine release in the nucleus accumbens and caudatus. Eur. J. Pharmacol. 187:555-56
60. Jackson DM, Ahlenius S, Anden NE, Engel J. 1977. Antagonism by locally applied dopamine into the nucleus accumbens or the corpus striatum of alpha-methyltyrosine-induced disruption of conditioned avoidance behaviour. J. Neural Transm. 41:231-39
61. Janak PH, Chang JY, Woodward DJ. 1999. Neuronal spike activity in the nucleus accumbens of behaving rats during ethanol self-administration. Brain Res. 817:172-84
62. Johnson SW, North RA. 1992a. Opioids excite dopamine neurons by hyperpolarization of local interneurons. J. Neurosci. 12:483-88
63. Johnson SW, North RA. 1992b. Two types of neurone in the rat ventral tegmental area and their synaptic inputs. J. Physiol. 450:455-68
64. Jones S, Kauer JA. 1999. Amphetamine depresses excitatory synaptic transmission via serotonin receptors in the ventral tegmental area. J. Neurosci. 19:9780-87
65. Juraska JM, Wilson CJ, Groves PM. 1977. The substantia nigra of the rat: a Golgi study. J. Comp. Neurol. 172:585-600
66. Kalivas PW, Volkow ND. 2005. The neural basis of addiction: a pathology of motivation and choice. Am. J. Psychiatr. 162:1403-13
67. Kawagoe R, Takikawa Y, Hikosaka O. 2004. Reward-predicting activity of dopamine and caudate neurons-a possible mechanism of motivational control of saccadic eye movement. J. Neurophysiol. 91:1013-24
68. Kawano M, Kawasaki A, Sakata-Haga H, Fukui Y, Kawano H, et al. 2006. Particular subpopulations of midbrain and hypothalamic dopamine neurons express vesicular glutamate transporter 2 in the rat brain. J. Comp. Neurol. 498:581-92
69. Kennedy RT, Jones SR, Wightman RM. 1992. Dynamic observation of dopamine autoreceptor effects in rat striatal slices. J. Neurochem. 59:449-55
70. Kiyatkin EA, Rebec GV. 2001. Impulse activity of ventral tegmental area neurons during heroin self-administration in rats. Neuroscience 102:565-80
71. Kombian SB, Malenka RC. 1994. Simultaneous LTP of non-NMDA- and LTD of NMDA-receptor-mediated responses in the nucleus accumbens. Nature 368:242-46
72. Lacey MG, Mercuri NB, North RA. 1989. Two cell types in rat substantia nigra zona compacta distinguished by membrane properties and the actions of dopamine and opioids. J. Neurosci. 9:1233-41
73. Latimer LG, Duffy P, Kalivas PW. 1987. Mu opioid receptor involvement in enkephalin activation of dopamine neurons in the ventral tegmental area. J. Pharmacol. Exp. Ther. 241:328-37
74. Lavin A, Nogueira L, Lapish CC, Wightman RM, Phillips PE, Seamans JK. 2005. Mesocortical dopamine neurons operate in distinct temporal domains using multimodal signaling. J. Neurosci. 25:5013-23
75. Laviolette SR, Nader K, van der Kooy D. 2002. Motivational state determines the functional role of the mesolimbic dopamine system in the mediation of opiate reward processes. Behav. Brain Res. 129:17-29
76. Leone P, Pocock D, Wise RA. 1991. Morphine-dopamine interaction: Ventral tegmental morphine increases nucleus accumbens dopamine release. Pharmacol. Biochem. Behav. 39:469-72
77. Li Y, Kauer JA. 2004. Repeated exposure to amphetamine disrupts dopaminergic modulation of excitatory synaptic plasticity and neurotransmission in nucleus accumbens. Synapse 51:1-10
78. Lindvall O, Bjorklund A. 1974. Organization of ascending catecholamine neuron systems in rat-brain as revealed by glyoxylic-acid fluorescence method. Acta Physiol. Scand. Suppl. 412:1-48
79. Lindvall O, Bjorklund A, Divac I. 1978. Organization of catecholamine neurons projecting to frontal cortex in rat. Brain Res. 142:1-24
80. Lindvall O, Bjorklund A, Moore RY, Stenevi U. 1974. Mesencephalic dopamine neurons projecting to neocortex. Brain Res. 81:325-31
81. Lisman JE, Grace AA. 2005. The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron 46:703-13
82. Ljungberg T, Apicella P, Schultz W. 1992. Responses of monkey dopamine neurons during learning of behavioral reactions. J. Neurophysiol. 67:145-63
83. Lu XY, Ghasemzadeh MB, Kalivas PW. 1998. Expression of D1 receptor, D2 receptor, substance P and enkephalin messenger RNAs in the neurons projecting from the nucleus accumbens. Neuroscience 82:767-80
84. Lyness WH, Friedle NM, Moore KE. 1979. Destruction of dopaminergic nerve terminals in nucleus accumbens: effect on d-amphetamine self-administration. Pharmacol. Biochem. Behav. 11:553-56
85. Mackey WB, van der Kooy D. 1985. Neuroleptics block the positive reinforcing effects of amphetamine but not of morphine as measured by place conditioning. Pharmacol. Biochem. Behav. 22:101-5
86. Margolis EB, Hjelmstad GO, Bonci A, Fields HL. 2003. Kappa-opioid agonists directly inhibit midbrain dopaminergic neurons. J. Neurosci. 23:9981-86
87. Margolis EB, Hjelmstad GO, Bonci A, Fields HL. 2005. Both kappa and mu opioid agonists inhibit glutamatergic input to ventral tegmental area neurons. J. Neurophysiol. 93:3086-93
88. Margolis EB, Lock H, Chefer VI, Shippenberg TS, Hjelmstad GO, Fields HL. 2006a. Kappa opioids selectively control dopaminergic neurons projecting to the prefrontal cortex. Proc. Natl. Acad. Sci. USA 103:2938-42
89. Margolis EB, Lock H, Hjelmstad GO, Fields HL. 2004. Direct kappa opioid action on ventral tegmental area dopaminergic neurons is dependent on projection target. Soc. Neurosci. Abstr. 46.9
90. Margolis EB, Lock H, Hjelmstad GO, Fields HL. 2006b. The ventral tegmental area revisited: Is there an electrophysiological marker for dopaminergic neurons? J. Physiol. 577(Pt. 3):907-24
91. Matthews RT, German DC. 1984. Electrophysiological evidence for excitation of rat ventral tegmental area dopamine neurons by morphine. Neuroscience 11:617-25
92. McBride WJ, Murphy JM, Ikemoto S. 1999. Localization of brain reinforcement mechanisms: intracranial self-administration and intracranial place-conditioning studies. Behav. Brain Res. 101:129-52
93. McClure SM, Daw ND, Montague PR. 2003. A computational substrate for incentive salience. Trends Neurosci. 26:423-28
94. McHaffie JG, Jiang H, May PJ, Coizet V, Overton PG, et al. 2006. A direct projection from superior colliculus to substantia nigra pars compacta in the cat. Neuroscience 138:221-34
95. Mirenowicz J, Schultz W. 1994. Importance of unpredictability for reward responses in primate dopamine neurons. J. Neurophysiol. 72:1024-27
96. Montague PR, Berns GS. 2002. Neural economics and the biological substrates of valuation. Neuron 36:265-84
97. Montague PR, Hyman SE, Cohen JD. 2004a. Computational roles for dopamine in behavioural control. Nature 431:760-67
98. Montague PR, McClure SM, Baldwin PR, Phillips PE, Budygin EA, et al. 2004b. Dynamic gain control of dopamine delivery in freely moving animals. J. Neurosci. 24:1754-59
99. Morris G, Nevet A, Arkadir D, Vaadia E, Bergman H. 2006. Midbrain dopamine neurons encode decisions for future action. Nat. Neurosci. 9:1057-63
100. Murschall A, Hauber W. 2006. Inactivation of the ventral tegmental area abolished the general excitatory influence of Pavlovian cues on instrumental performance. Learn. Mem. 13:123-26
101. Nader K, van der Kooy D. 1997. Deprivation state switches the neurobiological substrates mediating opiate reward in the ventral tegmental area. J. Neurosci. 17:383-90
102. Nicola SM. 2007. The nucleus accumbens as part of a basal ganglia action selection circuit. Psychopharmacology 191:521-50
103. Nicola SM, Hopf FW, Hjelmstad GO. 2004a. Contrast enhancement: a physiological effect of striatal dopamine? Cell Tissue Res. 318:93-106
104. Nicola SM, Kombian SB, Malenka RC. 1996. Psychostimulants depress excitatory synaptic transmission in the nucleus accumbens via presynaptic D1-like dopamine receptors. J. Neurosci. 16:1591-604
105. Nicola SM, Malenka RC. 1997. Dopamine depresses excitatory and inhibitory synaptic transmission by distinct mechanisms in the nucleus accumbens. J. Neurosci. 17:5697-710
106. Nicola SM, Surmeier J, Malenka RC. 2000. Dopaminergic modulation of neuronal excitability in the striatum and nucleus accumbens. Annu. Rev. Neurosci. 23:185-215
107. Nicola SM, Taha SA, Kim SW, Fields HL. 2005. Nucleus accumbens dopamine release is necessary and sufficient to promote the behavioral response to reward-predictive cues. Neuroscience 135:1025-33
108. Nicola SM, Yun IA, Wakabayashi KT, Fields HL. 2004b. Cue-evoked firing of nucleus accumbens neurons encodes motivational significance during a discriminative stimulus task. J. Neurophysiol. 91:1840-65
109. Nicola SM, Yun IA, Wakabayashi KT, Fields HL. 2004c. Firing of nucleus accumbens neurons during the consummatory phase of a discriminative stimulus task depends on previous reward predictive cues. J. Neurophysiol. 91:1866-82
110. Oakman SA, Faris PL, Kerr PE, Cozzari C, Hartman BK. 1995. Distribution of pontomesencephalic cholinergic neurons projecting to substantia nigra differs significantly from those projecting to ventral tegmental area. J. Neurosci. 15:5859-69
111. O'Donnell P. 2003. Dopamine gating of forebrain neural ensembles. Eur. J. Neurosci. 17:429-35
112. Olds J, Milner P. 1954. Positive reinforcement produced by electrical stimulation of septal area and other regions of rat brain. J. Comp. Physiol. Psychol. 47:419-27
113. Olds ME, Olds J. 1963. Approach-avoidance analysis of rat diencephalon. J. Comp. Neurol. 120:259-95
114. Olds ME, Olds J. 1969. Effects of lesions in medial forebrain bundle on self-stimulation behavior. Am. J. Physiol. 217:1253-64
115. Olmstead MC, Franklin KB. 1997. The development of a conditioned place preference to morphine: effects of lesions of various CNS sites. Behav. Neurosci. 111:1313-23
116. Omelchenko N, Sesack SR. 2005. Laterodorsal tegmental projections to identified cell populations in the rat ventral tegmental area. J. Comp. Neurol. 483:217-35
117. Omelchenko N, Sesack SR. 2006. Cholinergic axons in the rat ventral tegmental area synapse preferentially onto mesoaccumbens dopamine neurons. J. Comp. Neurol. 494:863-75
118. Otani S, Daniel H, Roisin MP, Crepel F. 2003. Dopaminergic modulation of long-term synaptic plasticity in rat prefrontal neurons. Cereb. Cortex 13:1251-56
119. Pan WX, Hyland BI. 2005. Pedunculopontine tegmental nucleus controls conditioned responses of midbrain dopamine neurons in behaving rats. J. Neurosci. 25:4725-32
120. Pan WX, Schmidt R, Wickens JR, Hyland BI. 2005. Dopamine cells respond to predicted events during classical conditioning: evidence for eligibility traces in the reward-learning network. J. Neurosci. 25:6235-42
121. Parkinson JA, Dalley JW, Cardinal RN, Bamford A, Fehnert B, et al. 2002. Nucleus accumbens dopamine depletion impairs both acquisition and performance of appetitive Pavlovian approach behaviour: implications for mesoaccumbens dopamine function. Behav. Brain Res. 137:149-63
122. Paxinos G, Watson C. 1998. The Rat Brain in Stereotaxic Coordinates. New York: Academic. 4th ed.
123. Pennartz CM, Ameerun RF, Groenewegen HJ, Lopes da Silva FH. 1993. Synaptic plasticity in an in vitro slice preparation of the rat nucleus accumbens. Eur. J. Neurosci. 5:107-17
124. Pennartz CM, Dolleman-Van der Weel MJ, Kitai ST, Lopes da Silva FH. 1992. Presynaptic dopamine D1 receptors attenuate excitatory and inhibitory limbic i nputs to the shell region of the rat nucleus accumbens studied in vitro. J. Neurophysiol. 67:1325-34
125. Phillips AG, LePiane FG, Fibiger HC. 1983. Dopaminergic mediation of reward produced by direct injection of enkephalin into the ventral tegmental area of the rat. Life Sci. 33:2505-11
126. Phillips PE, Stuber GD, Heien ML, Wightman RM, Carelli RM. 2003. Subsecond dopamine release promotes cocaine seeking. Nature 422:614-18
127. Phillipson OT. 1979. Afferent projections to the ventral tegmental area of Tsai and interfascicular nucleus: a horseradish peroxidase study in the rat. J. Comp. Neurol. 187:117-43
128. Pickel VM, Chan J, Nirenberg MJ. 2002. Region-specific targeting of dopamine D2-receptors and somatodendritic vesicular monoamine transporter 2 (VMAT2) within ventral tegmental area subdivisions. Synapse 45:113-24
129. Pothos EN, Davila V, Sulzer D. 1998. Presynaptic recording of quanta from midbrain dopamine neurons and modulation of the quantal size. J. Neurosci. 18:4106-18
130. Richards CD, Shiroyama T, Kitai ST. 1997. Electrophysiological and immunocytochemical characterization of GABA and dopamine neurons in the substantia nigra of the rat. Neuroscience 80:545-57
131. Richardson NR, Gratton A. 1996. Behavior-relevant changes in nucleus accumbens dopamine transmission elicited by food reinforcement: an electrochemical study in rat. J. Neurosci. 16:8160-69
132. Robbe D, Kopf M, Remaury A, Bockaert J, Manzoni OJ. 2002. Endogenous cannabinoids mediate long-term synaptic depression in the nucleus accumbens. Proc. Natl. Acad. Sci. USA 99:8384-88
133. Roberts DC, Corcoran ME, Fibiger HC. 1977. On the role of ascending catecholaminergic systems in intravenous self-administration of cocaine. Pharmacol. Biochem. Behav. 6:615-20
134. Roberts DC, Koob GF, Klonoff P, Fibiger HC. 1980. Extinction and recovery of cocaine self-administration following 6-hydroxydopamine lesions of the nucleus accumbens. Pharmacol. Biochem. Behav. 12:781-87
135. Robinson DL, Heien ML, Wightman RM. 2002. Frequency of dopamine concentration transients increases in dorsal and ventral striatum of male rats during introduction of conspecifics. J. Neurosci. 22:10477-86
136. Robinson DL, Phillips PE, Budygin EA, Trafton BJ, Garris PA, Wightman RM. 2001. Subsecond changes in accumbal dopamine during sexual behavior in male rats. NeuroReport 12:2549-52
137. Roitman MF, Stuber GD, Phillips PE, Wightman RM, Carelli RM. 2004. Dopamine operates as a subsecond modulator of food seeking. J. Neurosci. 24:1265-71
138. Roitman MF, Wheeler RA, Carelli RM. 2005. Nucleus accumbens neurons are innately tuned for rewarding and aversive taste stimuli, encode their predictors, and are linked to motor output. Neuron 45:587-97
139. Rosin DL, Weston MC, Sevigny CP, Stornetta RL, Guyenet PG. 2003. Hypothalamic orexin (hypocretin) neurons express vesicular glutamate transporters VGLUT1 or VGLUT2. J. Comp. Neurol. 465:593-603
140. Satoh T, Nakai S, Sato T, Kimura M. 2003. Correlated coding of motivation and outcome of decision by dopamine neurons. J. Neurosci. 23:9913-23
141. Schultz W. 1998. Predictive reward signal of dopamine neurons. J. Neurophysiol. 80:1-27
142. Schultz W. 2002. Getting formal with dopamine and reward. Neuron 36:241-63
143. Schultz W, Apicella P, Ljungberg T. 1993. Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. J. Neurosci. 13:900-13
144. Schultz W, Tremblay L, Hollerman JR. 1998. Reward prediction in primate basal ganglia and frontal cortex. Neuropharmacology 37:421-29
145. Seamans JK, Yang CR. 2004. The principal features and mechanisms of dopamine modulation in the prefrontal cortex. Prog. Neurobiol. 74:1-58
146. Seguela P, Watkins KC, Descarries L. 1988. Ultrastructural features of dopamine axon terminals in the anteromedial and the suprarhinal cortex of adult rat. Brain Res. 442:11-22
147. Semba K, Fibiger HC. 1992. Afferent connections of the laterodorsal and the pedunculopontine tegmental nuclei in the rat: a retro- and antero-grade transport and immunohistochemical study. J. Comp. Neurol. 323:387-410
148. Sesack SR, Deutch AY, Roth RH, Bunney BS. 1989. Topographical organization of the efferent projections of the medial prefrontal cortex in the rat: an anterograde tract-tracing study with Phaseolus vulgaris leucoagglutinin. J. Comp. Neurol. 290:213-42
149. Sesack SR, Hawrylak VA, Matus C, Guido MA, Levey AI. 1998. Dopamine axon varicosities in the prelimbic division of the rat prefrontal cortex exhibit sparse immunoreactivity for the dopamine transporter. J. Neurosci. 18:2697-708
150. Sesack SR, Pickel VM. 1992. Prefrontal cortical efferents in the rat synapse on unlabeled neuronal targets of catecholamine terminals in the nucleus accumbens septi and on dopamine neurons in the ventral tegmental area. J. Comp. Neurol. 320:145-60
151. Setlow B, McGaugh JL. 1998. Sulpiride infused into the nucleus accumbens posttraining impairs memory of spatial water maze training. Behav. Neurosci. 112:603-10
152. Setlow B, McGaugh JL. 2000. D2 dopamine receptor blockade immediately post-training enhances retention in hidden and visible platform versions of the water maze. Learn. Mem. 7:187-91
153. Shippenberg TS, Herz A. 1987. Place preference conditioning reveals the involvement of D1-dopamine receptors in the motivational properties of mu- and kappa-opioid agonists. Brain Res. 436:169-72
154. Smith-Roe SL, Kelley AE. 2000. Coincident activation of NMDA and dopamine D1 receptors within the nucleus accumbens core is required for appetitive instrumental learning. J. Neurosci. 20:7737-42
155. Spanagel R, Herz A, Shippenberg TS. 1992. Opposing tonically active endogenous opioid systems modulate the mesolimbic dopaminergic pathway. Proc. Natl. Acad. Sci. USA 89:2046-50
156. Steffensen SC, Stobbs SH, Colago EE, Lee RS, Koob GF, et al. 2006. Contingent and non-contingent effects of heroin on mu-opioid receptor-containing ventral tegmental area GAB A neurons. Exp. Neurol. 202:139-51
157. Stellar JR, Stellar E. 1985. The Neurobiology of Motivation and Reward. New York: Springer-Verlag
158. Sugrue LP, Corrado GS, Newsome WT. 2005. Choosing the greater of two goods: neural currencies for valuation and decision making. Nat. Rev. Neurosci. 6:363-75
159. Sulzer D, Joyce MP, Lin L, Geldwert D, Haber SN, et al. 1998. Dopamine neurons make glutamatergic synapses in vitro. J. Neurosci. 18:4588-602
160. Swanson LW. 1982. The projections of the ventral tegmental area and adjacent regions: a combined fluorescent retrograde tracer and immunofluorescence study in the rat. Brain Res. Bull. 9:321-53
161. Taha SA, Fields HL. 2005. Encoding of palatability and appetitive behaviors by distinct neuronal populations in the nucleus accumbens. J. Neurosci. 25:1193-202
162. Takahata R, Moghaddam B. 2000. Target-specific glutamatergic regulation of dopamine neurons in the ventral tegmental area. J. Neurochem. 75:1775-78
163. Takikawa Y, Kawagoe R, Hikosaka O. 2004. A possible role of midbrain dopamine neurons in short- and long-term adaptation of saccades to position-reward mapping. J. Neurophysiol. 92:2520-29
164. Taylor JR, Robbins TW. 1986. 6-Hydroxydopamine lesions of the nucleus accumbens, but not of the caudate nucleus, attenuate enhanced responding with reward-related stimuli produced by intra-accumbens d-amphetamine. Psychopharmacology 90:390-97
165. Thomas MJ, Beurrier C, Bonci A, Malenka RC. 2001. Long-term depression in the nucleus accumbens: a neural correlate of behavioral sensitization to cocaine. Nat. Neurosci. 4:1217-23
166. Thomas MJ, Malenka RC, Bonci A. 2000. Modulation of long-term depression by dopamine in the mesolimbic system. J. Neurosci. 20:5581-86
167. Tobler PN, Dickinson A, Schultz W. 2003. Coding of predicted reward omission by dopamine neurons in a conditioned inhibition paradigm. J. Neurosci. 23:10402-10
168. Tobler PN, Fiorillo CD, Schultz W. 2005. Adaptive coding of reward value by dopamine neurons. Science 307:1642-45
169. Totterdell S, Smith AD. 1989. Convergence of hippocampal and dopaminergic input onto identified neurons in the nucleus accumbens of the rat. J. Chem. Neuroanat. 2:285-98
170. Tzchentke TM. 2000. The medial prefrontal cortex as part of the brain reward system. Amino Acids 91:211-19
171. Tzschentke TM. 1998. Measuring reward with the conditioned place preference paradigm: a comprehensive review of drug effects, recent progress and new issues. Prog. Neurobiol. 56:613-72
172. Ungerstedt U. 1971a. Adipsia and aphagia after 6-hydroxydopamine induced degeneration of the nigro-striatal dopamine system. Acta Physiol. Scand. Suppl. 367:95-122
173. Ungerstedt U. 1971b. Stereotaxic mapping of the monoamine pathways in the rat brain. Acta Physiol. Scand. Suppl. 367:1-48
174. Ungless MA. 2004. Dopamine: the salient issue. Trends Neurosci. 27:702-6
175. Ungless MA, Magill PJ, Bolam JP. 2004. Uniform inhibition of dopamine neurons in the ventral tegmental area by aversive stimuli. Science 303:2040-42
176. Van Bockstaele EJ, Pickel VM. 1995. GABA-containing neurons in the ventral tegmental area project to the nucleus accumbens in rat brain. Brain Res. 682:215-21
177. Vittoz NM, Berridge CW. 2006. Hypocretin/orexin selectively increases dopamine efflux within the prefrontal cortex: involvement of the ventral tegmental area. Neuropsychopharmacology 31:384-95
178. Wadenberg ML, Ericson E, Magnusson O, Ahlenius S. 1990. Suppression of conditioned avoidance behavior by the local application of (-)sulpiride into the ventral, but not the dorsal, striatum of the rat. Biol. Psychiatr. 28:297-307
179. Wallace DM, Magnuson DJ, Gray TS. 1992. Organization of amygdaloid projections to brainstem dopaminergic, noradrenergic, and adrenergic cell groups in the rat. Brain Res. Bull. 28:447-54
180. Wan X, Peoples LL. 2006. Firing patterns of accumbal neurons during a pavlovian-conditioned approach task. J. Neurophysiol. 96:652-60
181. Wassef M, Berod A, Sotelo C. 1981. Dopaminergic dendrites in the pars reticulata of the rat substantia nigra and their striatal input. Combined immunocytochemical localization of tyrosine hydroxylase and anterograde degeneration. Neuroscience 6:2125-39
182. Westerink BH, Kwint HF, de Vries JB. 1996. The pharmacology of mesolimbic dopamine neurons: a dual-probe microdialysis study in the ventral tegmental area and nucleus accumbens of the rat brain. J. Neurosci. 16:2605-11
183. Wilson DI, Bowman EM. 2004. Nucleus accumbens neurons in the rat exhibit differential activity to conditioned reinforcers and primary reinforcers within a second-order schedule of saccharin reinforcement. Eur. J. Neurosci. 20:2777-88
184. Wise RA. 1982. Neuroleptics and operant behavior: the anhedonia hypothesis. Behav. Brain Sci. 5:39-87
185. Wise RA. 2002. Brain reward circuitry: insights from unsensed incentives. Neuron 36:229-40
186. Wise RA. 2004. Dopamine, learning and motivation. Nat. Rev. Neurosci. 5:483-94
187. Wise RA. 2005. Forebrain substrates of reward and motivation. J. Comp. Neurol. 493:115-21
188. Wolterink G, Phillips G, Cador M, Donselaar-Wolterink I, Robbins TW, Everitt BJ. 1993. Relative roles of ventral striatal D1 and D2 dopamine receptors in responding with conditioned reinforcement. Psychopharmacology 110:355-64
189. Wyvell CL, Berridge KC. 2000. Intra-accumbens amphetamine increases the conditioned incentive salience of sucrose reward: enhancement of reward "wanting" without enhanced "liking" or response reinforcement. J. Neurosci. 20:8122-30
190. Yamaguchi T, Sheen W, Morales M. 2007. Glutamatergic neurons are present in the rat ventral tegmental area. Eur. J. Neurosci. 25:106-118
191. Youngren KD, Daly DA, Moghaddam B. 1993. Distinct actions of endogenous excitatory amino acids on the outflow of dopamine in the nucleus accumbens. J. Pharmacol. Exp. Ther. 264:289-93
192. Yun IA, Nicola SM, Fields HL. 2004a. Contrasting effects of dopamine and glutamate receptor antagonist injection in the nucleus accumbens suggest a neural mechanism underlying cue-evoked goal-directed behavior. Eur. J. Neurosci. 20:249-63
193. Yun IA, Wakabayashi KT, Fields HL, Nicola SM. 2004b. The ventral tegmental area is required for the behavioral and nucleus accumbens neuronal firing responses to incentive cues. J. Neurosci. 24:2923-33
194. Zarrindast MR, Rezayof A, Sahraei H, Haeri-Rohani A, Rassouli Y. 2003. Involvement of dopamine D1 receptors of the central amygdala on the acquisition and expression of morphine-induced place preference in rat. Brain Res. 965:212-21