Dopaminergic modulation of appetitive and aversive predictive learning

Reviews in the Neurosciences

Volumn 20, Issue 5-6, 2009, Pages 383-404

  Iordanova, Mihaela D ^a  

^a CARDIFF UNIVERSITY   (United Kingdom)

Author keywords

Mesolimbic; Nucleus accumbens; Opioids; Pavlovian conditioning; Predictive error; Ventral tegmental area

Indexed keywords

DOPAMINE; MORPHINE; NALOXONE;

APPETITE; AVERSION; BEHAVIOR; CORPUS STRIATUM; DOPAMINERGIC ACTIVITY; ELECTROPHYSIOLOGY; FEAR; HUMAN; LEARNING; MEASUREMENT ERROR; MESOLIMBIC DOPAMINERGIC SYSTEM; NEUROCHEMISTRY; NEUROTRANSMISSION; NONHUMAN; NUCLEUS ACCUMBENS; PREDICTION; PRIORITY JOURNAL; REVIEW; THALAMUS VENTRAL NUCLEUS;

EID: 77950609223     PISSN: 03341763     EISSN: None     Source Type: Journal    
DOI: 10.1515/REVNEURO.2009.20.5-6.383     Document Type: Review

References (156)

1. Abler B, Walter H, Erk S, Kammerer H, Spitzer M. Prediction error as a linear function of reward probability is coded in human nucleus accumbens. Neuroimage 2006; 31: 790-795.
2. Apicella P, Scamati E, Ljungberg T, Schultz W. Neuronal activity in monkey striatum related to the expectation of predictable environmental events. J Neurophysiol 1992; 68: 945-960.
3. Bardo MT, Hammer RP Jr. Autoradiographic localization of dopamine D1 and D2 receptors in rat nucleus accumbens: resistance to differential rearing conditions. Neuroscience 1991; 45: 281-290.
4. Bassareo V, Di Chiara G. Differential influence of associative and nonassociative learning mechanisms on the responsiveness of prefrontal and accumbal dopamine transmission to food stimuli in rats fed ad libitum. J Neurosci 1997; 17: 851-861
5. Bennett BD, Bolam JP. Synaptic input and output of parvalbumin- immunoreactive neurons in the neostriatum of the rat. Neuroscience 1994; 62: 707-719.
6. Berns GS, McClure SM, Pagnoni G, Montague PR. Predictability modulates human brain response to reward. J Neurosci 2001; 21: 2793-2798.
7. Brischoux F, Chakraborty S, Brierley DI, Ungless MA. Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli. Proc Natl Acad Sci USA 2009; 106: 4894-4899.
8. Brown MT, Henny P, Bolam JP, Magill PJ. Activity of neurochemically heterogeneous dopaminergic neurons in the substantia nigra during spontaneous and driven changes in brain state. J Neurosci 2009; 29: 2915-2925.
9. Cameron DL, Wessendorf MW, Williams JT. A subset of ventral tegmental area neurons is inhibited by dopamine, 5-hydroxytryptamine and opioids. Neuroscience 1997; 77: 155-166.
10. Campeau S, Miserendino MJ, Davis M. Intra-amygdala infusion of the N-methyl-D-aspartate receptor antagonist AP5 blocks acquisition but not expression of fear-potentiated startle to an auditory conditioned stimulus. Behav Neurosci 1992; 106: 569-574.
11. Chiodo LA, Antelman SM, Caggiula AR, Lineberry CG. Sensory stimuli alter the discharge rate of dopamine (DA) neurons: evidence for two functional types of DA cells in the substantia nigra. Brain Res 1980; 189: 544-549.
12. Chiodo LA, Caggiula AR, Antelman SM, Lineberry CG. Reciprocal influences of activating and immobilizing stimuli on the activity of nigrostriatal dopamine neurons. Brain Res 1979; 176: 385-390.
13. Cohen GA, Doze VA, Madison DV. Opioid inhibition of GABA release from presynaptic terminals of rat hippocampal interneurons. Neuron 1992; 9: 325-335.
14. Cole S, McNally GP. Opioid receptors mediate direct predictive fear learning: evidence from one-trial blocking. Learn Mem 2007; 14: 229-235.
15. Damsma G, Pfaus JG, Wenkstern D, Phillips AG, Fibiger HC. Sexual behavior increases dopamine transmission in the nucleus accumbens and striatum of male rats: comparison with novelty and locomotion. Behav Neurosci 1992; 106: 181-191.
16. Datla KP, Ahier RG, Young AM, Gray JA, Joseph MH. Conditioned appetitive stimulus increases extracellular dopamine in the nucleus accumbens of the rat. Eur J Neurosci 2002; 16: 1987-1993.
17. Daugé V, Rossignol P, Roques BP. Comparison of the behavioural effects induced by administration in rat nucleus accumbens or nucleus caudatus of selective mu and delta opioid peptides or kelatorphan an inhibitor of enkephalin-degrading-enzymes. Psychopharmacol (Berl) 1988; 96: 343-352.
18. Daugé V, Rossignol P, Roques BP. Blockade of dopamine receptors reverses the behavioral effects of endogenous enkephalins in the nucleus caudatus but not in the nucleus accumbens: differential involvement of delta and mu opioid receptors. Psychopharmacol (Berl) 1989; 99: 168-175.
19. Daw ND, Kakade S, Dayan P. Opponent interactions between serotonin and dopamine. Neural Networks 2002; 15: 603-616.
20. Delgado MR, Gillis MM, Phelps EA. Regulating the expectation of reward via cognitive strategies. Nat Neurosci 2008; 11: 880-881.
21. Delgado MR, Li J, Schiller D, Phelps EA. The role of the striatum in aversive learning and aversive prediction errors. Philos Trans R Soc Lond B Biol Sci 2008; 363: 3787-3800.
22. de Olmos J, Alheid GF, Beltramino CA. Amygdala. In: Paxinos G, ed. The Rat Nervous System: Vol 1. Forebrain and midbrain. New York: Academic Press, 1985; 223-334.
23. Doherty MD, Gratton A. NMDA receptors in nucleus accumbens modulate stress-induced dopamine release in nucleus accumbens and ventral tegmental area. Synapse 1997; 26: 225-234.
24. Domesick VB. Further observation on the anatomy of nucleus accumbens and caudatoputamen in the rat: similarities and contrasts. In: Chronister RB, DeFrance JB, eds. The Neurobiology of the Nucleus Accumbens. Brunswick, ME: The Haer Institute for Electrophys Res, 1981; 7-39.
25. Erdtsieck-Ernste EB, Feenstra MG, Botterblom MH, Van Uum HF, Sluiter AA, Heinsbroek RP. C-Fos expression in the rat brain after pharmacological stimulation of the rat "mediodorsal" thalamus by means of microdialysis. Neuroscience 1995; 66: 115-131.
26. Everitt BJ, Cardinal RN, Parkinson JA, Robbins TW. Appetitive behavior: impact of amygdala-dependent mechanisms of emotional learning. Ann NY Acad Sci 2003; 985: 233-250.
27. Fanselow MS, Kim JJ. Acquisition of contextual Pavlovian fear conditioning is blocked by application of an NMDA receptor antagonist D,L-2-amino-5-phosphonovaleric acid to the basolateral amygdala. Behav Neurosci 1994; 108: 210-212.
28. Fiorillo SD, Tobler PN, Schultz W. Discrete coding of reward probabilities and uncertainty by dopamine neurons. Science 2003; 299: 1898-1902. (Pubitemid 36356659)
29. Floresco SB. Dopaminergic regulation of limbic-striatal interplay. J Psychiatry Neurosci 2007; 32: 400-411.
30. Floresco SB, West AR, Ash B, Moore H, Grace AA. Afferent modulation of dopamine neuron firing differentially regulates tonic and phasic dopamine transmission. Nat Neurosci 2003; 6: 968-973.
31. Goosens KA, Maren S. NMDA receptors are essential for the acquisition, but not expression, of conditional fear and associative spike firing in the lateral amygdala. Eur J Neurosci 2004; 20: 537-548.
32. Grace AA. Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: a hypothesis for the etiology of schizophrenia. Neuroscience 1991; 41: 1-24.
33. Graybiel AM, Ragsdale CW Jr. Biochemical anatomy of the striatum. In: Emson PC, ed. Chemical Neuro-anatomy. New York: Raven Press, 1983; 427-503.
34. Groenewegen HJ, Wright CI, Beijer AV. The nucleus accumbens: gateway for limbic structures to reach the motor system? Prog Brain Res 1996; 107: 485-511.
35. Guarraci FA, Kapp BS. An electrophysiological characterization of ventral tegmental area dopaminergic neurons during differential pavlovian fear conditioning in the awake rabbit. Behav Brain Res 1999; 99: 169-179.
36. Heimer L, Alheid GF, de Olmos JS, Groenewegen HJ, Haber SN, Harlan RE, Zahm DS. Basal ganglia. In: Paxinos G, ed. The Rat Nervous System: Vol.1. Forebrain and midbrain. San Diego, CA: Academic Press, 1997; 37-86.
37. nd Ed. San Diego, CA: Academic Press, 1995; 579-628.
38. Heimer L, Zahm DS, Churchill L, Kalivas PW, Wohltmann C. Specificity in the projection patterns of accumbal core and shell in the rat. Neuroscience 1991; 41: 89-125.
39. Hernandez L, Hoebel BG. Food reward and cocaine increase extracellular dopamine in the nucleus accumbens as measured by microdialysis. Life Sci 1988; 42: 1705-1712.
40. Himmelheber AM, Bruno JP, Sarter M. Effects of intra-accumbens infusions of amphetamine or cis-flupenthixol on sustained attention performance in rats. Behav · Brain Res 2000; 116: 123-133.
41. Hirose N, Murakawa K, Takada K, Oi Y, Suzuki T, Nagase H, Cools AR, Koshikawa N. Interactions among mu- and delta-opioid receptors, especially putative delta1- and delta2-opioid receptors, promote dopamine release in the nucleus accumbens. Neuroscience 2005; 135: 213-225. (Pubitemid 41219750)
42. Hjelmstad GO. Dopamine excites nucleus accumbens neurons through the differential modulation of glutamate and GABA release. J Neurosci 2004; 24: 8621-8628.
43. Hjelmstad GO, Fields HL. Kappa opioid receptor activation in the nucleus accumbens inhibits glutamate and GABA release through different mechanisms. J Neurophysiol 2003; 89: 2389-2395.
44. Hoffman AF, Lupica CR. Direct actions of cannabinoids on synaptic transmission in the nucleus accumbens: a comparison with opioids. J Neurophysiol 2001; 85: 72-83.
45. Hollerman JR, Schultz W. Dopamine neurons report an error in the temporal prediction of reward during learning. Nat Neurosci 1998; 1: 304-309. (Pubitemid 128652677)
46. Hommer DW, Bunney BS. Effect of sensory stimuli on the activity of dopaminergic neurons: involvement of non-dopaminergic nigral neurons and striato-nigral pathways. Life Sci 1980; 27: 377-386.
47. Horvitz JC. Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events. Neuroscience 2000; 96: 651-656.
48. Ikemoto S, Panksepp J. The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking. Brain Res Brain Res Rev 1999; 31: 6-41. (Pubitemid 30009611)
49. Imperato A, Angelucci L, Casolini P, Zocchi A, Puglisi-Allegra S. Repeated stressful experiences differently affect limbic dopamine release during and following stress. Brain Res 1992; 577: 194-199.
50. Imperato A, Puglisi-Allegra S, Casolini P, Angelucci L. Changes in brain dopamine and acetylcholine release during and following stress are independent of the pituitary-adrenocortical axis. Brain Res 1991; 538: 111-117.
51. Iordanova MD, McNally GP, Westbrook RF. Opioid receptors in the nucleus accumbens regulate attentional learning in the blocking paradigm. J Neurosci 2006; 26: 4036-4045.
52. Iordanova MD, Westbrook RF, Killcross AS. Dopamine activity in the nucleus accumbens modulates blocking in fear conditioning. Eur J Neurosci 2006; 24: 3265-3270.
53. Johnson SW, North RA. Opioids excite dopamine neurons by hyperpolarization of local interneurons. J Neurosci 1992; 12: 483-488.
54. Joseph MH, Datla K, Young AM. The interpretation of the measurement of nucleus accumbens dopamine by in vivo dialysis: the kick, the craving or the cognition? Neurosci Biobehav Rev 2003; 27: 527-541.
55. Joseph MH, Peters SL, Moran PM, Grigoryan GA, Young AM, Gray JA. Modulation of latent inhibition in the rat by altered dopamine transmission in the nucleus accumbens at the time of conditioning. Neuroscience 2000; 101: 921-930.
56. Kalivas PW, Churchill L, Klitenick MA. GABA and enkephalin projection from the nucleus accumbens and ventral pallidum to the ventral tegmental area. Neuroscience 1993; 57: 1047-1060. (Pubitemid 23355006)
57. Kalivas PW, Widerlöv E, Stanley D, Breese G, Prange AJ Jr. Enkephalin action on the mesolimbic system: a dopamine-dependent and a dopamine-independent increase in locomotor activity. J Pharmacol Exp Ther 1983; 227: 229-237. (Pubitemid 14205294)
58. Kamin LJ. 'Attention-like' processes in classical conditioning. In: Jones MR, ed. Miami Symposium on the Prediction of Behavior: Aversive Stimulation. Miami, FL: University of Miami Press, 1968; 9-33.
59. Kamin LJ. Predictability, surprise, attention, and conditioning. In: Campbell B, Church R, eds. Punishment and Aversive Behaviour. New York: Appleton Century Crofts, 1969; 279-296.
60. Kawaguchi Y, Wilson CJ, Augood SJ, Emson PC. Striatal interneurones: chemical, physiological and morphological characterization. Trends Neurosci 1995; 18: 527-535.
61. Keefe KA, Sved AF, Zigmond MJ, Abercrombie ED. Stress-induced dopamine release in the neostriatum: evaluation of the role of action potentials in nigrostriatal dopamine neurons or local initiation by endogenous excitatory amino acids. J Neurochem 1993; 61: 1943-1952.
62. Kemp JM, Powell TP. The synaptic organization of the caudate nucleus. Philos Trans R Soc Lond B Biol Sci 1971; 262: 403-412.
63. Killcross S, Robbins TW, Everitt BJ. Different types of fear-conditioned behaviour mediated by separate nuclei within amygdala. Nature 1997; 388: 377-380. (Pubitemid 27334815)
64. Kim JJ, DeCola JP, Landeira-Fernandez J, Fanselow MS. N-Methyl-D-aspartate receptor antagonist APV blocks acquisition but not expression of fear conditioning. Behav Neurosci 1991; 105: 126-133.
65. Kim JJ, Jung MW. Neural circuits and mechanisms involved in Pavlovian fear conditioning: a critical review. Neurosci Biobehav Rev 2006; 30: 188-202.
66. Kita H, Kitai ST. Glutamate decarboxylase immuno-reactive neurons in rat neostriatum: their morphological types and populations. Brain Res 1988; 447: 346-352.
67. Kiyatkin EA. Functional properties of presumed dopamine-containing and other ventral tegmental area neurons in conscious rats. Int J Neurosci 1988; 42: 21-43.
68. Kiyatkin EA, Gratton A Electrochemical monitoring of extracellular dopamine in nucleus accumbens of rats lever-pressing for food. Brain Res 1994; 652: 225-234.
69. Kiyatkin EA, Zhukov VN. Impulse activity of mesencephalic neurons on nociceptive stimulation in awake rats. Neurosci Behav Physiol 1988; 18: 393-400.
70. Krettek JE, Price JL. Amygdaloid projections to subcortical structures within the basal forebrain and brainstem in the rat and cat. J Comp Neurol 1978; 178: 225-254.
71. Li YQ, Jia HG, Rao ZR, Shi JW. Serotonin-, substance P- or leucine-enkephalin-containing neurons in the midbrain periaqueductal gray and nucleus raphe dorsalis send projection fibers to the central amygdaloid nucleus in the rat. Neurosci Lett 1990; 120: 124-127.
72. Li YQ, Rao ZR, Shi JW. Midbrain periaqueductal gray neurons with substance P- or enkephalin-like immunoreactivity send projection fibers to the nucleus accumbens in the rat. Neurosci Lett. 1990; 119: 269-271.
73. Li YQ, Rao ZR, Shi JW. Collateral projections from the midbrain periaqueductal gray to the nucleus raphe magnus and nucleus accumbens in the rat. A fluorescent retrograde double-labelling study. Neurosci Lett 1990; 117: 285-288.
74. Li YQ, Rao ZR, Shi JW. Serotoninergic projections from the midbrain periaqueductal gray to the nucleus accumbens in the rat. Neurosci Lett 1989; 98: 276-279.
75. Ma QP, Han JS. Neurochemical studies on the mesolimbic circuitry of antinociception. Brain Res 1991; 566: 95-102.
76. Mackintosh NJ. A theory of attention: variations in the associability of stimuli with reinforcement. Psychol Rev 1975; 82: 276-298.
77. Maren S. Synaptic mechanisms of associative memory in the amygdala. Neuron 2005; 47: 783-786.
78. Maren S, Aharonov G, Stote DL, Fanselow MS. N-Methyl-D-aspartate receptors in the basolateral amygdala are required for both acquisition and expression of conditional fear in rats. Behav Neurosci 1996; 110: 1365-1374.
79. Maren S, Fanselow MS. Synaptic plasticity in the basolateral amygdala induced by hippocampal formation stimulation -I in vivo. J Neurosci 1995; 15: 7548-7564.
80. Maren S, Yap SA, Goosens KA. The amygdala is essential for the development of neuronal plasticity in the medial geniculate nucleus during auditory fear conditioning in rats. J Neurosci 2001; 21: 135-140.
81. Mark GP, Smith SE, Rada PV, Hoebel BG. An appetitively conditioned taste elicits a preferential increase in mesolimbic dopamine release. Pharmacol Biochem Behav 1994; 48: 651-660.
82. McClure SM, Berns GS, Montague PR. Temporal prediction errors in a passive learning task activate human striatum. Neuron 2003; 38: 339-346.
83. McNally GP, Cole S. Opioid receptors in the midbrain periaqueductal gray regulate prediction errors during pavlovian fear conditioning. Behav Neurosci 2006; 120: 313-323.
84. Meshul CK, McGinty JF. Kappa opioid receptor immunoreactivity in the nucleus accumbens and caudate-putamen is primarily associated with synaptic vesicles in axons. Neuroscience 2000; 96: 91-99.
85. Milad MR, Vidal-Gonzalez I, Quirk GJ. Electrical stimulation of medial prefrontal cortex reduces conditioned fear in a temporally specific manner. Behav Neurosci 2004; 118: 389-394.
86. Mirenowicz J, Schultz W. Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 1996; 379: 449-451.
87. Mirenowicz J, Schultz W. Importance of unpredictability for reward responses in primate dopamine neurons. J Neurophysiol 1994; 72: 1024-1027.
88. Miserendino MJ, Sananes CB, Melia KR, Davis M. Blocking of acquisition but not expression of conditioned fear-potentiated startle by NMDA antagonists in the amygdala. Nature 1990; 345: 716-718.
89. Missale C, Nash SR, Robinson SW, Jaber M, Caron MG. Dopamine receptors: from structure to function. Physiol Rev 1998; 78: 189-225.
90. Mogenson GJ, Jones DL, Yim CY. From motivation to action: functional interface between the limbic system and the motor system. Prog Neurobiol 1980; 14: 69-97.
91. Muigg P, Hetzenauer A, Hauer G, Hauschild M, Gaburro S, Frank E, Landgraf R, Singewald N. Impaired extinction of learned fear in rats selectively bred for high anxiety - evidence of altered neuronal processing in prefrontal-amygdala pathways. Eur J Neurosci. 2008; 28: 2299-2309.
92. Muller J, Corodimas KP, Fridel Z, LeDoux JE. Functional inactivation of the lateral and basal nuclei of the amygdala by muscimol infusion prevents fear conditioning to an explicit conditioned stimulus and to contextual stimuli. Behav Neurosci 1997; 111: 683-691.
93. Niv Y, Schoenbaum G. Dialogues on prediction errors. Trends Cogn Sci 2008; 12: 265-272.
94. Oades RD, Halliday GM. Ventral tegmental (A10) system: Neurobiology: 1. Anatomy and connectivity. Brain Res Brain Res Rev 1987; 12: 117-165.
95. O'Doherty JP, Dayan P, Fristen K, Critchley H, Dolan RJ. Temporal difference models and reward-related learning in the human brain. Neuron 2003; 38: 329-337.
96. Ottersen OP, Ben-Ari Y. Pontine and mesencephalic afferents to the central nucleus of the amygdala of the rat. Neurosci Lett 1978; 8: 329-334.
97. Pagnoni G, Zink CF, Montague PR, Berns GS. Activity in human ventral striatum locked to errors of reward prediction. Nat Neurosci 2002; 5: 97-98.
98. Pan WX, Schmidt R, Wickens JR, Hyland BI. Tripartite mechanism of extinction suggested by dopamine neuron activity and temporal difference model. J Neurosci 2008; 28: 9619-9631.
99. th Ed. Sydney: Academic, 1998.
100. Pearce JM, Hall G. A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychol Rev 1980; 87: 532-552.
101. Pennartz CM, Groenewegen HJ, Lopes da Silva FH. The nucleus accumbens as a complex of functionally distinct neuronal ensembles: an integration of behavioural, electrophysiological and anatomical data. Prog Neurobiol 1994; 42: 719-761.
102. Pert A, Sivit C. Neuroanatomical focus for morphine and enkephalin-induced hypermotility. Nature 1977; 265: 645-647.
103. Pezze MA, Feldon J. Mesolimbic dopaminergic pathways in fear conditioning. Prog Neurobiol 2004; 74: 301-320.
104. Pfaus JG, Damsma G, Wenkstern D, Fibiger HC. Sexual activity increases dopamine transmission in the nucleus accumbens and striatum of female rats. Brain Res 1995; 693: 21-30.
105. Phillips PE, Wightman RM. Extrasynaptic dopamine and phasic neuronal activity. Nat Neurosci 2004; 7: 199.
106. Puglisi-Allegra S, Imperato A, Angelucci L, Cabib S. Acute stress induces time-dependent responses in dopamine mesolimbic system. Brain Res 1991; 554: 217-222.
107. Quirk GJ, Repa C, LeDoux JE. Fear conditioning enhances short-latency auditory responses of lateral amygdala neurons: parallel recordings in the freely behaving rat. Neuron 1995; 15: 1029-1039.
108. Rescorla RA, Wagner AR. A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. In: Black AH, Prokasy WF, eds. Classical Conditioning II: Current Research and Theory. New York: Appleton Century Crofts, 1972; 64-99.
109. Rizvi TA, Ennis M, Behbehani MM, Shipley MT. Connections between the central nucleus of the amygdala and the midbrain periaqueductal gray: topography and reciprocity. J Comp Neurol 1991; 303: 121-131.
110. Robbins TW, Evenden JL, Ksir C, Reading P, Wood S, Carli M. The effects of d-amphetamine, alpha-flupenthixol, and mesolimbic dopamine depletion on a test of attentional switching in the rat. Psychopharmacology (Berl) 1986; 90: 72-78.
111. Rodrigues SM. Schafe GE. LeDoux JE. Intra-amygdala blockade of the NR2B subunit of the NMDA receptor disrupts the acquisition but not the expression of fear conditioning. J Neurosci 2001; 21: 6889-6896.
112. Romanski LM, Clugnet MC. Bordi F. LeDoux JE. Somatosensory and auditory convergence in the lateral nucleus of the amygdala. Behav Neurosci 1993; 107: 444-450. (Pubitemid 23181931)
113. Samson RD, Duvarci S, Paré D. Synaptic plasticity in the central nucleus of the amygdala. Rev Neurosci 2005; 16: 287-302. (Pubitemid 43185081)
114. Saulskaya N, Marsden CA. Conditioned dopamine release: dependence upon N-methyl-D-aspartate receptors. Neuroscience 1995; 67: 57-63.
115. Schultz W. Behavioral dopamine signals. Trends Neurosci 2007; 30: 203-210.
116. Schultz W. Behavioral theories and the neurophysiology of reward. Annu Rev Psychol 2006; 57: 87-115.
117. Schultz W. Getting formal with dopamine and reward. Neuron 2002; 36: 241-263.
118. Schultz W. Reward signaling by dopamine neurons. Neuroscientist 2001; 7: 293-302.
119. Schultz W. Multiple reward signals in the brain. Nat Rev Neurosci 2000; 1: 199-207.
120. Schultz W. Dopamine neurons and their role in reward mechanisms. Curr Opin Neurobiol 1997; 7: 191-197. (Pubitemid 27219855)
121. Schultz W, Dickinson A. Neuronal coding of prediction errors. Annu Rev Neurosci 2000; 23: 473-500.
122. Schultz W, Dayan P, Montague P. A neural substrate of prediction and reward. Science 1997; 275: 1593-1599.
123. Schultz W, Romo R. Responses of nigrostriatal dopamine neurons to high-intensity somatosensory stimulation in the anesthetized monkey. J Neurophysiol 1987; 57: 201-217.
124. Seymour B, Daw N, Dayan P, Singer T, Dolan R. Differential encoding of losses and gains in the human striatum. J Neurosci 2007; 27: 4826-4831. (Pubitemid 46699059)
125. Seymour B, O'Doherty JP, Koltzenburg M, Wiech K, Frackowiak R, Fristen K, Dolan R. Opponent appetitive-aversive neural processes underlie predictive learning of pain relief. Nat Neurosci 2005; 8: 1234-1240. (Pubitemid 43348143)
126. Shetreat ME, Lin L, Wong AC, Rayport S. Visualization of D1 dopamine receptors on living nucleus accumbens neurons and their colocalization with D2 receptors. J Neurochem 1996; 66: 1475-1482. (Pubitemid 26090550)
127. Shippenberg TS, Herz A, Spanagel R, Bals-Kubik R, Stein C. Conditioning of opioid reinforcement: neuro-anatomical and neurochemical substrates. Ann NY Acad Sci 1992; 654: 347-356.
128. Siggins GR, Martin G, Nie Z, Yuan X, Madamba S. Opiate modulation of glutamatergic transmission in nucleus accumbens neurons in vitro. Analgesia 1995; 1: 728-733.
129. Sigurdsson T, Doyère V, Cain CK, LeDoux JE. Long-term potentiation in the amygdala: a cellular mechanism of fear learning and memory. Neuropharmacology 2007; 52: 215-227. (Pubitemid 46026826)
130. Spanagel R, Herz A, Shippenberg TS. Opposing tonically active endogenous opioid systems modulate the mesolimbic dopaminergic pathway. Proc Natl Acad Sci USA 1992; 89: 2046-2050.
131. Solomon RL, Corbit JD. An opponent-process theory of motivation. I. Temporal dynamics of affect. Psychol Rev 1974; 81: 119-145.
132. Sorg BA, Kalivas PW. Effects of cocaine and footshock stress on extracellular dopamine levels in the ventral striatum. Brain Res 1991; 559: 29-36.
133. Stinus L, Cador M, Le Moal M. Interaction between endogenous opioids and dopamine within the nucleus accumbens. Ann NY Acad Sci 1992; 654: 254-273.
134. Sutton RS, Barto AG. Time-derivative models of Pavlovian reinforcement. In: Gabriel M, Moore J, eds. Learning and Computational Neuroscience: Foundations of Adaptive Networks. Cambridge, MA: MIT Press, 1990; 497-537.
135. Svingos AL, Moriwaki A, Wang JB, Uhl GR, Pickel VM. mu-Opioid receptors are localized to extrasynaptic plasma membranes of GABAergic neurons and their targets in the rat nucleus accumbens. J Neurosci 1997; 17: 2585-2594. (Pubitemid 27137424)
136. Svingos AL, Colago EE, Pickel VM. Cellular sites for dynorphin activation of kappa-opioid receptors in the rat nucleus accumbens shell. J Neurosci 1999; 19: 1804-1813.
137. Swanson LW. The projections of the ventral tegmental area and adjacent regions: a combined fluorescence retrograde tracer and immunofluorescence study in the rat. Brain Res Bull 1982; 9: 321-353.
138. Tobler PN, Dickinson A, Schultz W. Coding of predicted reward omission by dopamine neurons in a conditioned inhibition paradigm. J Neurosci 2003; 23: 10402-10410. (Pubitemid 37444617)
139. Tobler PN, Fiorillo CD, Schultz W. Adaptive coding of reward value by dopamine neurons. Science 2005; 307: 1642-1645. (Pubitemid 40354749)
140. Tzschentke TM. Pharmacology and behavioral pharmacology of the mesocortical dopamine system. Prog Neurobiol 2001; 63: 241-320.
141. Ungless MA. Dopamine: the salient issue. Trends Neurosci 2004; 27: 702-706.
142. Ungless MA, Magill PJ, Bolam JP. Uniform inhibition of dopamine neurons in the ventral tegmental area by aversive stimuli. Science 2004; 303: 2040-2042. (Pubitemid 38393283)
143. Van Bockstaele EJ, Pickel VM. GABA-containing neurons in the ventral tegmental area project to the nucleus accumbens in rat brain. Brain Res 1995; 682: 215-221.
144. Walaas I, Fonnum F. Biochemical evidence for gamma-aminobutyrate containing fibres from the nucleus accumbens to the substantia nigra and ventral tegmental area in the rat. Neuroscience 1980; 5: 63-72. (Pubitemid 10203401)
145. Waelti P, Dickinson A, Schultz W. Dopamine responses comply with basic assumptions of formal learning theory. Nature 2001; 412: 43-48. (Pubitemid 32851502)
146. Wagner AR, Rescorla RA. Inhibition in Pavlovian conditioning: application of a theory. In: Boakes RA, Halliday MSE, eds. Inhibition and Learning. London: Academic Press, 1972; 301-336.
147. Wenkstern D, Pfaus JG, Fibiger HC. Dopamine transmission increases in the nucleus accumbens of male rats during their first exposure to sexually receptive female rats. Brain Res 1993; 618: 41-46. (Pubitemid 23212801)
148. Wilensky AE, Schafe GE, Kristensen MP, LeDoux JE. Rethinking the fear circuit: the central nucleus of the amygdala is required for the acquisition, consolidation, and expression of Pavlovian fear conditioning. J Neurosci 2006; 26: 12387-12396.
149. Wilensky AE, Schafe GE, LeDoux JE. Functional inactivation of the amygdala before but not after auditory fear conditioning prevents memory formation. J Neurosci 1999; 19: RC48.
150. Wilkinson LS, Humby T, Killcross AS, Torres EM, Everitt BJ, Robbins TW. Dissociations in dopamine release in medial prefrontal cortex and ventral striatum during the acquisition and extinction of classical aversive conditioning in the rat. Eur J Neurosci 1998; 10: 1019-1026. (Pubitemid 28375626)
151. Wilson C, Nomikos GG, Collu M, Fibiger HC. Dopaminergic correlates of motivated behavior: importance of drive. J Neurosci 1995; 15: 5169-5178.
152. Yoshida M, Yokoo H, Mizoguchi K, Kawahara H, Tsuda A, Nishikawa T, Tanaka M. Eating and drinking cause increased dopamine release in the nucleus accumbens and ventral tegmental area in the rat: measurement by in vivo microdialysis. Neurosci Lett 1992; 139: 73-76.
153. Young AM. Increased extracellular dopamine in nucleus accumbens in response to unconditioned and conditioned aversive stimuli: studies using 1 min microdialysis in rats. J Neurosci Methods 2004; 138: 57-63.
154. Young AM, Ahier RG, Upton RL, Joseph MH, Gray JA. Increased extracellular dopamine in the nucleus accumbens of the rat during associative learning of neutral stimuli. Neuroscience 1998; 83: 1175-1183.
155. Young AM, Joseph MH, Gray JA. Latent inhibition of conditioned dopamine release in rat nucleus accumbens. Neuroscience 1993; 54: 5-9.
156. Yuan XR, Madamba S, Siggins GR. Opioid peptides reduce synaptic transmission in the nucleus accumbens. Neurosci Lett 1992; 134: 223-228.