Encoding of aversion by dopamine and the nucleus accumbens

Frontiers in Neuroscience

Volumn , Issue SEP, 2012, Pages

  McCutcheon, James E ^a   Ebner, Stephanie R ^a   Loriaux, Amy L ^a   Roitman, Mitchell F ^a  

^a UNIVERSITY OF ILLINOIS AT CHICAGO   (United States)

Author keywords

Conditioned taste aversion; Electrophysiology; Reward; Taste reactivity; Ventral tegmental area; Voltammetry

Indexed keywords

DOPAMINE; QUININE; SUCROSE;

ARTICLE; AVERSION; AVERSIVE BEHAVIOR; BRAIN REGION; CYCLIC POTENTIOMETRY; DOPAMINE RELEASE; DOPAMINERGIC NERVE CELL; HUMAN; LEARNING; NERVE CONDUCTION; NONHUMAN; NUCLEUS ACCUMBENS; REWARD; SIGNAL TRANSDUCTION; STIMULUS RESPONSE; SUBSTANTIA NIGRA; TASTE AVERSION; VENTRAL TEGMENTUM;

EID: 84870952673     PISSN: 16624548     EISSN: 1662453X     Source Type: Journal    
DOI: 10.3389/fnins.2012.00137     Document Type: Article

References (95)

1. Abercrombie, E. D., Keefe, K. A., DiFrischia, D. S., and Zigmond, M. J. (1989). Differential effect of stress on in vivo dopamine release in striatum, nucleus accumbens, and medial frontal cortex. J. Neurochem. 52,1655-1658.
2. Anstrom, K. K., Miczek, K. A., and Budygin, E. A. (2009). Increased phasic dopamine signaling in the mesolimbic pathway during social defeat in rats. Neuroscience 161, 3-12.
3. Aragona, B. J., Day, J. J., Roitman, M. F., Cleaveland, N. A., Wightman, R. M., and Carelli, R. M. (2009). Regional specificity in the real-time development of phasic dopamine transmission patterns during acquisition of a cue-cocaine association in rats. Eur. J. Neurosci. 30, 1889-1899.
4. Baliki, M. N., Geha, P. Y., Fields, H. L., and Apkarian, A. V. (2010). Predicting value of pain and analgesia: nucleus accumbens response to noxious stimuli changes in the presence of chronic pain. Neuron 66, 149-160.
5. Bassareo, V., and Di Chiara, G. (1999). Differential responsiveness of dopamine transmission to food-stimuli in nucleus accumbens shell/core compartments. Neuroscience 89, 637-641.
6. Beeler, J. A., Frazier, C. R. M., and Zhuang, X. (2012). Putting desire on a budget: dopamine and energy expenditure, reconciling reward and resources. Front. Integr. Neurosci. 6:49. doi: 10.3389/fnint.2012.00049
7. Benabid, A. L., and Jeaugey, L. (1989). Cells of the rat lateral habenula respond to high-threshold somatosensory inputs. Neurosci. Lett. 96,289-294.
8. Berridge,K.C. (2000). Measuringhedo-nic impact in animals and infants: microstructure of affective taste reactivity patterns. Neurosci. Biobe-hav. Rev. 24,173-198.
9. Berridge, K. C., Flynn, F. W., Schulkin, J., and Grill, H. J. (1984). Sodium depletion enhances salt palatability in rats. Behav. Neurosci. 98, 652-660.
10. Berridge, K. C., and Robinson, T. E. (1998). What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res. Brain Res. Rev. 28, 309-369.
11. Berridge, K. C., and Robinson, T. E. (2003). Parsing reward. Trends Neurosci. 26,507-513.
12. Brischoux, F., Chakraborty, S., Brierley, D. I., and Ungless, M. A. (2009). Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli. Proc. Natl. Acad. Sci. U.S.A. 106, 4894-4899.
13. Bromberg-Martin, E. S., Matsumoto, M., and Hikosaka, O. (2010). Dopamine in motivational control. Neuron 68, 815-834.
14. Brown, H. D., McCutcheon, J. E., Cone, J. J., Ragozzino, M. E., and Roitman, M. F. (2011). Primary food reward and reward-predictive stimuli evoke different patterns of phasic dopamine signaling throughout the striatum. Eur. J. Neurosci. 34, 1997-2006.
15. Brown, M. T. C., Henny, P., Bolam, J. P., and Magill, P. J. (2009). Activity of neurochemically heterogeneous dopaminergic neurons in the sub-stantia nigra during spontaneous and driven changes in brain state. J. Neurosci. 29,2915-2925.
16. Budygin, E. A., Park, J., Bass, C. E., Grinevich, V. P., Bonin, K. D., and Wightman, R. M. (2012). Aversive stimulus differentially triggers sub-second dopamine release in reward regions. Neuroscience 201, 331-337.
17. Cacciapaglia, F., Saddoris, M. P., Wightman, R. M., and Carelli, R. M. (2012). Differential dopamine release dynamics in the nucleus accumbens core and shell track distinct aspects of goal-directed behavior for sucrose. Neuropharmacology 62,2050-2056.
18. Calabresi, P., Picconi, B., Tozzi, A., and Di Filippo, M. (2007). Dopamine-mediated regulation of corticostri-atal synaptic plasticity. Trends Neurosci. 30,211-219.
19. Carlezon, W A., and Thomas, M. J. (2009). Biological substrates of reward and aversion: a nucleus accumbens activity hypothesis. Neuropharmacology 56(Suppl. 1), 122-132.
20. Chiodo, L. A., Antelman, S. M., Caggiula, A. R., and Lineberry, C. G. (1980). Sensory stimuli alter the discharge rate of dopamine (DA) neurons: evidence for two functional types of DA cells in the substantia nigra. Brain Res. 189, 544-549.
21. Cohen, J. Y., Haesler, S., Vong, L., Lowell, B. B., and Uchida, N. (2012). Neuron-type-specific signals for reward and punishment in the ventral tegmental area. Nature 482, 85-88.
22. Coizet, V., Dommett, E. J., Klop, E. M., Redgrave, P., and Overton, P. G. (2010). The parabrachial nucleus is a critical link in the transmission of short latency nociceptive information to midbrain dopaminergic neurons. Neuroscience 168,263-272.
23. Coizet, V., Dommett, E. J., Redgrave, P., and Overton, P. G. (2006). Nociceptive responses of midbrain dopaminergic neurones are modulated by the superior collicu-lus in the rat. Neuroscience 139, 1479-1493.
24. Deroche-Gamonet, V., Belin, D., and Piazza, P. V. (2004). Evidence for addiction-like behavior in the rat. Science 305, 1014-1017.
25. Dreyer, J. K., Herrik, K. F., Berg, R. W., and Hounsgaard, J. D. (2010). Influence of phasic and tonic dopamine release on receptor activation. J. Neurosci. 30, 14273-14283.
26. Ebner, S. R., Roitman, M. F., Potter, D. N., Rachlin, A. B., and Chartoff, E. H. (2010). Depressive-like effects of the kappa opioid receptor agonist salvi-norinA are associated with decreased phasic dopamine release in the nucleus accumbens. Psychopharma-cology (Berl.) 210, 241-252.
27. Fields, H. L., Hjelmstad, G. O., Mar-golis, E. B., and Nicola, S. M. (2007). Ventral tegmental area neurons in learned appetitive behavior and positive reinforcement. Annu. Rev. Neurosci. 30, 289-316.
28. Gao, D. M., Jeaugey, L., Pollak, P., and Benabid, A. L. (1990). Intensity-dependent nociceptive responses from presumed dopaminergic neurons of the substantia nigra, pars compacta in the rat and their modification by lateral habenula inputs. Brain Res. 529, 315-319.
29. Garris, P. A., Christensen, J. R., Rebec, G. V., and Wightman, R. M. (1997). Real-time measurement of electrically evoked extracellular dopamine in the striatum of freely moving rats. J. Neurochem. 68,152-161.
30. Grill, H. J., and Norgren, R. (1978). The taste reactivity test. I. Mimetic responses to gustatory stimuli in neurologically normal rats. Brain Res. 143,263-279.
31. Guarraci, F. A., and Kapp, B. S. (1999). An electrophysiological characterization of ventral tegmental area dopaminergic neurons during differential pavlovian fear conditioning in the awake rabbit. Behav. Brain Res. 99, 169-179.
32. Heien, M. L. A. V., Johnson, M. A., and Wightman, R. M. (2004). Resolving neurotransmitters detected by fast-scan cyclic voltammetry. Anal. Chem. 76, 5697-5704.
33. Horvitz, J. C. (2000). Mesolimbocor-tical and nigrostriatal dopamine responses to salient non-reward events. Neuroscience 96, 651-656.
34. Jhou, T. C., Fields, H. L., Baxter, M. G., Saper, C. B., and Holland, P. C. (2009). The rostromedial tegmental nucleus (RMTg), a GABAergic afferent to midbrain dopamine neurons, encodes aversive stimuli and inhibits motor responses. Neuron 61, 786-800.
35. Joshua, M., Adler, A., Mitelman, R., Vaa-dia, E., and Bergman, H. (2008). Midbrain dopaminergic neurons and striatal cholinergic interneu-rons encode the difference between reward and aversive events at different epochs of probabilistic classical conditioning trials. J. Neurosci. 28, 11673-11684.
36. Keithley, R. B., Carelli, R. M., and Wightman, R. M. (2010). Rank estimation and the multivariate analysis of in vivo fast-scan cyclic voltammetric data. Anal. Chem. 82, 5541-5551.
37. Kelley A. E., Baldo, B. A., Pratt, W. E., and Will, M. J. (2005). Corticostriatal-hypothalamic circuitry and food motivation: integration of energy, action, and reward. Physiol. Behav. 86, 773-795.
38. Kenny, P. J. (2011). Common cellular and molecular mechanisms in obesity and drug addiction. Nat. Rev. Neurosci. 12,638-651.
39. Kim, M. J., Mizumori, S. J. Y., and Bernstein, I. L. (2010). Neuronal representation of conditioned taste in the basolateral amygdala of rats. Neurobiol. Learn. Mem. 93,406-414.
40. Kiyatkin, E. A. (1988). Functional properties of presumed dopamine-containing and other ventral tegmental area neurons in conscious rats. Int. J. Neurosci. 42, 21-43.
41. Kiyatkin, E. A. (1995). Functional significance of mesolimbic dopamine. Neurosci. Biobehav. Rev. 19, 573-598.
42. Knutson, B., Burgdorf, J., and Panksepp, J. (2002). Ultrasonic vocalizations as indices of affective states in rats. Psychol Bull. 128, 961-977.
43. Koob, G. F. (2008). A role for brain stress systems in addiction. Neuron 59,11-34.
44. Koulchitsky, S., De Backer, B., Querte-mont, E., Charlier, C., and Seutin, V. (2012). Differential effects of cocaine on dopamine neuron firing in awake and anesthetized rats. Neuropsychopharmacology 37, 1559-1571.
45. Kravitz, A. V., and Kreitzer, A. C. (2012). Striatal mechanisms underlying movement, reinforcement, and punishment. Physiology (Bethesda) 27,167-177.
46. Kravitz, A. V., Tye, L. D., and Kreitzer, A. C. (2012). Distinct roles for direct and indirect pathway striatal neurons in reinforcement. Nat. Neurosci. 15,816-818.
47. Lammel, S., Ion, D. I., Roeper, J., and Malenka, R. C. (2011). Projection-specific modulation of dopamine neuron synapses by aver-sive and rewarding stimuli. Neuron 70,855-862.
48. Loriaux, A. L., Roitman, J. D., and Roit-man, M. F. (2011). Nucleus accum-bens shell, but not core, tracks motivational value of salt. J. Neurophysiol. 1537-1544.
49. Maeda, H., and Mogenson, G. J. (1982). Effects of peripheral stimulation on the activity of neurons in the ventral tegmental area, substantia nigra, and midbrain reticular formation of rats. Brain Res. Bull. 8, 7-14.
50. Mantz, J., Thierry, A. M., and Glowin-ski, J. (1989). Effect of noxious tail pinch on the discharge rate of meso-cortical and mesolimbic dopamine neurons: selective activation of the mesocortical system. Brain Res. 476, 377-381.
51. Marinelli, M., Rudick, C. N., Hu, X.-T., and White, F. J. (2006). Excitability of dopamine neurons: modulation and physiological consequences. CNS Neurol. Disord. Drug Targets 5, 79-97.
52. Matsuda, W., Furuta, T., Nakamura, K. C., Hioki, H., Fujiyama, F., Arai, R., and Kaneko, T. (2009). Single nigrostriatal dopaminergic neurons form widely spread and highly dense axonal arborizations in the neostria-tum. J. Neurosci. 29, 444-453.
53. Matsumoto, M., and Hikosaka, O. (2007). Lateral habenula as a source of negative reward signals in dopamine neurons. Nature 447, 1111-1115.
54. Matsumoto, M., and Hikosaka, O. (2009). Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459, 837-841.
55. McCutcheon, J. E., Beeler, J. A., and Roitman, M. F. (2012). Sucrose-predictive cues evoke greater phasic dopamine release than saccharin-predictive cues. Synapse 66,346-351.
56. Mileykovskiy, B., and Morales, M. (2011). Duration of inhibition of ventral tegmental area dopamine neurons encodes a level of conditioned fear. J. Neurosci. 31, 7471-7476.
57. Mirenowicz, J., and Schultz, W. (1996). Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 379,449-451.
58. Nestler, E. J., and Carlezon, W A. (2006). The mesolimbic dopamine reward circuit in depression. Biol Psychiatry 59, 1151-1159.
59. Olds, J., and Milner, P. (1954). Positive reinforcement produced by electrical stimulation of septal area and other regions of rat brain. J. Comp. Physiol. Psychol. 47, 419-427.
60. Owesson-White, C. A., Cheer, J. E, Beyene, M., Carelli, R. M., and Wightman, R. M. (2008). Dynamic changes in accumbens dopamine correlate with learning during intracranial self-stimulation. Proc. Natl. Acad. Sci. U.S.A. 105, 11957-11962.
61. Owesson-White, C. A., Roitman, M. F., Sombers, L. A., Belle, A. M., Keithley, R. B., Peele, J. L., Carelli, R. M., and Wightman, R. M. (2012). Sources contributing to the average extracellular concentration of dopamine in the nucleus accumbens. J. Neurochem. 121,252-262.
62. Park, J., Wheeler, R. A., Fontillas, K., Keithley, R. B., Carelli, R. M., and Wightman, R. M. (2012). Cate-cholamines in the bed nucleus of the stria terminalis reciprocally respond to reward and aversion. Biol. Psychiatry 71,327-334.
63. Peciña, S., and Berridge, K. C. (2000). Opioid site in nucleus accumbens shell mediates eating and hedonic "liking" for food: map based on microinjection Fos plumes. Brain Res. 863, 71-86.
64. Peciña, S., and Berridge, K. C. (2005). Hedonic hot spot in nucleus accumbens shell: where do mu-opioids cause increased hedonic impact of sweetness? J. Neurosci. 25, 11777-11786.
65. Phillips, P. E. M., Stuber, G. D., Heien, M. L. A. V., Wightman, R. M., and Carelli, R. M. (2003). Subsecond dopamine release promotes cocaine seeking. Nature 422, 614-618.
66. Redgrave, P., Gurney, K., and Reynolds, J. (2008). What is reinforced by phasic dopamine signals? Brain Res. Rev. 58, 322-339.
67. Redish, A. D., Jensen, S., Johnson, A., and Kurth-Nelson, Z. (2007). Reconciling reinforcement learning models with behavioral extinction and renewal: implications for addiction, relapse, and problem gambling. Psychol. Rev. 114,784-805.
68. Richfield, E. K., Penney, J. B., and Young, A. B. (1989). Anatomical and affinity state comparisons between dopamine D1 and D2 receptors in the rat central nervous system. Neuroscience 30, 767-777.
69. Robinson, D. L., Heien, M. L., and Wightman, R. M. (2002). Frequency of dopamine concentration transients increases in dorsal and ventral striatum of male rats during introduction of conspecifics. J. Neurosci. 22,10477-10486.
70. Roitman, M. F., Stuber, G. D., Phillips, P. E. M., Wightman, R. M., and Carelli, R. M. (2004). Dopamine operates as a subsecond modulator of food seeking. J. Neurosci. 24,1265-1271.
71. Roitman, M. F., Wheeler, R. A., and Carelli, R. M. (2005). Nucleus accumbens neurons are innately tuned for rewarding and aversive taste stimuli, encode their predictors, and are linked to motor output. Neuron 45, 587-597.
72. Roitman, M. F., Wheeler, R. A., Tiesinga, P. H. E., Roitman, J. D., and Carelli, R. M. (2010). Hedonic and nucleus accumbens neural responses to a natural reward are regulated by aversive conditioning. Learn. Mem. 17, 539-546.
73. Roitman, M. F., Wheeler, R. A., Wightman, R. M., and Carelli, R. M. (2008). Real-time chemical responses in the nucleus accumbens differentiate rewarding and aversive stimuli. Nat. Neurosci. 11, 1376-1377.
74. Salamone, J. D. (2007). Functions of mesolimbic dopamine: changing concepts and shifting paradigms. Psychopharmacology (Berl.) 191,389.
75. Schultz, W. (1998). Predictive reward signal of dopamine neurons. J. Neurophysiol. 80, 1-27.
76. Schultz, W (2000). Multiple reward signals in the brain. Nat. Rev. Neurosci. 1, 199-207.
77. Schultz, W., and Romo, R. (1987). Responses of nigrostriatal dopamine neurons to high-intensity somatosensory stimulation in the anesthetized monkey. J. Neurophysiol. 57, 201-217.
78. Sombers, L. A., Beyene, M., Carelli, R. M., and Wightman, R. M. (2009). Synaptic overflow of dopamine in the nucleus accumbens arises from neuronal activity in the ventral tegmental area. J. Neurosci. 29, 1735-1742.
79. Stamatakis, A. M., and Stuber, G. D. (2012). Activation of lateral habenula inputs to the ventral midbrain promotes behavioral avoidance. Nat. Neurosci. 15, 1105-1107.
80. Steiner, J. E., Glaser, D., Hawilo, M. E., and Berridge, K. C. (2001). Comparative expression of hedonic impact: affective reactions to taste by human infants and other primates. Neurosci. Biobehav. Rev. 25, 53-74.
81. Stuber, G. D., Klanker, M., Ridder, B. D., Bowers, M. S., Joosten, R. N., Feenstra, M. G., Bonci, A., and de Ridder, B. (2008).Reward-predictive cues enhance midbrain dopamine neurons. Science 321, 1690-1692.
82. Surmeier, D. J., Carrillo-Reid, L., and Bargas, J. (2011). Dopaminergic modulation of striatal neurons, circuits, and assemblies. Neuroscience 198,3-18.
83. Tan, K. R., Yvon, C., Turiault, M., Mirz-abekov, J. J., Doehner, J., Labouèbe, G., Deisseroth, K., Tye, K. M., and Lüscher, C. (2012). GABA neurons of the VTA drive conditioned place aversion. Neuron 73, 1173-1183.
84. Tindell, A. J., Smith, K. S., Peciña, S., Berridge, K. C., and Aldridge, J. W. (2006). Ventral pallidum firing codes hedonic reward: when a bad taste turns good. J. Neurophysiol. 96, 2399-2409.
85. Ungless, M. A., and Grace, A. A. (2012). Are you or aren't you? Challenges associated with physiologically identifying dopamine neurons. Trends Neurosci. 35, 422-430.
86. Ungless, M. A., Magill, P. J., and Bolam, J. P. (2004). Uniform inhibition of dopamine neurons in the ventral tegmental area by aversive stimuli. Science 303, 2040-2042.
87. Vanderschuren, L. J. M. J., and Everitt, B. J. (2004). Drug seeking becomes compulsive after prolonged cocaine self-administration. Science 305, 1017-1019.
88. Venton, B. J., Zhang, H., Garris, P. A., Phillips, P. E. M., Sulzer, D., and Wightman, R. M. (2003). Real-time decoding of dopamine concentration changes in the caudate-putamen during tonic and phasic firing. J. Neurochem. 87, 1284-1295.
89. Wang,D.V., andTsien,J.Z. (2011). Convergent processing of both positive and negative motivational signals by the VTA dopamine neuronal populations. PLoS ONE 6, e17047. doi:10.1371/journal.pone.0017047
90. Wheeler, R. A., Aragona, B. J., Fuhrmann, K. A., Jones, J. L., Day, J. J., Cacciapaglia, F., Wightman, R. M., and Carelli, R. M. (2011). Cocaine cues drive opposing context-dependent shifts in reward processing and emotional state. Biol. Psychiatry 69, 1067-1074.
91. Wheeler, R. A., Twining, R. C., Jones, J. L., Slater, J. M., Grigson, P. S., and Carelli, R. M. (2008). Behavioral and electrophysiological indices of negative affect predict cocaine self-administration. Neuron 57, 774-785.
92. Wightman, R. M., Heien, M. L. A. V., Wassum, K. M., Sombers, L. A., Aragona, B. J., Khan, A. S., Ari-ansen, J. L., Cheer, J. F., Phillips, P. E. M., and Carelli, R. M. (2007). Dopamine release is heterogeneous within microenvironments of the rat nucleus accumbens. Eur. J. Neurosci. 26, 2046-2054.
93. Williams, G. V., and Millar, J. (1990). Concentration-dependent actions of stimulated dopamine release on neuronal activity in rat striatum. Neuroscience 39, 1-16.
94. Wise, R. A. (2004). Dopamine, learning and motivation. Nat. Rev. Neurosci. 5, 483-494.
95. Zweifel, L. S., Fadok, J. P., Argilli, E., Garelick, M. G., Jones, G. L., Dicker-son, T. M. K., Allen, J. M., Mizumori, S. J. Y., Bonci, A., and Palmiter, R. D. (2011). Activation of dopamine neurons is critical for aversive conditioning and prevention of generalized anxiety. Nat. Neurosci. 14, 620-626.