The role of dopamine in the context of aversive stimuli with particular reference to acoustically signaled avoidance learning

Frontiers in Neuroscience

Volumn , Issue SEP, 2012, Pages

  Ilango, Anton ^a   Shumake, Jason ^a,c   Wetzel, Wolfram ^a   Scheich, Henning ^a   Ohl, Frank W ^a,b  

^a LEIBNIZ INSTITUTE FOR NEUROBIOLOGY   (Germany)

^b OTTO VON GUERICKE UNIVERSITY   (Germany)

^c UNIVERSITY OF TEXAS AT AUSTIN   (United States)

Author keywords

Aversive stimuli; Avoidance learning; Dopamine; Dorsal vs. Ventral striatum; Intracranial self stimulation; Lateral habenula; Reward and punishment; Ventral tegmental area

Indexed keywords

DOPAMINE;

ASSOCIATION; AVERSIVE STIMULATION; AVOIDANCE BEHAVIOR; BEHAVIORAL SCIENCE; BRAIN DEPTH STIMULATION; BRAIN REGION; DOPAMINE RELEASE; DOPAMINERGIC SYSTEM; ELECTROPHYSIOLOGY; HUMAN; MICRODIALYSIS; NERVE STIMULATION; POTENTIOMETRY; SHORT SURVEY; SIGNAL TRANSDUCTION;

EID: 84870892269     PISSN: 16624548     EISSN: 1662453X     Source Type: Journal    
DOI: 10.3389/fnins.2012.00132     Document Type: Short Survey

References (103)

1. Abercrombie, E. D., Keefe, K. A., DiFrischia, D. S., and Zigmond, M. J. (1989). Differential effect of stress on in vivo dopamine release in striatum, nucleus accumbens, and medial frontal cortex. J. Neurochem. 52, 1655-1658.
2. Aldavert-Vera, L., Costa-Miserachs, D., Massanes-Rotger, E., Soriano-Mas, C., Segura-Torres, P., and Morgado-Bernal, I. (1997). Facilitation of a distributed shuttle-box conditioning with posttraining intracranial self-stimulation in old rats. Neuro-biol. Learn. Mem. 67, 254-258.
3. Anstrom, K. K., Miczek, K. A., and Budygin, E. A. (2009). Increased phasic dopamine signaling in the mesolimbic pathway during social defeat in rats. Neuroscience 161, 3-12.
4. Bao, S., Chan, V. T., and Merzenich, M. M. (2001). Cortical remodeling induced by activity of ventral tegmental dopamine neurons. Nature 412, 79-83.
5. Baron, A., Dewaard, R. J., and Lip-son, J. (1977). Increased reinforcement when timeout from avoidance includes access to a safe place. J. Exp. Anal. Behav. 27, 479-494.
6. Beninger, R. J., Hoffman, D. C., and Mazurski, E. J. (1989). Receptor subtype-specific dopaminergic agents and conditioned behavior. Neurosci. Biobehav. Rev. 13, 113-122.
7. Boschen, S. L., Wietzikoski, E. C., Winn, P., and Da Cunha, C. (2011). The role of nucleus accumbens and dorsolateral striatal D2 receptors in active avoidance conditioning. Neurobiol. Learn. Mem. 96, 254-262.
8. Boutelle, M. G., Zetterström, T., Pei, Q., Svensson, L., and Fillenz, M. (1990). In vivo neurochemical effects of tail pinch. J. Neurosci. Methods 34, 151-157.
9. Bracs, P. U., Jackson, D. M., and Gregory, P. (1982). alpha-methyl-p-tyrosine inhibition of a conditioned avoidance response: reversal by dopamine applied to the nucleus accumbens. Psychopharma-cology (Berl.) 77, 159-163.
10. Brischoux, F., Chakraborty, S., Brierley, D. I., and Ungless, M. A. (2009). Phasic excitation of dopamine neu-ronsin ventralVTAbynoxious stimuli. Proc. Natl. Acad. Sci. U.S.A. 106, 4894-4899.
11. Bromberg-Martin, E. S., Matsumoto, M., and Hikosaka, O. (2010). Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 68, 815-834.
12. Brown, M. T., Henny, P., Bolam, J. P., and Magill, P. J. (2009). Activity of neurochemically heterogeneous dopaminergic neurons in the sub-stantia nigra during spontaneous and driven changes in brain state. J. Neurosci. 29, 2915-2925.
13. Budinger, E., Laszcz, A., Lison, H., Sche-ich, H., and Ohl, F. W. (2008). Non-sensory cortical and subcorti-cal connections of the primary auditory cortex in Mongolian gerbils: bottom-up and top-down process-ingof neuronal information via field AI. Brain Res. 1220, 2-32.
14. Budygin, E. A., Park, J., Bass, C. E., Grinevich, V. P., Bonin, K. D., and Wightman, R. M. (2012). Aversive stimulus differentially triggers sub-second dopamine release in reward regions. Neuroscience 201, 331-337.
15. Carder, B. (1970). Lateral hypothalamic stimulation and avoidance in rats. J. Comp. Physiol. Psychol. 71, 325-333.
16. Castro-Alamancos,M. A., and Borrell, J. (1992). Facilitation and recovery of shuttle box avoidance behavior after frontal cortex lesions is induced by a contingent electrical stimulation in the ventral tegmental nucleus. Behav. Brain Res. 50, 69-76.
17. Christoph, G. R., Leonzio, R. J., and Wilcox, K. S. (1986). Stimulation of the lateral habenula inhibits dopamine-containing neurons in the substantia nigra and ventral tegmental area of the rat. J. Neurosci. 6, 613-619.
18. Cicala, G. A., and Owen, I. W. (1976). Warning signal termination and a feedback signal may not serve the same function. Learn. Motiv. 7, 356-367.
19. Cohen, J. Y., Haesler, S., and Vong, L., Lowell, B. B., and Uchida, N. (2012). Neuron-type-specific signals for reward and punishment in the ventral tegmental area. Nature 482, 85-88.
20. Coizet, V., Dommett, E. J., Klop, E. M., Redgrave, P., and Overton, P. G. (2010). The parabrachial nucleus is a critical link in the transmission of short latency nociceptive information to midbrain dopaminergic neurons.Neuroscience 168,263-272.
21. Coizet, V., Dommett, E. J., Redgrave, P., and Overton, P. G. (2006). Nociceptive responses of midbrain dopaminergic neurones are modulated by the superior colliculus in the rat. Neuroscience 139, 1479-1493.
22. Cooper, B. R., Breese, G. R., Grant, L. D., and Howard, J. L. (1973). Effects of 6-hydroxydopamine treatments on active avoidance responding: evidence for involvement of brain dopamine. J. Pharmacol. Exp. Ther. 185, 358-370.
23. Destrade, C., and Jaffard, R. (1978). Post-trial hippocampal and lateral hypothalamic electrical stimulation. Facilitation on long-term memory of appetitive and avoidance learning tasks. Behav. Biol. 22, 354-374.
24. Dickinson, A. (1976). Appetitive-aversion interactions: facilitation of aversive conditioning by prior appetitive training in the rat. Anim. Learn. Behav. 4, 416-420.
25. Dickinson, A., and Pearce, J. M. (1977). Inhibitory interactions between appetitive and aversive stimuli. Psychol. Bull. 84, 690-711.
26. Dinsmoor, J. A. (1977). Escape, avoidance, punishment: where do we stand? J. Exp. Anal. Behav. 28, 83-95.
27. Dinsmoor, J. A. (2001). Stimuli inevitably generated by behavior that avoids electric shock are inherently reinforcing. J. Exp. Anal. Behav. 75, 311-333.
28. Fibiger, H. C., LePiane, F. G., Jakubovic, A., and Phillips, A. G. (1987). The role of dopamine in intracranial self-stimulation of the ventral tegmental area. J. Neurosci. 7, 3888-3896.
29. Fiorino, D. F., Coury, A., Fibiger, H. C., and Phillips, A. G. (1993). Electrical stimulation of reward sites in the ventral tegmental area increases dopamine transmission in the nucleus accumbens of the rat. Behav. Brain Res. 55, 131-141.
30. Gao, D. M., Hoffman, D., and Ben-abid, A. L. (1996). Simultaneous recording of spontaneous activities and nociceptive responses from neurons in the pars compacta of substantia nigra and in the lateral habenula. Eur. J. Neurosci. 8, 1474-1478.
31. Gao, D. M., Jeaugey, L., Pollak, P., and Benabid, A. L. (1990). Intensity-dependent nociceptive responses from presumed dopaminergic neurons of the substantia nigra pars compacta in the rat and their modification by lateral habenula inputs. Brain Res. 529, 315-319.
32. Giorgi, O., Lecca, D., Piras, G., Driscoll, P., and Corda, M. G. (2003). Dissociation between mesocortical dopamine release and fear-related behaviours in two psychogeneti-cally selected lines of rats that differ in coping strategies to aver-sive conditions. Eur. J. Neurosci. 17, 2716-2726.
33. Guarraci, F. A., and Kapp, B. S. (1999). An electrophysiological characterization of ventral tegmental area dopaminergic neurons during differential pavlovian fear conditioning in the awake rabbit. Behav. Brain Res. 99, 169-179.
34. Huston, J. P., Mueller, C. C., and Mon-dadori, C. (1977). Memory facilitation by posttrial hypothalamic stimulation and other reinforcers: a central theory of reinforcement. Biobe-hav. Rev. 1, 143-150.
35. Huston, J. P., and Oitzl, M. S. (1989). The relationship between reinforcement and memory: parallels in the rewarding and mnemonic effects of the neuropeptide substance P. Neu-rosci. Biobehav. Rev. 13, 171-180.
36. Ikemoto, S. (2007). Dopamine reward circuitry: two projection systems from the ventral midbrain to the nucleus accumbens-olfactory tubercle complex. Brain Res. Rev. 56, 27-78.
37. Ikemoto, S., and Panksepp, J. (1999). The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking. Brain Res. Brain Res. Rev. 31, 6-41.
38. Ilango, A., Wetzel, W., Scheich, H., and Ohl, F. W. (2010). The combination of appetitive and aversive reinforcers and the nature of their interaction during auditory learning. Neu-roscience 166, 752-762.
39. Ilango, A., Wetzel, W., Scheich, H., and Ohl, F. W. (2011). Effects of ventral tegmental area stimulation on the acquisition and long term retention of active avoidance learning. Behav. Brain Res. 225, 515-521.
40. Imperato, A., Angelucci, L., Casolini, P., Zocchi, A., and Puglisi-Allegra, S. (1992). Repeated stressful experiences differently affect limbic dopamine release during and following stress. Brain Res. 577, 194-199.
41. Jackson, D. M., Ahlenius, S., Andén, N. E., and Engel, J. (1977). Antagonism by locally applied dopamine into the nucleus accumbens or the corpus striatum of alpha-methyltyrosine-induced disruption of conditioned avoidance behaviour. J. Neural Transm. 41, 231-239.
42. Ji, H., and Shepard, P. D. (2007). Lateral habenula stimulation inhibits rat midbrain dopamine neurons through a GABA(A) receptor-mediated mechanism. J. Neurosci. 27, 6923-6930.
43. Kalivas, P. W., and Duffy, P. (1995). Selective activation of dopamine transmission in the shell of the nucleus accumbens by stress. Brain Res. 675, 325-328.
44. Kelleher, R. T., and Cook, L. (1959). An analysis of the behavior of rats and monkeys on concurrent fixed-ratio avoidance schedules. J. Exp. Anal. Behav. 2, 203-211.
45. Kim, H., Shimojo, S., and O'Doherty, J. P. (2006). Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain. PLoS Biol. 4, e233. doi:10.1371/journal.pbio.0040233
46. Kim, Y., Wood, J., and Moghad-dam, B. (2012). Coordinated activity of ventral tegmental neurons adapts to appetitive and aversive learning. PLoS ONE 7, e29766. doi:10.1371/journal.pone.0029766
47. Konorski, J. (1967). The Integrative Activity of the Brain: An Interdisciplinary Approach. Chicago: Chicago University Press.
48. Kraus, M., Schicknick, H., Wetzel, W., Ohl, F., Staak, S., and Tischmeyer, W. (2002). Memory consolidation for the discrimination of frequency-modulated tones in mongolian ger-bils is sensitive to protein-synthesis inhibitors applied to the auditory cortex. Learn. Mem. 9, 293-303.
49. Mantz, J., Thierry, A. M., and Glowin-ski, J. (1989). Effect of noxious tail pinch on the discharge rate of meso-cortical and mesolimbic dopamine neurons: selective activation of the mesocortical system. Brain Res. 476, 377-381.
50. Margules, D. L., and Stein, L. (1968). Facilitation of sidman avoidance behavior by positive brain stimulation. J. Comp. Physiol. Psychol. 66, 182-184.
51. Masterson, F. A., Crawford, M., and Bartter, W. D. (1978). Brief escape from a dangerous place: the role of reinforcement in the rat's one-way avoidance acquisition. Learn. Motiv. 9, 141-163.
52. Matsumoto, M., and Hikosaka, O. (2007). Lateral habenula as a source of negative reward signals in dopamine neurons. Nature 447, 1111-1115.
53. Matsumoto, M., and Hikosaka, O. (2009). Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459, 837-841.
54. McCullough, L. D., Sokolowski, J. D., and Salamone,J.D. (1993).Aneuro-chemical and behavioral investigation of the involvement of nucleus accumbens dopamine in instrumental avoidance. Neuroscience 52, 919-925.
55. Mileykovskiy, B., and Morales, M. (2011). Duration of inhibition of ventral tegmental area dopamine neurons encodes a levelof conditioned fear. J. Neurosci. 31, 7471-7476.
56. Mirenowicz, J., and Schultz, W. (1996). Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 379, 449-451.
57. Modaresi, H. A. (1975). One-way characteristic performance of rats under two-way signaled avoidance conditions. Learn. Motiv. 6, 484-497.
58. Mondadori, C., Ornstein, K., Waser, P. G., and Huston, J. P. (1976). Post-trial reinforcing hypothalamic stimulation can facilitate avoidance learning. Neurosci. Lett. 2, 183-187.
59. Morris, R. G. M. (1975). Preconditioning of reinforcing properties to an exteroceptive feedback stimulus. Learn. Motiv. 6, 289-298.
60. Ohl, F. W., Wetzel, W., Wagner, T., Rech, A., and Scheich, H. (1999). Bilateral ablation of auditory cortex in Mongolian gerbil affects discrimination of frequency modulated tones but not of pure tones. Learn. Mem. 6, 347-362.
61. Olds, J. (1958). Self-stimulation of the brain. Its use to study local effects of hunger, sex, and drugs. Science 127, 315-324.
62. Olds, J., and Milner, P. M. (1954). Positive reinforcement producedbyelec-trical stimulation of septal area and other regions of rat brain. J. Comp. Physiol. Psychol. 47, 419-427.
63. Olds, M. E., and Olds, J. (1962). Approach-escape interactions in rat brain. Am. J. Physiol. 203, 803-810.
64. Owesson-White, C. A., Cheer, J. F., Beyene, M., Carelli, R. M., and Wightman, R. M. (2008). Dynamic changes in accumbens dopamine correlate with learning during intracranial self-stimulation. Proc. Natl. Acad. Sci. U.S.A. 105, 11957-11962.
65. Park, J., Wheeler, R. A., Fontillas, K., Keithley, R. B., Carelli, R. M., and Wightman, R. M. (2012). Cate-cholamines in the bed nucleus of the stria terminalis reciprocally respond to reward and aversion. Biol. Psychiatry 71, 327-334.
66. Pei, Q., Zetterström, T., and Fillenz, M. (1990). Tail pinch-induced changes in the turnover and release of dopamine and 5-hydroxytryptamine in different brain regions of the rat. Neuroscience 35, 133-138.
67. Roitman, M. F., Wheeler, R. A., Wightman, R. M., and Carelli, R. M. (2008). Real-time chemical responses in the nucleus accum-bens differentiate rewarding and aversive stimuli. Nat. Neurosci. 12, 1376-1377.
68. Ruiz-Medina, J., Redolar-Ripoll, D., Morgado-Bernal, I., Aldavert-Vera, L., and Segura-Torres, P. (2008). Intracranial self-stimulation improves memory consolidation in rats with little training. Neurobiol. Learn. Mem. 89, 574-581.
69. Salamone,J.D. (1994). Theinvolvement of nucleus accumbens dopamine in appetitive and aversive motivation. Behav. Brain Res. 61, 117-133.
70. Salamone, J. D., and Correa, M. (2002). Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine. Behav. Brain Res. 137, 3-25.
71. Schicknick, H., Reichenbach, N., Smalla, K. H., Scheich, H., Gundelfinger, E. D., and Tischmeyer, W. (2012). Dopamine modulates memory consolidation of discrimination learning in the auditory cortex. Eur. J. Neurosci. 35, 763-774.
72. Schicknick, H., Schott, B. H., Budinger, E., Smalla, K. H., Riedel, A., Sei-denbecher, C. I., Scheich, H., Gun-delfinger, E. D., and Tischmeyer, W. (2008). Dopaminergic modulation of auditory cortex-dependent memory consolidation through mTOR. Cereb. Cortex 18, 2646-2658.
73. Schultz, W., Dayan, P., and Montague, P. R. (1997). A neural substrate of prediction and reward. Science 275, 1593-1599.
74. Segura-Torres, P., Aldavert-Vera, L., Gatell-Segura, A., Redolar-Ripoll, D., and Morgado-Bernal, I. (2010). Intracranial self-stimulation recovers learning and memory capacity in basolateral amygdala-damaged rats. Neurobiol. Learn. Mem. 93, 117-126.
75. Segura-Torres, P., Capdevila-Ortís, L., Martí-Nicolovius, M., and Morgado-Bernal, I. (1988). Improvement of shuttle-box learning with pre- and post-trial intracranial self-stimulation in rats. Behav. Brain Res. 29, 111-117.
76. Segura-Torres, P., Portell-Cortés, I., and Morgado-Bernal, I. (1991). Improvement of shuttle-box avoidance with post-training intracra-nial self-stimulation, in rats: a parametric study. Behav. Brain Res. 42, 161-167.
77. Seymour, B., Singer, T., and Dolan, R. (2007). The neurobiology of punishment. Nat. Rev. Neurosci. 8, 300-311.
78. Shumake, J.,Ilango,A., Scheich, H.,Wet-zel, W., and Ohl,F. W. (2010). Differential neuromodulation of acquisition and retrieval of avoidance learning by the lateral habenula and ventral tegmental area. J. Neurosci. 30, 5876-5883.
79. Skinner, B. F. (1938). The Behavior of Organisms: An Experimental Analysis. New York: Appleton.
80. Sokolowski, J. D., McCullough, L. D., and Salamone,J. D.(1994). Effects of dopamine depletions in the medial prefrontal cortex onactive avoidance and escape in the rat. Brain Res. 65, 293-299.
81. Sorg, B. A., and Kalivas, P. W. (1991). Effects of cocaine and footshock stress on extracellular dopamine levels in the ventral striatum. Brain Res. 559, 29-36.
82. Sorg, B. A., and Kalivas, P. W. (1993). Effects of cocaine and footshock stress on extracellular dopamine levels in the medial prefrontal cortex. Neuroscience 53, 695-703.
83. Stark, H., Bischof, A., and Scheich, H. (1999). Increase of extracellular dopamine in prefrontal cortex of gerbils during acquisition of the avoidance strategy in the shuttle-box. Neurosci. Lett. 264, 77-80.
84. Stark, H., Bischof, A., Wagner, T., and Scheich, H. (2000). Stages of avoidance strategyformation in gerbils are correlated with dopaminergic transmission activity. Eur. J. Pharmacol. 405, 263-275.
85. Stark, H., Bischof, A., Wagner, T., and Scheich, H. (2001). Activation of the dopaminergic system of medial prefrontal cortex of gerbils during formation of relevant associations for the avoidance strategy in the shuttle-box. Prog. Neuropsy-chopharmacol. Biol. Psychiatry 25, 409-426.
86. Stark, H., Rothe, T., Deliano, M., and Scheich,H.(2008). Dynamicsofcor-tical theta activity correlates with stages of auditory avoidance strategy formation in a shuttle-box. Neuro-science 151, 467-475.
87. Stark, H., Rothe, T., Wagner, T., and Scheich, H. (2004). Learning a new behavioral strategy in the shuttle-box increases prefrontal dopamine. Neuroscience 126, 21-29.
88. Stein, L. (1965). Facilitation of avoidance behaviour by positive brain stimulation. J. Comp. Physiol. Psy-chol. 60, 9-19.
89. Tischmeyer, W., Schicknick, H., Kraus, M., Seidenbecher, C. I., Staak, S., Scheich, H., and Gundelfinger, E. D. (2003). Rapamycin-sensitive signalling in long-term consolidation of auditory cortex-dependent memory. Eur. J. Neurosci. 18, 942-950.
90. Tobler, P. N., Dickinson, A., and Schultz, W. (2003). Coding of predicted reward omission by dopamine neurons in a conditioned inhibition paradigm. J. Neurosci. 23, 10402-10410.
91. Tsai,C. T., Nakamura, S., and Iwama, K. (1980). Inhibition of neuronal activity of the substantia nigra by noxious stimuli and its modification by the caudate nucleus. Brain Res. 195, 299-311.
92. Tsai, H. C., Zhang, F., Adamantidis, A., Stuber, G. D., Bonci, A., de Lecea, L., and Deisseroth,K. (2009). Phasic firing in dopaminergic neurons is sufficient for behavioral conditioning. Science 324, 1080-1084.
93. Ungless, M. A., Argilli, E., and Bonci, A. (2010). Effects of stress and aversion on dopamine neurons: implications for addiction. Neurosci. Biobehav. Rev. 35, 151-156.
94. Ungless, M. A., Magill, P. J., and Bolam, J. P. (2004). Uniform inhibition of dopamine neurons in the ventral tegmental area by aversive stimuli. Science 303, 2040-2042.
95. Valenti, O., Lodge, D. J., and Grace,A. A. (2011). Aversive stimuli alter ventral tegmental area dopamine neuronactivity via a common action in the ventral hippocampus. J. Neurosci. 31, 4280-4289.
96. Wadenberg, M. L., Ericson, E., Magnus-son, O., and Ahlenius,S. (1990). Suppression of conditioned avoidance behavior by the local application of (-)sulpiride into the ventral, but not the dorsal, striatum of the rat. Biol. Psychiatry 28, 297-307.
97. Wahlsten, D., and Sharp, D. (1969). Improvement of shuttle avoidance by handling during the intertrial interval. J. Comp. Physiol. Psychol.67, 252-259.
98. Wang, D. V., and Tsien, J. Z. (2011). Convergent processing of both positive and negative motivational signals by the VTA dopamine neuronal populations. PLoS ONE 6, e17047. doi:10.1371/journal.pone.0017047
99. Wetzel, W., Ohl, F. W., and Scheich, H. (2008). Global versus local processing of frequency-modulated tones in gerbils: an animal model of lat-eralized auditory cortex functions. Proc. Natl. Acad. Sci. U.S.A. 105, 6753-6758.
100. Wetzel, W., Ohl, F. W., Wagner, T., and Scheich, H. (1998). Right auditory cortex lesion in Mongolian gerbils impairs discrimination of rising and falling frequency-modulated tones. Neurosci. Lett. 252, 115-118.
101. Wietzikoski, E. C., Boschen, S. L., Miyoshi, E., Bortolanza, M., Dos Santos, L. M., Frank, M., Brandão, M. L., Winn, P., and Da Cunha, C. (2012). Roles of D1-like dopamine receptors in the nucleus accum-bens and dorsolateral striatum in conditioned avoidance responses. Psychopharmacology (Berl.) 219, 159-169.
102. Witten, I. B., Steinberg, E. E., Lee, S. Y., Davidson, T. J., Zalocusky,K. A., Brodsky, M., Yizhar, O., Cho, S. L., Gong, S., Ramakrish-nan, C., Stuber, G. D., Tye, K. M., Janak, P. H., and Deisseroth, K. (2011). Recombinase-driver rat lines: tools, techniques, and opto-genetic application to dopamine-mediated reinforcement. Neuron 72, 721-733
103. Young, A. M., Joseph, M. H., and Gray, J. A. (1993). Latent inhibition of conditioned dopamine release in ratnucleus accumbens. Neuroscience 54, 5-9.