Contribution of emotional and motivational neurocircuitry to cue-signaled active avoidance learning

Frontiers in Behavioral Neuroscience

Volumn 8, Issue October, 2014, Pages

  Ilango, Anton ^a   Shumake, Jason ^b   Wetzel, Wolfram ^a   Ohl, Frank W ^a,c,d  

^a Leibniz Institute for Neurobioiogy   (Germany)

^b UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^c OTTO VON GUERICKE UNIVERSITY   (Germany)

^d Center for Brain and Behavioral Sciences (CBBS)   (Germany)

Author keywords

Active avoidance; Amygdala; Dopamine; Neural circuits; Punishment; Safety signal; Striatum

Indexed keywords

DOPAMINE;

AMYGDALOID NUCLEUS; ARTICLE; AVERSION; AVOIDANCE BEHAVIOR; DOPAMINE RELEASE; EMOTION; HUMAN; MOTIVATION; NOCICEPTIVE STIMULATION; PARABRACHIAL NUCLEUS; PREFRONTAL CORTEX; PUNISHMENT; VENTRAL TEGMENTUM;

EID: 84908372048     PISSN: 16625153     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnbeh.2014.00372     Document Type: Article

References (54)

1. Belin, D., and Everitt, B. J. (2008). Cocaine seeking habits depend upon dopamine-dependent serial connectivity linking the ventral with the dor-sal striatum. Neuron 57, 432-441. doi:10.1016/j.neuron.2007.12.019
2. Beutler, L. R., Eldred, K. C., Quintana, A., Keene, C. D., Rose, S. E., Postupna, N., et al. (2011). Severely impaired learning and altered neuronal morphology in mice lacking NMDA receptors in medium spiny neurons. PLoS ONE 6:e28168. doi:10.1371/ journal.pone.0028168
3. Bortolanza, M., Wietzikoski, E. C., Boschen, S. L., Dombrowski, P. A., Latimer, M., Maclaren, D. A., et al. (2010). Functional disconnection of the substantia nigra pars compacta from the peduncu- lopontine nucleus impairs learning of a conditioned avoidance task. Neurobiol. Learn. Mem. 94, 229-239. doi:10.1016/j.nlm.2010.05.011
4. Boschen, S. L., Wietzikoski, E. C., Winn, P., and Da Cunha, C. (2011). The role of nucleus accum- bens and dorsolateral striatal D2 receptors in active avoidance conditioning. Neurobiol. Learn. Mem. 96, 254-262. doi:10.1016/j.nlm.2011.05.002
5. Bromberg-Martin, E. S., Matsumoto, M., and Hikosaka, O. (2010). Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 68, 815-834. doi:10.1016/j.neuron.2010.11.022
6. Choi, J. S., Cain, C. K., and LeDoux, J. E. (2010). The role of amygdala nuclei in the expression of auditory signaled two-way active avoidance in rats. Learn. Mem. 17, 139-147. doi:10.1101/lm.1676610
7. Coizet, V., Dommett, E. J., Klop, E. M., Redgrave, P., and Overton, P. G. (2010). The parabrachial nucleus is a critical link in the transmission of short latency nociceptive information to midbrain dopaminergic neurons. Neuroscience 168,263-272. doi:10.1016/j.neuroscience.2010.03.049
8. Corbit, L. H., and Balleine, B. W. (2005). Double dissociation of basolateral and central amygdala lesions on the general and outcome-specific forms of pavlovian-instrumental transfer. J. Neurosci. 25, 962-970. doi:10.1523/JNEUR0SCI.4507- 04.2005
9. Darvas, M., Fadok, J. P., and Palmiter, R. D. (2011). Requirement of dopamine signaling in the amygdala and striatum for learning and maintenance of a conditioned avoidance response. Learn. Mem. 18, 136-143. doi:10.1101/lm.2041211
10. Dombrowski, P. A., Maia, T. V., Boschen, S. L., Bortolanza, M., Wendler, E., Schwarting, R. K., et al. (2013). Evidence that conditioned avoidance responses are reinforced by positive prediction errors signaled by tonic striatal dopamine. Behav. Brain Res. 241,112-119. doi:10.1016/j.bbr.2012.06.031
11. Fujimoto, K., Yoshida, M., Ikeguchi, K., and Niijima, K. (1989). Impairment of active avoidance produced after destruction of pedunculopontine nucleus areas in the rat. Neurosci. Res. 6, 321-328. doi:10.1016/0168-0102(89)90024-2
12. Horvitz, J. C. (2000). Mesolimbocortical and nigros-triatal dopamine responses to salient non-reward events. Neuroscience 96, 651-656. doi:10.1016/S0306-4522(00)00019-1
13. Ilango, A., Kesner, A. J., Keller, K. L., Stuber, G. D., Bonci, A., and Ikemoto, S. (2014). Similar roles of substantia nigra and ventral tegmental dopamine neurons in reward and aversion. J. Neurosci. 34, 817-822. doi:10.1523/JNEUR0SCI.1703-13.2014
14. Ilango, A., Shumake, J., Wetzel, W., Scheich, H., and Ohl, F. W. (2011). Effects of ventral tegmental area stimulation on the acquisition and long-term retention of active avoidance learning. Behav. Brain Res. 225,515-521. doi:10.1016/j.bbr.2011.08.014
15. Ilango, A., Shumake, J., Wetzel, W., Scheich, H., and Ohl, F. W. (2012). The role of dopamine in the context of aversive stimuli with particular reference to acoustically signaled avoidance learning. Front. Neurosci. 6:132. doi:10.3389/fnins.2012.00132
16. Ilango, A., Shumake, J., Wetzel, W., Scheich, H., and Ohl, F. W. (2013). Electrical stimulation of lateral habenula during learning: frequency-dependent effects onacquisitionbutnot retrieval ofatwo-way active avoidance response. PLoS ONE 8:e65684. doi:10.1371/journal.pone.0065684
17. Jhou, T. C., Fields, H. L., Baxter, M. G., Saper, C. B., and Holland P. C. (2009). The rostromedial tegmen-tal nucleus (RMTg), a GABAergic afferent to mid-brain dopamine neurons, encodes aversive stimuli and inhibits motor responses. Neuron 61, 786-800. doi:10.1016/j.neuron.2009.02.001
18. Lammel, S., Lim, B. K., and Malenka, R. C. (2014). Reward and aversion in a heterogeneous mid-brain dopamine system. Neuropharmacology 76, 351-359. doi:10.1016/j.neuropharm.2013.03.019
19. Lammel, S., Lim, B. K., Ran, C., Huang, K.W., Betley, M. J., Tye, K. M.,et al. (2012). Input-specific control of reward and aversion in the ventral tegmental area. Nature 491,212-217. doi:10.1038/nature11527
20. Lazaro-Munoz, G., LeDoux, J. E., and Cain, C. K. (2010). Sidman instrumental avoidance initially depends on lateral and basal amygdala and is con-strained by central amygdala-mediated Pavlovian processes. Biol. Psychiatry 67, 1120-1127. doi:10.1016/j.biopsych.2009.12.002
21. LeDoux, J. E. (2000). Emotion circuits in the brain. Annu. Rev. Neurosci. 2, 155-184. doi:10.1146/annurev.neuro.23.1.155
22. Lee, H. J., Youn, J. M., Gallagher M., and Holland P. C. (2008).Temporallylimitedroleofsubstantianigra-central amygdala connections in surprise-induced enhancement of learning. Eur. J. Neurosci. 27, 3043-3049. doi:10.1111/j.1460-9568.2008.06272.x
23. Lee, H. J., Youn, J. M., O, M. J., Gallagher M., and Holland P. C. (2006). Role of substantia nigra-amygdala connections in surprise-induced enhancement of attention. J. Neurosci. 26, 6077-6081. doi:10.1523/JNEUR0SCI.1316-06.2006
24. Lingawi, N. W., and Balleine, B. W. (2012). Amygdala central nucleus interacts with dorsolateral striatum to regulate the acquisition of habits. J. Neurosci. 32,1073-1081. doi:10.1523/JNEUR0SCI.4806-11.2012
25. Mena-Segovia, J., Winn, P., and Bolam, J. P. (2008). Cholinergic modulation of midbrain dopaminer-gic systems. Brain Res. Rev. 58, 265-271. doi:10. 1016/j.brainresrev.2008.02.003
26. Miller, N. E. (1948). Studies of fear as an acquirable drive fear as motivation and fear-reduction as rein-forcement in the learning of new responses. J. Exp. Psychol. 38, 89-101. doi:10.1037/h0058455
27. Moscarello, J. M., and LeDoux, J. E. (2013). Active avoidance learning requires prefrontal suppression of amygdala-mediated defensive reactions. J. Neu- rosci. 33, 3815-3823. doi:10.1523/JNEUROSCI.2596-12.2013
28. Mowrer, O. H., and Lamoreaux, R. R. (1946). Fear as an intervening variable in avoidance condi-tioning. J. Comp. Psychol. 39, 29-50. doi:10.1037/h0060150
29. Oleson, E. B., Gentry, R. N., Chioma, V. C., and Cheer, J. F. (2012). Subsecond dopamine release in the nucleus accumbens predicts conditioned pun-ishment and its successful avoidance. J. Neurosci. 32, 14804-14808. doi:10.1523/JNEUROSCI.3087- 12.2012
30. Paton, J. J., Belova, M. A., Morrison, S. E., and Salz-man, C. D. (2006). The primate amygdala repre-sents the positive and negative value of visual stim-uli during learning. Nature 439, 865-870. doi:10.1038/nature04490
31. Poremba, A., and Gabriel, M. (1997). Amygdalar lesions block discriminative avoidance learning and cingulothalamic training-induced neuronal plas-ticity in rabbits. J. Neurosci. 17, 5237-5244.
32. Poremba, A., and Gabriel, M. (1999). Amygdala neurons mediate acquisition but not maintenance of instrumental avoidance behavior in rabbits. J. Neurosci. 19, 9635-9641.
33. Roozendaal, B., Koolhaas, J. M., and Bohus, B. (1993). The central amygdala is involved in conditioning but not in retention of active and passive shock avoidance in male rats. Behav. Neural Biol. 59, 143-149. doi:10.1016/0163-1047(93)90873-G
34. Rouillard, C., and Freeman, A. S. (1995). Effects of electrical stimulation of the central nucleus of the amygdala on the in vivo electrophysiological activ-ity of rat nigral dopaminergic neurons. Synapse 21, 348-356. doi:10.1002/syn.890210410
35. Salamone, J. D. (1994). The involvement of nucleus accumbens dopamine in appetitive and aversive motivation. Behav. Brain Res. 61, 117-133. doi:10.1016/0166-4328(94)90153-8
36. Savonenko, A., Werka, T., Nikolaev E., Zielinski K., and Kaczmarek L. (2003). Complex effects of NMDA receptor antagonist APV in the basolateral amyg-dala on acquisition of two-way avoidance reac-tion and long-term fear memory. Learn. Mem. 10, 293-303. doi:10.1101/lm.58803
37. Segura-Torres, P., Aldavert-Vera, L., Gatell-Segura, A., Redolar-Ripoll, D., and Morgado-Bernal, I. (2010). Intracranial self-stimulation recovers learning and memorycapacityinbasolateralamygdala-damaged rats. Neurobiol. Learn. Mem. 93, 117-126. doi:10.1016/j.nlm.2009.09.001
38. Shumake, J., and Gonzalez-Lima, F. (2013). Functional opposition between habenula metabolism and the brain reward system. Front. Hum. Neurosci. 7:662. doi:10.3389/fnhum.2013.00662
39. Shumake, J., Ilango, A., Scheich, H., Wetzel, W., and Ohl, F. W. (2010). Differential neuromodulation of acquisition and retrieval of avoidance learn-ing by the lateral habenula and ventral tegmen-tal area. J. Neurosci. 30, 5876-5883. doi:10.1523/ JNEUROSCI.3604-09.2010
40. Singer, P., Wei, C. J., Chen, J. F., Boison, D., and Yee, B. K. (2013). Deletion of striatal adenosineA(2A) receptor spares latent inhibition and prepulse inhibition but impairs active avoidance learning. Behav. Brain Res. 242, 54-61. doi:10.1016/j.bbr.2012.12.024
41. Smith, D. M., Monteverde, J., Schwartz, E., Freeman, J. H. Jr., and Gabriel, M. (2001). Lesions in the central nucleus of the amygdala: discriminative avoidance learning, discriminative approach learning, and cingulothalamic training-induced neuronal activ-ity. Neurobiol. Learn. Mem. 76, 403-425. doi:10. 1006/nlme.2001.4019
42. Stamatakis, A. M., Jennings, J. H., Ung, R. L., Blair, G. A., Weinberg, R. J., Neve, R. L., et al. (2013). A unique population of ventral tegmental area neurons inhibits the lateral habenula to pro-mote reward. Neuron 80, 1039-1053. doi:10.1016/ j.neuron.2013.08.023
43. Stamatakis, A. M., and Stuber, G. D. (2012). Activation of lateral habenula inputs to the ventral midbrain promotes behavioral avoidance. Nat. Neurosci. 15, 1105-1107. doi:10.1038/nn.3145
44. Stark, H., Bischof, A., and Scheich, H. (1999). Increase of extracellular dopamine in prefrontal cortex of gerbils during acquisition of the avoidance strat-egy in the shuttle-box. Neurosci. Lett. 264, 77-80. doi:10.1016/S0304-3940(99)00174-3
45. Stark, H., Bischof, A., Wagner, T., and Scheich, H. (2001). Activation of the dopaminergic system of medial prefrontal cortex of gerbils during for-mation of relevant associations for the avoidance strategy in the shuttle-box. Prog. Neuropsychopharmacol. Biol. Psychiatry 25, 409-426. doi:10.1016/ S0278-5846(00)00171-8
46. Stark, H., Rothe, T., Wagner, T., and Scheich, H. (2004). Learning a new behavioral strategy in the shuttle-box increases prefrontal dopamine. Neu-roscience 126, 21-29. doi:10.1016/j.neuroscience.2004.02.026
47. Stuber, G. D., Hnasko, T. S., Britt, J. P., Edwards, R. H., and Bonci, A. (2010). Dopaminergic terminals in the nucleus accumbens but not the dorsal striatum corelease glutamate. J. Neurosci. 30, 8229-8233. doi:10.1523/JNEUROSCI.1754-10.2010
48. Tritsch, N. X., Ding, J. B., and Sabatini, B. L. (2012). Dopaminergic neurons inhibit striatal output through non-canonical release of GABA. Nature 490, 262-266. doi:10.1038/nature11466
49. Tye, K. M., and Janak, P. H. (2007). Amygdala neurons differentially encode motivation and rein-forcement. J. Neurosci. 27, 3937-3945. doi:10.1523/ JNEUROSCI.5281-06.2007
50. Tye, K. M., Stuber, G. D., de Ridder, B., Bonci, A., and Janak, P. H. (2008). Rapid strengthen-ing of thalamo-amygdala synapses mediates cue- reward learning. Nature 453, 1253-1257. doi:10.1038/nature06963
51. Wendler, E., Gaspar, J. C., Ferreira, T. L., Barbiero, J. K., Andreatini, R., Vital, M. A., et al. (2014). The roles of the nucleus accumbens core, dor-somedial striatum, and dorsolateral striatum in learning: performance and extinction of Pavlov-ian fear-conditioned responses and instrumental avoidance responses. Neurobiol. Learn. Mem. 109, 27-36. doi:10.1016/j.nlm.2013.11.009
52. Wietzikoski, E. C., Boschen, S. L., Miyoshi, E., Bor- tolanza, M., Dos Santos, L. M., Frank, M., et al. (2012). Roles ofD1-like dopamine receptors in the nucleus accumbens and dorsolateral striatum in conditioned avoidance responses. Psychopharma-cology (Berl.) 219, 159-169. doi:10.1007/s00213- 011-2384-3
53. Wilson, J. R., Mitchell, J. C., and Van Hoesen, G. W. (1972). Epithalamic and ventral tegmental contributions to avoidance behavior in rats. J. Comp. Physiol. Psychol. 78, 442-449. doi:10.1037/ h0032371
54. Yin, H. H., and Knowlton, B. J. (2006). The role of the basal ganglia in habit formation. Nat. Rev. Neurosci. 7, 464-476. doi:10.1038/nrn1919