On the role of subsecond dopamine release in conditioned avoidance

Frontiers in Neuroscience

Volumn , Issue 7 JUN, 2013, Pages

  Oleson, Erik B ^a   Cheer, Joseph F ^a  

^a UNIVERSITY OF MARYLAND SCHOOL OF MEDICINE   (United States)

Author keywords

Conditioned avoidance; Dopamine; Fear conditioning; Nucleus accumbens; Voltammetry

Indexed keywords

DOPAMINE;

AVOIDANCE BEHAVIOR; BEHAVIOR; DOPAMINE RELEASE; DOPAMINERGIC NERVE CELL; ESCAPE BEHAVIOR; FEAR; MEDICAL LITERATURE; MESOLIMBIC DOPAMINERGIC SYSTEM; NEUROMODULATION; NONHUMAN; NUCLEUS ACCUMBENS; REINFORCEMENT; REVIEW; SIGNAL TRANSDUCTION;

EID: 84887124492     PISSN: 16624548     EISSN: 1662453X     Source Type: Journal    
DOI: 10.3389/fnins.2013.00096     Document Type: Review

References (70)

1. Amalric, M., and Koob, G. F. (1987). Depletion of dopamine in the caudate nucleus but not in nucleus accumbens impairs reaction-time performance in rats. J. Neurosci. 7, 2129-2134.
2. Arnt, J. (1982). Pharmacological specificity of conditioned avoidance response inhibition in rats: inhibition by neuroleptics and correlation to dopamine receptor blockade. Acta Pharmacol. Toxicol. 51, 321-329.
3. Badrinarayan, A., Wescott, S. A., Vander Weele, C. M., Saunders, B. T., Couturier, B. E., Maren, S., et al. (2012). Aversive stimuli differentially modulate real-time dopamine transmission dynamics within the nucleus accumbens core and shell. J. Neurosci. 32, 15779-15790. doi: 10.1523/JNEUROSCI.3557-12.2012
4. Bechterev, V. M. (1913). The Psychologie Objective. Paris: Alcan.
5. Bolles, R. C. (1972). The avoidance learning problem. Psychol. Learn. Motiv. Adv. Res. Theory 6, 97.
6. Brady, A. M., and O'Donnell, P. (2004). Dopaminergic modulation of prefrontal cortical input to nucleus accumbens neurons in vivo. J. Neurosci. 24, 1040-1049. doi: 10.1523/JNEUROSCI.4178-03.2004
7. Bromberg-Martin, E. S., Matsumoto, M., and Hikosaka, O. (2010). Distinct tonic and phasic anticipatory activity in lateral habenula and dopamine neurons. Neuron 67, 144-155. doi: 10.1016/j.neuron.2010.06.016
8. Cardinal, R. N., Parkinson, J. A., Hall, J., and Everitt, B. J. (2002). Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neurosci. Biobehav. Rev. 26, 321-352. doi: 10.1016/S0149-7634(02)00007-6
9. Cooper, B. R., Breese, G. R., Grant, L. D., and Howard, J. L. (1973). Effects of 6-hydroxydopamine treatments on active avoidance responding: evidence for involvement of brain dopamine. J. Pharmacol. Exp. Therapeut. 185, 358-370.
10. Darvas, M., Fadok, J. P., and Palmiter, R. D. (2011). Requirement of dopamine signaling in the amygdala and striatum for learning and maintenance of a conditioned avoidance response. Learn. Mem. 18, 136-143. doi: 10.1101/lm.2041211
11. Davis, M. (1992). "The role of the amygdala in conditioned fear," in The Amygdala: Neurobiological Aspects of Emotion, Memory, and Mental Dysfunction, ed J. P. Aggleton (New York, NY: Wiley-Liss), 255-306.
12. DeLong, M. R., and Wichmann, T. (2007). Circuits and circuit disorders of the basal ganglia. Arch. Neurol. 64, 20. doi: 10.1001/archneur.64.1.20
13. Depue, R. A., and Collins, P. F. (1999). Neurobiology of the structure of personality: dopamine, facilitation of incentive motivation, and extraversion. Behav. Brain Sci. 22, 491-517. doi: 10.1017/S0140525X99002046
14. Dinsmoor, J. A. (1954). Punishment: I. The avoidance hypothesis. Psychol. Rev. 61, 34. doi: 10.1037/h0062725
15. Dinsmoor, J. A. (2001). Stimuli inevitably generated by behavior that avoids electric shock are inherently reinforcing. J. Exp. Anal. Behav. 75, 311. doi: 10.1901/jeab.2001.75-311
16. Dinsmoor, J. A., and Sears, G. W. (1973). Control of avoidance by a response-produced stimulus. Learn. Motiv. 4, 284-293. doi: 10.1016/0023-9690(73)90018-0
17. Dombrowski, P. A., Maia, T. V., Boschen, S. L., Bortolanza, M., Wendler, E., Schwarting, R. K., et al. (2012). Evidence that conditioned avoidance responses are reinforced by positive prediction errors signaled by tonic striatal dopamine. Behav. Brain Res. 241, 112-119. doi: 10.1016/j.bbr.2012.06.031
18. Dreyer, J. K., Herrik, K. F., Berg, R. W., and Hounsgaard, J. D. (2010). Influence of phasic and tonic dopamine release on receptor activation. J. Neurosci. 30, 14273-14283. doi: 10.1523/JNEUROSCI.1894-10.2010
19. Everitt, B. J., and Robbins, T. W. (2005). Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nat. Neurosci. 8, 1481-1489. doi: 10.1038/nn1579
20. Feenstra, M. G., Vogel, M., Botterblom, M. H., Joosten, R. N., and de Bruin, J. P. (2001). Dopamine and noradrenaline efflux in the rat prefrontal cortex after classical aversive conditioning to an auditory cue. Eur. J. Neurosci. 13, 1051-1054. doi: 10.1046/j.0953-816x.2001.01471.x
21. Fibiger, H. C., Zis, A. P., and Phillips, A. G. (1975). Haloperidol-induced disruption of conditioned avoidance responding: attenuation by prior training or by anticholinergic drugs. Eur. J. Pharmacol. 30, 309-314. doi: 10.1016/0014-2999(75)90114-4
22. Floresco, S. B., Blaha, C. D., Yang, C. R., and Phillips, A. G. (2001). Modulation of hippocampal and amygdalar-evoked activity of nucleus accumbens neurons by dopamine: cellular mechanisms of input selection. J. Neurosci. 21, 2851-2860.
23. Gabriel, M. (1993). "Discriminative avoidance learning: a model system," in Neurobiology of Cingulate Cortex and Limbic Thalamus: A Comprehensive Handbook, eds B. A. Vogt and G. Michael (Cambridge, MA: Birkhäuser), 478-523.
24. Gabriel, M., Kubota, Y., Sparenborg, S., Straube, K., and Vogt, B. A. (1991). Effects of cingulate cortical lesions on avoidance learning and training-induced unit activity in rabbits. Exp. Brain Res. 86, 585-600. doi: 10.1007/BF00230532
25. Gabriel, M., Sparenborg, S., and Kubota, Y. (1989). Anterior and medial thalamic lesions, discriminative avoidance learning, and cingulate cortical neuronal activity in rabbits. Exp. Brain Res. 76, 441-457. doi: 10.1007/BF00247901
26. Garcia, R., Vouimba, R. M., Baudry, M., and Thompson, R. F. (1999). The amygdala modulates prefrontal cortex activity relative to conditioned fear. Nature 402, 294-296. doi: 10.1038/46286
27. Grace, A. A. (1991). Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: a hypothesis for the etiology of schizophrenia. Neuroscience 41, 1-24. doi: 10.1016/0306-4522(91)90196-U
28. Hollon, N. G., Soden, M. E., and Wanat, M. J. (2013). Dopaminergic prediction errors persevere in the nucleus accumbens core during negative reinforcement. J. Neurosci. 33, 3253-3255. doi: 10.1523/JNEUROSCI.5762-12.2013
29. Kamin, L. J., Brimer, C. J., and Black, A. H. (1963). Conditioned suppression as a monitor of fear of the CS in the course of avoidance training. J. Comp. Physiol. Psychol. 56, 497. doi: 10.1037/h0047966
30. Kapur, S. (2003). Psychosis as a state of aberrant salience: a framework linking biology, phenomenology, and pharmacology in schizophrenia. Am. J. Psychiatry 160, 13-23. doi: 10.1176/appi.ajp.160.1.13
31. Kapur, S., Mizrahi, R., and Li, M. (2005). From dopamine to salience to psychosis-linking biology, pharmacology and phenomenology of psychosis. Schizophr. Res. 79, 59-68. doi: 10.1016/j.schres.2005.01.003
32. Kravitz, A. V., Freeze, B. S., Parker, P. R., Kay, K., Thwin, M. T., Deisseroth, K., et al. (2010). Regulation of parkinsonian motor behaviours by optogenetic control of basal ganglia circuitry. Nature 466, 622-626. doi: 10.1038/nature09159
33. Lashley, K. S. (1916). Reflex secretion of the human parotid gland. J. Exp. Psychol. 1, 461. doi: 10.1037/h0073282
34. LeDoux, J. (2003). The emotional brain, fear, and the amygdala. Cell. Mol. Neurobiol. 23, 727-738.
35. Ledoux, J. E., and Muller, J. (1997). Emotional memory and psychopathology. Philos. Trans. R. Soc. Lond. B Biol. Sci. 352, 1719-1726. doi: 10.1098/rstb.1997.0154
36. Maia, T. V. (2010). Two-factor theory, the actor-critic model, and conditioned avoidance. Learn. Behav. 38, 50-67. doi: 10.3758/LB.38.1.50
37. McClure, S. M., Daw, N. D., and Read Montague, P. (2003). A computational substrate for incentive salience. Trends Neurosci. 26, 423-428. doi: 10.1016/S0166-2236(03)00177-2
38. McCullough, L. D., Sokolowski, J. D., and Salamone, J. D. (1993). A neurochemical and behavioral investigation of the involvement of nucleus accumbens dopamine in instrumental avoidance. Neuroscience 52, 919-925. doi: 10.1016/0306-4522(93)90538-Q
39. McGinty, V. B., Hayden, B. Y., Heilbronner, S. R., Dumont, E. C., Graves, S. M., Mirrione, M. M., et al. (2011). Emerging, reemerging, and forgotten brain areas of the reward circuit: notes from the 2010 motivational neural networks conference. Behav. Brain Res. 225, 348-357. doi: 10.1016/j.bbr.2011.07.036
40. Miller, N. E. (1948). Studies of fear as an acquirable drive: I. Fear as motivation and fear-reduction as reinforcement in the learning of new responses. J. Exp. Psychol. 38, 89.
41. Mogenson, G. J., Jones, D. L., and Yim, C. Y. (1980). From motivation to action: functional interface between the limbic system and the motor system. Prog. Neurobiol. 14, 69-97. doi: 10.1016/0301-0082(80)90018-0
42. Morgan, M. A., and LeDoux, J. E. (1995). Differential contribution of dorsal and ventral medial prefrontal cortex to the acquisition and extinction of conditioned fear in rats. Behav. Neurosci. 109, 681.
43. Moutoussis, M., Bentall, R. P., Williams, J., and Dayan, P. (2008). A temporal difference account of avoidance learning. Network 19, 137-160. doi: 10.1080/09548980802192784
44. Mowrer, O. H. (1951). Two-factor learning theory: summary and comment. Psychol. Rev. 58, 350.
45. Mowrer, O. H., and Aiken, E. G. (1954). Contiguity vs. drive-reduction in conditioned fear: temporal variations in conditioned and unconditioned stimulus. Am. J. Psychol. 67, 26-38.
46. Nasser, H. M., and McNally, G. P. (2012). Appetitive-aversive interactions in Pavlovian fear conditioning. Behav. Neurosci. 126, 404. doi: 10.1037/a0028341
47. Navratilova, E., Xie, J. Y., Okun, A., Qu, C., Eyde, N., Ci, S., et al. (2012). Pain relief produces negative reinforcement through activation of mesolimbic reward-valuation circuitry. Proc. Natl. Acad. Sci. U.S.A. 109, 20709-20713. doi: 10.1073/pnas.1214605109
48. Oleson, E. B., Gentry, R. N., Chioma, V. C., and Cheer, J. F. (2012). Subsecond dopamine release in the nucleus accumbens predicts conditioned punishment and its successful avoidance. J. Neurosci. 32, 14804-14808. doi: 10.1523/JNEUROSCI.3087-12.2012
49. Pavlov, I. P. (2003). Conditioned Reflexes, Mineola: Dover Publications.
50. Perry, M., Li, Q., and Kennedy, R. T. (2009). Review of recent advances in analytical techniques for the determination of neurotransmitters. Anal. Chim. Acta 653, 1-22. doi: 10.1016/j.aca.2009.08.038
51. Poremba, A., and Gabriel, M. (1999). Amygdala neurons mediate acquisition but not maintenance of instrumental avoidance behavior in rabbits. J. Neurosci. 19, 9635-9641.
52. Rescorla, R. A. (1969). Establishment of a positive reinforcer through contrast with shock. J. Comp. Physiol. Psychol. 67, 260.
53. Schultz, W., Dayan, P., and Montague, P. R. (1997). A neural substrate of prediction and reward. Science 275, 1593-1599. doi: 10.1126/science.275.5306.1593
54. Sidman, M. (1953). Avoidance conditioning with brief shock and no exteroceptive warning signal. Science 118, 157-158. doi: 10.1126/science.118.3058.157
55. Skinner, B. F. (1938). The Behavior of Organisms: An Experimental Analysis, New York, NY: Appleton-Century.
56. Smith, A. J., Becker, S., and Kapur, S. (2005). A computational model of the functional role of the ventral-striatal D2 receptor in the expression of previously acquired behaviors. Neural Comput. 17, 361-395. doi: 10.1162/0899766053011546
57. Solomon, R. L., and Corbit, J. D. (1974). An opponent-process theory of motivation: I. Temporal dynamics of affect. Psychol. Rev. 81, 119-145. doi: 10.1037/h0036128
58. Solomon, R. L., Kamin, L. J., and Wynne, L. C. (1953). Traumatic avoidance learning: the outcomes of several extinction procedures with dogs. J. Abnorm. Psychol. 48, 291. doi: 10.1037/h0058943
59. Spanagel, R., and Weiss, F. (1999). The dopamine hypothesis of reward: past and current status. Trends Neurosci. 22, 521-527. doi: 10.1016/S0166-2236(99)01447-2
60. Sutton, R. S. (1988). Learning to predict by the methods of temporal differences. Mach. Learn. 3, 9-44. doi: 10.1007/BF00115009
61. Swanson, L. W. (1982). The projections of the ventral tegmental area and adjacent regions: a combined fluorescent retrograde tracer and immunofluorescence study in the rat. Brain Res. Bull. 9, 321-353. doi: 10.1016/0361-9230(82)90145-9
62. Wadenberg, M. L., Ericson, E., Magnusson, O., and Ahlenius, S. (1990). Suppression of conditioned avoidance behavior by the local application of (-) sulpiride into the ventral, but not the dorsal, striatum of the rat. Biol. Psychiatry 28, 297-307. doi: 10.1016/0006-3223(90)90657-N
63. Warner, L. H. (1932). The association span of the white rat. J. Genet. Psychol. 41, 57-90. doi: 10.1080/08856559.1932.9944143
64. Watson, J. B. (1916). The place of the conditioned-reflex in psychology. Psychol. Rev. 23, 89. doi: 10.1037/h0070003
65. Weisman, R. G., and Litner, J. S. (1969). Positive conditioned reinforcement of Sidman avoidance behavior in rats. J. Comp. Physiol. Psychol. 68, 597.
66. Wilkinson, L. S., Humby, T., Killcross, A. S., Torres, E. M., Everitt, B. J., and Robbins, T. W. (1998). Dissociations in dopamine release in medial prefrontal cortex and ventral striatum during the acquisition and extinction of classical aversive conditioning in the rat. Eur. J. Neurosci. 10, 1019-1026. doi: 10.1046/j.1460-9568.1998.00119.x
67. Willuhn, I., Burgeno, L. M., Everitt, B. J., and Phillips, P. E. (2012). Hierarchical recruitment of phasic dopamine signaling in the striatum during the progression of cocaine use. Proc. Natl. Acad. Sci.U.S.A. 109, 20703-20708. doi: 10.1073/pnas.1213460109
68. Wise, R. A. (2004). Dopamine, learning and motivation. Nat. Rev. Neurosci. 5, 483-494. doi: 10.1038/nrn1406
69. Young, A. M., Joseph, M. H., and Gray, J. A. (1993). Latent inhibition of conditioned dopamine release in rat nucleus accumbens. Neuroscience 54, 5-9. doi: 10.1016/0306-4522(93)90378-S
70. Zis, A. P., Fibiger, H. C., and Phillips, A. G. (1974). Reversal by L-dopa of impaired learning due to destruction of the dopaminergic nigro-neostriatal projection. Science 185, 960-962. doi: 10.1126/science.185.4155.960