Dopamine and extinction: A convergence of theory with fear and reward circuitry

Neurobiology of Learning and Memory

Volumn 108, Issue , 2014, Pages 65-77

  Abraham, Antony D ^a   Neve, Kim A ^a   Lattal, K Matthew ^a  

^a OREGON HEALTH AND SCIENCE UNIVERSITY   (United States)

Author keywords

Amygdala; Dopamine; Extinction; Fear; Learning; Memory; Nucleus accumbens; Ventral tegmental area

Indexed keywords

AMYGDALA; DOPAMINE; EXTINCTION; FEAR; LEARNING; MEMORY; NUCLEUS ACCUMBENS; VENTRAL TEGMENTAL AREA;

ANIMALS; BRAIN; CONDITIONING (PSYCHOLOGY); DOPAMINE; EXTINCTION, PSYCHOLOGICAL; FEAR; HUMANS; LEARNING; MICE; RATS; REWARD;

EID: 84893720325     PISSN: 10747427     EISSN: 10959564     Source Type: Journal    
DOI: 10.1016/j.nlm.2013.11.007     Document Type: Review

References (143)

1. Abraham A.D., Cunningham C.L., Lattal K.M. Methylphenidate enhances extinction of contextual fear. Learning & Memory 2012, 19(2):67-72. 10.1101/lm.024752.111.
2. Allen J.A., Yost J.M., Setola V., Chen X., Sassano M.F., Chen M., et al. Discovery of beta-arrestin-biased dopamine D2 ligands for probing signal transduction pathways essential for antipsychotic efficacy. Proceedings of the National Academy of Sciences of the United States of America 2011, 108(45):18488-18493. 10.1073/pnas.1104807108.
3. Arnt J., Hyttel J., Sanchez C. Partial and full dopamine D1 receptor agonists in mice and rats: Relation between behavioural effects and stimulation of adenylate cyclase activity in vitro. European Journal of Pharmacology 1992, 213(2):259-267.
4. Badrinarayan A., Wescott S.A., Vander Weele C.M., Saunders B.T., Couturier B.E., Maren S., et al. Aversive stimuli differentially modulate real-time dopamine transmission dynamics within the nucleus accumbens core and shell. Journal of Neuroscience 2012, 32(45):15779-15790. 10.1523/JNEUROSCI.3557-12.2012.
5. Balleine B.W., Killcross S. Parallel incentive processing: An integrated view of amygdala function. Trends in Neurosciences 2006, 29(5):272-279. 10.1016/j.tins.2006.03.002.
6. Beaulieu J.M., Gainetdinov R.R. The physiology, signaling, and pharmacology of dopamine receptors. Pharmacological Reviews 2011, 63(1):182-217. 10.1124/pr.110.002642.
7. Beaulieu J.M., Sotnikova T.D., Marion S., Lefkowitz R.J., Gainetdinov R.R., Caron M.G. An Akt/beta-arrestin 2/PP2A signaling complex mediates dopaminergic neurotransmission and behavior. Cell 2005, 122(2):261-273. 10.1016/j.cell.2005.05.012.
8. Beaulieu J.M., Sotnikova T.D., Yao W.D., Kockeritz L., Woodgett J.R., Gainetdinov R.R., et al. Lithium antagonizes dopamine-dependent behaviors mediated by an AKT/glycogen synthase kinase 3 signaling cascade. Proceedings of the National Academy of Sciences of the United States of America 2004, 101(14):5099-5104. 10.1073/pnas.0307921101.
9. Belin D., Belin-Rauscent A., Murray J.E., Everitt B.J. Addiction: Failure of control over maladaptive incentive habits. Current Opinion in Neurobiology 2013, 23(4):564-572. 10.1016/j.conb.2013.01.025.
10. Berridge C.W., Devilbiss D.M., Andrzejewski M.E., Arnsten A.F., Kelley A.E., Schmeichel B., et al. Methylphenidate preferentially increases catecholamine neurotransmission within the prefrontal cortex at low doses that enhance cognitive function. Biological Psychiatry 2006, 60(10):1111-1120. 10.1016/j.biopsych.2006.04.022.
11. Berridge K.C., Robinson T.E. Parsing reward. Trends in Neurosciences 2003, 26(9):507-513. 10.1016/S0166-2236(03)00233-9.
12. Borowski T.B., Kokkinidis L. The effects of cocaine, amphetamine, and the dopamine D1 receptor agonist SKF 38393 on fear extinction as measured with potentiated startle: Implications for psychomotor stimulant psychosis. Behavioral Neuroscience 1998, 112(4):952-965.
13. Bouton M.E. Context, time, and memory retrieval in the interference paradigms of Pavlovian learning. Psychological Bulletin 1993, 114(1):80-99.
14. Bouton M.E., Bolles R.C. Contextual control of the extinction of conditioned fear. Learning and Motivation 1979, 10(4):445-446. 10.1016/0023-9690(79)90057-2.
15. Bouton M.E., Peck C.A. Spontaneous recovery in cross-motivational transfer (counterconditioning). Animal Learning & Behavior 1992, 20(4):313-321.
16. Bradfield L.A., McNally G.P. The role of nucleus accumbens shell in learning about neutral versus excitatory stimuli during Pavlovian fear conditioning. Learning & Memory 2010, 17(7):337-343. 10.1101/lm.1798810.
17. Brewster W.K., Nichols D.E., Riggs R.M., Mottola D.M., Lovenberg T.W., Lewis M.H., et al. Trans-10,11-dihydroxy-5,6,6a,7,8,12b-hexahydrobenzo[a]phenanthridine: A highly potent selective dopamine D1 full agonist. Journal of Medicinal Chemistry 1990, 33(6):1756-1764.
18. Brischoux F., Chakraborty S., Brierley D.I., Ungless M.A. Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli. Proceedings of the National Academy of Sciences of the United States of America 2009, 106(12):4894-4899. 10.1073/pnas.0811507106.
19. Bromberg-Martin E.S., Matsumoto M., Hikosaka O. Dopamine in motivational control: Rewarding, aversive, and alerting. Neuron 2010, 68(5):815-834. 10.1016/j.neuron.2010.11.022.
20. Buckley C.T., Caldwell K.K. Fear conditioning is associated with altered integration of PLC and ERK signaling in the hippocampus. Pharmacology, Biochemistry and Behavior 2004, 79(4):633-640.
21. Budygin E.A., Park J., Bass C.E., Grinevich V.P., Bonin K.D., Wightman R.M. Aversive stimulus differentially triggers subsecond dopamine release in reward regions. Neuroscience 2012, 201:331-337. 10.1016/j.neuroscience.2011.10.056.
22. Busti D., Geracitano R., Whittle N., Dalezios Y., Manko M., Kaufmann W., et al. Different fear states engage distinct networks within the intercalated cell clusters of the amygdala. Journal of Neuroscience 2011, 31(13):5131-5144. 10.1523/JNEUROSCI.6100-10.2011.
23. Campese V., Delamater A.R. ABA and ABC renewal of conditioned magazine appraoch are not impaired by dorsal hippocampus inactivation or lesions. Behavioural Brain Research 2013, 248(1):62-73.
24. Carmack S.A., Wood S.C., Anagnostaras S.G. Amphetamine and extinction of cued fear. Neuroscience Letters 2010, 468(1):18-22. 10.1016/j.neulet.2009.10.049.
25. Chun L.S., Free R.B., Doyle T.B., Huang X.P., Rankin M.L., Sibley D.R. D1-D2 dopamine receptor synergy promotes calcium signaling via multiple mechanisms. Molecular Pharmacology 2013, 84(2):190-200. 10.1124/mol.113.085175.
26. Corbit L.H., Balleine B.W. Double dissociation of basolateral and central amygdala lesions on the general and outcome-specific forms of pavlovian-instrumental transfer. Journal of Neuroscience 2005, 25(4):962-970.
27. Corbit L.H., Balleine B.W. The general and outcome-specific forms of Pavlovian-instrumental transfer are differentially mediated by the nucleus accumbens core and shell. Journal of Neuroscience 2011, 31(33):11786-11794. 10.1523/JNEUROSCI.2711-11.2011.
28. Corcoran K.A., Maren S. Hippocampal inactivation disrupts contextual retrieval of fear memory after extinction. Journal of Neuroscience 2001, 21(5):1720-1726.
29. Corral-Frias N.S., Lahood R.P., Edelman-Vogelsang K.E., French E.D., Fellous J.M. Involvement of the ventral tegmental area in a rodent model of post-traumatic stress disorder. Neuropsychopharmacology 2013, 38(2):350-363. 10.1038/npp.2012.189.
30. Cunningham C.L., Henderson C.M., Bormann N.M. Extinction of ethanol-induced conditioned place preference and conditioned place aversion: Effects of naloxone. Psychopharmacology (Berlin) 1998, 139(1-2):62-70.
31. Darvas M., Fadok J.P., Palmiter R.D. Requirement of dopamine signaling in the amygdala and striatum for learning and maintenance of a conditioned avoidance response. Learning & Memory 2011, 18(3):136-143. 10.1101/lm.2041211.
32. Dayan P., Balleine B.W. Reward, motivation, and reinforcement learning. Neuron 2002, 36(2):285-298.
33. de Oliveira A.R., Reimer A.E., de Macedo C.E., de Carvalho M.C., Silva M.A., Brandão M.L. Conditioned fear is modulated by D2 receptor pathway connecting the ventral tegmental area and basolateral amygdala. Neurobiology of Learning and Memory 2011, 95(1):37-45.
34. Dickinson A., Dearing M.F. Appetitive-aversive interactions and inhibitory processes. Jerzy Konorksi 1979, to:203-231. Erlbaum, Totawa, NJ. A.A. Dickinson, A. Boakes (Eds.).
35. Dickinson A., Pearce J. Inhibitory interactions between appetitive and aversive stimuli. Psychological Bulletin 1977, 84(4):690-711.
36. Ehrlich I., Humeau Y., Grenier F., Ciocchi S., Herry C., Lüthi A. Amygdala inhibitory circuits and the control of fear memory. Neuron 2009, 62(6):757-771. 10.1016/j.neuron.2009.05.026.
37. El-Ghundi M., O'Dowd B.F., George S.R. Prolonged fear responses in mice lacking dopamine D1 receptor. Brain Research 2001, 892(1):86-93.
38. Ettenberg A. Opponent process properties of self-administered cocaine. Neuroscience and Biobehavioral Reviews 2004, 27(8):721-728. 10.1016/j.neubiorev.2003.11.009.
39. Fadok J.P., Darvas M., Dickerson T.M., Palmiter R.D. Long-term memory for pavlovian fear conditioning requires dopamine in the nucleus accumbens and basolateral amygdala. PLoS One 2010, 5(9):e12751. 10.1371/journal.pone.0012751.
40. Fadok J.P., Dickerson T.M., Palmiter R.D. Dopamine is necessary for cue-dependent fear conditioning. Journal of Neuroscience 2009, 29(36):11089-11097. 10.1523/JNEUROSCI.1616-09.2009.
41. Fernandez Espejo E. Prefrontocortical dopamine loss in rats delays long-term extinction of contextual conditioned fear, and reduces social interaction without affecting short-term social interaction memory. Neuropsychopharmacology 2003, 28(3):490-498. 10.1038/sj.npp.1300066.
42. Fiorenza N.G., Rosa J., Izquierdo I., Myskiw J.C. Modulation of the extinction of two different fear-motivated tasks in three distinct brain areas. Behavioural Brain Research 2012, 232(1):210-216. 10.1016/j.bbr.2012.04.015.
43. Flagel S.B., Robinson T.E., Clark J.J., Clinton S.M., Watson S.J., Seeman P., et al. An animal model of genetic vulnerability to behavioral disinhibition and responsiveness to reward-related cues: Implications for addiction. Neuropsychopharmacology 2010, 35(2):388-400. 10.1038/npp.2009.142.
44. Floresco S.B., Yang C.R., Phillips A.G., Blaha C.D. Basolateral amygdala stimulation evokes glutamate receptor-dependent dopamine efflux in the nucleus accumbens of the anaesthetized rat. European Journal of Neuroscience 1998, 10(4):1241-1251.
45. Friedman E., Jin L.Q., Cai G.P., Hollon T.R., Drago J., Sibley D.R., et al. D1-like dopaminergic activation of phosphoinositide hydrolysis is independent of D1A dopamine receptors: Evidence from D1A knockout mice. Molecular Pharmacology 1997, 51(1):6-11.
46. Fuxe K., Jacobsen K.X., Hoistad M., Tinner B., Jansson A., Staines W.A., et al. The dopamine D1 receptor-rich main and paracapsular intercalated nerve cell groups of the rat amygdala: Relationship to the dopamine innervation. Neuroscience 2003, 119(3):733-746.
47. Gao C., Sun X., Wolf M.E. Activation of D1 dopamine receptors increases surface expression of AMPA receptors and facilitates their synaptic incorporation in cultured hippocampal neurons. Journal of Neurochemistry 2006, 98(5):1664-1677. 10.1111/j.1471-4159.2006.03999.x.
48. Gill K.M., Grace A.A. Heterogeneous processing of amygdala and hippocampal inputs in the rostral and caudal subregions of the nucleus accumbens. International Journal of Neuropsychopharmacology 2011, 14(10):1301-1314. 10.1017/S1461145710001586.
49. Gould T.D., Manji H.K. DARPP-32: A molecular switch at the nexus of reward pathway plasticity. Proceedings of the National Academy of Sciences of the United States of America 2005, 102(2):253-254. 10.1073/pnas.0408700102.
50. Greba Q., Kokkinidis L. Peripheral and intraamygdalar administration of the dopamine D1 receptor antagonist SCH 23390 blocks fear-potentiated startle but not shock reactivity or the shock sensitization of acoustic startle. Behavioral Neuroscience 2000, 114(2):262-272.
51. Guarraci F.A., Frohardt R.J., Falls W.A., Kapp B.S. The effects of intra-amygdaloid infusions of a D2 dopamine receptor antagonist on Pavlovian fear conditioning. Behavioral Neuroscience 2000, 114(3):647-651.
52. Guarraci F.A., Frohardt R.J., Kapp B.S. Amygdaloid D1 dopamine receptor involvement in Pavlovian fear conditioning. Brain Research 1999, 827(1-2):28-40.
53. Haaker J., Gaburro S., Sah A., Gartmann N., Lonsdorf T.B., Meier K., et al. Single dose of L-dopa makes extinction memories context-independent and prevents the return of fear. Proceedings of the National Academy of Sciences of the United States of America 2013, 110(26):E2428-E2436. 10.1073/pnas.1303061110.
54. Hasbi A., O'Dowd B.F., George S.R. Dopamine D1-D2 receptor heteromer signaling pathway in the brain: Emerging physiological relevance. Molecular Brain 2011, 4:26. 10.1186/1756-6606-4-26.
55. Hikind N., Maroun M. Microinfusion of the D1 receptor antagonist, SCH23390 into the IL but not the BLA impairs consolidation of extinction of auditory fear conditioning. Neurobiology of Learning and Memory 2008, 90(1):217-222. 10.1016/j.nlm.2008.03.003.
56. Holland P.C., Gallagher M. Amygdala circuitry in attentional and representational processes. Trends in Cognitive Sciences 1999, 3(2):65-73.
57. Holtzman-Assif O., Laurent V., Westbrook R.F. Blockade of dopamine activity in the nucleus accumbens impairs learning extinction of conditioned fear. Learning & Memory 2010, 17(2):71-75. 10.1101/lm.1668310.
58. Horvitz J.C. Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events. Neuroscience 2000, 96(4):651-656.
59. Houlihan D.J. Psychostimulant treatment of combat-related posttraumatic stress disorder. Journal of Psychopharmacology 2011, 25(11):1568-1572. 10.1177/0269881110385600.
60. Hu J.L., Liu G., Li Y.C., Gao W.J., Huang Y.Q. Dopamine D1 receptor-mediated NMDA receptor insertion depends on Fyn but not Src kinase pathway in prefrontal cortical neurons. Molecular Brain 2010, 3:20. 10.1186/1756-6606-3-20.
61. Huang Y.Y., Simpson E., Kellendonk C., Kandel E.R. Genetic evidence for the bidirectional modulation of synaptic plasticity in the prefrontal cortex by D1 receptors. Proceedings of the National Academy of Sciences of the United States of America 2004, 101(9):3236-3241. 10.1073/pnas.0308280101.
62. Hugues S., Garcia R., Lena I. Time course of extracellular catecholamine and glutamate levels in the rat medial prefrontal cortex during and after extinction of conditioned fear. Synapse (New York, N.Y.) 2007, 61(11):933-937. 10.1002/syn.20448.
63. Hyman S.E., Malenka R.C. Addiction and the brain: The neurobiology of compulsion and its persistence. Nature Reviews Neuroscience 2001, 2(10):695-703. 10.1038/35094560.
64. Iordanova M.D. Dopaminergic modulation of appetitive and aversive predictive learning. Reviews in the Neurosciences 2009, 20:383-404.
65. Iordanova M.D., Westbrook R.F., Killcross A.S. Dopamine activity in the nucleus accumbens modulates blocking in fear conditioning. European Journal of Neuroscience 2006, 24:3265-3270.
66. Inoue T., Izumi T., Maki Y., Muraki I., Koyama T. Effect of the dopamine D(1/5) antagonist SCH 23390 on the acquisition of conditioned fear. Pharmacology, Biochemistry and Behavior 2000, 66(3):573-578.
67. Jhou T.C., Geisler S., Marinelli M., Degarmo B.A., Zahm D.S. The mesopontine rostromedial tegmental nucleus: A structure targeted by the lateral habenula that projects to the ventral tegmental area of Tsai and substantia nigra compacta. Journal of Comparative Neurology 2009, 513(6):566-596. 10.1002/cne.21891.
68. Jin L.Q., Goswami S., Cai G., Zhen X., Friedman E. SKF83959 selectively regulates phosphatidylinositol-linked D1 dopamine receptors in rat brain. Journal of Neurochemistry 2003, 85(2):378-386.
69. Konorski J. Integrative activity of the brain: An interdisciplinary approach 1967, University of Chicago Press, Chicago, Illinois.
70. LaLumiere R.T., Nawar E.M., McGaugh J.L. Modulation of memory consolidation by the basolateral amygdala or nucleus accumbens shell requires concurrent dopamine receptor activation in both brain regions. Learning & Memory 2005, 12(3):296-301. 10.1101/lm.93205.
71. Lalumiere R.T., Nguyen L.T., McGaugh J.L. Post-training intrabasolateral amygdala infusions of dopamine modulate consolidation of inhibitory avoidance memory: Involvement of noradrenergic and cholinergic systems. European Journal of Neuroscience 2004, 20(10):2804-2810. 10.1111/j.1460-9568.2004.03744.x.
72. Lammel S., Ion D.I., Roeper J., Malenka R.C. Projection-specific modulation of dopamine neuron synapses by aversive and rewarding stimuli. Neuron 2011, 70(5):855-862. 10.1016/j.neuron.2011.03.025.
73. Lammel S., Lim B.K., Ran C., Huang K.W., Betley M.J., Tye K., et al. Input-specific control of reward and aversion in the ventral tegmental area. Nature 2012, 491(7423):212-217. 10.1038/nature11527.
74. Lamont E.W., Kokkinidis L. Infusion of the dopamine D1 receptor antagonist SCH 23390 into the amygdala blocks fear expression in a potentiated startle paradigm. Brain Research 1998, 795(1-2):128-136.
75. Lauzon N.M., Bechard M., Ahmad T., Laviolette S.R. Supra-normal stimulation of dopamine D1 receptors in the prelimbic cortex blocks behavioral expression of both aversive and rewarding associative memories through a cyclic-AMP-dependent signaling pathway. Neuropharmacology 2013, 67:104-114. 10.1016/j.neuropharm.2012.10.029.
76. Lemos J.C., Wanat M.J., Smith J.S., Reyes B.A., Hollon N.G., Van Bockstaele E., et al. Severe stress switches CRF action in the nucleus accumbens from appetitive to aversive. Nature 2012, 490(7420):402-406. 10.1038/nature11436.
77. Leonard S.K., Anderson C.M., Lachowicz J.E., Schulz D.W., Kilts C.D., Mailman R.B. Amygdaloid D1 receptors are not linked to stimulation of adenylate cyclase. Synapse (New York, N.Y.) 2003, 50(4):320-333. 10.1002/syn.10272.
78. Levita L., Dalley J.W., Robbins T.W. Nucleus accumbens dopamine and learned fear revisited: A review and some new findings. Behavioural Brain Research 2002, 137(1-2):115-127.
79. Li C., Dabrowska J., Hazra R., Rainnie D.G. Synergistic activation of dopamine D1 and TrkB receptors mediate gain control of synaptic plasticity in the basolateral amygdala. PLoS One 2011, 6(10):e26065. 10.1371/journal.pone.0026065.
80. Luo A.H., Tahsili-Fahadan P., Wise R.A., Lupica C.R., Aston-Jones G. Linking context with reward: A functional circuit from hippocampal CA3 to ventral tegmental area. Science 2011, 333(6040):353-357. 10.1126/science.1204622.
81. Mackintosh N.J. The psychology of animal learning 1974, Academic Press, New York.
82. Mannoury la Cour C., Vidal S., Pasteau V., Cussac D., Millan M.J. Dopamine D1 receptor coupling to Gs/olf and Gq in rat striatum and cortex: A scintillation proximity assay (SPA)/antibody-capture characterization of benzazepine agonists. Neuropharmacology 2007, 52(3):1003-1014. 10.1016/j.neuropharm.2006.10.021.
83. Mansour A., Watson S.J. Dopamine receptor expression in the central nervous system. Psychopharmacology - The fourth generation of progress 1995, Lippincott Williams & Wilkins, Philadelphia, PA. F.E. Bloom, D.J. Kupfer (Eds.).
84. McCutcheon J.E., Ebner S.R., Loriaux A.L., Roitman M.F. Encoding of aversion by dopamine and the nucleus accumbens. Frontiers in Neuroscience 2012, 6:137. 10.3389/fnins.2012.00137.
85. McGaugh J.L. The amygdala modulates the consolidation of memories of emotionally arousing experiences. Annual Review of Neuroscience 2004, 27:1-28. 10.1146/annurev.neuro.27.070203.144157.
86. Miczek K.A., Luttinger D. Differential attenuation of two kinds of conditioned suppression by d-amphetamine and pentobarbital. Journal of Pharmacology and Experimental Therapeutics 1978, 205(2):282-290.
87. Milad M.R., Pitman R.K., Ellis C.B., Gold A.L., Shin L.M., Lasko N., et al. Neurobiological basis of failure to recall extinction memory in posttraumatic stress disorder. Biological Psychiatry 2009, 66(12):1075-1082. 10.1016/j.biopsych.2009.06.026.
88. Mileykovskiy B., Morales M. Duration of inhibition of ventral tegmental area dopamine neurons encodes a level of conditioned fear. Journal of Neuroscience 2011, 31(20):7471-7476. 10.1523/JNEUROSCI.5731-10.2011.
89. Morrow B.A., Elsworth J.D., Rasmusson A.M., Roth R.H. The role of mesoprefrontal dopamine neurons in the acquisition and expression of conditioned fear in the rat. Neuroscience 1999, 92(2):553-564.
90. Moustafa A.A., Gilbertson M.W., Orr S.P., Herzallah M.M., Servatius R.J., Myers C.E. A model of amygdala-hippocampal-prefrontal interaction in fear conditioning and extinction in animals. Brain and Cognition 2013, 81(1):29-43. 10.1016/j.bandc.2012.10.005.
91. Mueller D., Bravo-Rivera C., Quirk G.J. Infralimbic D2 receptors are necessary for fear extinction and extinction-related tone responses. Biological Psychiatry 2010, 68(11):1055-1060. 10.1016/j.biopsych.2010.08.014.
92. Mueller D., Olivera-Figueroa L.A., Pine D.S., Quirk G.J. The effects of yohimbine and amphetamine on fear expression and extinction in rats. Psychopharmacology (Berlin) 2009, 204(4):599-606. 10.1007/s00213-009-1491-x.
93. Nader K., LeDoux J.E. Inhibition of the mesoamygdala dopaminergic pathway impairs the retrieval of conditioned fear associations. Behavioral Neuroscience 1999, 113(5):891-901.
94. Nasser H.M., McNally G.P. Appetitive-aversive interactions in Pavlovian fear conditioning. Behavioral Neuroscience 2012, 126(3):404-422. 10.1037/a0028341.
95. Neve K.A. Dopamine receptors 2004, Humana Press, Totowa, New Jersey.
96. Ortiz O., Delgado-Garcia J.M., Espadas I., Bahi A., Trullas R., Dreyer J., et al. Associative learning and CA3-CA1 synaptic plasticity are impaired in D1R null, Drd1a-/- mice and in hippocampal siRNA silenced Drd1a mice. Journal of Neuroscience 2010, 30(37):12288-12300. 10.1523/JNEUROSCI.2655-10.2010.
97. Ouyang M., Young M.B., Lestini M.M., Schutsky K., Thomas S.A. Redundant catecholamine signaling consolidates fear memory via phospholipase C. Journal of Neuroscience 2012, 32(6):1932-1941. 10.1523/JNEUROSCI.5231-11.2012.
98. Pan W.X., Schmidt R., Wickens J.R., Hyland B.I. Tripartite mechanism of extinction suggested by dopamine neuron activity and temporal difference model. Journal of Neuroscience 2008, 28(39):9619-9631. 10.1523/JNEUROSCI.0255-08.2008.
99. Patton M.H., Bizup B.T., Grace A.A. The infralimbic cortex bidirectionally modulates mesolimbic dopamine neuron activity via distinct neural pathways. Journal of Neuroscience 2013, 33(43):16865-16873. 10.1523/JNEUROSCI.2449-13.2013.
100. Peck C.A., Bouton M.E. Context and performance in aversive-to-appetitive and appetitive-to-aversive transfer. Learning and Motivation 1990, 21(1):1-31. 10.1016/0023-9690(90)90002-6.
101. Peters J., Kalivas P.W., Quirk G.J. Extinction circuits for fear and addiction overlap in prefrontal cortex. Learning & Memory 2009, 16(5):279-288. 10.1101/lm.1041309.
102. Pezze M.A., Bast T., Feldon J. Significance of dopamine transmission in the rat medial prefrontal cortex for conditioned fear. Cerebral Cortex 2003, 13(4):371-380.
103. Pezze M.A., Feldon J. Mesolimbic dopaminergic pathways in fear conditioning. Progress in Neurobiology 2004, 74(5):301-320. 10.1016/j.pneurobio.2004.09.004.
104. Pezze M.A., Heidbreder C.A., Feldon J., Murphy C.A. Selective responding of nucleus accumbens core and shell dopamine to aversively conditioned contextual and discrete stimuli. Neuroscience 2001, 108(1):91-102.
105. Ponnusamy R., Nissim H.A., Barad M. Systemic blockade of D2-like dopamine receptors facilitates extinction of conditioned fear in mice. Learning & Memory 2005, 12(4):399-406. 10.1101/lm.96605.
106. Puig M.V., Miller E.K. The role of prefrontal dopamine D1 receptors in the neural mechanisms of associative learning. Neuron 2012, 74(5):874-886. 10.1016/j.neuron.2012.04.018.
107. Quirk G.J., Mueller D. Neural mechanisms of extinction learning and retrieval. Neuropsychopharmacology 2008, 33(1):56-72. 10.1038/sj.npp.1301555.
108. Ragozzino M.E. The effects of dopamine D(1) receptor blockade in the prelimbic-infralimbic areas on behavioral flexibility. Learning & Memory 2002, 9(1):18-28. 10.1101/lm.45802.
109. Rashid A.J., So C.H., Kong M.M., Furtak T., El-Ghundi M., Cheng R., et al. D1-D2 dopamine receptor heterooligomers with unique pharmacology are coupled to rapid activation of Gq/11 in the striatum. Proceedings of the National Academy of Sciences of the United States of America 2007, 104(2):654-659. 10.1073/pnas.0604049104.
110. Redgrave P., Prescott T.J., Gurney K. Is the short-latency dopamine response too short to signal reward error?. Trends in Neurosciences 1999, 22(4):146-151. 10.1016/S0166-2236(98)01373-3.
111. Rescorla R.A. Experimental extinction 2001, Lawrence Eribaum Associates Publishers, Mahwah, New Jersey.
112. Rescorla, R. A., & Wagner, A. R. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In A. H. Black, & W. F. Prokasy (Eds.), Classical conditioning II (pp. 64-99). Appleton-Century-Crofts.
113. Rescorla R.A., Holland P.C. Some behavioral approaches to the study of learning. Neural mechanisms of learning and memory 1976, 165-192. MIT Press, Cambridge, MA. E. Bennett, M.R. Rozensweig (Eds.).
114. Reymond M.J., Porter J.C. Involvement of hypothalamic dopamine in the regulation of prolactin secretion. Hormone Research 1985, 22(3):142-152.
115. Reynolds S.M., Berridge K.C. Emotional environments retune the valence of appetitive versus fearful functions in nucleus accumbens. Nature Neuroscience 2008, 11(4):423-425. 10.1038/nn2061.
116. Richard J.M., Berridge K.C. Nucleus accumbens dopamine/glutamate interaction switches modes to generate desire versus dread: D(1) alone for appetitive eating but D(1) and D(2) together for fear. Journal of Neuroscience 2011, 31(36):12866-12879. 10.1523/JNEUROSCI.1339-11.2011.
117. Rodriguez-Romaguera J., Do Monte F.H., Quirk G.J. Deep brain stimulation of the ventral striatum enhances extinction of conditioned fear. Proceedings of the National Academy of Sciences of the United States of America 2012, 109(22):8764-8769. 10.1073/pnas.1200782109.
118. Rosenkranz J.A., Grace A.A. Cellular mechanisms of infralimbic and prelimbic prefrontal cortical inhibition and dopaminergic modulation of basolateral amygdala neurons in vivo. Journal of Neuroscience 2002, 22(1):324-337.
119. Rossato J.I., Bevilaqua L.R., Izquierdo I., Medina J.H., Cammarota M. Dopamine controls persistence of long-term memory storage. Science 2009, 325(5943):1017-1020. 10.1126/science.1172545.
120. Sahu A., Tyeryar K.R., Vongtau H.O., Sibley D.R., Undieh A.S. D5 dopamine receptors are required for dopaminergic activation of phospholipase C. Molecular Pharmacology 2009, 75(3):447-453. 10.1124/mol.108.053017.
121. Salamone J.D. The involvement of nucleus accumbens dopamine in appetitive and aversive motivation. Behavioural Brain Research 1994, 61(2):117-133. 10.1016/0166-4328(94)90153-8.
122. Salamone J.D., Correa M. The mysterious motivational functions of mesolimbic dopamine. Neuron 2012, 76(3):470-485. 10.1016/j.neuron.2012.10.021.
123. Schultz W. Behavioral theories and the neurophysiology of reward. Annual Review of Psychology 2006, 57:87-115. 10.1146/annurev.psych.56.091103.070229.
124. Schultz W., Dickinson A. Neuronal coding of prediction errors. Annual Review of Neuroscience 2000, 23:473-500. 10.1146/annurev.neuro.23.1.473.
125. Seamans J.K., Yang C.R. The principal features and mechanisms of dopamine modulation in the prefrontal cortex. Progress in Neurobiology 2004, 74(1):1-58. 10.1016/j.pneurobio.2004.05.006.
126. Shin L.M., Rauch S.L., Pitman R.K. Amygdala, medial prefrontal cortex, and hippocampal function in PTSD. Annals of the New York Academy of Sciences 2006, 1071:67-79. 10.1196/annals.1364.007.
127. Stamatakis A.M., Stuber G.D. Activation of lateral habenula inputs to the ventral midbrain promotes behavioral avoidance. Nature Neuroscience 2012, 15(8):1105-1107. 10.1038/nn.3145.
128. Steinberg E.E., Keiflin R., Boivin J.R., Witten I.B., Deisseroth K., Janak P.H. A causal link between prediction errors, dopamine neurons and learning. Nature Neuroscience 2013, 16(7):966-973. 10.1038/nn.3413.
129. Stuber G.D., Britt J.P., Bonci A. Optogenetic modulation of neural circuits that underlie reward seeking. Biological Psychiatry 2012, 71(12):1061-1067. 10.1016/j.biopsych.2011.11.010.
130. Undie A.S., Weinstock J., Sarau H.M., Friedman E. Evidence for a distinct D1-like dopamine receptor that couples to activation of phosphoinositide metabolism in brain. Journal of Neurochemistry 1994, 62(5):2045-2048.
131. Urban J.D., Clarke W.P., von Zastrow M., Nichols D.E., Kobilka B., Weinstein H., et al. Functional selectivity and classical concepts of quantitative pharmacology. Journal of Pharmacology and Experimental Therapeutics 2007, 320(1):1-13. 10.1124/jpet.106.104463.
132. Valenti O., Lodge D.J., Grace A.A. Aversive stimuli alter ventral tegmental area dopamine neuron activity via a common action in the ventral hippocampus. Journal of Neuroscience 2011, 31(11):4280-4289. 10.1523/JNEUROSCI.5310-10.2011.
133. Valjent E., Pascoli V., Svenningsson P., Paul S., Enslen H., Corvol J., et al. Regulation of a protein phosphatase cascade allows convergent dopamine and glutamate signals to activate ERK in the striatum. Proceedings of the National Academy of Sciences of the United States of America 2005, 102(2):491-496. 10.1073/pnas.0408305102.
134. Vincent S.L., Khan Y., Benes F.M. Cellular colocalization of dopamine D1 and D2 receptors in rat medial prefrontal cortex. Synapse (New York, N.Y.) 1995, 19(2):112-120. 10.1002/syn.890190207.
135. Voorn P., Vanderschuren L.J., Groenewegen H.J., Robbins T.W., Pennartz C.M. Putting a spin on the dorsal-ventral divide of the striatum. Trends in Neurosciences 2004, 27(8):468-474. 10.1016/j.tins.2004.06.006.
136. Weiner D.M., Levey A.I., Sunahara R.K., Niznik H.B., O'Dowd B.F., Seeman P., et al. D1 and D2 dopamine receptor mRNA in rat brain. Proceedings of the National Academy of Sciences of the United States of America 1991, 88(5):1859-1863.
137. White N.M., Salinas J.A. Mnemonic functions of dorsal striatum and hippocampus in aversive conditioning. Behavioural Brain Research 2003, 142(1-2):99-107.
138. Wickens J.R., Horvitz J.C., Costa R.M., Killcross S. Dopaminergic mechanisms in actions and habits. Journal of Neuroscience 2007, 27(31):8181-8183. 10.1523/JNEUROSCI.1671-07.2007.
139. Wise R.A. Dopamine, learning and motivation. Nature Reviews Neuroscience 2004, 5(6):483-494. 10.1038/nrn1406.
140. Xu T.X., Yao W.D. D1 and D2 dopamine receptors in separate circuits cooperate to drive associative long-term potentiation in the prefrontal cortex. Proceedings of the National Academy of Sciences of the United States of America 2010, 107(37):16366-16371. 10.1073/pnas.1004108107.
141. Yawata S., Yamaguchi T., Danjo T., Hikida T., Nakanishi S. Pathway-specific control of reward learning and its flexibility via selective dopamine receptors in the nucleus accumbens. Proceedings of the National Academy of Sciences of the United States of America 2012, 109(31):12764-12769. 10.1073/pnas.1210797109.
142. Zweifel L.S., Fadok J.P., Argilli E., Garelick M.G., Jones G.L., Dickerson T., et al. Activation of dopamine neurons is critical for aversive conditioning and prevention of generalized anxiety. Nature Neuroscience 2011, 14(5):620-626. 10.1038/nn.2808.
143. Zweifel L.S., Parker J.G., Lobb C.J., Rainwater A., Wall V.Z., Fadok J., et al. Disruption of NMDAR-dependent burst firing by dopamine neurons provides selective assessment of phasic dopamine-dependent behavior. Proceedings of the National Academy of Sciences of the United States of America 2009, 106(18):7281-7288. 10.1073/pnas.0813415106.