A unifying model of the role of the infralimbic cortex in extinction and habits

Learning and Memory

Volumn 21, Issue 9, 2014, Pages 441-448

  Barker, Jacqueline M ^a   Taylor, Jane R ^b   Chandler, L Judson ^a  

^a MEDICAL UNIVERSITY OF SOUTH CAROLINA   (United States)

^b YALE UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL; BIOLOGICAL MODEL; CONDITIONED REFLEX; HABIT; HUMAN; MENTAL DISEASE; PATHOPHYSIOLOGY; PHYSIOLOGY; PREFRONTAL CORTEX; REINFORCEMENT; REWARD;

ANIMALS; CONDITIONING, CLASSICAL; EXTINCTION, PSYCHOLOGICAL; HABITS; HUMANS; MENTAL DISORDERS; MODELS, BIOLOGICAL; PREFRONTAL CORTEX; REWARD;

EID: 84907777212     PISSN: 10720502     EISSN: 15495485     Source Type: Journal    
DOI: 10.1101/lm.035501.114     Document Type: Review

References (92)

1. Adams CD. 1982. Variations in the sensitivity of instrumental responding to reinforcer devaluation. Q J Exp Psychol B 34: 77-98.
2. Arnsten AFT. 2007. Catecholamine and second messenger influences on prefrontal cortical networks of "representational knowledge": a rational bridge between genetics and the symptoms of mental illness. Cereb Cortex 17 Suppl 1: i6-i15.
3. Balleine BW, Dickinson A. 1998. Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37: 407-419.
4. Barker JM, Torregrossa MM, Taylor JR. 2012. Low prefrontal PSA-NCAM confers risk for alcoholism-related behavior. Nat Neurosci 15: 1356-1358.
5. Barker JM, Torregrossa MM, Taylor JR. 2013. Bidirectional modulation of infralimbic dopamine D1 and D2 receptor activity regulates flexible reward seeking. Front Neurosci 7: 126.
6. Bechara A. 2003. Risky business: emotion, decision-making, and addiction. J Gambl Stud 19: 23-51.
7. Belin D, Everitt BJ. 2008. Cocaine seeking habits depend upon dopamine-dependent serial connectivity linking the ventral with the dorsal striatum. Neuron 57: 432-441.
8. Berendse HW, Galis-de Graaf Y, Groenewegen HJ. 1992. Topographical organization and relationship with ventral striatal compartments of prefrontal corticostriatal projections in the rat. J Comp Neurol 316: 314-347.
9. Bossert JM, Stern AL, Theberge FRM, Marchant NJ, Wang H-L, Morales M, Shaham Y. 2012. Role of projections from ventral medial prefrontal cortex to nucleus accumbens shell in context-induced reinstatement of heroin seeking. J Neurosci 32: 4982-4991.
10. Bouton ME. 2004. Context and behavioral processes in extinction. Learn Mem 11: 485-494.
11. Cassell MD, Wright DJ. 1986. Topography of projections from the medial prefrontal cortex to the amygdala in the rat. Brain Res Bull 17: 321-333.
12. Castillo-Gómez E, Gómez-Climent MA, Varea E, Guirado R, Blasco-Ibáñez JM, Crespo C, Martínez-Guijarro FJ, Nácher J. 2008. Dopamine acting through D2 receptors modulates the expression of PSA-NCAM, a molecule related to neuronal structural plasticity, in the medial prefrontal cortex of adult rats. Exp Neurol 214: 97-111.
13. Chudasama Y, Robbins TW. 2003. Dissociable contributions of the orbitofrontal and infralimbic cortex to Pavlovian autoshaping and discrimination reversal learning: further evidence for the functional heterogeneity of the rodent frontal cortex. J Neurosci 23: 8771-8780.
14. Courtney KE, Ghahremani DG, Ray LA. 2012. Fronto-striatal functional connectivity during response inhibition in alcohol dependence. Addict Biol 18: 593-604.
15. Coutureau E, Killcross S. 2003. Inactivation of the infralimbic prefrontal cortex reinstates goal-directed responding in overtrained rats. Behav Brain Res 146: 167-174.
16. Delamater AR, Westbrook RF. 2013. Psychological and neural mechanisms of experimental extinction: a selective review. Neurobiol Learn Mem.
17. de Wit S, Corlett PR, Aitken MR, Dickinson A, Fletcher PC. 2009. Differential engagement of the ventromedial prefrontal cortex by goal-directed and habitual behavior toward food pictures in humans. J Neurosci 29: 11330-11338.
18. de Wit S, Watson P, Harsay HA, Cohen MX, van de Vijver I, Ridderinkhof KR. 2012. Corticostriatal connectivity underlies individual differences in the balance between habitual and goal-directed action control. J Neurosci 32: 12066-12075.
19. Dickinson A. 1985. Actions and habits: the development of behavioural autonomy. Philos Trans R Soc Lond B Biol Sci 308: 67-78.
20. Dickinson A, Wood N, Smith JW. 2002. Alcohol seeking by rats: action or habit? Q J Exp Psychol B 55: 331-348.
21. Everitt BJ, Robbins TW. 2013. From the ventral to the dorsal striatum: devolving views of their roles in drug addiction. Neurosci Biobehav Rev. doi: 10.1016/j.neubiorev.2013.02.010.
22. Everitt BJ, Belin D, Economidou D, Pelloux Y, Dalley JW, Robbins TW. 2008. Review. Neural mechanisms underlying the vulnerability to develop compulsive drug-seeking habits and addiction. Philos Trans R Soc Lond B Biol Sci 363: 3125-3135.
23. Floresco SB. 2013. Prefrontal dopamine and behavioral flexibility: shifting from an "inverted-U" toward a family of functions. Front Neurosci 7: 62.
24. Floresco SB, Magyar O, Ghods-Sharifi S, Vexelman C, Tse MTL. 2006. Multiple dopamine receptor subtypes in the medial prefrontal cortex of the rat regulate set-shifting. Neuropsychopharmacology 31: 297-309.
25. Francois J, Huxter J, Conway MW, Lowry JP, Tricklebank MD, Gilmour G. 2014. Differential contributions of infralimbic prefrontal cortex and nucleus accumbens during reward-based learning and extinction. J Neurosci 34: 596-607.
26. Gass JT, Chandler LJ. 2013. The plasticity of extinction: contribution of the prefrontal cortex in treating addiction through inhibitory learning. Front Psychiatry 4: 46.
27. Gee S, Ellwood I, Patel T, Luongo F, Deisseroth K, Sohal VS. 2012. Synaptic activity unmasks dopamine D2 receptor modulation of a specific class of layer V pyramidal neurons in prefrontal cortex. J Neurosci 32: 4959-4971.
28. George O, Koob GF. 2010. Individual differences in prefrontal cortex function and the transition from drug use to drug dependence. Neurosci Biobehav Rev 35: 232-247.
29. Gerfen CR. 1984. The neostriatal mosaic: compartmentalization of corticostriatal input and striatonigral output systems. Nature 311: 461-464.
30. Gerfen CR, Engber TM, Mahan LC, Susel Z, Chase TN, Monsma FJ, Sibley DR. 1990. D1 and D2 dopamine receptor-regulated gene expression of striatonigral and striatopallidal neurons. Science 250: 1429-1432.
31. Haber S. 2008. Parallel and integrative processing through the Basal Ganglia reward circuit: lessons from addiction. Biol Psychiatry 64: 173-174.
32. Haber SN, Knutson B. 2010. The reward circuit: linking primate anatomy and human imaging. Neuropsychopharmacology 35: 4-26.
33. Haddon JE, Killcross S. 2011a. Inactivation of the infralimbic prefrontal cortex in rats reduces the influence of inappropriate habitual responding in a response-conflict task. Neuroscience 199: 205-212.
34. Haddon JE, Killcross S. 2011b. Rat prefrontal dopamine and cognitive control: impaired and enhanced conflict performance. Behav Neurosci 125: 344-349.
35. Hartley CA, Fischl B, Phelps EA. 2011. Brain structure correlates of individual differences in the acquisition and inhibition of conditioned fear. Cereb Cortex 21: 1954-1962.
36. Hedou G, Feldon J, Heidbreder CA. 1999a. Effects of cocaine on dopamine in subregions of the rat prefrontal cortex and their efferents to subterritories of the nucleus accumbens. Eur J Pharmacol 372: 143-155.
37. Hedou G, Homberg J, Feldon J, Heidbreder CA. 1999b. Amphetamine microinfusion in the dorso-ventral axis of the prefrontal cortex differentially modulates dopamine neurotransmission in the shell-core subterritories of the nucleus accumbens. Ann N Y Acad Sci 877: 823-827.
38. Hedou G, Homberg J, Feldon J, Heidbreder CA. 2001. Expression of sensitization to amphetamine and dynamics of dopamine neurotransmission in different laminae of the rat medial prefrontal cortex. Neuropharmacology 40: 366-382.
39. Heidbreder CA, Groenewegen HJ. 2003. The medial prefrontal cortex in the rat: evidence for a dorso-ventral distinction based upon functional and anatomical characteristics. Neurosci Biobehav Rev 27: 555-579.
40. Hitchcott PK, Quinn JJ, Taylor JR. 2007. Bidirectional modulation of goal-directed actions by prefrontal cortical dopamine. Cereb Cortex 17: 2820-2827.
41. Hugues S, Deschaux O, Garcia R. 2004. Postextinction infusion of a mitogen-activated protein kinase inhibitor into the medial prefrontal cortex impairs memory of the extinction of conditioned fear. Learn Mem 11: 540-543.
42. Hugues S, Chessel A, Lena I, Marsault R, Garcia R. 2006. Prefrontal infusion of PD098059 immediately after fear extinction training blocks extinction-associated prefrontal synaptic plasticity and decreases prefrontal ERK2 phosphorylation. Synapse 60: 280-287.
43. Hurley KM, Herbert H, Moga MM, Saper CB. 1991. Efferent projections of the infralimbic cortex of the rat. J Comp Neurol 308: 249-276.
44. Jentsch JD, Taylor JR. 1999. Impulsivity resulting from frontostriatal dysfunction in drug abuse: implications for the control of behavior by reward-related stimuli. Psychopharmacology (Berl) 146: 373-390.
45. Killcross S, Coutureau E. 2003. Coordination of actions and habits in the medial prefrontal cortex of rats. Cereb Cortex 13: 400-408.
46. Knapska E, Maren S. 2009. Reciprocal patterns of c-Fos expression in the medial prefrontal cortex and amygdala after extinction and renewal of conditioned fear. Learn Mem 16: 486-493.
47. Kravitz AV, Kreitzer AC. 2012. Striatal mechanisms underlying movement, reinforcement, and punishment. Physiology (Bethesda) 27: 167-177.
48. LaLumiere RT, Niehoff KE, Kalivas PW. 2010. The infralimbic cortex regulates the consolidation of extinction after cocaine self-administration. Learn Mem 17: 168-175.
49. Laurent V, Westbrook RF. 2009. Inactivation of the infralimbic but not the prelimbic cortex impairs consolidation and retrieval of fear extinction. Learn Mem 16: 520-529.
50. Lebrón K, Milad MR, Quirk GJ. 2004. Delayed recall of fear extinction in rats with lesions of ventral medial prefrontal cortex. Learn Mem 11: 544-548.
51. Li CR, Sinha R. 2008. Inhibitory control and emotional stress regulation: neuroimaging evidence for frontal-limbic dysfunction in psycho-stimulant addiction. Neurosci Biobehav Rev 32: 581-597.
52. Lingawi NW, Balleine BW. 2012. Amygdala central nucleus interacts with dorsolateral striatum to regulate the acquisition of habits. J Neurosci 32: 1073-1081.
53. Marchant NJ, Furlong TM, McNally GP. 2010. Medial dorsal hypothalamus mediates the inhibition of reward seeking after extinction. J Neurosci 30: 14102-14115.
54. Marquis J-P, Killcross S, Haddon JE. 2007. Inactivation of the prelimbic, but not infralimbic, prefrontal cortex impairs the contextual control of response conflict in rats. Eur J Neurosci 25: 559-566.
55. Mcdonald AJ, Mascagni F, Guo L. 1996. Projections of the medial and lateral prefrontal cortices to the amygdala: a Phaseolus vulgaris leucoagglutinin study in the rat. Neuroscience 71: 55-75.
56. Miguéns M, Crespo JA, Del Olmo N, Higuera-Matas A, Montoya GL, García-Lecumberri C, Ambrosio E. 2008. Differential cocaine-induced modulation of glutamate and dopamine transporters after contingent and non-contingent administration. Neuropharmacology 55: 771-779.
57. Milad MR, Quirk GJ. 2002. Neurons in medial prefrontal cortex signal memory for fear extinction. Nature 420: 70-74.
58. Milad MR, Furtak SC, Greenberg JL, Keshaviah A, Im JJ, Falkenstein MJ, Jenike M, Rauch SL, Wilhelm S. 2013. Deficits in conditioned fear extinction in obsessive-compulsive disorder and neurobiological changes in the fear circuit. JAMA Psychiatry 70: 608-618.
59. Miles FJ, Everitt BJ, Dickinson A. 2003. Oral cocaine seeking by rats: action or habit? Behav Neurosci 117: 927-938.
60. Millan EZ, Marchant NJ, McNally GP. 2011. Extinction of drug seeking. Behav Brain Res 217: 454-462.
61. Morgan MA, Romanski LM, LeDoux JE. 1993. Extinction of emotional learning: contribution of medial prefrontal cortex. Neurosci Lett 163: 109-113.
62. Mueller D, Bravo-Rivera C, Quirk GJ. 2010. Infralimbic D2 receptors are necessary for fear extinction and extinction-related tone responses. Biol Psychiatry 68: 1055-1060.
63. Nelson A, Killcross S. 2006. Amphetamine exposure enhances habit formation. J Neurosci 26: 3805-3812.
64. Nelson AJD, Killcross S. 2013. Accelerated habit formation following amphetamine exposure is reversed by D1, but enhanced by D2, receptor antagonists. Front Neurosci 7: 76.
65. Nieuwenhuis ILC, Takashima A. 2011. The role of the ventromedial prefrontal cortex in memory consolidation. Behav Brain Res 218: 325-334.
66. Onn SP, West AR, Grace AA. 2000. Dopamine-mediated regulation of striatal neuronal and network interactions. Trends Neurosci 23: S48-S56.
67. Peters J, De Vries TJ. 2013. D-cycloserine administered directly to infralimbic medial prefrontal cortex enhances extinction memory in sucrose-seeking animals. Neuroscience 230: 24-30.
68. Peters J, LaLumiere RT, Kalivas PW. 2008. Infralimbic prefrontal cortex is responsible for inhibiting cocaine seeking in extinguished rats. J Neurosci 28: 6046-6053.
69. Peters J, Kalivas PW, Quirk GJ. 2009. Extinction circuits for fear and addiction overlap in prefrontal cortex. Learn Mem 16: 279-288.
70. Peters J, Dieppa-Perea LM, Melendez LM, Quirk GJ. 2010. Induction of fear extinction with hippocampal-infralimbic BDNF. Science 328: 1288-1290.
71. Peters J, Pattij T, De Vries TJ. 2013. Targeting cocaine versus heroin memories: divergent roles within ventromedial prefrontal cortex. Trends Pharmacol Sci. 34: 689-6950.
72. Quirk GJ, Beer JS. 2006. Prefrontal involvement in the regulation of emotion: convergence of rat and human studies. Curr Opin Neurobiol 16: 723-727.
73. Quirk GJ, Russo GK, Barron JL, Lebron K. 2000. The role of ventromedial prefrontal cortex in the recovery of extinguished fear. J Neurosci 20: 6225-6231.
74. Rescorla RA. 2001. Experimental extinction. In Handbook of contemporary learning theories, pp. 119-154. Lawrence Erlbaum Associates, Mahwah, NJ.
75. Santini E, Ge H, Ren K, Peña de Ortiz S, Quirk GJ. 2004. Consolidation of fear extinction requires protein synthesis in the medial prefrontal cortex. J Neurosci 24: 5704-5710.
76. Santini E, Quirk GJ, Porter JT. 2008. Fear conditioning and extinction differentially modify the intrinsic excitability of infralimbic neurons. J Neurosci 28: 4028-4036.
77. Shin LM, Whalen PJ, Pitman RK, Bush G, Macklin ML, Lasko NB, Orr SP, McInerney SC, Rauch SL. 2001. An fMRI study of anterior cingulate function in posttraumatic stress disorder. Biol Psychiatry 50: 932-942.
78. Sierra-Mercado D, Corcoran KA, Lebrón-Milad K, Quirk GJ. 2006. Inactivation of the ventromedial prefrontal cortex reduces expression of conditioned fear and impairs subsequent recall of extinction. Eur J Neurosci 24: 1751-1758.
79. Sierra-Mercado D, Padilla-Coreano N, Quirk GJ. 2011. Dissociable roles of prelimbic and infralimbic cortices, ventral hippocampus, and basolateral amygdala in the expression and extinction of conditioned fear. Neuropsychopharmacology 36: 529-538.
80. Sinha R, Li CSR. 2007. Imaging stress- and cue-induced drug and alcohol craving: association with relapse and clinical implications. Drug Alcohol Rev 26: 25-31.
81. Sjoerds Z, de Wit S, van den Brink W, Robbins TW, Beekman ATF, Penninx BWJH, Veltman DJ. 2013. Behavioral and neuroimaging evidence for overreliance on habit learning in alcohol-dependent patients. Transl Psychiatry 3: e337.
82. Smith KS, Graybiel AM. 2013. A dual operator view of habitual behavior reflecting cortical and striatal dynamics. Neuron 79: 361-374.
83. Smith KS, Virkud A, Deisseroth K, Graybiel AM. 2012. Reversible online control of habitual behavior by optogenetic perturbation of medial prefrontal cortex. Proc Natl Acad Sci 109: 18932-18937.
84. Surmeier DJ, Song WJ, Yan Z. 1996. Coordinated expression of dopamine receptors in neostriatal medium spiny neurons. J Neurosci 16: 6579-6591.
85. Thierry AM, Blanc G, Sobel A, Stinus L, Golwinski J. 1973. Dopaminergic terminals in the rat cortex. Science 182: 499-501.
86. Thompson RH, Swanson LW. 2010. Hypothesis-driven structural connectivity analysis supports network over hierarchical model of brain architecture. Proc Natl Acad Sci 107: 15235-15239.
87. Torregrossa MM, Sanchez H, Taylor JR. 2010. D-cycloserine reduces the context specificity of Pavlovian extinction of cocaine cues through actions in the nucleus accumbens. J Neurosci 30: 10526-10533.
88. Van Eden CG, Uylings HB. 1985. Cytoarchitectonic development of the prefrontal cortex in the rat. J Comp Neurol 241: 253-267.
89. Vincent SL, Khan Y, Benes FM. 1995. Cellular colocalization of dopamine D1 and D2 receptors in rat medial prefrontal cortex. Synapse 19: 112-120.
90. Willcocks AL, McNally GP. 2012. The role of medial prefrontal cortex in extinction and reinstatement of alcohol-seeking in rats. Eur J Neurosci.
91. Winter S, Dieckmann M, Schwabe K. 2009. Dopamine in the prefrontal cortex regulates rats behavioral flexibility to changing reward value. Behav Brain Res 198: 206-213.
92. Yin HH, Knowlton BJ. 2006. The role of the basal ganglia in habit formation. Neuroscience 7: 464-476.