The roles of the nucleus accumbens core, dorsomedial striatum, and dorsolateral striatum in learning: Performance and extinction of Pavlovian fear-conditioned responses and instrumental avoidance responses

Neurobiology of Learning and Memory

Volumn 109, Issue , 2013, Pages 27-36

  Wendler, Etieli ^a   Gaspar, Jessica C C ^a   Ferreira, Tatiana L ^b   Barbiero, Janaína K ^a   Andreatini, Roberto ^a   Vital, Maria A B F ^a   Blaha, Charles D ^c   Winn, Philip ^d   Da Cunha, Claudio ^a,c  

^a FEDERAL UNIVERSITY OF PARANÁ   (Brazil)

^b UNIVERSIDADE FEDERAL DO ABC   (Brazil)

^c University of Memphis   (United States)

^d UNIVERSITY OF STRATHCLYDE   (United Kingdom)

Author keywords

Caudate putamen; Conditioned avoidance responses; Neostriatum; Pavlovian fear conditioning; Procedural memory; Ventral striatum

Indexed keywords

ANIMAL EXPERIMENT; ANIMAL TISSUE; ARTICLE; AVOIDANCE BEHAVIOR; CONDITIONED REFLEX; CONTROLLED STUDY; CORPUS STRIATUM; DORSOLATERAL STRIATUM; DORSOMEDIAL STRIATUM; FEAR; FOOTSHOCK; FREEZING; GOAL ATTAINMENT; INSTRUMENTAL CONDITIONING; MALE; NONHUMAN; NUCLEUS ACCUMBENS; NUCLEUS ACCUMBENS CORE; RAT; REINFORCEMENT; RESPONSE TIME; SHAM PROCEDURE; TASK PERFORMANCE;

CAUDATE-PUTAMEN; CONDITIONED AVOIDANCE RESPONSES; NEOSTRIATUM; PAVLOVIAN FEAR CONDITIONING; PROCEDURAL MEMORY; VENTRAL STRIATUM;

ANIMALS; AVOIDANCE LEARNING; CONDITIONING, CLASSICAL; CONDITIONING, OPERANT; CORPUS STRIATUM; EXTINCTION, PSYCHOLOGICAL; FEAR; MALE; NUCLEUS ACCUMBENS; RATS; RATS, WISTAR;

EID: 84890840756     PISSN: 10747427     EISSN: 10959564     Source Type: Journal    
DOI: 10.1016/j.nlm.2013.11.009     Document Type: Article

References (79)

1. Albrechet-Souza L., Borelli K.G., Almada R.C., Brandao M.L. Midazolam reduces the selective activation of the rhinal cortex by contextual fear stimuli. Behavioural Brain Research 2011, 216:631-638.
2. Alderson H.L., Latimer M.P., Blaha C.D., Phillips A.G., Winn P. An examination of d-amphetamine self-administration in pedunculopontine tegmental nucleus-lesioned rats. Neuroscience 2004, 125:349-358.
3. Anstrom K.K., Woodward D.J. Restraint increases dopaminergic burst firing in awake rats. Neuropsychopharmacology 2005, 30(10):1832-1840.
4. Balleine B.W., Delgado M.R., Hikosaka O. The role of the dorsal striatum in reward and decision-making. Journal of Neuroscience 2007, 27:8161-8165.
5. Balleine B.W., O'Doherty J.P. Human and rodent homologies in action control: Corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology 2010, 35:48-69.
6. Belin D., Jonkman S., Dickinson A., Robbins T.W., Everitt B.J. Parallel and interactive learning processes within the basal ganglia: Relevance for the understanding of addiction. Behavioural Brain Research 2009, 199:89-102.
7. Berridge K.C. From prediction error to incentive salience: Mesolimbic computation of reward motivation. European Journal of Neuroscience 2012, 35:1124-1143.
8. Blanchard R.J., Blanchard D.C. Crouching as an index of fear. Journal of Comparative Physiology and Psychology 1969, 67:370-375.
9. Blanchard R.J., Blanchard D.C. Attack and defense in rodents as ethoexperimental models for the study of emotion. Progress in Neuro-Psychopharmacology & Biological Psychiatry 1989, 13:S3-S14.
10. Bolles R.C. Species-specific defense reactions and avoidance learning. Psychological Review 1970, 77:32-48.
11. Boschen S.L., Wietzikoski E.C., Winn P., Da Cunha C. The role of nucleus accumbens and dorsolateral striatal D2 receptors in active avoidance conditioning. Neurobiology of Learning and Memory 2011, 96:254-262.
12. Bossert J.M., Stern A.L., Theberge F.R.M., Marchant N.J., Wang H.-L., Morales M., et al. Role of projections from ventral medial prefrontal cortex to nucleus accumbens shell in context-induced reinstatement of heroin seeking. Journal of Neuroscience 2012, 32:4982-4991.
13. Broadbent N.J., Squire L.R., Clark R.E. Rats depend on habit memory for discrimination learning and retention. Learning and Memory 2009, 14:145-151.
14. Cammarota M., Bevilaqua L.R.M., Kohler C., Medina J.H., Izquierdo I. Learning twice is different from learning once and from learning more. Neuroscience 2005, 132:273-279.
15. Castañé A., Theobald T.E.H., Robbins T.W. Selective lesions of the dorsomedial striatum impair serial spatial reversal learning in rats. Behavioral Brain Research 2010, 210:74-83.
16. Da Cunha C., Gomes A., Blaha C.D. The role of the basal ganglia in motivated behavior. Reviews in Neurosciences 2012, 23:747-767.
17. Da Cunha C., Gevaerd M.S., Vital M., Miyoshi E., Andreatini R., Silveira R., et al. Memory disruption in rats with nigral lesions induced by MPTP: A model for early Parkinson's disease amnesia. Behavioural Brain Research 2001, 124:9-18.
18. Da Cunha C., Wietzikoski E.C., Dombrowski P., Santos L.M., Bortolanza M., Boschen S.L., et al. Learning processing in the basal ganglia: A mosaic of broken mirrors. Behavioural Brain Research 2009, 199:156-169.
19. Darvas M., Fadok J.P., Palmiter R.D. Requirement of dopamine signaling in the amygdala and striatum for learning and maintenance of a conditioned avoidance response. Learning and Memory 2011, 18:136-143.
20. Deakin J.F.W., Graeff F. 5-ht and mechanisms of defence. Journal of Psychopharmacology 1991, 5:305-315.
21. Delgado M.R., Li J., Schiller D., Phelps E.A. The role of the striatum in aversive learning and aversive prediction errors. The Philosophical Transactions of the Royal Society of London Series B - Biological Sciences 2008, 363:3787-3800.
22. Delgado M.R., Tricomi E. Reward processing and decision making in the human striatum. Neuroscience of decision making 2011, 145-172. Psychology Press, Hove. O. Vartanian, D.R. Mandel (Eds.).
23. Devan B.D., White N.M. Parallel information processing in the dorsal striatum: Relation to hippocampal function. Journal of Neuroscience 1999, 19:2789-2798.
24. Dezfouli A., Balleine B.W. Habits, action sequences and reinforcement learning. European Journal of Neuroscience 2012, 35:1036-1051.
25. Di Chiara G. Nucleus accumbens shell and core dopamine: Differential role in behavior and addiction. Behavioural Brain Research 2002, 137:75-114.
26. Dickinson A., Balleine B. Motivational control of goal-directed action. Animal Learning & Behavior 1994, 22:1-18.
27. Dombrowski P., Maia T.V., Boschen S.L., Bortolanza M., Wendler E., Schwarting R.K.W., et al. Evidence that conditioned avoidance responses are reinforced by positive prediction errors signaled by tonic striatal dopamine. Behavioural Brain Research 2013, 241:112-119.
28. Fanselow M.S., Bolles R.C. Naloxone and shock-elicited freezing in the rat. Journal of Comparative and Physiological Psychology 1979, 93:736-744.
29. Ferreira T.L., Moreira K.M., Ikeda D.C., Bueno O.F.A., Gabriela M., Oliveira M.G.M. Effects of dorsal striatum lesions in tone fear conditioning and contextual fear conditioning. Brain Research 2003, 987:17-24.
30. Flagel S.B., Clark J.J., Robinson T.E., Mayo L., Czuj A., Willuhn I., et al. A selective role for dopamine in stimulus-reward learning. Nature 2011, 469:53-U63.
31. Graybiel A.M. Habits, rituals, and the evaluative brain. Annual Review of Neuroscience 2008, 31:359-387.
32. Haber S.N., Knutson B. The reward circuit: Linking primate anatomy and human imaging. Neuropsychopharmacology 2010, 35:4-26.
33. Haralambous T., Westbrook R.F. An infusion of bupivacaine into the nucleus accumbens disrupts the acquisition but not the expression of contextual fear conditioning. Behavioral Neuroscience 1999, 113:925-940.
34. Ikemoto S. Dopamine reward circuitry: Two projection systems from the ventral midbrain to the nucleus accumbens-olfactory tubercle complex. Brain Research Reviews 2007, 56:27-78.
35. Ikemoto S., Panksepp J. The role of nucleus accumbens dopamine in motivated behavior: A unifying interpretation with special reference to reward-seeking. Brain Research Reviews 1999, 31:6-41.
36. Izquierdo I., Bevilaqua L.R.M., Rossato J.I., Bonini J.S., Da Silva W.C., Medina J.H., et al. The connection between the hippocampal and the striatal memory systems of the brain: A review of recent findings. Neurotoxicity Research 2006, 10:113-121.
37. Jensen J., McIntosh A.R., Crawley A.P., Mikulis D.J., Remington G., Kapur S. Direct activation of the ventral striatum in anticipation of aversive stimuli. Neuron 2003, 40:1251-1257.
38. Klucken T., Schweckendiek J., Koppe G., Merz C.J., Kagerer S., Walter B., et al. Neural correlates of disgust- and fear-conditioned responses. Neuroscience 2012, 201:209-218.
39. Knowlton B.J., Mangels J.A., Squire L.R. A neostriatal habit learning system in humans. Science 1996, 273:1399-1402.
40. Kravitz A.V., Tye L.D., Kreitzer A.C. Distinct roles for direct and indirect pathway striatal neurons in reinforcement. Nature Neuroscience 2012, 15:816-U823.
41. La Lumiere R.T., Nawar E.M., McGaugh J.L. Modulation of memory consolidation by the basolateral amygdala or nucleus accumbens shell requires concurrent dopamine receptor activation in both brain regions. Learning & Memory 2005, 12:296-301.
42. Levita L., Dalley J.W., Robbins T.W. Disruption of Pavlovian contextual conditioning by excitotoxic lesions of the nucleus accumbens core. Behavioral Neuroscience 2002, 116:539-552.
43. Levita L., Hoskin R., Champi S. Avoidance of harm and anxiety: A role for the nucleus accumbens. Neuroimage 2012, 62:189-198.
44. Liljeholm M., O'Doherty J.P. Contributions of the striatum to learning, motivation, and performance: An associative account. Trends in Cognitive Sciences 2012, 16:467-475.
45. Lovibond P.F., Chen S.X., Mitchell C.J., Weidemann G. Competition between an avoidance response and a safety signal: Evidence for a single learning system. Biological Psychology 2013, 92:9-16.
46. Maia T.V. Two-factor theory, the actor-critic model, and conditioned avoidance. Learning & Behavior 2010, 38:50-67.
47. Manago F., Castellano C., Oliverio A., Mele A., De Leonibus E. Role of dopamine receptors subtypes, D1-like and D2-like, within the nucleus accumbens subregions, core and shell, on memory consolidation in the one-trial inhibitory avoidance task. Learning & Memory 2009, 16:46-52.
48. Martinez R.C.R., Oliveira A.R., Macedo C.E., Molina V.A., Brandao M.L. Involvement of dopaminergic mechanisms in the nucleus accumbens core and shell subregions in the expression of fear conditioning. Neuroscience Letters 2008, 446:112-116.
49. McCullough L.D., Salamone J.D. Involvement of nucleus accumbens dopamine in the motor activity induced by periodic food presentantion: A microdialysis and behavioral study. Brain Research 1992, 592:29-36.
50. McCullough L.D., Sokolowski J.D., Salamone J.D. A neurochemical and behavioral investigation of the involvement of nucleus accumbens dopamine in instrumental avoidance. Neuroscience 1993, 52:919-925.
51. Mishkin M., Malamut B., Bachevalier J. Memories and habits: Two neural systems. Neurobiology of learning and memory 1982, 65-77. Guilford, New York. R.G.M. Morris, P. Garrud, J.N.P. Rawlins, J. O'Keefe (Eds.).
52. Mowrer O.H. Two-factor learning theory reconsidered, with special reference to secondary reinforcement and the concept of habit. Psychological Review 1956, 63:114-128.
53. Packard M.G., Introini-Collison I., McGaugh J.L. Stria terminalis lesions attenuate memory enhancement produced by intracaudate nucleus injections of oxotremorine. Neurobiology of Learning and Memory 1996, 65:278-282.
54. Packard M.G., Knowlton B.J. Learning and memory functions of the basal ganglia. Annual Review of Neuroscience 2002, 25:563-593.
55. Parkinson J.A., Robbins T.W., Everitt B.J. Selective excitotoxic lesions of the nucleus accumbens core and shell differentially affect aversive pavlovian conditioning to discrete and contextual cues. Psychobiology 1999, 27:256-266.
56. Paxinos G., Watson C. The rat brain in stereotaxic coordinates 2005, Academic Press Ltd, San Diego, CA, USA.
57. Pezze M.A., Feldon J. Mesolimbic dopaminergic pathways in fear conditioning. Progress in Neurobiology 2004, 74:301-320.
58. Phan K.L., Taylor S.F., Welsh R.C., Ho S.-H., Britton J.C., Liberzon I. Neural correlates of individual ratings of emotional salience: A trial-related fMRI study. NeuroImage 2004, 21(2):768-780.
59. Prado-Alcala R.A., Fernandez-Samblancat M., Solodkinherrera M. Injections of atropine into the caudate-nucleus impair the acquisition and the maintenance of passive-avoidance. Pharmacology Biochemistry and Behavior 1985, 22:243-247.
60. Redgrave P., Rodriguez M., Smith Y., Rodriguez-Oroz M.C., Lehericy S., Bergman H., et al. Goal-directed and habitual control in the basal ganglia: Implications for Parkinson's disease. Nature Reviews Neuroscience 2010, 11:760-772.
61. Riedel G., Harrington N.R., Hall G., Macphail E.M. Nucleus accumbens lesions impair context, but not cue, conditioning in rats. NeuroReport 1997, 8:2477-2481.
62. Roozendaal B., de Quervain D.J.F., Ferry B., Setlow B., McGaugh J.L. Basolateral amygdala-nucleus accumbens interactions in mediating glucocorticoid enhancement of memory consolidation. Journal of Neuroscience 2001, 21:2518-2525.
63. Salamone J.D., Cousins M.S., Snyder B.J. Behavioral functions of nucleus accumbens dopamine: Empirical and conceptual problems with the anhedonia hypothesis. Neuroscience & Biobehavioral Reviews 1997, 21(3):341-359.
64. Salomone J.D. The involvement of nucleus accumbens dopamine in appetitive and aversive motivation. Behavioral Brain Research 1994, 61(2):117-133.
65. Salomone J.D. The behavioral neurochemistry of motivation: Methodological and conceptual issues in studies of the dynamic activity of nucleus accumbens dopamine. Journal of Neuroscience Methods 1996, 64:137-149.
66. Schenberg E.E., Ferreira T.L., Figueredo L.Z., Hipolide D.C., Nobrega J.N., Oliveira M.G.M. Fear conditioning performance and NMDA receptor subtypes: NR2a differential expression in the striatum. Brain Research Bulletin 2006, 69:440-446.
67. Schultz W., Dayan P., Montague P.R. A neural substrate of prediction and reward. Science 1997, 275:1593-1599.
68. Sorg B.A., Kalivas P.W. Effects of cocaine and footshock stress on extracellular dopamine levels in the ventral striatum. Brain Research 1991, 559(1):29-36.
69. Tidey J.W., Miczek K.A. Social defeat stress selectively alters mesocorticolimbic dopamine release: An in vivo microdialysis study. Brain Research 1996, 721(1-2):140-149.
70. Wadenberg M.L., Ericson E., Magnusson O., Ahlenius S. Suppression of conditioned avoidance-behavior by the local application of (-)sulpiride into the ventral, but not the dorsal, striatum of the rat. Biological Psychiatry 1990, 28:297-307.
71. White N.M., Salinas J.A. Mnemonic functions of dorsal striatum and hippocampus in aversive conditioning. Behavioural Brain Research 2003, 142:99-107.
72. Wietzikoski E.C., Boschen S.L., Miyoshi E., Bortolanza M., Santos L.M., Frank M., et al. Roles of D1-like dopamine receptors in the nucleus accumbens and dorsolateral striatum in conditioned avoidance response. Psychopharmacology (Berlin) 2012, 219:159-169.
73. Wilson D.I.G., MacLaren D.A.A., Winn P. Bar pressing for food: Differential consequences of lesions to the anterior versus posterior pedunculopontine. European Journal of Neuroscience 2009, 30:504-513.
74. Wyers E.J., Peeke H.V.S., Williston J., Herz M.J. Retroactive impairment of passive avoidance learning by stimulation of caudate nucleus. Experimental Neurology 1968, 22:350-366.
75. Yin H.H., Knowlton B.J. The role of the basal ganglia in habit formation. Nature Reviews Neuroscience 2006, 7:464-476.
76. Yin H.H., Knowlton B.J., Balleine B.W. Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. European Journal of Neuroscience 2004, 19:181-189.
77. Yin H.H., Knowlton B.J., Balleine B.W. Inactivation of dorsolateral striatum enhances sensitivity to changes in the action-outcome contingency in instrumental conditioning. Behavioural Brain Research 2006, 166:189-196.
78. Yin H.H., Ostlund S.B., Balleine B.W. Reward-guided learning beyond dopamine in the nucleus accumbens: The integrative functions of cortico-basal ganglia networks. European Journal of Neuroscience 2008, 28:1437-1448.
79. Young A.M.J. Increased extracellular dopamine in nucleus accumbens in response to unconditioned and conditioned aversive stimuli: Studies using 1min microdialysis in rats. Journal of Neuroscience Methods 2004, 138:57-63.