Preferential involvement by nucleus accumbens shell in mediating probabilistic learning and reversal shifts

Journal of Neuroscience

Volumn 34, Issue 13, 2014, Pages 4618-4626

  Dalton, Gemma L ^a   Phillips, Anthony G ^a   Floresco, Stan B ^a  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

Cognitive flexibility; Nucleus accumbens; Probabilistic reinforcement learning; Rat; Reversal learning

Indexed keywords

ANIMAL EXPERIMENT; ANIMAL TISSUE; ARTICLE; CONTROLLED STUDY; HISTOLOGY; LATENT PERIOD; LEARNING; MALE; NONHUMAN; NUCLEUS ACCUMBENS; PRIORITY JOURNAL; PROBABILISTIC REVERSAL LEARNING; RAT; REINFORCEMENT; REWARD; TASK PERFORMANCE;

COGNITIVE FLEXIBILITY; NUCLEUS ACCUMBENS; PROBABILISTIC REINFORCEMENT LEARNING; RAT; REVERSAL LEARNING;

ANIMALS; BACLOFEN; CONDITIONING, OPERANT; GABA AGONISTS; MALE; MICROINJECTIONS; MUSCIMOL; NUCLEUS ACCUMBENS; PROBABILITY LEARNING; RATS; RATS, LONG-EVANS; REINFORCEMENT (PSYCHOLOGY); REVERSAL LEARNING;

EID: 84897826494     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.5058-13.2014     Document Type: Article

References (55)

1. Ambroggi F, Ishikawa A, Fields HL, Nicola SM (2008) Basolateral amygdala neurons facilitate reward seeking behavior by exciting nucleus accumbens neurons. Neuron 59:648-661. CrossRef Medline
2. Ambroggi F, Ghazizadeh A, Nicola SM, Fields HL (2011) Roles of nucleus accumbens core and shell in incentive-cue responding and behavioral inhibition. J Neurosci 31:6820-6830. CrossRef Medline
3. Baliki MN, Mansour A, Baria AT, Huang L, Berger SE, Fields HL, Apkarian AV (2013) Parceling human accumbens into putative core and shell dissociates encoding of values for reward and pain. J Neurosci 33:16383-16393. CrossRef Medline
4. Bari A, Theobald DE, Caprioli D, Mar AC, Aidoo-Micah A, Dalley JW, Robbins TW (2010) Serotonin modulates sensitivity to reward and negative feedback in a probabilistic reversal learning task in rats. Neuropsychopharmacology 35:1290-1301. CrossRef Medline
5. Baudonnat M, Huber A, David V, Walton ME (2013) Heads for learning, tails for memory: reward, reinforcement and a role of dopamine in determining behavioral relevance across multiple timescales. Front Neurosci 7:175. CrossRef Medline
6. Birrell JM, Brown VJ (2000) Medial frontal cortex mediates perceptual attentional set-shifting in the rat. J Neurosci 20:4320-4324. Medline
7. Blaiss CA, Janak PH (2009) The nucleus accumbens core and shell are critical for the expression, but not the consolidation, of Pavlovian conditioned approach. Behav Brain Res 200:22-32. CrossRef Medline
8. Block AE, Dhanji H, Thompson-Tardif SF, Floresco SB (2007) Thalamicprefrontal cortical-ventral striatal circuitry mediates dissociable components of strategy set shifting. Cereb Cortex 17:1625-1636. CrossRef Medline
9. Burk JA, Mair RG (2001) Effects of dorsal and ventral striatal lesions on delayed matching trained with retractable levers. Behav Brain Res 122:67-78. CrossRef Medline
10. Cardinal RN, Pennicott DR, Sugathapala CL, Robbins TW, Everitt BJ (2001) Impulsive choice induced in rats by lesions of the nucleus accumbens core. Science 292:2499-2501. CrossRef Medline
11. Castañé A, Theobald DE, Robbins TW (2010) Selective lesions of the dorsomedial striatum impair serial spatial reversal learning in rats. Behav Brain Res 210:74-83. CrossRef Medline
12. Cools R, Barker RA, Sahakian BJ, Robbins TW (2001) Enhanced or impaired cognitive function in Parkinson's disease as a function of dopaminergic medication and task demands. Cereb Cortex 11:1136-1143. CrossRef Medline
13. Cools R, Clark L, Owen AM, Robbins TW (2002) Defining the neural mechanisms of probabilistic reversal learning using event-related functional magnetic resonance imaging. J Neurosci 22:4563-4567. Medline
14. Cools R, Lewis SJ, Clark L, Barker RA, Robbins TW (2007) L-DOPA disrupts activity in the nucleus accumbens during reversal learning in Parkinson's disease. Neuropsychopharmacology 32:180-189. CrossRef Medline
15. Dias R, Robbins TW, Roberts AC (1996) Primate analogue of the Wisconsin Card Sorting Test: effects of excitotoxic lesions of the prefrontal cortex in the marmoset. Behav Neurosci 110:872-886. CrossRef Medline
16. DiCiano P, Robbins TW, Everitt BJ (2008) Differential effects of nucleus accumbens core, shell, or dorsal striatal inactivations on the persistence, reacquisition, or reinstatement of responding for a drug-paired conditioned reinforcer. Neuropsychopharmacology 33:1413-1425. CrossRef Medline
17. Floresco SB (2007) Dopaminergic regulation of limbic-striatal interplay. J Psychiatry Neurosci 32:400-411. Medline
18. Floresco SB, Seamans JK, Phillips AG (1996) A selective role for dopamine in the nucleus accumbens of the rat in random foraging but not delayed spatial win-shift-based foraging. Behav Brain Res 80:161-168. CrossRef Medline
19. Floresco SB, Ghods-Sharifi S, Vexelman C, Magyar O (2006) Dissociable roles for the nucleus accumbens core and shell in regulating set-shifting. J Neurosci 26:2449-2457. CrossRef Medline
20. Floresco SB, McLaughlin RJ, Haluk DM (2008) Opposing roles for the nucleus accumbens core and shell in cue-induced reinstatement of foodseeking behavior. Neuroscience 154:877-884. CrossRef Medline
21. Floresco SB, Zhang Y, Enomoto T (2009) Neural circuits subserving behavioral flexibility and their relevance to schizophrenia. Behav Brain Res 204:396-409. CrossRef Medline
22. Gal G, Schiller D, Weiner I (2005) Latent inhibition is disrupted by nucleus accumbens shell lesion but is abnormally persistent following entire nucleus accumbens lesion: the neural site controlling the expression and disruption of the stimulus preexposure effect. Behav Brain Res 162:246-255. CrossRef Medline
23. Ghods-Sharifi S, Floresco SB (2010) Differential effects on effort discounting induced by inactivations of the nucleus accumbens core or shell. Behav Neurosci 124:179-191. CrossRef Medline
24. Ghods-Sharifi S, Haluk DM, Floresco SB (2008) Differential effects of inactivation of the orbitofrontal cortex on strategy set-shifting and reversal learning. Neurobiol Learn Mem 89:567-573. CrossRef Medline
25. Haluk DM, Floresco SB (2009) Ventral striatal dopamine modulation of different forms of behavioral flexibility. Neuropsychopharmacology 34: 2041-2052. CrossRef Medline
26. Hampton AN, O'Doherty JP (2007) Decoding the neural substrates of reward-related decision making with functional MRI. Proc Natl Acad Sci U S A 104:1377-1382. CrossRef Medline
27. Kim H, Sul JH, Huh N, Lee D, Jung MW (2009) Role of striatum in updating values of chosen actions. J Neurosci 29:14701-14712. CrossRef Medline
28. Lindgren HS, Wickens R, Tait DS, Brown VJ, Dunnett SB (2013) Lesions of the dorsomedial striatum impair formation of attentional set in rats. Neuropharmacology 71:148-153. CrossRef Medline
29. Marquis JP, Killcross S, Haddon JE (2007) Inactivation of the prelimbic, but not infralimbic, prefrontal cortex impairs the contextual control of response conflict in rats. Eur J Neurosci 25:559-566. CrossRef Medline
30. McAlonan K, Brown VJ (2003) Orbital prefrontal cortex mediates reversal learning and not attentional set-shifting in the rat. Behav Brain Res 146: 97-103. CrossRef Medline
31. Mell T, Wartenburger I, Marschner A, Villringer A, Reischies FM, Heekeren HR (2009) Altered function of ventral striatum during reward-based decision making in old age. Front Hum Neurosci 3:34. CrossRef Medline
32. Moreira CM, Masson S, Carvalho MC, Brandão ML (2007) Exploratory behaviour of rats in the elevated plus-maze is differentially sensitive to inactivation of the basolateral and central amygdaloid nuclei. Brain Res Bull 71:466-474. CrossRef Medline
33. Nicola SM (2010) The flexible approach hypothesis: unification of effort and cue-responding hypotheses for the role of nucleus accumbens dopamine in the activation of reward seeking behavior. J Neurosci 30:16585-16600. CrossRef Medline
34. Parkinson JA, Willoughby PJ, Robbins TW, Everitt BJ (2000) Disconnection of the anterior cingulate cortex and nucleus accumbens core impairs Pavlovian approach behavior: further evidence for limbic cortical-ventral striatopallidal systems. Behav Neurosci 114:42-63. CrossRef Medline
35. Paxinos G, Watson C (2005) The rat brain in stereotaxic coordinates, Ed 5. San Diego: Elsevier Academic.
36. Peters J, La Lumiere RT, Kalivas PW (2008) Infralimbic prefrontal cortex is responsible for inhibiting cocaine seeking in extinguished rats. J Neurosci 28:6046-6053. CrossRef Medline
37. Peterson DA, Elliott C, Song DD, Makeig S, Sejnowski TJ, Poizner H (2009) Probabilistic reversal learning is impaired in Parkinson's disease. Neuroscience 163:1092-1101. CrossRef Medline
38. Pothuizen HH, Jongen-Rêlo AL, Feldon J, Yee BK (2005) Double dissociation of the effects of selective nucleus accumbens core and shell lesions on impulsive-choice behaviour and salience learning in rats. Eur J Neurosci 22:2605-2616. CrossRef Medline
39. Ragozzino ME, Detrick S, Kesner RP (1999) Involvement of the prelimbic/ infralimbic areas of the rodent prefrontal cortex in behavioral flexibility for place and response learning. J Neurosci 19:4585-4594. Medline
40. Ragozzino ME, Jih J, Tzavos A (2002) Involvement of the dorsomedial striatum in behavioral flexibility: role of muscarinic cholinergic receptors. Brain Res 953:205-214. CrossRef Medline
41. Reynolds SM, Berridge KC (2001) Fear and feeding in the nucleus accumbens shell: rostrocaudal segregation of GABA-elicited defensive behavior versus eating behavior. J Neurosci 21:3261-3270. Medline
42. Reynolds SM, Berridge KC (2008) Emotional environments retune the valence of appetitive versus fearful functions in nucleus accumbens. Nat Neurosci 11:423-425. CrossRef Medline
43. Roiser JP, Cannon DM, Gandhi SK, Taylor Tavares J, Erickson K, Wood S, Klaver JM, Clark L, Zarate CA Jr, Sahakian BJ, Drevets WC (2009) Hot and cold cognition in unmedicated depressed subjects with bipolar disorder. Bipolar Disord 11:178-189. CrossRef Medline
44. Saunders BT, Robinson TE (2012) The role of dopamine in the accumbens core in the expression of Pavlovian-conditioned responses. Eur J Neurosci 36:2521-2532. CrossRef Medline
45. Schoenbaum G, Setlow B (2003) Lesions of nucleus accumbens disrupt learning about aversive outcomes. J Neurosci 23:9833-9841. Medline
46. Seamans JK, Phillips AG (1994) Selective memory impairments produced by transient lidocaine-induced lesions of the nucleus accumbens in rats. Behav Neurosci 108:456-468. CrossRef Medline
47. Stopper CM, Floresco SB (2011) Contributions of the nucleus accumbens and its subregions to different aspects of risk-based decision making. Cogn Affect Behav Neurosci 11:97-112. CrossRef Medline
48. Stratford TR, Kelley AE (1997) GABA in the nucleus accumbens shell participates in the central regulation of feeding behavior. J Neurosci 17: 4434-4440. Medline
49. Taylor Tavares JV, Clark L, Furey ML, Williams GB, Sahakian BJ, Drevets WC (2008) Neural basis of abnormal response to negative feedback in unmedicated mood disorders. Neuroimage 42:1118-1126. CrossRef Medline
50. Tsuchida A, Doll BB, Fellows LK (2010) Beyond reversal: a critical role for human orbitofrontal cortex in flexible learning from probabilistic feedback. J Neurosci 30:16868-16875. CrossRef Medline
51. van Duuren E, van der Plasse G, van der Blom R, Joosten RN, Mulder AB, Pennartz CM, Feenstra MG (2007) Pharmacological manipulation of neuronal ensemble activity by reverse microdialysis in freely moving rats: a comparative study of the effects of tetrodotoxin, lidocaine, and muscimol. J Pharmacol Exp Ther 323:61-69. CrossRef Medline
52. Waltz JA, Gold JM (2007) Probabilistic reversal learning impairments in schizophrenia: further evidence of orbitofrontal dysfunction. Schizophr Res 93:296-303. CrossRef Medline
53. Weiner I (2003) The "two-headed" latent inhibition model of schizophrenia: modeling positive and negative symptoms and their treatment. Psychopharmacology (Berl) 169:257-297. CrossRef Medline
54. Weiner I, Feldon J (1997) The switching model of latent inhibition: an update of neural substrates. Behav Brain Res 88:11-25. CrossRef Medline
55. Záborszky L, Alheid GF, Beinfeld MC, Eiden LE, Heimer L, Palkovits M (1985) Cholecystokinin innervation of the ventral striatum: a morphological and radioimmunological study. Neuroscience 14:427-453. CrossRef Medline