Striatum-dependent habits are insensitive to both increases and decreases in reinforcer value in mice

European Journal of Neuroscience

Volumn 37, Issue 6, 2013, Pages 1012-1021

  Quinn, Jennifer J ^a   Pittenger, Christopher ^b   Lee, Anni S ^b   Pierson, Jamie L ^a   Taylor, Jane R ^b  

^a MIAMI UNIVERSITY   (United States)

^b YALE UNIVERSITY   (United States)

Author keywords

Devaluation; Goal directed; Habitual; Instrumental; Learning

Indexed keywords

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ANIMAL MODEL; ANIMAL TISSUE; ARTICLE; BRAIN DAMAGE; C57BL 6 MOUSE; CONTROLLED STUDY; CORPUS STRIATUM; DECISION MAKING; DIET RESTRICTION; GENETIC ASSOCIATION; HABIT; HABITUATION; HISTOPATHOLOGY; INSTRUMENTAL CONDITIONING; LEARNING; MOTIVATION; MOUSE; NEUROANATOMY; NONHUMAN; PRIORITY JOURNAL; REINFORCEMENT; STIMULUS RESPONSE; TASTE AVERSION;

ANIMALS; CONDITIONING, OPERANT; CORPUS STRIATUM; HABITS; HABITUATION, PSYCHOPHYSIOLOGIC; MICE; MICE, INBRED C57BL; REINFORCEMENT (PSYCHOLOGY);

EID: 84875371901     PISSN: 0953816X     EISSN: 14609568     Source Type: Journal    
DOI: 10.1111/ejn.12106     Document Type: Article

References (48)

1. Adams, C. & Dickinson, A. (1981) Instrumental responding following reinforcer devaluation. Q. J. Exp. Psychol. Sect. B. Comp. Physiol. Psychol., 33, 109-121.
2. Albin, R.L. & Mink, J.W. (2006) Recent advances in Tourette syndrome research. Trends Neurosci., 29, 175-182.
3. Ashby, F.G., Turner, B.O. & Horvitz, J.C. (2010) Cortical and basal ganglia contributions to habit learning and automaticity. Trends Cogn. Sci., 14, 208-215.
4. Balleine, B.W. & Dickinson, A. (1998) Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology, 37, 407-419.
5. Balleine, B.W. & O'Doherty, J.P. (2010) Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacol., 35, 48-69.
6. Barker, J.M., Torregrossa, M.M., Arnold, A.P. & Taylor, J.R. (2010) Dissociation of genetic and hormonal influences on sex differences in alcoholism-related behaviors. J. Neurosci., 30, 9140-9144.
7. Barnes, T.D., Kubota, Y., Hu, D., Jin, D.Z. & Graybiel, A.M. (2005) Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories. Nature, 437, 1158-1161.
8. Belin, D. & Everitt, B.J. (2008) Cocaine seeking habits depend upon dopamine-dependent serial connectivity linking the ventral with the dorsal striatum. Neuron, 57, 432-441.
9. Canales, J.J. (2005) Stimulant-induced adaptations in neostriatal matrix and striosome systems: transiting from instrumental responding to habitual behavior in drug addiction. Neurobiol. Learn. Mem., 83, 93-103.
10. Carelli, R.M., Wolske, M. & West, M.O. (1997) Loss of lever press-related firing of rat striatal forelimb neurons after repeated sessions in a lever pressing task. J. Neurosci., 17, 1804-1814.
11. Colwill, R. & Rescorla, R. (1988) The role of response-reinforcer associations increases throughout extended instrumental training. Anim. Learn. Behav., 16, 105-111.
12. Corbit, L.H., Nie, H. & Janak, P.H. (2012) Habitual alcohol seeking: time course and the contribution of subregions of the dorsal striatum. Biol. Psychiatry., 72, 389-395.
13. Devan, B.D., McDonald, R.J. & White, N.M. (1999) Effects of medial and lateral caudate-putamen lesions on place- and cue-guided behaviors in the water maze: relation to thigmotaxis. Behav. Brain Res., 100, 5-14.
14. Everitt, B.J. & Robbins, T.W. (2005) Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nat. Neurosci., 8, 1481-1489.
15. Faure, A., Haberland, U., Conde, F. & El Massioui, N. (2005) Lesion to the nigrostriatal dopamine system disrupts stimulus-response habit formation. J. Neurosci., 25, 2771-2780.
16. Featherstone, R.E. & McDonald, R.J. (2004) Dorsal striatum and stimulus-response learning: lesions of the dorsolateral, but not dorsomedial, striatum impair acquisition of a simple discrimination task. Behav. Brain Res., 150, 15-23.
17. Grahn, J.A., Parkinson, J.A. & Owen, A.M. (2008) The cognitive functions of the caudate nucleus. Prog. Neurobiol., 86, 141-155.
18. Graybiel, A.M. (2008) Habits, rituals, and the evaluative brain. Annu. Rev. Neurosci., 31, 359-387.
19. Hilário, M.R. & Costa, R.M. (2008) High on habits. Front Neurosci., 2, 208-217.
20. Hilário, M.R., Clouse, E., Yin, H.H. & Costa, R.M. (2007) Endocannabinoid signaling is critical for habit formation. Front Integr. Neurosci., 1, 6.
21. Hitchcott, P.K., Quinn, J.J. & Taylor, J.R. (2007) Bidirectional modulation of goal-directed actions by prefrontal cortical dopamine. Cereb. Cortex, 17, 2820-2827.
22. Holland, P.C. (2004) Relations between Pavlovian-instrumental transfer and reinforcer devaluation. J. Exp. Psychol. Anim. Behav. Process, 30, 104-117.
23. Jog, M.S., Kubota, Y., Connolly, C.I., Hillegaart, V. & Graybiel, A.M. (1999) Building neural representations of habits. Science, 286, 1745-1749.
24. Kubota, Y., Liu, J., Hu, D., DeCoteau, W.E., Eden, U.T., Smith, A.C. & Graybiel, A.M. (2009) Stable encoding of task structure coexists with flexible coding of task events in sensorimotor striatum. J. Neurophysiol., 102, 2142-2160.
25. Leckman, J.F. & Riddle, M.A. (2000) Tourette's syndrome: when habit-forming systems form habits of their own? Neuron, 28, 349-354.
26. Lederle, L., Weber, S., Wright, T., Feyder, M., Brigman, J.L., Crombag, H.S., Saksida, L.M., Bussey, T.J. & Holmes, A. (2011) Reward-related behavioral paradigms for addiction research in the mouse: performance of common inbred strains. PLoS ONE, 6, e15536.
27. Lee, A.S., Duman, R.S. & Pittenger, C. (2008) A double dissociation revealing bidirectional competition between striatum and hippocampus during learning. Proc. Natl. Acad. Sci. USA, 105, 17163-17168.
28. Lingawi, N.W. & Balleine, B.W. (2012) Amygdala central nucleus interacts with dorsolateral striatum to regulate the acquisition of habits. J. Neurosci., 32, 1073-1081.
29. Lovinger, D.M. (2010) Neurotransmitter roles in synaptic modulation, plasticity and learning in the dorsal striatum. Neuropharmacology, 58, 951-961.
30. Packard, M.G. & McGaugh, J.L. (1996) Inactivation of hippocampus or caudate nucleus with lidocaine differentially affects expression of place and response learning. Neurobiol. Learn. Mem., 65, 65-72.
31. Paxinos, G. & Franklin, K.B.J. (2001) The Mouse Brain in Stereotaxic Coordinates, 2nd Edn. Academic Press, San Diego.
32. Pennartz, C.M., Berke, J.D., Graybiel, A.M., Ito, R., Lansink, C.S., van der Meer, M., Redish, A.D., Smith, K.S. & Voorn, P. (2009) Corticostriatal interactions during learning, memory processing, and decision making. J. Neurosci., 29, 12831-12838.
33. Pittenger, C., Fasano, S., Mazzocchi-Jones, D., Dunnett, S.B., Kandel, E.R. & Brambilla, R. (2006) Impaired bidirectional synaptic plasticity and procedural memory formation in striatum-specific cAMP response element-binding protein-deficient mice. J. Neurosci., 26, 2808-2813.
34. Quinn, J.J., Hitchcott, P.K., Umeda, E.A., Arnold, A.P. & Taylor, J.R. (2007) Sex chromosome complement regulates habit formation. Nat. Neurosci., 10, 1398-1400.
35. Ragozzino, M.E., Ragozzino, K.E., Mizumori, S.J. & Kesner, R.P. (2002) Role of the dorsomedial striatum in behavioral flexibility for response and visual cue discrimination learning. Behav. Neurosci., 116, 105-115.
36. Rescorla, R. (1992) Response outcome versus outcome response associations in instrumental learning. Anim. Learn. Behav., 20, 223-232.
37. Tang, C., Pawlak, A.P., Prokopenko, V. & West, M.O. (2007) Changes in activity of the striatum during formation of a motor habit. Eur. J. Neurosci., 25, 1212-1227.
38. Torregrossa, M.M., Quinn, J.J. & Taylor, J.R. (2008) Impulsivity, compulsivity, and habit: the role of orbitofrontal cortex revisited. Biol. Psychiatry, 63, 253-255.
39. Tricomi, E., Balleine, B.W. & O'Doherty, J.P. (2009) A specific role for posterior dorsolateral striatum in human habit learning. Eur. J. Neurosci., 29, 2225-2232.
40. Wickens, J.R., Horvitz, J.C., Costa, R.M. & Killcross, S. (2007) Dopaminergic mechanisms in actions and habits. J. Neurosci., 27, 8181-8183.
41. Yin, H.H. (2010) The sensorimotor striatum is necessary for serial order learning. J. Neurosci., 30, 14719-14723.
42. Yin, H.H. & Knowlton, B.J. (2006) The role of the basal ganglia in habit formation. Nat. Rev. Neurosci., 7, 464-476.
43. Yin, H.H., Knowlton, B.J. & Balleine, B.W. (2004) Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. Eur. J. Neurosci., 19, 181-189.
44. Yin, H.H., Knowlton, B.J. & Balleine, B.W. (2005a) Blockade of NMDA receptors in the dorsomedial striatum prevents action-outcome learning in instrumental conditioning. Eur. J. Neurosci., 22, 505-512.
45. Yin, H.H., Ostlund, S.B., Knowlton, B.J. & Balleine, B.W. (2005b) The role of the dorsomedial striatum in instrumental conditioning. Eur. J. Neurosci., 22, 513-523.
46. Yin, H.H., Knowlton, B.J. & Balleine, B.W. (2006) Inactivation of dorsolateral striatum enhances sensitivity to changes in the action-outcome contingency in instrumental conditioning. Behav. Brain Res., 166, 189-196.
47. Yin, H.H., Mulcare, S.P., Hilário, M.R., Clouse, E., Holloway, T., Davis, M.I., Hansson, A.C., Lovinger, D.M. & Costa, R.M. (2009) Dynamic reorganization of striatal circuits during the acquisition and consolidation of a skill. Nat. Neurosci., 12, 333-341.
48. Yu, C., Gupta, J., Chen, J.F. & Yin, H.H. (2009) Genetic deletion of A2A adenosine receptors in the striatum selectively impairs habit formation. J. Neurosci., 29, 15100-15103.