Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning

European Journal of Neuroscience

Volumn 19, Issue 1, 2004, Pages 181-189

  Yin, Henry H ^a   Knowlton, Barbara J ^a   Balleine, Bernard W ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Basal ganglia; Dorsomedial striatum; Instrumental conditioning; Interval schedules; Procedural learning; Striatum

Indexed keywords

LITHIUM CHLORIDE; SODIUM CHLORIDE; SUCROSE;

ANIMAL EXPERIMENT; ANIMAL TISSUE; ARTICLE; BEHAVIOR; BRAIN FUNCTION; BRAIN INJURY; BRAIN REGION; CONDITIONING; CONTROLLED STUDY; CORPUS STRIATUM; EXPECTANCY; HABIT; LEARNING; MALE; NONHUMAN; PRIORITY JOURNAL; RAT; STIMULUS RESPONSE; TASK PERFORMANCE; TASTE AVERSION; TRAINING;

ANIMALS; BEHAVIOR, ANIMAL; BIOFEEDBACK (PSYCHOLOGY); COGNITION; CONDITIONING, OPERANT; DENERVATION; EXTINCTION, PSYCHOLOGICAL; FEMALE; HABITS; LEARNING; MALE; MOTIVATION; NEOSTRIATUM; RATS; RATS, LONG-EVANS; REINFORCEMENT (PSYCHOLOGY);

EID: 1642580578     PISSN: 0953816X     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1460-9568.2004.03095.x     Document Type: Article

References (48)

1. Adams, C.D. (1981) Variations in the sensitivity of instrumental responding to reinforcer devalaution. Q. J. Exp. Psychol., 34B, 77-98.
2. Adams, C.D. & Dickinson, A. (1981) Instrumental responding following reinforcer devaluation. Q. J. Exp. Psychol., 33B, 109-121.
3. Apicella, P., Ljungberg, T., Scarnati, E. & Schultz, W. (1991) Responses to reward in monkey dorsal and ventral striatum. Exp. Brain Res., 85, 491-500.
4. Balleine, B.W. (2001) Incentive processes in instrumental conditioning. In Klein, S.B. (Ed.), Handbook of Contemporary Learning Theories. Lawrence Erlbaum Associates, Inc., Publishers, Mahwah, NJ, pp. 307-366
5. Balleine, B.W. & Dickinson, A. (1998) Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology, 37, 407-419.
6. Balleine, B.W. & Dickinson, A. (2000) The effect of lesions of the insular cortex on instrumental conditioning: evidence for a role in incentive memory. J. Neurosci., 20, 8954-8964.
7. Balleine, B. & Killcross, S. (1994) Effects of ibotenic acid lesions of the nucleus accumbens on instrumental action. Behav. Brain Res., 65, 181-193.
8. Balleine, B.W., Killcross, A.S. & Dickinson. A. (2003) The effect of lesions of the basolateral amygdala on instrumental conditioning. J. Neurosci., 23, 666-675.
9. Baum, W.M. (1973) The Correlation-Based Law of Effect. J. Exp. Anal. Behav., 20, 137-153.
10. Bonardi, C., Honey, R.C. & Hall, G. (1990) Context specificity of conditioning in flavor-aversion learing: extinction and blocking tests. Anim. Learning Behav., 18, 229-237.
11. de Borchgrave, R., Rawlins, J.N., Dickinson, A. & Balleine, B.W. (2002) Effects of cytotoxic nucleus accumbens lesions on instrumental conditioning in rats. Exp. Brain Res., 144, 50-68.
12. Carelli, R.M., Wolske, M. & West, M.O. (1997) Loss of lever press-related firing of rat striatal forelimb neurons after repeated sessions in a lever pressing task. J. Neurosci., 17, 1804-1814.
13. Colwill, R.M. & Rescorla, R.A. (1990) Effect of reinforcer devaluation on discriminative control of instrumental behavior. J. Exp. Psychol. Anim. Behav. Process, 16, 40-47.
14. Corbit, L.H., Muir, J.L. & Balleine, B.W. (2001) The role of the nucleus accumbens in instrumental conditioning: evidence of a functional dissociation between accumbens core and shell. J. Neurosci., 21, 3251-3260.
15. Corbit, L.H., Muir, J.L. & Balleine, B.W. (2003) Lesions of mediodorsal thalamus and anterior thalamic nuclei produce dissociable effects on instrumental conditioning in rats. Eur. J. Neurosci., 18, 1286-1294.
16. Devan, B.D., McDonald, R.J. & White, N.M. (1999) Effects of medial and lateral caudate-putamen lesions on place-and cue-guided behaviors in the water maze: relation to thigmotaxis. Behav. Brain Res., 100, 5-14.
17. Devan, B.D. & White, N.M. (1999) Parallel information processing in the dorsal striatum: relation to hippocampal function. J. Neurosci., 19, 2789-2798.
18. Dickinson, A. (1980) Contemporary Animal Learning Theory. Cambridge University Press, Cambridge.
19. Dickinson, A. (1985) Actions and habits: the development of behavioural autonomy. Phil. Trans. R. Soc. Lond., B308, 67-78.
20. Dickinson, A. (1989) Expectancy theory in animal conditioning. In Klein, S.B. & Mowrer, R.R. (Eds), Contemporary Learning Theories: Pavlovian Conditioning and the Status of Traditional Learning Theories. Lawrence Erlbaum Associates, Hillsdale, NJ: pp. 279-308
21. Dickinson, A. (1994) Instrumental conditioning. In Mackintosh, N.J. (Ed.), Animal Cognition and Learning. Academic Press. London, pp. 4-79.
22. Dickinson, A. & Balleine, B. (1994) Motivational control of goal-directed action. Anim. Learning Behav., 22, 1-18.
23. Dickinson, A., Balleine, B.W., Watt, A., Gonzales, F. & Boakes, R.A. (1995) Overtraining and the motivational control of instrumental action. Anim. Learning Behav., 22, 197-206.
24. Dickinson, A., Nicholas, D.J. & Adams, C.D. (1983) The effect of the instrumental training contingency on susceptibility to reinforcer devaluation. Q. J. Exp. Psychol., 35B, 35-51.
25. Everitt, B.J. & Wolf, M.E. (2002) Psychomotor stimulant addiction: a neural systems perspective. J. Neurosci., 22, 3312-3320.
26. Graybiel, A.M. (1990) Neurotransmitters and neuromodulators in the basal ganglia. Trends Neurosci., 13, 244-254.
27. Graybiel, A.M. (1998) The basal ganglia and chunking of action repertoires. Neurobiol. Learn. Mem., 70, 119-136.
28. Hall, J., Parkinson, J.A., Connor, T.M., Dickinson, A. & Everitt, B.J. (2001) Involvement of the central nucleus of the amygdala and nucleus accumbens core in mediating Pavlovian influences on instrumental behaviour. Eur. J. Neurosci., 13, 1984-1992.
29. Hikosaka, K. & Watanabe, M. (2000) Delay activity of orbital and lateral prefrontal neurons of the monkey varying with different rewards. Cereb. Cortex, 10, 263-271.
30. Hollerman, J.R., Tremblay, L. & Schultz, W. (2000) Involvement of basal ganglia and orbitofrontal cortex in goal-directed behavior. Prog. Brain Res., 126, 193-215.
31. Jaeger, D., Gilman, S. & Aldridge, J.W. (1993) Primate basal ganglia activity in a precued reaching task: preparation for movement. Exp. Brain Res., 95, 51-64.
32. Jog, M.S., Kubota, Y., Connolly, C.I., Hillegaart, V. & Graybiel, A.M. (1999) Building neural representations of habits. Science, 286, 1745-1749.
33. Killcross, S. & Coutureau, E. (2003) Coordination of actions and habits in the medial prefrontal cortex of rats. Cereb. Cortex, 13, 400-408.
34. Kimura, M. (1990) Behaviorally contingent property of movement-related activity of the primate putamen. J. Neurophysiol., 63, 1277-1296.
35. Kimura, M. (1992) Behavioral modulation of sensory responses of primate putamen neurons. Brain Res., 578, 204-214.
36. Kimura, M., Aosaki, T., Hu, Y., Ishida, A. & Watanabe, K. (1992) Activity of primate putamen neurons is selective to the mode of voluntary movement: visually guided, self-initiated or memory-guided. Exp. Brain Res., 89, 473-477.
37. Knowlton, B.J., Mangels, J.A. & Squire, L.R. (1996) A neostriatal habit learning system in humans [see comments]. Science, 273, 1399-1402.
38. Lauwereyns, J., Takikawa, Y., Kawagoe, R., Kobayashi, S., Koizumi, M., Coe, B., Sakagami, M. & Hikosaka, O. (2002a) Feature-based anticipation of cues that predict reward in monkey caudate nucleus. Neuron, 33, 463-473.
39. Lauwereyns, J., Watanabe, K., Coe, B. & Hikosaka, O. (2002b) A neural correlate of response bias in monkey caudate nucleus. Nature, 418, 413-417.
40. Leon, M.I. & Shadlen, M.N. (1999) Effect of expected reward magnitude on the response of neurons in the dorsolateral prefrontal cortex of the macaque. Neuron, 24, 415-425.
41. Lopez, M., Balleine, B. & Dickinson, A. (1992) Incentive learning following reinforcer devaluation is not conditional upon the motivational state during re-exposure. Q. J. Exp. Psychol. B, 45, 265-284.
42. McDonald, R.J. & White, N.M. (1993) A triple dissociation of memory systems: hippocampus, amygdala, and dorsal striatum. Behav. Neurosci., 107, 3-22.
43. Packard, M.G. & Knowlton, B.J. (2002) Learning and memory functions of the basal ganglia. Annu. Rev. Neurosci., 25, 563-593.
44. Packard, M.G. & McGaugh, J.L. (1996) Inactivation of hippocampus or caudate nucleus with lidocaine differentially affects expression of place and response learning. Neurobiol. Learn. Mem., 65, 65-72.
45. Parkinson, J.A., Cardinal, R.N. & Everitt, B.J. (2000) Limbic cortical-ventral striatal systems underlying appetitive conditioning. Prog. Brain Res., 126, 263-285.
46. Paxinos, G. & Watson, C. (1998) The Rat Brain in Stereotaxic Coordinates, Academic Press, San Diego.
47. West, M.O., Carelli, R.M., Pomerantz, M., Cohen, S.M., Gardner, J.P., Chapin, J.K. & Woodward, D.J. (1990) A region in the dorsolateral striatum of the rat exhibiting single-unit correlations with specific locomotor limb movements. J. Neurophysiol., 64, 1233-1246.
48. White, I.M. & Rebec, G.V. (1993) Responses of rat striatal neurons during performance of a lever-release version of the conditioned avoidance response task. Brain Res., 616, 71-82.