Cortical and basal ganglia contributions to habit learning and automaticity

Trends in Cognitive Sciences

Volumn 14, Issue 5, 2010, Pages 208-215

  Ashby, F Gregory ^a   Turner, Benjamin O ^a   Horvitz, Jon C ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b CITY COLLEGE OF NEW YORK   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COGNITIVE SYSTEMS;

20TH CENTURY; BASAL GANGLIA; EARLY LEARNING; HABIT LEARNING; SENSORIMOTOR STRIATUM; STRIATUM; SUBCORTICAL STRUCTURES;

BIOLOGY;

DOPAMINE;

AUTOMATICITY; BASAL GANGLION; BEHAVIOR; BRAIN CORTEX; COGNITION; CORPUS STRIATUM; HABIT; HUMAN; LEARNING; NERVE CELL PLASTICITY; NONHUMAN; REVIEW; SENSORIMOTOR CORTEX; AUTOMATISM; PHYSIOLOGY;

ASSOCIATION LEARNING; AUTOMATISM; BASAL GANGLIA; CEREBRAL CORTEX; HABITS; HUMANS; LEARNING;

EID: 77956207035     PISSN: 13646613     EISSN: 1879307X     Source Type: Journal    
DOI: 10.1016/j.tics.2010.02.001     Document Type: Review

References (86)

1. Rosenbaum, D.A. et al. (2001) Acquisition of intellectual and perceptual-motor skills. Annu. Rev. Psychol. 52, 453-470
2. Sherrington, C.S. (1906) The integrative action of the nervous system, Yale University Press
3. Lashley, K.S. (1950) In search of the engram. In Society of Experimental Biology Symposium (Vol. 4), pp. 454-480, Cambridge University Press
4. Matsuzaka, Y. et al. (2007) Skill representation in the primary motor cortex after long-term practice. J. Neurophysiol. 97, 1819-1832
5. Moors, A. and Houwer, J.D. (2006) Automaticity: A theoretical and conceptual analysis. Psychol. Bull. 132, 297-326
6. Bargh, J.A. and Williams, E.L. (2006) The automaticity of social life. Curr. Dir. Psychol. Sci. 15, 1-4
7. Yarrow, K. et al. (2009) Inside the brain of an elite athlete: The neural processes that support high achievement in sports. Nat. Rev. Neurosci. 10, 585-596
8. Doyon, J. et al. (2009) Contributions of the basal ganglia and functionally related brain structures to motor learning. Behav. Brain. Res. 199, 61-75
9. Ito, M. (2002) Historical review of the significance of the cerebellum and the role of Purkinje cells in motor learning. Ann. N. Y. Acad. Sci. 978, 273-288
10. Ramnani, N. (2006) The primate cortico-cerebellar system: anatomy and function. Nat. Rev. Neurosci. 7, 511-522
11. Ashby, F.G. and Ennis, J.M. (2006) The role of the basal ganglia in category learning. In The psychology of learning and motivation (Ross, B.H., ed.), pp. 1-36, Elsevier
12. Doyon, J. andUngerleider, L.G. (2002)Functionalanatomy ofmotor skill learning. In Neuropsychology of memory (Squire, L.R. and Schacter, D.L., eds), pp. 225-238, Guilford Press
13. Packard, M.G. and Knowlton, B.J. (2002) Learning and memory functions of the basal ganglia. Annu. Rev. Neurosci. 25, 563-593
14. Miyachi, S. et al. (2002) Differential activation of monkey striatal neurons in the early and late stages of procedural learning. Exp. Brain Res. 146, 122-126
15. Lehéricy, S. et al. (2005) Distinct basal ganglia territories are engaged in early and advanced motor sequence learning. Proc. Natl. Acad. Sci. U. S. A. 102, 12566-12571
16. Poldrack, R.A. et al. (2005) The neural correlates of motor skill automaticity. J. Neurosci. 25, 5356-5364
17. Wu, T. et al. (2004) How self-initiated memorized movements become automatic: A functional MRI study. J. Neurophysiol. 91, 1690-1698
18. Miyachi, S. et al. (1997) Differential roles of monkey striatum in learning of sequential hand movement. Exp. Brain Res. 115, 1-5
19. Yin, H.H. et al. (2008) Reward-guided learning beyond dopamine in the nucleus accumbens: The integrative functions of cortico-basal ganglia networks. Eur. J. Neurosci. 28, 1437-1448
20. Yin, H.H. et al. (2005) The role of the dorsomedial striatum in instrumental conditioning. Eur. J. Neurosci. 22, 513-523
21. Yin, H.H. et al. (2004) Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. Eur. J. Neurosci. 19, 181-189
22. Carelli, R.M. et al. (1997) Loss of lever press-related firing of rat striatal forelimb neurons after repeated sessions in a lever pressing task. J. Neurosci. 17, 1804-1814
23. Barnes, T.D. et al. (2005) Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories. Nature 437, 1158-1161
24. Tang, C. et al. (2007) Changes in activity of the striatum during formation of a motor habit. Eur. J. Neurosci. 25, 1212-1227
25. Kelly, R.M. and Strick, P.L. (2004) Macro-architecture of basal ganglia loops with the cerebral cortex: Use of rabies virus to reveal multisynaptic circuits. Prog. Brain Res. 143, 449-459
26. Haber, S.N. and Gdowski,M.J. (2004) The basal ganglia, In The human nervous system (2nd edn) (Paxinos, G. and Mai, J.K., eds), pp. 676-738, Elsevier
27. Belin, D. et al. (2009) Parallel and interactive learning processes within the basal ganglia: Relevance for the understanding of addiction. Behav. Brain Res. 199, 89-102
28. Costa, R.M. (2007) Plastic corticostriatal circuits for action learning: What's dopamine got to do with it? Ann. N. Y. Acad. Sci. 1104, 172-191
29. Yin, H.H. and Knowlton, B.J. (2006) The role of the basal ganglia in habit formation. Nat. Rev. Neurosci. 7, 464-476
30. Turner, R.S. et al. (2005) Sequential motor behavior and the basal ganglia. In The basal ganglia VIII (Advances in Behavioral Biology, vol. 56) (Bolam, J.P., Ingham, C.A. and Magill, P.J., eds), pp. 563-574, Springer
31. Doupe, A.J. et al. (2005) Birdbrains could teach basal ganglia research a new song. Trends Neurosci. 28, 353-363
32. Calabresi, P. et al. (2007) Dopamine-mediated regulation of corticostriatal synaptic plasticity. Trends Neurosci. 30, 211-219
33. Wickens, J.R. et al. (2003) Neural mechanisms of reward-related motor learning. Curr. Opin. Neurobiol. 13, 685-690
34. Doya, K. (2007) Reinforcement learning: Computational theory and biological mechanisms. HFSP J. 1, 30-40
35. Dayan, P. and Abbott, L.F. (2001) Theoretical neuroscience: Computational and mathematical modeling of neural systems, MIT Press
36. Schultz, W. (2002) Getting formal with dopamine and reward. Neuron 36, 241-263
37. Horvitz, J.C. (2009) Stimulus-response and response-outcome learning mechanisms in the striatum. Behav. Brain Res. 199, 129-140
38. Wickens, J.R. et al. (2007) Striatal contributions to reward and decision making: Making sense of regional variations in a reiterated processing matrix. Ann. N. Y. Acad. Sci. 1104, 192-212
39. Aosaki, T. et al. (1994) Effect of the nigrostriatal dopamine system on acquired neural responses in the striatum of behaving monkeys. Science 265, 412-415
40. Koos, T. et al. (2004) Comparison of IPSCs evoked by spiny and fastspiking neurons in the neostriatum. J. Neurosci. 24, 7916-7922
41. Tunstall, M.J. et al. (2002) Inhibitory interactions between spiny projection neurons in the rat striatum. J. Neurophysiol. 88, 1263-1269
42. Horvitz, J.C. et al. (2007) A "good parent" function of dopamine: Transient modulation of learning and performance during early stages of training. Ann. N. Y. Acad. Sci. 1104, 270-288
43. Mazzoni, P. et al. (2007) Why don't wemove faster? Parkinson's disease, movement vigor, and implicit motivation. J. Neurosci. 27, 7105-7116
44. MacDonald, C.J. and Meck, W.H. (2006) Interaction of raclopride and preparatory interval effects on simple reaction time performance. Behav. Brain Res. 175, 62-74
45. Asmus, F. et al. (2008) Kick and rush: Paradoxical kinesia in Parkinson disease. Neurology 71, 695
46. Choi, W.Y. et al. (2005) Extended habit training reduces dopamine mediation of appetitive response expression. J. Neurosci. 25, 6729- 6733
47. Bespalov, A.Y. et al. (2007) AMPA receptor antagonists reverse effects of extended habit training on signaled food approach responding in rats. Psychopharmacology (Berl) 195, 11-18
48. Ashby, F.G. et al. (2007) A neurobiological theory of automaticity in perceptual categorization. Psychol. Rev. 114, 632-656
49. Horvitz, J.C. (2002) Dopamine gating of glutamatergic sensorimotor and incentive motivational input signals to the striatum. Behav. Brain Res. 137, 65-74
50. O'Donnell, P. (2003) Dopamine gating of forebrain neural ensembles. Eur. J. Neurosci. 17, 429-435
51. Kelly, A.M.C. and Garavan, H. (2005) Human functional neuroimaging of brain changes associated with practice. Cereb. Cortex 15, 1089-1102
52. Jansma, J.M. et al. (2001) Functional anatomical correlates of controlled and automatic processing. J. Cogn. Neurosci. 13, 730-743
53. Hempel, A. et al. (2004) Plasticity of cortical activation related to working memory during training. Am. J. Psychiatry. 161, 745-747
54. Toni, I. et al. (2001) Learning arbitrary visuomotor associations: temporal dynamic of brain activity. Neuroimage 14, 1048-1057
55. Toni, I. et al. (2002) Changes of corticostriatal effective connectivity during visuomotor learning. Cereb. Cortex 12, 1040-1047
56. Karni, A. et al. (1995) Functional MRI evidence for adult motor cortex plasticity during motor skill learning. Nature 377, 155-158
57. Hazeltine, E. et al. (1997) Attention and stimulus characteristics determine the locus of motor-sequence encoding. A PET study. Brain 120, 123-140
58. Honda, M. et al. (1998) Dynamic cortical involvement in implicit and explicit motor sequence learning. A PET study. Brain 121, 2159-2173
59. Iacoboni, M. et al. (1996) Brain-behavior relationships: evidence from practice effects in spatial stimulus-response compatibility. J. Neurophysiol. 76, 321-331
60. Poldrack, R.A. et al. (1998) The neural basis of visual skill learning: an fMRI study of mirror reading. Cereb. Cortex 8, 1-10
61. Poldrack, R.A. and Gabrieli, J.D. (2001) Characterizing the neural mechanisms of skill learning and repetition priming: evidence from mirror reading. Brain 124, 67-82
62. Sakai, K. et al. (1998) Transition of brain activation from frontal to parietal areas in visuomotor sequence learning. J. Neurosci. 18, 1827- 1840
63. Raichle, M.E. et al. (1994) Practice-related changes in human brain functional anatomy during nonmotor learning. Cereb. Cortex 4, 8-26
64. Floyer-Lea, A. and Matthews, P.M. (2005) Distinguishable brain activation networks for short- and long-term motor skill learning. J. Neurophysiol. 94, 512-518
65. Landau, S.M. and D'Esposito, M. (2006) Sequence learning in pianists and nonpianists: An fMRI study of motor expertise. Cogn. Affect. Behav. Neurosci. 6, 246-259
66. Coutureau, E. and Killcross, S. (2003) Inactivation of the infralimbic prefrontal cortex reinstates goal-directed responding in overtrained rats. Behav. Brain Res. 146, 167-174
67. Schultz, W. (2006) Behavioral theories and the neurophysiology of reward. Annu. Rev. Psychol. 57, 87-115
68. Wunderlich, K. et al. (2009) Neural computations underlying actionbased decision making in the human brain. Proc. Natl. Acad. Sci. U. S. A. 106, 17199-17204
69. Amemori, K. and Sawaguchi, T. (2006) Contrasting effects of reward expectation on sensory and motor memories in primate prefrontal neurons. Cereb. Cortex 16, 1002-1015
70. de Wit, S. et al. (2009) Differential engagement of the ventromedial prefrontal cortex by goal-directed and habitual behavior toward food pictures in humans. J. Neurosci. 29, 11330-11338
71. Cragg, S.J. et al. (1997) Heterogeneity of electrically evoked dopamine release and reuptake in substantia nigra, ventral tegmental area, and striatum. J. Neurophysiol. 77, 863-873
72. Tzschentke, T.M. (2001) Pharmacology and behavioral pharmacology of the mesocortical dopamine system. Prog. Neurobiol. 63, 241-320
73. Seamans, J.K. and Yang, C.R. (2004) The principal features and mechanisms of dopamine modulation in the prefrontal cortex. Prog. Neurobiol. 74, 1-57
74. Seamans, J.K. and Robbins, T.W. (2009) Dopamine modulation of prefrontal cortex and cognitive function, In The dopamine receptors (2nd edn) (Neve, K.A., ed.), Springer
75. Feenstra, M.G. and Botterblom, M.H. (1996) Rapid sampling of extracellular dopamine in the rat prefrontal cortex during food consumption, handling and exposure to novelty. Brain Res. 742, 17-24
76. Feldman, D.E. (2009) Synaptic mechanisms for plasticity in neocortex. Annu. Rev. Neurosci. 32, 33-55
77. Wise, S.P. et al. (1996) The frontal cortex-basal ganglia system in primates. Crit. Rev. Neurobiol. 10, 317-356
78. Ashby, F.G. et al. (1998) A neuropsychological theory of multiple systems in category learning. Psychol. Rev. 105, 442-481
79. Hyman, S.E. et al. (2006) Neural mechanisms of addiction: The role of reward-related learning and memory. Annu. Rev. Neurosci. 29, 565- 598
80. Everitt, B.J. et al. (2008) Neural mechanisms underlying the vulnerability to develop compulsive drug-seeking habits and addiction. Philos. Trans. R. Soc. Lond. B Biol. Sci. 363, 3125-3135
81. Gerdeman, G.L. et al. (2003) It could be habit forming: Drugs of abuse and synaptic plasticity. Trends Neurosci. 26, 184-192
82. Canales, J.J. (2005) Stimulant-induced adaptations in neostriatal matrix and striosome systems: Transiting from instrumental responding to habitual behavior in drug addiction. Neurobiol. Learn. Mem. 83, 93-103
83. Schneider, W. and Shiffrin, R.M. (1977) Controlled and automatic human information processing: I. Detection, search, and attention. Psychol. Rev. 84, 1-66
84. Dickinson, A. (1985) Actions and habits: the development of behavioural autonomy. Philos. Trans. R. Soc. Lond. B Biol. Sci. 308, 67-78
85. Alexander, G.E. et al. (1986) Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu. Rev. Neurosci. 9, 357-381
86. Foerde, K. et al. (2008) Selective corticostriatal dysfunction in schizophrenia: Examination of motor and cognitive skill learning. Neuropsychology 22, 100-109