The striatum: Where skills and habits meet

Cold Spring Harbor Perspectives in Biology

Volumn 7, Issue 8, 2015, Pages

  Graybiel, Ann M ^a,b   Grafton, Scott T ^c  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BEHAVIOR; CORPUS STRIATUM; HUMAN; LEARNING; MOTOR PERFORMANCE; PHYSIOLOGY;

BEHAVIOR; CORPUS STRIATUM; HUMANS; LEARNING; MOTOR SKILLS;

EID: 84926495470     PISSN: None     EISSN: 19430264     Source Type: Journal    
DOI: 10.1101/cshperspect.a021691     Document Type: Article

References (68)

1. Acuna DE, Wymbs NF, Reynolds CA, Picard N, Turner RS, Strick PL, Grafton ST, Körding K. 2014. Multi-faceted aspects of chunking enable robust algorithms. J Neurophysiol 112: 1849-1856.
2. Atallah HE, McCool AD, Howe MW, Graybiel AM. 2014. Neurons in the ventral striatum exhibit cell-type-specific representations of outcome during learning. Neuron 82: 1145-1156.
3. Baéz-Mendoza R, Harris CJ, Schultz W. 2013. Activity of striatal neurons reflects social action and own reward. Proc Natl Acad Sci 110: 16634-16639.
4. Balleine BW, Dickinson A. 1998. Goal-directed instrumental action: Contingency and incentive learning and their cortical substrates. Neuropharmacology 37: 407-419.
5. Barnes TD, Kubota Y, Hu D, Jin DZ, Graybiel AM. 2005. Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories. Nature 437: 1158-1161.
6. Barnes TD, Mao J-B, Hu D, Kubota Y, Dreyer AA, Stamoulis C, Brown EN, Graybiel AM. 2011. Advance cueing produces enhanced action-boundary patterns of spike activity in the sensorimotor striatum. J Neurophysiol 105: 1861-1878.
7. Bassett DS, Yang M, Wymbs NF, Grafton ST. 2015. Learninginduced autonomy of sensorimotor systems. Nat Neurosci 18: 744-751.
8. Belin D, Jonkman S, Dickinson A, Robbins TW, Everitt BJ. 2009. Parallel and interactive learning processes within the basal ganglia: Relevance for the understanding of addiction. Behav Brain Res 199: 89-102.
9. Bernstein NA. 1967. The coordination and regulation of movements. Pergamon, New York.
10. Bevan MD, Smith AD, Bolam JP. 1996. The substantia nigra as a site of synaptic integration of functionally diverse information arising from the ventral pallidum and the globus pallidus in the rat. Neuroscience 75: 5-12.
11. Brown MT, Tan KR, O'Connor EC, Nikonenko I, Muller D, Luscher C. 2012. Ventral tegmental area GABA projections pause accumbal cholinergic interneurons to enhance associative learning. Nature 492: 452-456.
12. Daniel R, Pollmann S. 2014. A universal role of the ventral striatum in reward-based learning: Evidence fromhuman studies. Neurobiol Learn Mem 114: 90-100.
13. de Rugy A, Loeb GE, Carroll TJ. 2012. Muscle coordination is habitual rather than optimal. JNeurosci 32: 7384-7391.
14. Desmurget M, Turner RS. 2010. Motor sequences and the basal ganglia: Kinematics, not habits. J Neurosci 30: 7685-7690.
15. Desrochers TM, Jin DZ, Goodman ND, Graybiel AM. 2010. Optimal habits can develop spontaneously through sensitivity to local cost. Proc Natl Acad Sci 107: 20512-20517.
16. Dickinson A. 1985. Actions and habits: The development of behavioural autonomy. Philos Trans R Soc Lond B Biol Sci 308: 67-78.
17. Diuk C, Tsai K, Wallis J, Botvinick M, Niv Y. 2013. Hierarchical learning induces two simultaneous, but separable, prediction errors in human basal ganglia. J Neurosci 33: 5797-5805.
18. Doig NM, Magill PJ, Apicella P, Bolam JP, Sharott A. 2014. Cortical and thalamic excitation mediate the multiphasic responses of striatal cholinergic interneurons to motivationally salient stimuli. J Neurosci 34: 3101-3117.
19. Doyon J, Bellec, Amsel, Penhune, Monchi, Carrier, Lehéricy S, Benali H. 2009. Contributions of the basal ganglia and functionally related brain structures to motor learning. Behav Brain Res 199: 61-75.
20. Everitt BJ, RobbinsTW. 2013. From the ventral to the dorsal striatum: Devolving views of their roles in drug addiction. Neurosci Biobehav Rev 37: 1946-1954.
21. Frank MJ, Fossella JA. 2011. Neurogenetics and pharmacology of learning, motivation, and cognition. Neuropsychopharmacology 36: 133-152.
22. Fujii N, Graybiel AM. 2003. Representation of action sequence boundaries by macaque prefrontal cortical neurons. Science 301: 1246-1249.
23. Gao Z, van Beugen BJ, De Zeeuw CI. 2012. Distributed synergistic plasticity and cerebellar learning. Nat Rev Neurosci 13: 619-635.
24. Garrison J, Erdeniz B, Done J. 2013. Prediction error in reinforcement learning: A meta-analysis of neuroimaging studies. Neurosci Biobehav Rev 37: 1297-1310.
25. Gepshtein S, Li X, Snider J, Plank M, LeeD, Poizner H. 2014. Dopamine function and the efficiency of human movement. J Cogn Neurosci 26: 645-657.
26. Graybiel AM. 1997. The basal ganglia and cognitive pattern generators. Schizophr Bull 23: 459-469.
27. Graybiel A. 1998. The basal ganglia and chunking of action repertoires. Neurobiol Learn Mem 70: 119-136.
28. Graybiel AM. 2008. Habits, rituals, and the evaluative brain. Annu Rev Neurosci 31: 359-387.
29. Grol MJ, de Lange FP, Verstraten FA, Passingham RE, Toni I. 2006. Cerebral changes during performance of overlearned arbitrary visuomotor associations. J Neurosci 26: 117-125.
30. Hernandez LF, Kubota Y, Hu D, Howe MW, Lemaire N, Graybiel AM. 2013. Selective effects of dopamine depletion and L-DOPA therapy on learning-related firing dynamics of striatal neurons. J Neurosci 33: 4782-4795.
31. Herrojo Ruiz M, Rusconi M, Brücke C, Haynes J-D, Schö-necker T, Kühn AA. 2014. Encoding of sequence boundaries in the subthalamic nucleus of patients with Parkinson's disease. Brain 137: 2715-2730.
32. Hikosaka O, Sakamoto M, Usui S. 1989. Functional properties of monkey caudate neurons. III: Activities related to expectation of target and reward. J Neurophysiol 61: 814-832.
33. Hikosaka O, Nakahara H, Rand MK, Sakai K, Lu X, Nakamura K, Miyachi S, Doya K. 1999. Parallel neural networks for learning sequential procedures. TrendsNeurosci 22: 464-471.
34. Howe MW, Tierney PL, Sandberg SG, Phillips PE, Graybiel AM. 2013. Prolonged dopamine signalling in striatum signals proximity and value of distant rewards. Nature 500: 575-579.
35. Jin X, Costa RM. 2010. Start/stop signals emerge in nigrostriatal circuits during sequence learning. Nature 466: 457-462.
36. Jog MS, Kubota Y, Connolly CI, Hillegaart V, Graybiel AM. 1999. Building neural representations of habits. Science 286: 1745-1749.
37. Karni A, Meyer G, Jezzard P, Adams MM, Turner R, Ungerleider LG. 1995. Functional MRI evidence for adult motor cortex plasticity during motor skill learning. Nature 377: 155-157.
38. Kool W, McGuire JT, Rosen ZB, Botvinick MM. 2010. Decision making and the avoidance of cognitive demand. J Exp Psychol Gen 139: 665-682.
39. Kubota Y, Liu J, Hu D, DeCoteau WE, Eden UT, Smith AC, Graybiel AM. 2009. Stable encoding of task structure coexists with flexible coding of task events in sensorimotor striatum. J Neurophysiol 102: 2142-2160.
40. Lehéricy S, Benali H, Van de Moortele PF, Pelegrini-Issac M, Waechter T, Ugurbil K, Doyon J. 2005. Distinct basal ganglia territories are engaged in early and advanced motor sequence learning. Proc Natl Acad Sci 102: 12566-12571.
41. Levesque M, Bedard MA, Courtemanche R, Tremblay PL, Scherzer P, Blanchet PJ. 2007. Raclopride-induced motor consolidation impairment in primates: Role of the dopamine type-2 receptor in movement chunking into integrated sequences. Exp Brain Res 182: 499-508.
42. Li J, Daw ND. 2011. Signals in human striatum are appropriate for policy update rather than value prediction. J Neurosci 31: 5504-5511.
43. Matsumoto M, Hikosaka O. 2009. Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459: 837-841.
44. Miller GA. 1956. The magic number seven plus or minus two: Some limits on our automatization of cognitive skills. Psychol Rev 63: 81-97.
45. Miyachi S, Hikosaka O, Miyashita K, Karadi Z, Rand MK. 1997. Differential roles of monkey striatum in learning of sequential hand movement. Exp Brain Res 115: 1-5.
46. Miyachi S, HikosakaO, Lu X. 2002. Differential activation of monkey striatal neurons in the early and late stages of procedural learning. Exp Brain Res 146: 122-126.
47. Ramkumar P, Acuna DE, Berniker M, Grafton S, Turner RS, Körding KP. 2014. Movement chunking as locally optimal control. In Translational and Computational Motor Control (TCMC) 2014. Washington, DC, November 14.
48. Schreiweis C, Bornschein U, Burguiere E, Kerimoglu C, Schreiter S, Dannemann M, Goyal S, Rea E, French CA, Puliyadi R, et al. 2014. Humanized Foxp2 accelerates learning by enhancing transitions from declarative to procedural performance. Proc Natl Acad Sci 111: 14253-14258.
49. SchultzW. 2002. Getting formal with dopamine and reward. Neuron 36: 241-263.
50. Smith KS, Graybiel AM. 2013. A dual operator view of habitual behavior reflecting cortical and striatal dynamics. Neuron 79: 361-374.
51. Smith KS, Virkud A, Deisseroth K, Graybiel AM. 2012. Reversible online control of habitual behavior by optogenetic perturbation of medial prefrontal cortex. Proc Natl Acad Sci 109: 18932-18937.
52. Stice E, Yokum S, Burger K, Epstein L, Smolen A. 2012. Multilocus genetic composite reflecting dopamine signaling capacity predicts reward circuitry responsivity. J Neurosci 32: 10093-10100.
53. Sutton RS, Barto AG. 1998. Reinforcement learning. MIT Press, Cambridge, MA.
54. Takemura A, Inoue Y, Gomi H, Kawato M, Kawano K. 2001. Change in neuronal firing patterns in the process of motor command generation for the ocular following response. J Neurophysiol 86: 1750-1763.
55. Thorn CA, Atallah H, Howe M, Graybiel AM. 2010. Differential dynamics of activity changes in dorsolateral and dorsomedial striatal loops during learning. Neuron 66: 781-795.
56. Todorov E, Jordan MI. 2002. Optimal feedback control as a theory of motor coordination. Nat Neurosci 5: 1226-1235.
57. Tremblay P-L, Bedard M-A, Levesque M, Chebli M, Parent M, Courtemanche R, Blanchet PJ. 2009. Motor sequence learning in primate: Role of the D2 receptor inmovement chunking during consolidation. Behav Brain Res 198: 231-239.
58. Tremblay PL, Bedard MA, Langlois D, Blanchet PJ, Lemay M, Parent M. 2010. Movement chunking during sequence learning is a dopamine-dependent process: A study conducted in Parkinson's disease. Exp Brain Res 205: 375-385.
59. Volkow ND, Wang G-J, Fowler JS, Tomasi D, Telang F. 2011. Addiction: Beyond dopamine reward circuitry. Proc Natl Acad Sci 108: 15037-15042.
60. Volkow ND, Tomasi D, Wang GJ, Logan J, Alexoff DL, Jayne M, Fowler JS, Wong C, Yin P, Du C. 2014a. Stimulant-induced dopamine increases are markedly blunted in active cocaine abusers. Mol Psychiatry 19: 1037-1043.
61. VolkowND, Wang GJ, Telang F, Fowler JS, AlexoffD, Logan J, Jayne M, Wong C, TomasiD. 2014b. Decreased dopamine brain reactivity in marijuana abusers is associated with negative emotionality and addiction severity. Proc Natl Acad Sci 111: E3149-E3156.
62. Weickert TW, Mattay VS, Das S, Bigelow LB, Apud JA, Egan MF, Weinberger DR, Goldberg TE. 2013. Dopaminergic therapy removal differentially effects learning in schizophrenia and Parkinson's disease. Schizophr Res 149: 162-166.
63. Wiestler T, Diedrichsen J. 2013. Skill learning strengthens cortical representations of motor sequences. eLife 2: e00801.
64. Wymbs NF, Grafton ST. 2014. The human motor system supports sequence-specific representations over multiple training dependent time scales. Cereb Cortex doi: 10. 1093/cercor/bhu144.
65. Wymbs NF, Bassett DS, Mucha PJ, Porter MA, Grafton ST. 2012. Differential recruitment of the sensorimotor putamen and frontoparietal cortex during motor chunking in humans. Neuron 74: 936-946.
66. Yamada H, Inokawa H, Matsumoto N, Ueda Y, Enomoto K, Kimura M. 2013. Coding of the long-term value of multiple future rewards in the primate striatum. J Neurophysiol 109: 1140-1151.
67. Yanike M, Ferrera VP. 2014. Representation of outcome risk and action in the anterior caudate nucleus. J Neurosci 34: 3279-3290.
68. Yin HH, Knowlton BJ. 2006. The role of the basal ganglia in habit formation. Nat Rev Neurosci 7: 464-476.