Stable encoding of task structure coexists with flexible coding of task events in sensorimotor striatum

Journal of Neurophysiology

Volumn 102, Issue 4, 2009, Pages 2142-2160

  Kubota, Yasuo ^a   Liu, Jun ^a   Hu, Dan ^a   DeCoteau, William E ^b   Eden, Uri T ^c   Smith, Anne C ^d   Graybiel, Ann M ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b ST LAWRENCE UNIVERSITY   (United States)

^c Boston University   (United States)

^d UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL CELL; ANIMAL EXPERIMENT; ARTICLE; BEHAVIOR; COGNITION; CORPUS STRIATUM; HABIT; LEARNING; MALE; MOUSE; NERVE CELL; NEUROMUSCULAR FUNCTION; NONHUMAN; PRIORITY JOURNAL; SENSORIMOTOR FUNCTION; SENSORY STIMULATION; STIMULUS RESPONSE; TASK PERFORMANCE;

ACOUSTIC STIMULATION; ANIMALS; AUDITORY PERCEPTION; CORPUS STRIATUM; CUES; LEARNING; MALE; MAZE LEARNING; MICE; MICE, INBRED C57BL; MICROELECTRODES; NEURONAL PLASTICITY; NEURONS; NEUROPSYCHOLOGICAL TESTS; PHYSICAL STIMULATION; PSYCHOMOTOR PERFORMANCE; TOUCH PERCEPTION;

EID: 70350279035     PISSN: 00223077     EISSN: 15221598     Source Type: Journal    
DOI: 10.1152/jn.00522.2009     Document Type: Article

References (71)

1. Aldridge JW, Berridge KC, Rosen AR. Basal ganglia neural mechanisms of natural movement sequences. Can J Physiol Pharmacol 82: 732-739, 2004.
2. Alloway KD, Lou L, Nwabueze-Ogbo F, Chakrabarti S. Topography of cortical projections to the dorsolateral neostriatum in rats: multiple overlapping sensorimotor pathways. J Comp Neurol 499: 33-48, 2006. (Pubitemid 44423694)
3. Aosaki T, Tsubokawa H, Ishida A, Watanabe K, Graybiel AM, Kimura M. Responses of tonically active neurons in the primate's striatum undergo systematic changes during behavioral sensorimotor conditioning. J Neurosci 14: 3969-3984, 1994. (Pubitemid 24174138)
4. Atallah HE, Lopez-Paniagua D, Rudy JW, O'Reilly RC. Separate neural substrates for skill learning and performance in the ventral and dorsal striatum. Nat Neurosci 10: 126-131, 2007. (Pubitemid 46026536)
5. Balleine BW, Delgado MR, Hikosaka O. The role of the dorsal striatum in reward and decision-making. J Neurosci 27: 8161-8165, 2007. (Pubitemid 47219597)
6. Barnes T, Kubota Y, Hu D, Jin DZ, Graybiel AM. Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories. Nature 437: 1158-1161, 2005. (Pubitemid 41509353)
7. Belin D, Jonkman S, Dickinson A, Robbins TW, Everitt BJ. Parallel and interactive learning processes within the basal ganglia: relevance for the understanding of addiction. Behav Brain Res 199: 89-102, 2009.
8. Berke JD, Breck JT, Eichenbaum H. Striatal versus hippocampal representations during win-stay maze performance. J Neurophysiol 101: 1575-1587, 2009.
9. Berretta S, Parthasarathy HB, Graybiel AM. Local release of GABAergic inhibition in the motor cortex induces immediate-early gene expression in indirect pathway neurons of the striatum. J Neurosci 17: 4752-4763, 1997. (Pubitemid 27246932)
10. Blazquez P, Fujii N, Kojima J, Graybiel AM. A network representation of response probability in the striatum. Neuron 33: 973-982, 2002. (Pubitemid 34246361)
11. Brown LL. Somatotopic organization in rat striatum: evidence for a combinatorial map. Proc Natl Acad Sci USA 89: 7403-7407, 1992.
12. Cools R, Ivry RB, D'Esposito M. The human striatum is necessary for responding to changes in stimulus relevance. J Cogn Neurosci 18: 1973-1983, 2006.
13. Corbit LH, Janak PH. Inactivation of the lateral but not medial dorsal striatum eliminates the excitatory impact of Pavlovian stimuli on instrumental responding. J Neurosci 27: 13977-13981, 2007.
14. Costa RM, Cohen D, Nicolelis MA. Differential corticostriatal plasticity during fast and slow motor skill learning in mice. Curr Biol 14: 1124-1134, 2004. (Pubitemid 38893975)
15. Dahlin E, Neely AS, Larsson A, Backman L, Nyberg L. Transfer of learning after updating training mediated by the striatum. Science 320: 1510-1512, 2008. (Pubitemid 351929433)
16. Daw ND, Doya K. The computational neurobiology of learning and reward. Curr Opin Neurobiol 16: 199-204, 2006.
17. Daw ND, Niv Y, Dayan P. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat Neurosci 8: 1704-1711, 2005. (Pubitemid 41683198)
18. Dayan P, Balleine BW. Reward, motivation, and reinforcement learning. Neuron 36: 285-298, 2002.
19. Doyon J, Benali H. Reorganization and plasticity in the adult brain during learning of motor skills. Curr Opin Neurobiol 15: 161-167, 2005. (Pubitemid 41569264)
20. Doyon J, Penhune V, Ungerleider LG. Distinct contribution of the corticostriatal and cortico-cerebellar systems to motor skill learning. Neuropsychologia 41: 252-262, 2003. (Pubitemid 35365955)
21. Emondi AA, Rebrik SP, Kurgansky AV, Miller KD. Tracking neurons recorded from tetrodes across time. J Neurosci Methods 135: 95-105, 2004.
22. Eschenko O, Mizumori SJ. Memory influences on hippocampal and striatal neural codes: effects of a shift between task rules. Neurobiol Learn Mem 87: 495-509, 2007. (Pubitemid 46483118)
23. Everitt BJ, Robbins TW. Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nat Neurosci 8: 1481-1489, 2005.
24. Floyer-Lea A, Matthews PM. Changing brain networks for visuomotor control with increased movement automaticity. J Neurophysiol 92: 2405-2412, 2004. (Pubitemid 39298692)
25. Graybiel AM. The basal ganglia: learning new tricks and loving it. Curr Opin Neurobiol 15: 638-644, 2005. (Pubitemid 41683155)
26. Graybiel AM. Habits, rituals and the evaluative brain. Annu Rev Neurosci 31: 359-387, 2008.
27. Haruno M, Kawato M. Different neural correlates of reward expectation and reward expectation error in the putamen and caudate nucleus during stimulus- action-reward association learning. J Neurophysiol 95: 948-959, 2006. (Pubitemid 44699097)
28. Hazeltine E, Grafton ST, Ivry R. Attention and stimulus characteristics determine the locus of motor-sequence encoding. A PET study. Brain 120: 123-140, 1997. (Pubitemid 27081266)
29. Jog MS, Connolly CI, Kubota Y, Iyengar DR, Garrido L, Harlan R, Graybiel AM. Tetrode technology: advances in implantable hardware, neuroimaging, and data analysis techniques. J Neurosci Methods 117: 141-152, 2002. (Pubitemid 34718161)
30. Jog M, Kubota Y, Connolly CI, Hillegaart V, Graybiel AM. Building neural representations of habits. Science 286: 1745-1749, 1999.
31. Jueptner M, Weiller C. A review of differences between basal ganglia and cerebellar control of movements as revealed by functional imaging studies. Brain 121: 1437-1449, 1998. (Pubitemid 28349897)
32. Kawaguchi Y, Wilson CJ, Augood SJ, Emson PC. Striatal interneurones: chemical, physiological and morphological characterization. Trends Neurosci 18: 527-535, 1995.
33. Kimchi EY, Laubach M. Dynamic encoding of action selection by the medial striatum. J Neurosci 29: 3148-3159, 2009.
34. Kimchi EY, Torregrossa MM, Taylor JR, Laubach M. Neuronal correlates of instrumental learning in the dorsal striatum. J Neurophysiol 102: 475-489, 2009.
35. Koós T, Tepper JM. Dual cholinergic control of fast-spiking interneurons in the neostriatum. J Neurosci 22: 529-535, 2002. (Pubitemid 34049092)
36. Lau B, Glimcher PW. Action and outcome encoding in the primate caudate nucleus. J Neurosci 27: 14502-14514, 2007.
37. Matell MS, Meck WH, Nicolelis MA. Interval timing and the encoding of signal duration by ensembles of cortical and striatal neurons. Behav Neurosci 117: 760-773, 2003.
38. McGeorge AJ, Faull RLM. The organization of the projection from the cerebral cortex to the striatum in the rat. Neuroscience 29: 503-537, 1989. (Pubitemid 19167370)
39. McNab F, Klingberg T. Prefrontal cortex and basal ganglia control access to working memory. Nat Neurosci 11: 103-107, 2008.
40. Monchi O, Petrides M, Strafella AP, Worsley KJ, Doyon J. Functional role of the basal ganglia in the planning and execution of actions. Ann Neurol 59: 257-264, 2006. (Pubitemid 43202478)
41. Morris G, Arkadir D, Nevet A, Vaadia E, Bergman H. Coincident but distinct messages of midbrain dopamine and striatal tonically active neurons. Neuron 43: 133-143, 2004. (Pubitemid 38952825)
42. Nelder JA, Wedderburn RW. Generalized linear models. J R Stat Soc Ser A 135: 370-384, 1972.
43. Niv Y, Joel D, Dayan P. A normative perspective on motivation. Trends Cogn Sci 10: 375-381, 2006.
44. O'Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ. Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304: 452-454, 2004. (Pubitemid 38495943)
45. Packard MG. Exhumed from thought: basal ganglia and response learning in the plus-maze. Behav Brain Res 199: 24-31, 2009.
46. Parthasarathy HB, Graybiel AM. Cortically driven immediate-early gene expression reflects modular influence of sensorimotor cortex on identified striatal neurons in the squirrel monkey. J Neurosci 17: 2477-2491, 1997.
47. Pasupathy A, Miller EK. Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature 433: 873-876, 2005. (Pubitemid 40314896)
48. Poldrack RA, Sabb FW, Foerde K, Tom SM, Asarnow RF, Bookheimer SY, Knowlton BJ. The neural correlates of motor skill automaticity. J Neurosci 25: 5356-5364, 2005. (Pubitemid 40770915)
49. Ragozzino ME. The contribution of the medial prefrontal cortex, orbitofrontal cortex, and dorsomedial striatum to behavioral flexibility. Ann NY Acad Sci 1121: 355-375, 2007.
50. Ragozzino ME, Ragozzino KE, Mizumori SJ, Kesner RP. Role of the dorsomedial striatum in behavioral flexibility for response and visual cue discrimination learning. Behav Neurosci 116: 105-115, 2002.
51. Ravel S, Legallet E, Apicella P. Responses of tonically active neurons in the monkey striatum discriminate between motivationally opposing stimuli. J Neurosci 23: 8489-8497, 2003. (Pubitemid 37158748)
52. Redish AD, Jensen S, Johnson A. A unified framework for addiction: vulnerabilities in the decision process. Behav Brain Sci 31: 415-437; discussion 437-487, 2008.
53. Samejima K, Ueda Y, Doya K, Kimura M. Representation of action-specific reward values in the striatum. Science 310: 1337-1340, 2005. (Pubitemid 41698867)
54. Schmitzer-Torbert NC, Redish AD. Task-dependent encoding of space and events by striatal neurons is dependent on neural subtype. Neuroscience 153: 349-360, 2008.
55. Schultz W, Tremblay L, Hollerman JR. Changes in behavior-related neuronal activity in the striatum during learning. Trends Neurosci 26: 321-328, 2003. (Pubitemid 36694320)
56. Spiegelhalter DJ, Best NG, Carlin BR, van der Linde A. Bayesian measures of model complexity and fit. J Roy Stat Soc B 64: 583-616, 2002.
57. Sutton RS, Barto AG. Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press, 1998.
58. Tang C, Pawlak AP, Prokopenko V, West MO. Changes in activity of the striatum during formation of a motor habit. Eur J Neurosci 25: 1212-1227, 2007. (Pubitemid 46310655)
59. Tepper JM, Bolam JP. Functional diversity and specificity of neostriatal interneurons. Curr Opin Neurobiol 14: 685-692, 2004. (Pubitemid 39576198)
60. Thorn CA, Atallah H, Howe M, Graybiel A. Ensemble unit activity differs between lateral and medial striatal regions during T-maze task learning Soc Neurosci Abstr 578.7, 2008.
61. Van Golf Racht-Delatour B, Massioui NE. Alleviation of overtraining reversal effect by transient inactivation of the dorsal striatum. Eur J Neurosci 12: 3343-3350, 2000. (Pubitemid 30751114)
62. Voorn P, Vanderschuren LJ, Groenewegen HJ, Robbins TW, Pennartz CM. Putting a spin on the dorsal-ventral divide of the striatum. Trends Neurosci 27: 468-474, 2004. (Pubitemid 38951039)
63. Watanabe K, Hikosaka O. Immediate changes in anticipatory activity of caudate neurons associated with reversal of position-reward contingency. J Neurophysiol 94: 1879-1887, 2005.
64. White NM. Some highlights of research on the effects of caudate nucleus lesions over the past 200 years. Behav Brain Res 199: 3-23, 2009.
65. White NM, McDonald RJ. Multiple parallel memory systems in the brain of the rat. Neurobiol Learn Mem 77: 125-184, 2002. (Pubitemid 34971650)
66. Williams ZM, Eskandar EN. Selective enhancement of associative learning by microstimulation of the anterior caudate. Nat Neurosci 9: 562-568, 2006.
67. Willingham DB, Salidis J, Gabrieli JD. Direct comparison of neural systems mediating conscious and unconscious skill learning. J Neurophysiol 88: 1451-1460, 2002. (Pubitemid 35025398)
68. Wilson CJ, Groves PM. Spontaneous firing patterns of identified spiny neurons in the rat neostriatum. Brain Res 220: 67-80, 1981.
69. Yin HH, Knowlton BJ. The role of the basal ganglia in habit formation. Nat Rev Neurosci 7: 464-476, 2006.
70. Yin HH, Knowlton BJ, Balleine BW. Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. Eur J Neurosci 19: 181-189, 2004.
71. Yin HH, Mulcare SP, Hilario MR, Clouse E, Holloway T, Davis MI, Hansson AC, Lovinger DM, Costa RM. Dynamic reorganization of striatal circuits during the acquisition and consolidation of a skill. Nat Neurosci 12: 333-341, 2009.