The basal ganglia: Learning new tricks and loving it

Current Opinion in Neurobiology

Volumn 15, Issue 6, 2005, Pages 638-644

  Graybiel, Ann M ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DOPAMINE; NEUROTRANSMITTER;

ANATOMY; BASAL GANGLION; BRAIN CORTEX; BRAIN FUNCTION; CEREBELLUM; COGNITION; GLOBUS PALLIDUS; LEARNING; MEDICAL RESEARCH; MESENCEPHALON; MOTOR CONTROL; NEOCORTEX; NERVE CELL; NERVE CELL PLASTICITY; NEUROIMAGING; PRIORITY JOURNAL; REINFORCEMENT; REVIEW; THALAMUS;

ANIMALS; BASAL GANGLIA; CEREBELLUM; CEREBRAL CORTEX; EFFERENT PATHWAYS; HUMANS; LEARNING; NEURONAL PLASTICITY; REINFORCEMENT (PSYCHOLOGY);

EID: 28044450643     PISSN: 09594388     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.conb.2005.10.006     Document Type: Review

References (63)

1. B.P. Olveczky, A.S. Andalman, and M.S. Fee Vocal experimentation in the juvenile songbird requires a basal ganglia circuit PLoS Biol 3 2005 e153 This study importantly extends evidence that the anterior forebrain pathway (equivalent to a cortico-basal ganglia circuit) is essential for variability in the song of young zebra finches.
2. M.H. Kao, A.J. Doupe, and M.S. Brainard Contributions of an avian basal ganglia-forebrain circuit to real-time modulation of song Nature 433 2005 638 643 The authors show that the variability in adult zebra finch song is subject to real-time modulation by the anterior forebrain pathway.
3. T. Barnes, Y. Kubota, D. Hu, D.Z. Jin, and A.M. Graybiel Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories Nature 437 2005 1158 1161 This study demonstrates a progression from highly variable spike firing to more stereotyped spike firing in the striatum of rats learning a procedural T-maze task.
4. S. Ishii, W. Yoshida, and J. Yoshimoto Control of exploitation- exploration meta-parameter in reinforcement learning Neural Netw 15 2002 665 687
5. R.S. Sutton, and A.G. Barto Reinforcement Learning: An Introduction 1998 MIT Press
6. K. Doya, and T.J. Sejnowski A novel reinforcement model of birdsong vocalization learning G. Tesauro D.S. Touretzky T.K. Leen Advances in Neural Information Processing Systems Vol.7 1995 MIT Press 101 108
7. J.C. Houk, and S.P. Wise Distributed modular architectures linking basal ganglia, cerebellum, and cerebral cortex: their role in planning and controlling action Cereb Cortex 5 1995 95 110
8. M. Djurfeldt, Ö. Ekeberg, and A.M. Graybiel Cortex-basal ganglia interaction and attractor states Neurocomputing 38-40 2001 573 579
9. A.M. Graybiel The basal ganglia and cognitive pattern generators Schizophr Bull 23 1997 459 469
10. M.J. Frank, B. Loughry, and R.C. O'Reilly Interactions between frontal cortex and basal ganglia in working memory: a computational model Cogn Affect Behav Neurosci 1 2001 137 160
11. A. Pasupathy, and E.K. Miller Different time courses of learning-related activity in the prefrontal cortex and striatum Nature 433 2005 873 876 The authors show that learning-related changes occur earlier in striatum than in prefrontal cortex in monkeys performing reversals in a conditional association task.
12. N. Fujii, and A. Graybiel Time-varying covariance of neural activities recorded in striatum and frontal cortex as monkeys perform sequential- saccade tasks Proc Natl Acad Sci USA 102 2005 9032 9037 This study presents evidence that the relative timing of neuronal responses in the primate striatum and frontal cortex varies depending on task and cortical region.
13. R.M. Costa, D. Cohen, and M.A. Nicolelis Differential corticostriatal plasticity during fast and slow motor skill learning in mice Curr Biol 14 2004 1124 1134
14. P.J. Brasted, and S.P. Wise Comparison of learning-related neuronal activity in the dorsal premotor cortex and striatum Eur J Neurosci 19 2004 721 740 These authors show near-simultaneous learning-related changes in premotor cortex and striatum as monkeys perform a conditional association task.
15. L.H. Shi, F. Luo, D.J. Woodward, and J.Y. Chang Neural responses in multiple basal ganglia regions during spontaneous and treadmill locomotion tasks in rats Exp Brain Res 157 2004 303 314
16. K. Watanabe, and O. Hikosaka Immediate changes in anticipatory activity of caudate neurons associated with reversal of position-reward contingency J Neurophysiol 2005
17. P.D. Nixon, K.R. McDonald, P.M. Gough, I.H. Alexander, and R.E. Passingham Cortico-basal ganglia pathways are essential for the recall of well-established visuomotor associations Eur J Neurosci 20 2004 3165 3178
18. R.A. Poldrack, F.W. Sabb, K. Foerde, S.M. Tom, R.F. Asarnow, S.Y. Bookheimer, and B.J. Knowlton The neural correlates of motor skill automaticity J Neurosci 25 2005 5356 5364
19. C.D. Fiorillo, P.N. Tobler, and W. Schultz Discrete coding of reward probability and uncertainty by dopamine neurons Science 299 2003 1898 1902
20. Y. Niv, M.O. Duff, and P. Dayan Dopamine, uncertainty and TD learning Behav Brain Funct 1 2005 6
21. H.M. Bayer, and P.W. Glimcher Midbrain dopamine neurons encode a quantitative reward prediction error signal Neuron 47 2005 129 141
22. G. Morris, D. Arkadir, A. Nevet, E. Vaadia, and H. Bergman Coincident but distinct messages of midbrain dopamine and striatal tonically active neurons Neuron 43 2004 133 143
23. T. Satoh, S. Nakai, T. Sato, and M. Kimura Correlated coding of motivation and outcome of decision by dopamine neurons J Neurosci 23 2003 9913 9923
24. P.N. Tobler, C.D. Fiorillo, and W. Schultz Adaptive coding of reward value by dopamine neurons Science 307 2005 1642 1645
25. H. Nakahara, H. Itoh, R. Kawagoe, Y. Takikawa, and O. Hikosaka Dopamine neurons can represent context-dependent prediction error Neuron 41 2004 269 280 This study demonstrates that dopamine-containing nigral neurons in the monkey can code a reward-prediction error in a context-dependent manner.
26. M.A. Ungless, P.J. Magill, and J.P. Bolam Uniform inhibition of dopamine neurons in the ventral tegmental area by aversive stimuli Science 303 2004 2040 2042
27. M.J. Frank, L.C. Seeberger, and R.C. O'Reilly By carrot or by stick: cognitive reinforcement learning in parkinsonism Science 306 2004 1940 1943 This study shows that dopamine agonist therapy influences learning with positive but not negative reinforcers.
28. H. Yamada, N. Matsumoto, and M. Kimura Tonically active neurons in the primate caudate nucleus and putamen differentially encode instructed motivational outcomes of action J Neurosci 24 2004 3500 3510
29. H.C. Cromwell, O.K. Hassani, and W. Schultz Relative reward processing in primate striatum Exp Brain Res 162 2005 520 525
30. J. Lauwereyns, K. Watanabe, B. Coe, and O. Hikosaka A neural correlate of response bias in monkey caudate nucleus Nature 418 2002 413 417
31. P. Blazquez, N. Fujii, J. Kojima, and A.M. Graybiel A network representation of response probability in the striatum Neuron 33 2002 973 982
32. D. Arkadir, G. Morris, E. Vaadia, and H. Bergman Independent coding of movement direction and reward prediction by single pallidal neurons J Neurosci 24 2004 10047 10056
33. T. Minamimoto, Y. Hori, and M. Kimura Complementary process to response bias in the centromedian nucleus of the thalamus Science 308 2005 1798 1801 The authors demonstrate that primate intralaminar thalamic neurons are selectively active when monkeys are required to make an action for an unpreferred small reward.
34. S.M. McClure, G.S. Berns, and P.R. Montague Temporal prediction errors in a passive learning task activate human striatum Neuron 38 2003 339 346
35. C.F. Zink, G. Pagnoni, M.E. Martin-Skurski, J.C. Chappelow, and G.S. Berns Human striatal responses to monetary reward depend on saliency Neuron 42 2004 509 517
36. H.H. Yin, B.J. Knowlton, and B.W. Balleine Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning Eur J Neurosci 19 2004 181 189
37. A. Christakou, T.W. Robbins, and B.J. Everitt Prolonged neglect following unilateral disruption of a prefrontal cortical-dorsal striatal system Eur J Neurosci 21 2005 782 792
38. A.B. Mulder, E. Tabuchi, and S.I. Wiener Neurons in hippocampal afferent zones of rat striatum parse routes into multi-pace segments during maze navigation Eur J Neurosci 19 2004 1923 1932
39. S.C. Tanaka, K. Doya, G. Okada, K. Ueda, Y. Okamoto, and S. Yamawaki Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops Nat Neurosci 7 2004 887 893
40. D.H. Zald, I. Boileau, W. El-Dearedy, R. Gunn, F. McGlone, G.S. Dichter, and A. Dagher Dopamine transmission in the human striatum during monetary reward tasks J Neurosci 24 2004 4105 4112
41. A. Aron, H. Fisher, D.J. Mashek, G. Strong, H. Li, and L.L. Brown Reward, motivation, and emotion systems associated with early-stage intense romantic love J Neurophysiol 94 2005 327 337 Together with the studies by Bartels and Zeki (see [42]), this work demonstrates selective activation of the caudate nucleus and ventral tegmental area when subjects saw pictures of their loved one (as contrasted with a neutral control).
42. A. Bartels, and S. Zeki The neural correlates of maternal and romantic love Neuroimage 21 2004 1155 1166
43. B. King-Casas, D. Tomlin, C. Anen, C.F. Camerer, S.R. Quartz, and P.R. Montague Getting to know you: reputation and trust in a two-person economic exchange Science 308 2005 78 83 This study demonstrates selective activation of the caudate nucleus when one player exhibits trust of the other in a 'trust game'.
44. D.J. de Quervain, U. Fischbacher, V. Treyer, M. Schellhammer, U. Schnyder, A. Buck, and E. Fehr The neural basis of altruistic punishment Science 305 2004 1254 1258 Also from a trust game experiment, evidence presented here suggests selective activation of the caudate nucleus when the player can deliver 'altruistic' punishment to the other player.
45. J.M. Tepper, T. Koos, and C.J. Wilson GABAergic microcircuits in the neostriatum Trends Neurosci 27 2004 662 669
46. A. Nambu, H. Tokuno, and M. Takada Functional significance of the cortico-subthalamo-pallidal 'hyperdirect' pathway Neurosci Res 43 2002 111 117
47. M. Levesque, and A. Parent The striatofugal fiber system in primates: a reevaluation of its organization based on single-axon tracing studies Proc Natl Acad Sci USA 102 2005 11888 11893 This study suggests a high degree of collateralization of both direct and indirect pathway axons in the monkey.
48. A.L. Person, and D.J. Perkel Unitary IPSPs drive precise thalamic spiking in a circuit required for learning Neuron 46 2005 129 140 The authors demonstrate, for the zebra finch thalamus, that basal ganglia output not only inhibits thalamic neurons but also can activate them by rebound excitation.
49. N. Chuhma, H. Zhang, J. Masson, X. Zhuang, D. Sulzer, R. Hen, and S. Rayport Dopamine neurons mediate a fast excitatory signal via their glutamatergic synapses J Neurosci 24 2004 972 981 This study suggests that dopamine-containing neurons in the mouse VTA can release glutamate as well as dopamine in the nucleus accumbens.
50. M.A. Sanchez-Gonzalez, M.A. Garcia-Cabezas, B. Rico, and C. Cavada The primate thalamus is a key target for brain dopamine J Neurosci 25 2005 6076 6083 The authors present evidence for a massive dopaminergic innervation of the primate thalamus.
51. M.F. Roitman, G.D. Stuber, P.E. Phillips, R.M. Wightman, and R.M. Carelli Dopamine operates as a subsecond modulator of food seeking J Neurosci 24 2004 1265 1271 This study points to the feasibility of simultaneous real-time monitoring of dopamine and neural activity.
52. W. Lei, Y. Jiao, N. Del Mar, and A. Reiner Evidence for differential cortical input to direct pathway versus indirect pathway striatal projection neurons in rats J Neurosci 24 2004 8289 8299 The authors demonstrate that pyramidal tract and non-pyramidal tract neurons of the motor cortex project, respectively, to indirect and direct pathway striatal neurons in the rat.
53. Berretta S, Parthasarathy HB, Graybiel AM: Local release of GABAergic inhibition in the motor cortex induces immediate-early gene expression in indirect pathway neurons of the striatum. J Neurosci 1997, 17: 4752-4763.
54. R. Courtemanche, N. Fujii, and A. Graybiel Synchronous, focally modulated β-band oscillations characterize local field potential activity in the striatum of awake behaving monkeys J Neurosci 23 2003 11741 11752
55. K. Doya Complementary roles of basal ganglia and cerebellum in learning and motor control Curr Opin Neurobiol 10 2000 732 739
56. E. Hoshi, L. Tremblay, J. Feger, P.L. Carras, and P.L. Strick The cerebellum communicates with the basal ganglia Nat Neurosci 2005 [E-pub ahead of print] This study demonstrates a disynaptic pathway from the cerebellum to the basal ganglia (putamen) in monkeys.
57. M. Desmurget, S.T. Grafton, P. Vindras, H. Grea, and R.S. Turner The basal ganglia network mediates the planning of movement amplitude Eur J Neurosci 19 2004 2871 2880
58. N. Schmitzer-Torbert, and A.D. Redish Neuronal activity in the rodent dorsal striatum in sequential navigation: separation of spatial and reward responses on the multiple T task J Neurophysiol 91 2004 2259 2272
59. J.J. Canales Intermittent cortical stimulation evokes sensitization to cocaine and enduring changes in matrix and striosome neuron responsiveness Synapse 57 2005 56 60
60. E. Saka, C. Goodrich, P. Harlan, B.K. Madras, and A.M. Graybiel Repetitive behaviors in monkeys are linked to specific striatal activation patterns J Neurosci 24 2004 7557 7565
61. T. Boraud, P. Brown, J.A. Goldberg, A.M. Graybiel, and P.J. Magill Oscillations in the basal ganglia: The good, the bad, and the unexpected J.P. Bolam C.A. Ingham P.J. Magill The Basal Ganglia VIII 2005 Springer Science and Business Media 3 24
62. J.D. Berke, M. Okatan, J. Skurski, and H.B. Eichenbaum Oscillatory entrainment of striatal neurons in freely moving rats Neuron 43 2004 883 896
63. X. Drouot, S. Oshino, B. Jarraya, L. Besret, H. Kishima, P. Remy, J. Dauguet, J.P. Lefaucheur, F. Dolle, and F. Conde Functional recovery in a primate model of Parkinson's disease following motor cortex stimulation Neuron 44 2004 769 778 The authors demonstrate that high frequency stimulation applied to the motor cortex of MPTP (1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine)- treated monkeys substantially reverses their parkinsonian symptoms.