Variability in action: CONTRIBUTIONS of a songbird cortical-basal ganglia circuit to vocal motor learning and control

Neuroscience

Volumn 296, Issue , 2015, Pages 39-47

  Woolley, S C ^a   Kao, M H ^b  

^a MCGILL UNIVERSITY   (Canada)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Basal ganglia; Reinforcement learning; Songbird; Variability

Indexed keywords

ANIMAL; ANIMAL MODEL; BASAL GANGLION; BRAIN CORTEX; LEARNING; NERVE CELL; NERVE CELL PLASTICITY; NERVE TRACT; PHYSIOLOGY; REINFORCEMENT; SONGBIRD; VOCALIZATION;

ANIMALS; BASAL GANGLIA; CEREBRAL CORTEX; LEARNING; MODELS, ANIMAL; NEURAL PATHWAYS; NEURONAL PLASTICITY; NEURONS; REINFORCEMENT (PSYCHOLOGY); SONGBIRDS; VOCALIZATION, ANIMAL;

EID: 84939993880     PISSN: 03064522     EISSN: 18737544     Source Type: Journal    
DOI: 10.1016/j.neuroscience.2014.10.010     Document Type: Review

References (91)

1. Ali F., Otchy T.M., Pehlevan C., Fantana A.L., Burak Y., Olveczky B.P. The basal ganglia is necessary for learning spectral, but not temporal, features of birdsong. Neuron 2013, 80:494-506.
2. Andalman A.S., Fee M.S. A basal ganglia-forebrain circuit in the songbird biases motor output to avoid vocal errors. Proc Natl Acad Sci USA 2009, 106:12518-12523.
3. Barnes T.D., Kubota Y., Hu D., Jin D.Z., Graybiel A.M. Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories. Nature 2005, 437:1158-1161.
4. Bar Gad I., Bergman H. Stepping out of the box: information processing in the neural networks of the basal ganglia. Curr Opin Neurobiol 2001, 11:689-695.
5. Bergman H., Feingold A., Nini A., Raz A., Slovin H., Abeles M., Vaadia E. Physiological aspects of information processing in the basal ganglia of normal and parkinsonian primates. TINS 1998, 21:32-38.
6. Bottjer S.W., Miesner E.A., Arnold A.P. Forebrain lesions disrupt development but not maintenance of song in passerine birds. Science 1984, 224:901-903.
7. Bottjer S.W. The distribution of tyrosine hydroxylase immunoreactivity in the brains of male and female zebra finches. J Neurobiol 1993, 24:51-69.
8. Brainard M.S., Doupe A.J. What songbirds teach us about learning. Nature 2002, 417:351-358.
9. Brainard M.S., Doupe A.J. Interruption of a basal ganglia-forebrain circuit prevents plasticity of learned vocalizations. Nature 2000, 404:762-766.
10. Brasted P.J., Wise S.P. Comparison of learning-related neuronal activity in the dorsal premotor cortex and striatum. Eur J Neurosci 2004, 19:721-740.
11. Carrillo G., Doupe A.J. Is the songbird Area X striatal, pallidal, or both? An anatomical study. J Comp Neurol 2004, 473:415-437.
12. Charlesworth J.D., Tumer E.C., Warren T.L., Brainard M.S. Learning the microstructure of successful behavior. Nat Neurosci 2011, 14:373-380.
13. Chen J.R., Stepanek L., Doupe A.J. Differential contributions of basal ganglia and thalamus to song initiation, tempo, and structure. J Neurophysiol 2014, 111:248-257.
14. Churchland M.M., Yu B.M., Ryu S.I., Santhanam G., Shenoy K.V. Neural variability in premotor cortex provides a signature of motor preparation. J Neurosci 2006, 26:3697-3712.
15. Churchland M.M., Afshar A., Shenoy K.V. A central source of movement variability. Neuron 2006, 52:1085-1096.
16. Costa R.M., Lin S.C., Sotnikova T.D., Cyr M., Gainetdinov R.R., Caron M.G., Nicolelis M.A. Rapid alterations in corticostriatal ensemble coordination during acute dopamine-dependent motor dysfunction. Neuron 2006, 52:359-369.
17. DeLong M.R. Activity of pallidal neurons during movement. J Neurophysiol 1971, 34:414-427.
18. DeLong M.R., Wichmann T. Circuits and circuit disorders of the basal ganglia. Arch Neurol 2007, 64:20-24.
19. Ding L., Perkel D.J. Dopamine modulates excitability of spiny neurons in the avian basal ganglia. J Neurosci 2002, 22:5210-5218.
20. Doupe A.J., Perkel D.J., Reiner A., Stern E.A. Birdbrains could teach basal ganglia research a new song. Trends Neurosci 2005, 28:353-363.
21. Doya K. Metalearning and neuromodulation. Neural Netw 2002, 15:495-506.
22. Doya K., Sejnowski T.J. A computational model of birdsong learning by auditory experience and auditory feedback. Central auditory processing and neural modeling 1998, 77-88. Plenum, New York, NY. P.W.F. Poon, J.F. Brugge (Eds.).
23. Doya K., Sejnowski T.J. A computational model of avian song learning. The new cognitive neurosciences 2000, 469-482. MIT, Cambridge, MA. M.F. Gazzaniga (Ed.).
24. Dugas-Ford J., Rowell J.J., Ragsdale C.W. Cell-type homologies and the origins of the neocortex. Proc Natl Acad Sci USA 2012, 109:16974-16979.
25. Farries M.A., Perkel D.J. A telencephalic nucleus essential for song learning contains neurons with physiological characteristics of both striatum and globus pallidus. J Neurosci 2002, 22:3773-3787.
26. Farries M.A., Ding L., Perkel D.J. Evidence for "direct" and "indirect" pathways through the song system basal ganglia. J Comp Neurol 2005, 484:93-104.
27. Fee M.S., Goldberg J.H. A hypothesis for basal ganglia-dependent reinforcement learning in the songbird. Neuroscience 2011, 198:152-170.
28. Gale S.D., Person A.L., Perkel D.J. A novel pathway forms a loop linking a vocal learning circuit with its dopaminergic input. J Comp Neurol 2008, 508:824-839.
29. Gdowski M.J., Miller L.E., Parrish T., Nenonene E.K., Houk J.C. Context dependency in the globus pallidus internal segment during targeted arm movements. J Neurophysiol 2001, 85:998-1004.
30. Goldberg J.H., Adler A., Bergman H., Fee M.S. Singing-related neural activity distinguishes two putative pallidal cell types in the songbird basal ganglia: comparison to the primate internal and external pallidal segments. J Neurosci 2010, 30:7088-7098.
31. Goldberg J.H., Farries M.A., Fee M.S. Integration of cortical and pallidal inputs in the basal ganglia-recipient thalamus of singing birds. J Neurophysiol 2012, 108:1403-1429.
32. Goldberg J.H., Fee M.S. Singing-related neural activity distinguishes four classes of putative striatal neurons in the songbird basal ganglia. J Neurophysiol 2010, 103:2002-2014.
33. Goldberg J.H., Fee M.S. Vocal babbling in songbirds requires the basal ganglia-recipient motor thalamus but not the basal ganglia. J Neurophysiol 2011, 105:2729-2739.
34. Goldberg J.H., Fee M.S. A cortical motor nucleus drives the basal ganglia-recipient thalamus in singing birds. Nat Neurosci 2012, 15:620-627.
35. Goldberg J.A., Rokni U., Boraud T., Vaadia E., Bergman H. Spike synchronization in the cortex/basal-ganglia networks of Parkinsonian primates reflects global dynamics of the local field potentials. J Neurosci 2004, 24:6003-6010.
36. Graybiel A.M. The basal ganglia: learning new tricks and loving it. Curr Opin Neurobiol 2005, 15:638-644.
37. Graybiel A.M. Habits rituals and the evaluative brain. Annu Rev Neurosci 2008, 31:359-387.
38. Graybiel A.M., Aosaki T., Flaherty A.W., Kimura M. The basal ganglia and adaptive motor control. Science 1994, 265:1826-1831.
39. Grillner S., Hellgren J., Ménard A., Saitoh K., Wikström M.A. Mechanisms for selection of basic motor programs - roles for the striatum and pallidum. TINS 2005, 28:364-370.
40. Hampton C.M., Sakata J.T., Brainard M.S. An avian basal ganglia-forebrain circuit contributes differentially to syllable versus sequence variability of adult Bengalese finch song. J Neurophysiol 2009, 101:3235-3245.
41. Handel A., Glimcher P.W. Contextual modulation of substantia nigra pars reticulata neurons. J Neurophysiol 2000, 83:3042-3048.
42. Hessler N.A., Doupe A.J. Social context modulates singing-related neural activity in the songbird forebrain. Nat Neurosci 1999, 2:209-211.
43. Hikosaka O., Sakamoto M., Usui S. Functional properties of monkey caudate neurons I Activities related to saccadic eye movements. J Neurophysiol 1989, 61:780-798.
44. Immelman K. Song development in the zebra finch and other estrildid finches. Bird vocalizations 1969, 61-74. Cambridge Univ Press, London. R.A. Hinde (Ed.).
45. Ishii S., Yoshida W., Yoshimoto J. Control of exploitation-exploration meta-parameter in reinforcement learning. Neural Netw 2002, 15:665-687.
46. Jarvis E.D., Güntürkün O., Bruce L., Csillag A., Karten H., Kuenzel W., Medina L., Paxinos G., Perkel D.J., Shimizu T., Striedter G., Wild J.M., Ball G.F., Dugas-Ford J., Durand S.E., Hough G.E., Husband S., Kubikova L., Lee D.W., Mello C.V., Powers A., Siang C., Smulders T.V., Wada K., White S.A., Yamamoto K., Yu J., Reiner A., Butler A.B. Avian brains and a new understanding of vertebrate brain evolution. Nat Rev Neurosci 2005, 6:151-159. Avian Brain Nomenclature Consortium.
47. Kao M.H., Brainard M.S. Lesions of an avian basal ganglia circuit prevent context-dependent changes to song variability. J Neurophysiol 2006, 96:1441-1455.
48. Kao M.H., Doupe A.J., Brainard M.S. Contributions of an avian basal ganglia-forebrain circuit to real-time modulation of song. Nature 2005, 433:638-643.
49. Kao M.H., Wright B.D., Doupe A.J. Neurons in a forebrain nucleus required for vocal plasticity rapidly switch between precise firing and variable bursting depending on social context. J Neurosci 2008, 28:13232-13247.
50. Karten H.J. The organization of the avian telencephalon and some speculations on the phylogeny of the amniote telencephalon. Comparative and evolutionary aspects of the vertebrate central nervous system 1969, 146-179. Ann N Y Acad Sci, New York. J. Pertras (Ed.).
51. Karten H.J. Homology and evolutionary origins of the 'neocortex'. Brain Behav Evol 1991, 38:264-272.
52. Kawagoe R., Takikawa Y., Hikosaka O. Expectation of reward modulates cognitive signals in the basal ganglia. Nat Neurosci 1998, 1:411-416.
53. Kojima S., Doupe A.J. Activity propagation in an avian basal ganglia-thalamocortical circuit essential for vocal learning. J. Neurosci. 2009, 29:4782-4793.
54. Kojima S., Doupe A.J. Social performance reveals unexpected vocal competency in young songbirds. Proc Natl Acad Sci USA 2011, 108:1687-1692.
55. Kojima S., Kao M.H., Doupe A.J. Task-related "cortical" bursting depends critically on basal ganglia input and is linked to vocal plasticity. Proc Natl Acad Sci USA 2013, 110:4756-4761.
56. Konishi M. The role of auditory feedback in the control of vocalization in the whitecrowned sparrow. Z Tierpsychol 1965, 22:770-783.
57. Lauwereyns J., Watanabe K., Coe B., Hikosaka O. A neural correlate of response bias in monkey caudate nucleus. Nature 2002, 418:413-417.
58. Leblois A., Bodor A.L., Person A.L., Perkel D.J. Millisecond timescale disinhibition mediates fast information transmission through an avian basal ganglia loop. J Neurosci 2009, 29:15420-15433.
59. Leblois A., Wendel B.J., Perkel D.J. Striatal dopamine modulates basal ganglia output and regulates social context-dependent behavioral variability through D1 receptors. J Neurosci 2010, 30:5730-5743.
60. Lewis J.W., Ryan S.M., Arnold A.P., Butcher L.L. Evidence for a catecholaminergic projection to area X in the zebra finch. J Comp Neurol 1981, 196:347-354.
61. Luo M., Perkel D.J. A GABAergic strongly inhibitory projection to a thalamic nucleus in the zebra finch song system. J Neurosci 1999, 19:6700-6711.
62. Marler P. A comparative approach to vocal learning: song development in white crowned sparrows. J Comp Physiol Psychol 1970, 7:11-25.
63. Mooney R. Neurobiology of song learning. Curr Opin Neurobiol. 2009, 19:654-660.
64. Nordeen K.W., Nordeen E.J. Anatomical and synaptic substrates for avian song learning. J Neurobiol. 1997, 33:532-548.
65. Nottebohm F., Stokes T.M., Leonard C.M. Central control of song in the canary Serinus canarius. J Comp Neurol 1976, 165:457-486.
66. Ölveczky B.P., Andalman A.S., Fee M.S. Vocal experimentation in the juvenile songbird requires a basal ganglia circuit. PLoS Biol 2005, 3:e153.
67. Osborne L.C., Lisberger S.G., Bialek W. A sensory source for motor variation. Nature 2005, 437:412-416.
68. Pasupathy A., Miller E.K. Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature 2005, 433:873-876.
69. Person A.L., Perkel D.J. Unitary IPSPs drive precise thalamic spiking in a circuit require for learning. Neuron 2005, 46:129-140.
70. Person A.L., Perkel D.J. Pallidal neuron activity increases during sensory relay through thalamus in a songbird circuit essential for learning. J Neurosci 2007, 27:8687-8698.
71. Person A.L., Gale S.D., Farries M.A., Perkel D.J. Organization of the songbird basal ganglia including area X. J Comp Neurol 2008, 508:840-866.
72. Reiner A., Laverghetta A.V., Meade C.A., Cuthbertson S.L., Bottjer S.W. An immunohistochemical and pathway tracing study of the striatopallidal organization of area X in the male zebra finch. J Comp Neurol 2004, 469:239-261.
73. Reiner A., Yamamoto K., Karten H.J. Organization and evolution of the avian forebrain. Anat Rec A Discov Mol Cell Evol Biol 2005, 287:1080-1102.
74. Sakata J.T., Brainard M.S. Social context rapidly modulates the influence of auditory feedback on avian vocal motor control. J Neurophysiol 2009, 102:2485-2497.
75. Sasaki A., Sotnikova T.D., Gainetdinov R.R., Jarvis E.D. Social context-dependent singing regulated dopamine. J Neurosci 2006, 30:9010-9014.
76. Scharff C., Nottebohm F. A comparative study of the behavioral deficits following lesions of various parts of the zebra finch song system: implications for vocal learning. J Neurosci 1991, 11:2896-2913.
77. Schultz W. Updating dopamine reward signals. Curr Opin Neurobiol 2013, 23:229-238.
78. Schultz W., Tremblay L., Hollerman J.R. Changes in behavior-related neuronal activity in the striatum during learning. Trends Neurosci 2003, 26:321-328.
79. Sheth S.A., Abuelem T., Gale J.T., Eskander E.M. Basal ganglia neurons dynamically facilitate exploration during associative learning. J Neurosci 2011, 31:4878-4885.
80. Sober S.J., Brainard M.S. Adult birdsong is actively maintained by error correction. Nat Neurosci. 2009, 12:927-931.
81. Sober S.J., Brainard M.S. Vocal learning is constrained by the statistics of sensorimotor experience. Proc Natl Acad Sci USA 2012, 109:21099-21103.
82. Soha J.A., Shimizu T., Doupe A.J. Development of the catecholaminergic innervation of the song system of the male zebra finch. J Neurobiol 1996, 29:473-489.
83. Stepanek L., Doupe A.J. Activity in a cortical-basal ganglia circuit for song is required for social context-dependent vocal variability. J Neurophysiol 2010, 104:2474-2486.
84. Sutton R.S., Barto A.G. Reinforcement learning: an introduction 1998, MIT Press, Cambridge, MA.
85. Tumer E.C., Brainard M.S. Performance variability enables adaptive plasticity of 'crystallized' adult birdsong. Nature 2007, 450:1240-1244.
86. Warren T.L., Tumer E.C., Charlesworth J.D., Brainard M.S. Mechanisms and time course of vocal learning and consolidation in the adult songbird. J Neurophysiol 2011, 106:1806-1821.
87. Wichmann T., DeLong M.R., Guridi J., Obeso J.A. Milestones in research on the pathophysiology of Parkinson's disease. Mov Disord 2011, 26:1032-1041.
88. Williams Z.M., Eskandar E.N. Selective enhancement of associative learning by microstimulation of the anterior caudate. Nat Neurosci 2006, 9:562-568.
89. Woolley S.C., Doupe A.J. Social context-induced song variation affects female behavior and gene expression. PLoS Biol 2008, 6:e62.
90. Woolley S.C., Rajan R., Joshua M., Doupe A.J. Emergence of context-dependent variability across a basal ganglia circuit. Neuron 2014, 82:208-223.
91. Wu H.G., Miyamoto Y.R., Gonzalez Castro L.N., Ölveczky B.P., Smith M.A. Temporal structure of motor variability is dynamically regulated and predicts motor learning ability. Nat Neurosci. 2014, 17:312-321.