Dopaminergic system in birdsong learning and maintenance

Journal of Chemical Neuroanatomy

Volumn 39, Issue 2, 2010, Pages 112-123

  Kubikova, Ľubica ^a   Košťál, Ľubor ^a  

^a INSTITUTE OF CHEMISTRY   (Slovakia)

Author keywords

Dopamine modulated plasticity; Incentive salience; Personality; Reinforcement; Reward; Reward prediction error; Vocal communication

Indexed keywords

DOPAMINE; DOPAMINE 1 RECEPTOR; DOPAMINE 2 RECEPTOR;

ANIMAL BEHAVIOR; AUDITORY CORTEX; BIOLOGY; CORPUS STRIATUM; DOPAMINE RELEASE; DOPAMINERGIC NERVE CELL; DOPAMINERGIC SYSTEM; INFORMATION PROCESSING; INNERVATION; LEARNING; MESENCEPHALON; MOTIVATION; NERVE CELL PLASTICITY; NEUROANATOMY; NEUROTRANSMISSION; NONHUMAN; PERSONALITY; PREDICTION; PRIORITY JOURNAL; REINFORCEMENT; REVIEW; REWARD; SEXUAL BEHAVIOR; SIGNAL TRANSDUCTION; SINGING; SONGBIRD; VENTRAL TEGMENTUM; VOCALIZATION;

ANIMALS; BRAIN; DOPAMINE; LEARNING; NEURAL PATHWAYS; NEURONAL PLASTICITY; REINFORCEMENT (PSYCHOLOGY); REWARD; VOCALIZATION, ANIMAL;

EID: 75349090574     PISSN: 08910618     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jchemneu.2009.10.004     Document Type: Review

References (175)

1. Acerbo M., Výboh P., Košťál L., Kubikova L., and Delius J. Repeated apomorphine administration alters dopamine D1 and D2 receptor densities in pigeon basal telencephalon. Exp. Brain Res. 160 (2005) 533-537
2. Aizman O., Brismar H., Uhlén P., Zettergren E., Levey A., Forssberg H., Greengard P., and Aperia A. Anatomical and physiological evidence for D and D 2 dopamine receptor colocalization in neostriatal neurons. Nat. Neurosci. 3 (2000) 226-230
3. Appeltants D., Absil P., Balthazart J., and Ball G. Identification of the origin of catecholaminergic inputs to HVc in canaries by retrograde tract tracing combined with tyrosine hydroxylase immunocytochemistry. J. Chem. Neuroanat. 18 (2000) 117-133
4. Appeltants D., Ball G., and Balthazart J. The origin of catecholaminergic inputs to the song control nucleus RA in canaries. Neuroreport 13 (2002) 649-653
5. Ariano M., Larson E., Noblett K., Sibley D., and Levine M. Coexpression of striatal dopamine receptor subtypes and excitatory amino acid subunits. Synapse 26 (1997) 400-414
6. Auger C., Bentley G., Auger A., Ramamurthy M., and Ball G. Expression of cAMP response element binding protein-binding protein in the song control system and hypothalamus of adult European starlings (Sturnus vulgaris). J. Neuroendocrinol. 14 (2002) 805-813
7. Bailey J., Breidenthal S., Jorgensen M., McCracken J., and Fairbanks L. The association of DRD4 and novelty seeking is found in a nonhuman primate model. Psychiatr. Genet. 17 (2007) 23-27
8. Balint E., and Csillag A. Nucleus accumbens subregions: hodological and immunohistochemical study in the domestic chick (Gallus domesticus). Cell Tissue Res. 327 (2007) 221-230
9. Ball G.F., Casto J.M., and Balthazart J. Autoradiographic localization of D1-like dopamine receptors in the forebrain of male and female Japanese quail and their relationship with immunoreactive tyrosine hydroxylase. J. Chem. Neuroanat. 9 (1995) 121-133
10. Barto A., and Dietterich T. Reinforcement learning and its relationship to supervised learning. In: Si J., Barto A., Powell W., and Wunsch II D. (Eds). Handbook of Learning and Approximate Dynamic Programming (2004), Wiley Interscience/IEEE Press, Piscataway, NJ 47-64
11. Barto A., Sutton R., and Anderson C. Neuronlike adaptive elements that can solve difficult learning control problems. IEEE Trans. Syst. Man Cybern. 13 (1983) 835-846
12. Berridge K. The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology 191 (2007) 391-431
13. Berridge K., and Robinson T. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?. Brain Res. Rev. 28 (1998) 309-369
14. Boehmler W., Obrecht-Pflumio S., Canfield V., Thisse C., Thisse B., and Levenson R. Evolution and expression of D2 and D3 dopamine receptor genes in zebrafish. Dev. Dyn. 230 (2004) 481-493
15. Boehmler W., Carr T., Thisse C., Thisse B., Canfield V.A., and Levenson R. D4 Dopamine receptor genes of zebrafish and effects of the antipsychotic clozapine on larval swimming behaviour. Genes Brain Behav. 6 (2007) 155-166
16. Bonci A., and Malenka R. Properties and plasticity of excitatory synapses on dopaminergic and GABAergic cells in the ventral tegmental area. J. Neurosci. 19 (1999) 3723-3730
17. Bottjer S. The distribution of tyrosine hydroxylase immunoreactivity in the brains of male and female zebra finches. J. Neurobiol. 24 (1993) 51-69
18. Bottjer S., Halsema K., Brown S., and Miesner E. Axonal connections of a forebrain nucleus involved with vocal learning in zebra finches. J. Comp. Neurol. 279 (1989) 312-326
19. Brainard M., and Doupe A. Auditory feedback in learning and maintenance of vocal behaviour. Nat. Rev. Neurosci. 1 (2000) 31-40
20. Bunzow J.R., Tol H.H.M.V., Grandy D.K., Albert P., Salon J., Christie M., Machida C.A., Neve K.A., and Civelli O. Cloning and expression of a rat D2 dopamine receptor cDNA. Nature 336 (1988) 783-787
21. Calabresi P., Maj R., Pisani A., Mercuri N.B., and Bernardi G. Long-term synaptic depression in the striatum: physiological and pharmacological characterization. J. Neurosci. 12 (1992) 4224-4233
22. Calabresi P., Pisani A., Centonze D., and Bernardi G. Synaptic plasticity and physiological interactions between dopamine and glutamate in the striatum. Neurosci. Biobehav. Rev. 21 (1997) 519-523
23. Calabresi P., Picconi B., Tozzi A., and Di Filippo M. Dopamine-mediated regulation of corticostriatal synaptic plasticity. Trends Neurosci. 30 (2007) 211-219
24. Callier S., Snapyan M., Le Crom S., Prou D., Vincent J., and Vernier P. Evolution and cell biology of dopamine receptors in vertebrates. Biol. Cell 95 (2003) 489-502
25. Cardinaud B., Sugamori K.S., Coudouel S., Vincent J.D., Niznik H.B., and Vernier P. Early emergence of three dopamine D1 receptor subtypes in vertebrates. Molecular phylogenetic, pharmacological, and functional criteria defining D1A, D1B, and D1C receptors in European eel Anguilla anguilla. J. Biol. Chem. 272 (1997) 2778-2787
26. Castelino C., Diekamp B., and Ball G. Noradrenergic projections to the song control nucleus area X of the medial striatum in male zebra finches (Taeniopygia guttata). J. Comp. Neurol. 502 (2007) 544-562
27. Casto J.M., and Ball G.F. Characterization and localization of D1 dopamine receptors in the sexually dimorphic vocal control nucleus, area X, and the basal ganglia of European starlings. J. Neurobiol. 25 (1994) 767-780
28. Centonze D., Picconi B., Gubellini P., Bernardi G., and Calabresi P. Dopaminergic control of synaptic plasticity in the dorsal striatum. Eur. J. Neurosci. 13 (2001) 1071-1077
29. Cepeda C., André V.M., Yamazaki I., Wu N., Kleiman-Weiner M., and Levine M.S. Differential electrophysiological properties of dopamine D1 and D2 receptor-containing striatal medium-sized spiny neurons. Eur. J. Neurosci. 27 3 (2008) 671-682
30. Davis S., Vanhoutte P., Pages C., Caboche J., and Laroche S. The MAPK/ERK cascade targets both Elk-1 and cAMP response element-binding protein to control long-term potentiation-dependent gene expression in the dentate gyrus in vivo. J. Neurosci. 20 (2000) 4563-4572
31. Daw N. Reinforcement Learning Models of the Dopamine System and their Behavioral Implications. Unpublished Ph.D. Thesis (2003), School of Computer Science, Carnegie Mellon University, Pittsburgh 239 pp
32. Dayan P., and Niv Y. Reinforcement learning: the good, the bad and the ugly. Curr. Opin. Neurobiol. 18 (2008) 185-196
33. Dearry A., Gingrich J.A., Falardeau P., Fremeau R.T., Bates M.D., and Caron M.G. Molecular cloning and expression of the gene for a human D1 dopamine receptor. Nature 347 (1990) 72-76
34. Demchyshyn L.L., Sugamori K.S., Lee F.J., Hamadanizadeh S.A., and Niznik H.B. The dopamine D1D receptor. Cloning and characterization of three pharmacologically distinct D1-like receptors from Gallus domesticus. J. Biol. Chem. 270 (1995) 4005-4012
35. Deregnaucourt S., Mitra P., Feher O., Maul K., Lints T., and Tchernichovski O. Song development: in search of the error-signal. Ann. N.Y. Acad. Sci. 1016 (2004) 364-376
36. Di Chiara G., Tanda G., and Carboni E. Estimation of in-vivo neurotransmitter release by brain microdialysis: the issue of validity. Behav. Pharmacol. 7 (1996) 640-657
37. Dietl M.M., and Palacios J.M. Neurotransmitter receptors in the avian brain. I. Dopamine receptors. Brain Res. 439 (1988) 354-359
38. Ding L., and Perkel D.J. Dopamine modulates excitability of spiny neurons in the avian basal ganglia. J. Neurosci. 22 (2002) 5210-5218
39. Ding L., and Perkel D. Long-term potentiation in an avian basal ganglia nucleus essential for vocal learning. J. Neurosci. 24 (2004) 488-494
40. Ding L., Perkel D., and Farries M. Presynaptic depression of glutamatergic synaptic transmission by D1-like dopamine receptor activation in the avian basal ganglia. J. Neurosci. 23 (2003) 6086-6095
41. Doupe A. Song-and order-selective neurons in the songbird anterior forebrain and their emergence during vocal development. J. Neurosci. 17 (1997) 1147-1167
42. Doupe A., and Konishi M. Song-selective auditory circuits in the vocal control system of the zebra finch. Proc. Natl. Acad. Sci. U.S.A. 88 (1991) 11339-11343
43. Doya K., and Sejnowski T. A novel reinforcement model of birdsong vocalization learning. In: Tesauro G., Touretzky D., and Leen T. (Eds). Advances in Neural Information Processing Systems 7 (1995), MIT Press, Cambridge, MA 101-108
44. Doya K., and Sejnowski T. A computational model of avian song learning. New Cogn. Neurosci. (1999) 469-482
45. Durstewitz D., Kröner S., and Güntürkün O. The dopaminergic innervation of the avian telencephalon. Prog. Neurobiol. 59 (1999) 161-195
46. Farries M., and Fairhall A. Reinforcement learning with modulated spike timing dependent synaptic plasticity. J. Neurophysiol. 98 (2007) 3648-3665
47. Fidler A.E., van Oers K., Drent P.J., Kuhn S., Mueller J.C., and Kempenaers B. Drd4 gene polymorphisms are associated with personality variation in a passerine bird. Proc. Biol. Sci. 274 (2007) 1685-1691
48. Fiete I., Fee M., and Seung H. Model of birdsong learning based on gradient estimation by dynamic perturbation of neural conductances. J. Neurophysiol. 98 (2007) 2038-2057
49. Gale S.D., and Perkel D.J. Properties of dopamine release and uptake in the songbird basal ganglia. J. Neurophysiol. 93 (2005) 1871-1879
50. Gale S., and Perkel D. Physiological properties of zebra finch ventral tegmental area and substantia nigra pars compacta neurons. J. Neurophysiol. 96 (2006) 2295-2306
51. Gale S., Person A., and Perkel D. A novel basal ganglia pathway forms a loop linking a vocal learning circuit with its dopaminergic input. J. Comp. Neurol. 508 (2008) 824-839
52. Garamszegi L., Eens M., and Török J. Birds reveal their personality when singing. PLoS ONE 3 (2008) e2647
53. Gerfen C., Engber T., Mahan L., Susel Z., Chase T., Monsma F., and Sibley D. D1 and D2 dopamine receptor-regulated gene expression of striatonigral and striatopallidal neurons. Science 250 (1990) 1429-1432
54. Gerfen C.R., Keefe K.A., and Gauda E.B. D1 and D2 dopamine receptor function in the striatum: coactivation of D1- and D2-dopamine receptors on separate populations of neurons results in potentiated immediate early gene response in D1-containing neurons. J. Neurosci. 15 (1995) 8167-8176
55. Gerits N., Kostenko S., Shiryaev A., Johannessen M., and Moens U. Relations between the mitogen-activated protein kinase and the cAMP-dependent protein kinase pathways: comradeship and hostility. Cell. Signal. 20 (2008) 1592-1607
56. Gertler T., Chan C., and Surmeier D. Dichotomous anatomical properties of adult striatal medium spiny neurons. J. Neurosci. 28 (2008) 10814-10824
57. Gould T.D., and Manji H.K. DARPP-32: a molecular switch at the nexus of reward pathway plasticity. Proc. Natl. Acad. Sci. U.S.A. 102 (2005) 253-254
58. Grandy D.K., Zhang Y.A., Bouvier C., Zhou Q.Y., Johnson R.A., Allen L., Buck K., Bunzow J.R., Salon J., and Civelli O. Multiple human D5 dopamine receptor genes: a functional receptor and two pseudogenes. Proc. Natl. Acad. Sci. U.S.A. 88 (1991) 9175-9179
59. Groothuis T.G.G., and Carere C. Avian personalities: characterization and epigenesis. Neurosci. Biobehav. Rev. 29 (2005) 137-150
60. Hara E., Kubikova L., Hessler N., and Jarvis E. Role of the midbrain dopaminergic system in modulation of vocal brain activation by social context. Eur. J. Neurosci. 25 (2007) 3406-3416
61. Harding C., Barclay S., and Waterman S. Changes in catecholamine levels and turnover rates in hypothalamic, vocal control, and auditory nuclei in male zebra finches during development. J. Neurobiol. 34 (1998) 329-346
62. Heimovics S., and Riters L. Immediate early gene activity in song control nuclei and brain areas regulating motivation relates positively to singing behavior during, but not outside of, a breeding context. J. Neurobiol. 65 (2005) 207-224
63. Heimovics S., and Riters L. Evidence that dopamine within motivation and song control brain regions regulates birdsong context-dependently. Physiol. Behav. 95 (2008) 258-266
64. Heimovics S.A., Cornil C.A., Ball G.F., and Riters L.V. D1-like dopamine receptor density in nuclei involved in social behavior correlates with song in a context-dependent fashion in male European starlings. Neuroscience 159 (2009) 962-973
65. Hein A.M., Sridharan A., Nordeen K.W., and Nordeen E.J. Characterization of CaMKII-expressing neurons within a striatal region implicated in avian vocal learning. Brain Res. 1155 (2007) 125-133
66. Hejjas K., Vas J., Topal J., Szantai E., Ronai Z., Szekely A., Kubinyi E., Horvath Z., Sasvari-Szekely M., and Miklosi A. Association of polymorphisms in the dopamine D4 receptor gene and the activity-impulsivity endophenotype in dogs. Anim. Genet. 38 (2007) 629-633
67. Hernández G., and Shizgal P. Dynamic changes in dopamine tone during self-stimulation of the ventral tegmental area in rats. Behav. Brain Res. 198 (2009) 91-97
68. Hessler N., and Doupe A. Singing-related neural activity in a dorsal forebrain-basal ganglia circuit of adult zebra finches. J. Neurosci. 19 (1999) 10461-11481
69. Hessler N., and Doupe A. Social context modulates singing-related neural activity in the songbird forebrain. Nat. Neurosci. 2 (1999) 209-211
70. Hirano J., Archer S.N., and Djamgoz M.B. Dopamine receptor subtypes expressed in vertebrate (carp and eel) retinae: cloning, sequencing and comparison of five D1-like and three D2-like receptors. Receptors Channels 5 (1998) 387-404
71. Horvitz J. Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events. Neuroscience 96 (2000) 651-656
72. Jarvis E., Scharff C., Grossman M., Ramos J., and Nottebohm F. For whom the bird sings: context-dependent gene expression. Neuron 21 (1998) 775-788
73. Joel D., and Weiner I. The connections of the dopaminergic system with the striatum in rats and primates: an analysis with respect to the functional and compartmental organization of the striatum. Neuroscience 96 (2000) 451-474
74. Johnson F., Sablan M., and Bottjer S. Topographic organization of a forebrain pathway involved with vocal learning in zebra finches. J. Comp. Neurol. 358 (1995) 260-278
75. Jones M., Errington M., French P., Fine A., Bliss T., Garel S., Charnay P., Bozon B., Laroche S., and Davis S. A requirement for the immediate early gene Zif268 in the expression of late LTP and long-term memories. Nat. Neurosci. 4 (2001) 289-296
76. Kao M., Doupe A., and Brainard M. Contributions of an avian basal ganglia-forebrain circuit to real-time modulation of song. Nature 433 (2005) 638-643
77. Kebabian J.W., and Calne D.B. Multiple receptors for dopamine. Nature 277 (1979) 93-96
78. Kobayashi K., Uno H., and Okanoya K. Partial lesions in the anterior forebrain pathway affect song production in adult Bengalese finches. Neuroreport 12 (2001) 353-358
79. Konishi M. The role of auditory feedback in the control of vocalization in the white-crowned sparrow. Z. Tierpsychol. 22 (1965) 770-783
80. Konishi M. The role of auditory feedback in birdsong. Ann. N.Y. Acad. Sci. 1016 (2004) 463-475
81. Košťál L., Výboh P., Savory C.J., Juráni M., Kubikova L., and Blažíček P. Influence of food restriction on dopamine receptor densities, catecholamine concentrations and dopamine turnover in chicken brain. Neuroscience 94 (1999) 323-328
82. Kubikova L., Turner E., and Jarvis E. The pallial basal ganglia pathway modulates the behaviorally driven gene expression of the motor pathway. Eur. J. Neurosci. 25 (2007) 2145-2160
83. Kubikova L., Turner E., Scharff C., and Jarvis E. A predisposition to stutter and its recovery following basal ganglia damage. Soc. Neurosci. Abstr. (2007)
84. 2-like dopamine receptors in Japanese quail brain. Cell. Mol. Neurobiol. 29 (2009) 961-970
85. Kubikova, L., Wada, K., Jarvis, E., in press. Dopamine receptors in a songbird brain. J. Comp. Neurol.
86. Le Crom S., Kapsimali M., Barôme P., and Vernier P. Dopamine receptors for every species: gene duplications and functional diversification in Craniates. J. Struct. Funct. Genomics 3 (2003) 161-176
87. Le Moine C., and Bloch B. D1 and D2 dopamine receptor gene expression in the rat striatum: sensitive cRNA probes demonstrate prominent segregation of D1 and D2 mRNAs in distinct neuronal populations of the dorsal and ventral striatum. J. Comp. Neurol. 355 (1995) 418-426
88. Lee J., Everitt B., and Thomas K. Independent cellular processes for hippocampal memory consolidation and reconsolidation. Science 304 (2004) 839-843
89. Lee S., So C., Rashid A., Varghese G., Cheng R., Lanca A., O'Dowd B., and George S. Dopamine D1 and D2 receptor co-activation generates a novel phospholipase C-mediated calcium signal. J. Biol. Chem. 279 (2004) 35671-35678
90. Lewis J., Ryan S., Arnold A., and Butcher L. Evidence for a catecholaminergic projection to area X in the zebra finch. J. Comp. Neurol. 196 (1981) 347-354
91. Liu W., and Nottebohm F. Variable rate of singing and variable song duration are associated with high immediate early gene expression in two anterior forebrain song nuclei. Proc. Natl. Acad. Sci. U.S.A. 102 (2005) 10724-10729
92. Macrae A.D., and Brenner S. Analysis of the dopamine receptor family in the compact genome of the puffer fish Fugu rubripes. Genomics 25 (1995) 436-446
93. Marler P. Three models of song learning: evidence from behavior. J. Neurobiol. 33 (1997) 501-516
94. Marler P., and Peters S. Selective vocal learning in a sparrow. Science 198 (1977) 519-521
95. Martin-Fardon R., Sandillon F., Thibault J., Privat A., and Vignon J. Long-term monitoring of extracellular dopamine concentration in the rat striatum by a repeated microdialysis procedure. J. Neurosci. Methods 72 (1997) 123-135
96. Matamales M., Bertran-Gonzalez J., Salomon L., Degos B., Deniau J.-M., Valjent E., Hervé D., and Girault J.-A. Striatal medium-sized spiny neurons: identification by nuclear staining and study of neuronal subpopulations in BAC transgenic mice. PLoS ONE 4 (2009) e4770
97. McClure S., Daw N., and Read Montague P. A computational substrate for incentive salience. Trends Neurosci. 26 (2003) 423-428
98. Mello C., Vates E., Okuhata S., and Nottebohm F. Descending auditory pathways in the adult male zebra finch (Taeniopygia guttata). J. Comp. Neurol. 395 (1998) 137-160
99. Missale C., Nash S., Robinson S., Jaber M., and Caron M. Dopamine receptors: from structure to function. Physiol. Rev. 78 (1998) 189-225
100. Momozawa Y., Takeuchi Y., Kusunose R., Kikusui T., and Mori Y. Association between equine temperament and polymorphisms in dopamine D4 receptor gene. Mamm. Genome 16 (2005) 538-544
101. Montague P., Hyman S., and Cohen J. Computational roles for dopamine in behavioural control. Nature 431 (2004) 760-767
102. Munafo M.R., Yalcin B., Willis-Owen S.A., and Flint J. Association of the dopamine D4 receptor (DRD4) gene and approach-related personality traits: meta-analysis and new data. Biol. Psychiatry 63 (2008) 197-206
103. Nelson D. Song overproduction and selective attrition lead to song sharing in the field sparrow (Spizella pusilla). Behav. Ecol. Sociobiol. 30 (1992) 415-424
104. Nelson D., and Marler P. Selection-based learning in bird song development. Proc. Natl. Acad. Sci. U.S.A. 91 (1994) 10498-10501
105. Nottebohm F., Stokes T., and Leonard C. Central control of song in the canary, Serinus canarius. J. Comp. Neurol. 165 (1976) 457-486
106. Nottebohm F., Paton J., and Kelley D. Connections of vocal control nuclei in the canary telencephalon. J. Comp. Neurol. (1982) 207
107. Olveczky B., Andalman A., and Fee M. Vocal experimentation in the juvenile songbird requires a basal ganglia circuit. PLoS Biol. 3 (2005) 902-909
108. Pan W., Schmidt R., Wickens J., and Hyland B. Tripartite mechanism of extinction suggested by dopamine neuron activity and temporal difference model. J. Neurosci. 28 (2008) 9619-9631
109. Person A., Gale S., Farries M., and Perkel D. Organization of the songbird basal ganglia, including area X. J. Comp. Neurol. (2008) 508
110. Redgrave P., Prescott T., and Gurney K. Is the short-latency dopamine response too short to signal reward error?. Trends Neurosci. 22 (1999) 146-151
111. Reiner A., Laverghetta A., Meade C., Cuthbertson S., and Bottjer S. An immunohistochemical and pathway tracing study of the striatopallidal organization of area X in the male zebra finch. J. Comp. Neurol. 469 (2004) 239-261
112. Reiner A., Perkel D., Bruce L., Butler A., Csillag A., Kuenzel W., Medina L., Paxinos G., Shimizu T., Striedter G., Wild M., Ball G., Durand S., Gütürkün O., Lee D., Mello C., Powers A., White S., Hough G., Kubikova L., Smulders T., Wada K., Dugas-Ford J., Husband S., Yamamoto K., Yu J., Siang C., and Jarvis E. Revised nomenclature for avian telencephalon and some related brainstem nuclei. J. Comp. Neurol. 473 (2004) 377-414
113. Richfield E.K., Young A.B., and Penney J.B. Comparative distribution of dopamine D-1 and D-2 receptors in the basal ganglia of turtles, pigeons, rats, cats, and monkeys. J. Comp. Neurol. 262 (1987) 446-463
114. Riters L.V. Evidence for opioid involvement in the motivation to sing. J. Chem. Neuroanat. 39 (2010) 141-150
115. Riters L., Schroeder M., Auger C., Eens M., Pinxten R., and Ball G. Evidence for opioid involvement in the regulation of song production in male European starlings (Sturnus vulgaris). Behav. Neurosci. 119 (2005) 245-255
116. Robinson D., Venton B., Heien M., and Wightman R. Detecting subsecond dopamine release with fast-scan cyclic voltammetry in vivo. Clin. Chem. 49 (2003) 1763-1773
117. Robinson D., Howard E., McConnell S., Gonzales R., and Wightman R. Disparity between tonic and phasic ethanol-induced dopamine increases in the nucleus accumbens of rats. Alcohol. Clin. Exp. Res. 33 (2009) 1187-1196
118. Rosenstein M., and Barto A. Supervised actor-critic reinforcement learning. In: Si J., Barto A., Powell W., and Wunsch II D. (Eds). Handbook of Learning and Approximate Dynamic Programming (2004), Wiley Interscience/IEEE Press, Piscataway, NJ 359-380
119. Sakaguchi H., and Saito N. The acetylcholine and catecholamine contents in song control nuclei of zebra finch during song ontogeny. Brain Res. 47 (1989) 313-317
120. Sakaguchi H., Wada K., Maekawa M., Watsuji T., and Hagiwara M. Song-induced phosphorylation of cAMP response element-binding protein in the songbird brain. J. Neurosci. 19 (1999) 3973-3981
121. Salamone J., Correa M., Farrar A., and Mingote S. Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology 191 (2007) 461-482
122. Sasaki A., Kubikova L., Wada K., Sotnikova T., Gainetdinov R., and Jarvis E. The dopaminergic system during singing behavior in zebra finches. Soc. Neurosci. Abstr. (2003)
123. Sasaki A., Sotnikova T., Gainetdinov R., and Jarvis E. Social context-dependent singing-regulated dopamine. J. Neurosci. 26 (2006) 9010-9014
124. Scharff C., and Nottebohm F. A comparative study of the behavioral deficits following lesions of various parts of the zebra finch song system: implications for vocal learning. J. Neurosci. 11 (1991) 2896-2913
125. Schnabel R., and Braun K. Development of dopamine receptors in the forebrain of the domestic chick in relation to auditory imprinting. An autoradiographic study. Brain Res. 720 (1996) 120-130
126. Schnabel R., Metzger M., Jiang S., Hemmings H.C., Greengard P., and Braun K. Localization of dopamine D1 receptors and dopaminoceptive neurons in the chick forebrain. J. Comp. Neurol. 388 (1997) 146-168
127. Schnell S.A., You S., Foster D.N., and El Halawani M.E. Molecular cloning and tissue distribution of an avian D2 dopamine receptor mRNA from the domestic turkey (Meleagris gallopavo). J. Comp. Neurol. 407 (1999) 543-554
128. Schroeder M., and Riters L. Pharmacological manipulations of dopamine and opioids have differential effects on sexually motivated song in male European starlings. Physiol. Behav. 88 (2006) 575-584
129. Schultz W. Predictive reward signal of dopamine neurons. J. Neurophysiol. 80 (1998) 1-27
130. Schultz W. Multiple reward signals in the brain. Nat. Rev. Neurosci. 1 (2000) 199-207
131. Schultz W. Behavioral theories and the neurophysiology of reward. Annu. Rev. Psychol. 57 (2006) 87-115
132. Schultz W. Behavioral dopamine signals. Trends Neurosci. 30 (2007) 203-210
133. Schultz W., and Dickinson A. Neuronal coding of prediction errors. Annu. Rev. Neurosci. 23 (2000) 473-500
134. Schultz W., Dayan P., and Montague P. A neural substrate of prediction and reward. Science 275 (1997) 1593-1599
135. Schultz W., Tremblay L., and Hollerman J.R. Reward prediction in primate basal ganglia and frontal cortex. Neuropharmacology 37 (1998) 421-429
136. Shen W., Flajolet M., Greengard P., and Surmeier D. Dichotomous dopaminergic control of striatal synaptic plasticity. Science 321 (2008) 848-851
137. Sih A., Bell A.M., Johnson J.C., and Ziemba R.E. Behavioral syndromes: an intergrative overiew. Q. Rev. Biol. 79 (2004) 241-277
138. Singh T., Nordeen E., and Nordeen K. Song tutoring triggers CaMKII phosphorylation within a specialized portion of the avian basal ganglia. J. Neurobiol. 65 (2005) 179-191
139. Smeets W., Marín O., and González A. Evolution of the basal ganglia: new perspectives through a comparative approach. J. Anat. 196 (2000) 501-517
140. Snyder-Keller A., Chandra R., Lin Y., and Mitchell E. Basal EGR-1 (zif268, NGFI-A, Krox-24) expression in developing striatal patches: role of dopamine and glutamate. Brain Res. 958 (2002) 297-304
141. Soha J., Shimizu T., and Doupe A. Development of the catecholaminergic innervation of the song system of the male zebra finch. J. Neurobiol. 29 (1996) 473-489
142. Sohrabji F., Nordeen E., and Nordeen K. Selective impairment of song learning following lesions of a forebrain nucleus in the juvenile zebra finch. Behav. Neural Biol. 53 (1990) 51-63
143. Sokoloff P., Giros B., Martres M.-P., Bouthenet M.-L., and Schwartz J.-C. Molecular cloning and characterization of a novel dopamine receptor (D3) as a target for neuroleptics. Nature 347 (1990) 146-151
144. Stewart M.G., Kabai P., Harrison E., Steele R.J., Kossut M., Gierdalski M., and Csillag A. The involvement of dopamine in the striatum in passive avoidance training in the chick. Neuroscience 70 (1996) 7-14
145. Stoof J., and Kebabian J. Opposing roles for D-1 and D-2 dopamine receptors in efflux of cyclic AMP from rat neostriatum. Nature 294 (1981) 366-368
146. Striedter G., and Vu E. Bilateral feedback projections to the forebrain in the premotor network for singing in zebra finches. J. Neurobiol. 34 (1998) 27-40
147. Sugamori K.S., Demchyshyn L.L., Chung M., and Niznik H.B. D1A, D1B, and D1C dopamine receptors from Xenopus laevis. Proc. Natl. Acad. Sci. U.S.A. 91 (1994) 10536-10540
148. Sun Z., and Reiner A. Localization of dopamine D1A and D1B receptor mRNAs in the forebrain and midbrain of the domestic chick. J. Chem. Neuroanat. 19 (2000) 211-224
149. Sunahara R.K., Niznik H.B., Weiner D.M., Stormann T.M., Brann M.R., Kennedy J.L., Gelernter J.E., Rozmahel R., Yang Y., Israel Y., Seeman P., and O'Dowd B.F. Human dopamine D1 receptor encoded by an intronless gene on chromosome 5. Nature 347 (1990) 80-83
150. Sunahara R.K., Guan H.-C., O'Dowd B.F., Seeman P., Laurier L.G., Ng G., George S.R., Torchia J., Van Tol H.H.M., and Niznik H.B. Cloning of the gene for a human dopamine D5 receptor with higher affinity for dopamine than D1. Nature 350 (1991) 614-619
151. Surmeier D.J., Song W.-J., and Yan Z. Coordinated expression of dopamine receptors in neostriatal medium spiny neurons. J. Neurosci. 16 (1996) 6579-6591
152. Surmeier D.J., Ding J., Day M., Wang Z., and Shen W. D1 and D2 dopamine-receptor modulation of striatal glutamatergic signaling in striatal medium spiny neurons. Trends Neurosci. 30 (2007) 228-235
153. Sutton R. Learning to predict by the methods of temporal differences. Mach. Learn. 3 (1988) 9-44
154. Sutton R., and Barto A. Reinforcement Learning: An Introduction (1998), MIT Press, Cambridge, MA
155. Tombaugh T. Effects of pimozide on nondiscriminated and discriminated performance in the pigeon. Psychopharmacology 73 (1981) 137-141
156. Troyer T., and Doupe A. An associational model of birdsong sensorimotor learning I. Efference copy and the learning of song syllables. J. Neurophysiol. 84 (2000) 1204-1223
157. Troyer T., and Doupe A. An associational model of birdsong sensorimotor learning II. Temporal hierarchies and the learning of song sequence. J. Neurophysiol. 84 (2000) 1224-1239
158. Vallone D., Picetti R., and Borrelli E. Structure and function of dopamine receptors. Neurosci. Biobehav. Rev. 24 (2000) 125-132
159. van Hierden Y.M., Koolhaas J.M., Košťál L., Výboh P., Sedlačková M., Rajman M., Juráni M., and Korte M.S. Chicks from a high and low feather pecking line of laying hens differ in apomorphine sensitivity. Physiol. Behav. 84 (2005) 471-477
160. Van Tol H.H.M., Bunzow J.R., Guan H.-C., Sunahara R.K., Seeman P., Niznik H.B., and Civelli O. Cloning of the gene for a human dopamine D4 receptor with high affinity for the antipsychotic clozapine. Nature 350 (1991) 610-614
161. Vates G., and Nottebohm F. Feedback circuitry within a song-learning pathway. Proc. Natl. Acad. Sci. U.S.A. 92 (1995) 5139-5143
162. Vates G., Vicario D., and Nottebohm F. Reafferent thalamo-"cortical" loops in the song system of oscine songbirds. J. Comp. Neurol. 380 (1997) 275-290
163. von der Kammer H., Mayhaus M., Albrecht C., Enderich J., Wegner M., and Nitsch R.M. Muscarinic acetylcholine receptors activate expression of the EGR gene family of transcription factors. Circ. Res. 91 (2002) 899-906
164. Wang Z., Kai L., Day M., Ronesi J., Yin H.H., Ding J., Tkatch T., Lovinger D.M., and Surmeier D.J. Dopaminergic control of corticostriatal long-term synaptic depression in medium spiny neurons is mediated by cholinergic interneurons. Neuron 50 3 (2006) 443-452
165. West A., Griffith E., and Greenberg M. Regulation of transcription factors by neuronal activity. Nat. Rev. Neurosci. 3 (2002) 921-931
166. Wild J. Descending projections of the songbird nucleus robustus archistriatalis. J. Comp. Neurol. 338 (1993) 225-241
167. Wise R. The dopamine synapse and the notion of 'pleasure centers' in the brain. Trends Neurosci. 3 (1980) 91-94
168. Wise R.A. Dopamine, learning and motivation. Nat. Rev. Neurosci. 5 (2004) 483-494
169. Wise R. Dopamine and reward: the anhedonia hypothesis 30 years on. Neurotox. Res. 14 (2008) 169-183
170. Wise R., Spindler J., DeWit H., and Gerberg G. Neuroleptic-induced "anhedonia" in rats: pimozide blocks reward quality of food. Science 201 (1978) 262-264
171. Worgotter F., and Porr B. Temporal sequence learning, prediction, and control: a review of different models and their relation to biological mechanisms. Neural Comput. 17 (2005) 245-319
172. Yanagihara S., and Hessler N. Modulation of singing-related activity in the songbird ventral tegmental area by social context. Eur. J. Neurosci. 24 (2006) 3619-3627
173. Zhang H., and Sulzer D. Glutamate spillover in the striatum depresses dopaminergic transmission by activating group I metabotropic glutamate receptors. J. Neurosci. 23 (2003) 10585-10592
174. Zhou Q.-Y., Grandy D.K., Thambi L., Kushner J.A., Tol H.H.M.V., Cone R., Pribnow D., Salon J., Bunzow J.R., and Civelli O. Cloning and expression of human and rat Dt dopamine receptors. Nature 347 (1990) 76-80
175. Zhou X., Moon C., Zheng F., Luo Y., Soellner D., Nunez J., and Wang H. N-methyl-d-aspartate-stimulated ERK1/2 signaling and the transcriptional up-regulation of plasticity-related genes are developmentally regulated following in vitro neuronal maturation. J. Neurosci. Res. 87 (2009) 2632-2644