Dopamine modulation of learning and memory in the prefrontal cortex: Insights from studies in primates, rodents, and birds

Frontiers in Neural Circuits

Volumn 8, Issue AUG, 2014, Pages

  Puig, M Victoria ^a   Rose, Jonas ^a,b   Schmidt, Robert ^c   Freund, Nadja ^d  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b UNIVERSITY OF TÜBINGEN   (Germany)

^c UNIVERSITY OF FREIBURG   (Germany)

^d UNIVERSITY HOSPITAL TÜBINGEN   (Germany)

Author keywords

Dopamine receptors; Evolution; Executive function; Learning and memory; Neuromodulation; Prefrontal cortex; Working memory

Indexed keywords

DOPAMINE; DOPAMINE 1 RECEPTOR; DOPAMINE 2 RECEPTOR;

BIRD; BRAIN DISEASE; BRAIN FUNCTION; COGNITION; CONCEPTUAL FRAMEWORK; DOPAMINERGIC NERVE CELL; DOPAMINERGIC SYSTEM; DOPAMINERGIC TRANSMISSION; EXECUTIVE FUNCTION; FUNCTIONAL ASSESSMENT; HAPLORHINI; HUMAN; LEARNING; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; MEDICAL RESEARCH; MEMORY; MENTAL CAPACITY; MENTAL DISEASE; NEUROCHEMISTRY; NEUROLOGIC DISEASE; NEUROMODULATION; NEUROPHYSIOLOGY; NONHUMAN; PREFRONTAL CORTEX; REVIEW; RODENT; SPECIES COMPARISON; ANIMAL; BIOLOGICAL MODEL; DRUG EFFECTS; METABOLISM; PHYSIOLOGY; RAT; SHORT TERM MEMORY;

ANIMALS; BIRDS; DOPAMINE; HUMANS; LEARNING; MEMORY, SHORT-TERM; MODELS, NEUROLOGICAL; PREFRONTAL CORTEX; RATS;

EID: 84905587068     PISSN: 16625110     EISSN: None     Source Type: Journal    
DOI: 10.3389/fncir.2014.00093     Document Type: Review

References (218)

1. Abi-Dargham, A. (2004). Do we still believe in the dopamine hypothesis? New data bring new evidence. Int. J. Neuropsychopharmacol. 7(Suppl. 1), S1-S5. doi: 10.1017/S1461145704004110
2. Abi-Dargham, A., and Moore, H. (2003). Prefrontal DA transmission at D1 receptors and the pathology of schizophrenia. Neuroscientist 9, 404-416. doi: 10.1177/1073858403252674
3. Albin, R. L., Young, A. B., and Penney, J. B. (1989). The functional anatomy of basal ganglia disorders. Trends Neurosci. 12, 366-375. doi: 10.1016/0166-2236(89)90074-X
4. Alderson, R. M., Kasper, L. J., Hudec, K. L., and Patros, C. H. G. (2013). Attention-deficit/hyperactivity disorder (ADHD) and working memory in adults: a meta-analytic review. Neuropsychology 27, 287-302. doi: 10.1037/a0032371
5. Alexander, G. E., and Crutcher, M. D. (1990). Functional architecture of basal ganglia circuits: neural substrates of parallel processing. Trends Neurosci. 13, 266-271. doi: 10.1016/0166-2236(90)90107-L
6. Andersen, S. L., Thompson, A. T., Rutstein, M., Hostetter, J. C., and Teicher, M. H. (2000). Dopamine receptor pruning in prefrontal cortex during the periadolescent period in rats. Synapse 37, 167-169. doi: 10.1002/1098-2396(200008)37:2<167::AID-SYN11>3.0.CO;2-B
7. Antzoulatos, E. G., and Miller, E. K. (2011). Differences between neural activity in prefrontal cortex and striatum during learning of novel abstract categories. Neuron 71, 243-249. doi: 10.1016/j.neuron.2011.05.040
8. Arnsten, A. F. (2012). Neuromodulation of thought: flexibilities and vulnerabilities in prefrontal cortical network synapses. Neuron 76, 223-239. doi: 10.1016/j.neuron.2012.08.038
9. Arnsten, A. F., Cai, J. X., Murphy, B. L., and Goldman-Rakic, P. S. (1994). Dopamine D1 receptor mechanisms in the cognitive performance of young adult and aged monkeys. Psychopharmacology (Berl.) 116, 143-151. doi: 10.1007/BF02245056
10. Arnsten, A. F., and Goldman-Rakic, P. S. (1998). Noise stress impairs prefrontal cortical cognitive function in monkeys: evidence for a hyperdopaminergic mechanism. Arch. Gen. Psychiatry 55, 362-368. doi: 10.1001/archpsyc.55.4.362
11. Arnsten, A. F. T. (2011). Catecholamine influences on dorsolateral prefrontal cortical networks. Biol. Psychiatry 69, e89-e99. doi: 10.1016/j.biopsych.2011.01.027
12. Arnsten, A. F. T., Paspalas, C. D., Gamo, N. J., Yang, Y., and Wang, M. (2010). Dynamic network connectivity: a new form of neuroplasticity. Trends Cogn. Sci. 14, 365-375. doi: 10.1016/j.tics.2010.05.003
13. Asaad, W. F., Rainer, G., and Miller, E. K. (1998). Neural activity in the primate prefrontal cortex during associative learning. Neuron 21, 1399-1407. doi: 10.1016/S0896-6273(00)80658-3
14. Avery, M. C., Dutt, N., and Krichmar, J. L. (2013). A large-scale neural network model of the influence of neuromodulatory levels on working memory and behavior. Front. Comput. Neurosci. 7:133. doi: 10.3389/fncom.2013. 00133
15. Bäckman, L., Karlsson, S., Fischer, H., Karlsson, P., Brehmer, Y., Rieckmann, A., et al. (2011). Dopamine D1 receptors and age differences in brain activation during working memory. Neurobiol. Aging 32, 1849-1856. doi: 10.1016/j.neurobiolaging.2009.10.018
16. Baddeley, A. (1992). Working memory. Science 255, 556-559. doi: 10.1126/science.1736359
17. Baddeley, A. (2000). The episodic buffer: a new component of working memory? Trends Cogn. Sci. 4, 417-423. doi: 10.1016/S1364-6613(00)01538-2
18. Baddeley, A., and Hitch, G. (1974). Working memory, in The Psychology of Learning and Motivation, ed. G. H. Bower (San Diego: Academic Press), 47-90.
19. Berridge, K. C. (2007). The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology (Berl.) 191, 391-431. doi: 10.1007/s00213-006-0578-x
20. Björklund, A., and Dunnett, S. B. (2007). Dopamine neuron systems in the brain: an update. Trends Neurosci. 30, 194-202. doi: 10.1016/j.tins.2007.03.006
21. Brischoux, F., Chakraborty, S., Brierley, D. I., and Ungless, M. A. (2009). Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli. Proc. Natl. Acad. Sci. U.S.A. 106, 4894-4899. doi: 10.1073/pnas.0811507106
22. Bromberg-Martin, E. S., Matsumoto, M., and Hikosaka, O. (2010). Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 68, 815-834. doi: 10.1016/j.neuron.2010.11.022
23. Brown, T. E. (2006). Executive functions and attention deficit hyperactivity disorder: implications of two conflicting views. Int. J. Disabil. Dev. Educ. 53, 35-46. doi: 10.1080/10349120500510024
24. Brozoski, T. J., Brown, R. M., Rosvold, H. E., and Goldman, P. S. (1979). Cognitive deficit caused by regional depletion of dopamine in prefrontal cortex of rhesus monkey. Science 205, 929-932. doi: 10.1126/science.112679
25. Brunel, N., and Wang, X. J. (2001). Effects of neuromodulation in a cortical network model of object working memory dominated by recurrent inhibition. J. Comput. Neurosci. 11, 63-85. doi: 10.1023/A:1011204814320
26. Bubser, M., and Schmidt, W. J. (1990). 6-Hydroxydopamine lesion of the rat prefrontal cortex increases locomotor activity, impairs acquisition of delayed alternation tasks, but does not affect uninterrupted tasks in the radial maze. Behav. Brain Res. 37, 157-168. doi: 10.1016/0166-4328(90)90091-R
27. Buckert, M., Kudielka, B. M., Reuter, M., and Fiebach, C. J. (2012). The COMT Val158Met polymorphism modulates working memory performance under acute stress. Psychoneuroendocrinology 37, 1810-1821. doi: 10.1016/j.psyneuen.2012.03.014
28. Cai, J. X., and Arnsten, A. F. (1997). Dose-dependent effects of the dopamine D1 receptor agonists A77636 or SKF81297 on spatial working memory in aged monkeys. J. Pharmacol. Exp. Ther. 283, 183-189.
29. Callier, S., Snapyan, M., Le Crom, S., Prou, D., Vincent, J.-D., and Vernier, P. (2003). Evolution and cell biology of dopamine receptors in vertebrates. Biol. Cell 95, 489-502. doi: 10.1016/S0248-4900(03)00089-3
30. Castner, S. A., and Williams, G. V. (2007). Tuning the engine of cognition: a focus on NMDA/D1 receptor interactions in prefrontal cortex. Brain Cogn. 63, 94-122. doi: 10.1016/j.bandc.2006.11.002
31. Chadderdon, G. L., and Sporns, O. (2006). A large-scale neurocomputational model of task-oriented behavior selection and working memory in prefrontal cortex. J. Cogn. Neurosci. 18, 242-257. doi: 10.1162/jocn.2006.18.2.242
32. Chen, J., Lipska, B. K., Halim, N., Ma, Q. D., Matsumoto, M., Melhem, S., et al. (2004). Functional analysis of genetic variation in catechol-O-Methyltransferase (COMT): effects on mRNA, protein, and enzyme activity in postmortem human brain. Am. J. Hum. Genet. 75, 807-821. doi: 10.1086/425589
33. Chudasama, Y., and Robbins, T. W. (2004). Dopaminergic modulation of visual attention and working memory in the rodent prefrontal cortex. Neuropsychopharmacology 29, 1628-1636. doi: 10.1038/sj.npp.1300490
34. Clarke, H. F., Cardinal, R. N., Rygula, R., Hong, Y. T., Fryer, T. D., Sawiak, S. J., et al. (2014). Orbitofrontal dopamine depletion upregulates caudate dopamine and alters behavior via changes in reinforcement sensitivity. J. Neurosci. 34, 7663-7676. doi: 10.1523/JNEUROSCI.0718-14.2014
35. Clarke, H. F., Dalley, J. W., Crofts, H. S., Robbins, T. W., and Roberts, A. C. (2004). Cognitive inflexibility after prefrontal serotonin depletion. Science 304, 878-880. doi: 10.1126/science.1094987
36. Clarke, H. F., Hill, G. J., Robbins, T. W., and Roberts, A. C. (2011). Dopamine, but not serotonin, regulates reversal learning in the marmoset caudate nucleus. J. Neurosci. 31, 4290-4297. doi: 10.1523/JNEUROSCI.5066-10.2011
37. Clarke, H. F., Robbins, T. W., and Roberts, A. C. (2008). Lesions of the medial striatum in monkeys produce perseverative impairments during reversal learning similar to those produced by lesions of the orbitofrontal cortex. J. Neurosci. 28, 10972-10982. doi: 10.1523/JNEUROSCI.1521-08.2008
38. Clarke, H. F., Walker, S. C., Crofts, H. S., Dalley, J. W., Robbins, T. W., and Roberts, A. C. (2005). Prefrontal serotonin depletion affects reversal learning but not attentional set shifting. J. Neurosci. 25, 532-538. doi: 10.1523/JNEUROSCI.3690-04.2005
39. Clarke, H. F., Walker, S. C., Dalley, J. W., Robbins, T. W., and Roberts, A. C. (2007). Cognitive inflexibility after prefrontal serotonin depletion is behaviorally and neurochemically specific. Cereb. Cortex 17, 18-27. doi: 10.1093/cercor/bhj120
40. Cohen, J. D., Braver, T. S., and Brown, J. W. (2002). Computational perspectives on dopamine function in prefrontal cortex. Curr. Opin. Neurobiol. 12, 223-229. doi: 10.1016/S0959-4388(02)00314-8
41. Collins, P., Roberts, A. C., Dias, R., Everitt, B. J., and Robbins, T. W. (1998). Perseveration and strategy in a novel spatial self-ordered sequencing task for nonhuman primates: effects of excitotoxic lesions and dopamine depletions of the prefrontal cortex. J. Cogn. Neurosci. 10, 332-354. doi: 10.1162/08989299 8562771
42. Colombo, M., and Broadbent, N. (2000). Is the avian hippocampus a functional homologue of the mammalian hippocampus? Neurosci. Biobehav. Rev. 24, 465-484. doi: 10.1016/S0149-7634(00)00016-6
43. D'Ardenne, K., Eshel, N., Luka, J., Lenartowicz, A., Nystrom, L. E., and Cohen, J. D. (2012). Role of prefrontal cortex and the midbrain dopamine system in working memory updating. Proc. Natl. Acad. Sci. U.S.A. 109, 19900-19909. doi: 10.1073/pnas.1116727109
44. Day, J. J., Roitman, M. F., Wightman, R. M., and Carelli, R. M. (2007). Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens. Nat. Neurosci. 10, 1020-1028. doi: 10.1038/nn1923
45. de Almeida, J., and Mengod, G. (2010). D2 and D4 dopamine receptor mRNA distribution in pyramidal neurons and GABAergic subpopulations in monkey prefrontal cortex: implications for schizophrenia treatment. Neuroscience 170, 1133-1139. doi: 10.1016/j.neuroscience.2010.08.025
46. de Almeida, J., Palacios, J. M., and Mengod, G. (2008). Distribution of 5-HT and DA receptors in primate prefrontal cortex: implications for pathophysiology and treatment, in Progress in Brain Research, Serotonin-Dopamine Interaction: Experimental Evidence and Therapeutic Relevance, Vol. 172, eds G. D. Giovanni, V. D. Matteo, and E. Esposito (Oxford: Elsevier LTD), 101-115.
47. de Frias, C. M., Marklund, P., Eriksson, E., Larsson, A., Oman, L., Annerbrink, K., et al. (2010). Influence of COMT gene polymorphism on fMRI-assessed sustained and transient activity during a working memory task. J. Cogn. Neurosci. 22, 1614-1622. doi: 10.1162/jocn.2009.21318
48. Descarries, L., Lemay, B., Doucet, G., and Berger, B. (1987). Regional and laminar density of the dopamine innervation in adult rat cerebral cortex. Neuroscience 21, 807-824. doi: 10.1016/0306-4522(87)90038-8
49. Diekamp, B., Kalt, T., and Güntürkün, O. (2002). Working memory neurons in pigeons. J. Neurosci. 22, RC210.
50. Diekamp, B., Kalt, T., Ruhm, A., Koch, M., and Güntürkün, O. (2000). Impairment in a discrimination reversal task after D1 receptor blockade in the pigeon prefrontal cortex. Behav. Neurosci. 114, 1145-1155. doi: 10.1037/0735-7044.114.6.1145
51. Dietl, M. M., and Palacios, J. M. (1988). Neurotransmitter receptors in the avian brain. I. Dopamine receptors. Brain Res. 439, 354-359. doi: 10.1016/0006-8993(88)91494-1
52. Doya, K. (2002). Metalearning and neuromodulation. Neural Netw. 15, 495-506. doi: 10.1016/S0893-6080(02)00044-8
53. Druzin, M. Y., Kurzina, N. P., Malinina, E. P., and Kozlov, A. P. (2000). The effects of local application of D2 selective dopaminergic drugs into the medial prefrontal cortex of rats in a delayed spatial choice task. Behav. Brain Res. 109, 99-111. doi: 10.1016/S0166-4328(99)00166-7
54. Durstewitz, D. (2009). Implications of synaptic biophysics for recurrent network dynamics and active memory. Neural Netw. 22, 1189-1200. doi: 10.1016/j.neunet.2009.07.016
55. Durstewitz, D., Kelc, M., and Güntürkün, O. (1999a). A neurocomputational theory of the dopaminergic modulation of working memory functions. J. Neurosci. 19, 2807-2822.
56. Durstewitz, D., Kröner, S., and Güntürkün, O. (1999b). The dopaminergic innervation of the avian telencephalon. Prog. Neurobiol. 59, 161-195. doi: 10.1016/S0301-0082(98)00100-2
57. Durstewitz, D., Kröner, S., Hemmings, H. C., and Güntürkün, O. (1998). The dopaminergic innervation of the pigeon telencephalon: distribution of DARPP-32 and co-occurrence with glutamate decarboxylase and tyrosine hydroxylase. Neuroscience 83, 763-779. doi: 10.1016/S0306-4522(97)00450-8
58. Durstewitz, D., and Seamans, J. K. (2002). The computational role of dopamine D1 receptors in working memory. Neural Netw. 15, 561-572. doi: 10.1016/S0893-6080(02)00049-7
59. Durstewitz, D., and Seamans, J. K. (2008). The dual-state theory of prefrontal cortex dopamine function with relevance to catechol-Omethyltransferase genotypes and schizophrenia. Biol. Psychiatry 64, 739-749. doi: 10.1016/j.biopsych.2008.05.015
60. Durstewitz, D., Seamans, J. K., and Sejnowski, T. J. (2000a). Dopamine-mediated stabilization of delay-period activity in a network model of prefrontal cortex. J. Neurophysiol. 83, 1733-1750.
61. Durstewitz, D., Seamans, J. K., and Sejnowski, T. J. (2000b). Neurocomputational models of working memory. Nat. Neurosci. 3, 1184-1191. doi: 10.1038/81460
62. Egan, M. F., Goldberg, T. E., Kolachana, B. S., Callicott, J. H., Mazzanti, C. M., Straub, R. E., et al. (2001). Effect of COMT Val108/158 Met genotype on frontal lobe function and risk for schizophrenia. Proc. Natl. Acad. Sci. U.S.A. 98, 6917-6922. doi: 10.1073/pnas.111134598
63. Emery, N. J., and Clayton, N. S. (2004). The mentality of crows: convergent evolution of intelligence in corvids and apes. Science 306, 1903-1907. doi: 10.1126/science.1098410
64. Fee, M. S., and Goldberg, J. H. (2011). A hypothesis for basal ganglia-dependent reinforcement learning in the songbird. Neuroscience 198, 152-170. doi: 10.1016/j.neuroscience.2011.09.069
65. Floresco, S. B. (2013). Prefrontal dopamine and behavioral flexibility: shifting from an inverted-U towards a family of functions. Front. Neurosci. 7:62. doi: 10.3389/fnins.2013.00062
66. Floresco, S. B., and Magyar, O. (2006). Mesocortical dopamine modulation of executive functions: beyond working memory. Psychopharmacology 188, 567-585. doi: 10.1007/s00213-006-0404-5
67. Floresco, S. B., and Phillips, A. G. (2001). Delay-dependent modulation of memory retrieval by infusion of a dopamine D1 agonist into the rat medial prefrontal cortex. Behav. Neurosci. 115, 934-939. doi: 10.1037/0735-7044.115.4.934
68. Frank, M. J., Loughry, B., and O'Reilly, R. C. (2001). Interactions between frontal cortex and basal ganglia in working memory: a computational model. Cogn. Affect. Behav. Neurosci. 1, 137-160. doi: 10.3758/CABN.1.2.137
69. Fuster, J. M., and Alexander, G. E. (1971). Neuron activity related to short-term memory. Science 173, 652-654. doi: 10.1126/science.173.3997.652
70. Gee, S., Ellwood, I., Patel, T., Luongo, F., Deisseroth, K., and Sohal, V. S. (2012). Synaptic activity unmasks dopamine D2 receptor modulation of a specific class of layer V pyramidal neurons in prefrontal cortex. J. Neurosci. 32, 4959-4971. doi: 10.1523/JNEUROSCI.5835-11.2012
71. Gerfen, C. R., and Surmeier, D. J. (2011). Modulation of striatal projection systems by dopamine. Annu. Rev. Neurosci. 34, 441-466. doi: 10.1146/annurev-neuro-061010-113641
72. Gizer, I. R., Ficks, C., and Waldman, I. D. (2009). Candidate gene studies of ADHD: a meta-analytic review. Hum. Genet. 126, 51-90. doi: 10.1007/s00439-009-0694-x
73. Glatt, S. J., Faraone, S. V., and Tsuang, M. T. (2003). Meta-analysis identifies an association between the dopamine D2 receptor gene and schizophrenia. Mol. Psychiatry 8, 911-915. doi: 10.1038/sj.mp.4001321
74. Gogtay, N., and Thompson, P. M. (2010). Mapping gray matter development: implications for typical development and vulnerability to psychopathology. Brain Cogn. 72, 6. doi: 10.1016/j.bandc.2009.08.009
75. Goldman-Rakic, P. S., Muly, I. I. I., and Williams, G. V. (2000). D1 receptors in prefrontal cells and circuits. Brain Res. Rev. 31, 295-301. doi: 10.1016/S0165-0173(99)00045-4
76. González-Burgos, G., Kröner, S., Krimer, L. S., Seamans, J. K., Urban, N. N., Henze, D. A., et al. (2002). Dopamine modulation of neuronal function in the monkey prefrontal cortex. Physiol. Behav. 77, 537-543. doi: 10.1016/S0031-9384(02)00940-X
77. Gorelova, N. A., and Yang, C. R. (2000). Dopamine D1/D5 receptor activation modulates a persistent sodium current in rat prefrontal cortical neurons in vitro. J. Neurophysiol. 84, 75-87.
78. Goto, Y., Otani, S., and Grace, A. A. (2007). The Yin and Yang of dopamine release: a new perspective. Neuropharmacology 53, 583-587. doi: 10.1016/j.neuropharm.2007.07.007
79. Grace, A. A. (1991). Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: a hypothesis for the etiology of schizophrenia. Neuroscience 41, 1-24. doi: 10.1016/0306-4522(91) 90196-U
80. Grace, A. A., and Bunney, B. S. (1984). The control of firing pattern in nigral dopamine neurons: burst firing. J. Neurosci. 4, 2877-2890.
81. Graybiel, A. M. (2008). Habits, rituals, and the evaluative brain. Annu. Rev. Neurosci. 31, 359-387. doi: 10.1146/annurev.neuro.29.051605.112851
82. Gulledge, A. T., and Jaffe, D. B. (1998). Dopamine decreases the excitability of layer V pyramidal cells in the rat prefrontal cortex. J. Neurosci. 18, 9139-9151.
83. Gulledge, A. T., and Jaffe, D. B. (2001). Multiple effects of dopamine on layer V pyramidal cell excitability in rat prefrontal cortex. J. Neurophysiol. 86, 586-595.
84. Güntürkün, O. (1997). Cognitive impairments after lesions of the neostriatum caudolaterale and its thalamic afferent in pigeons: functional similarities to the mammalian prefrontal system? J. Hirnforsch. 38, 133-143.
85. Güntürkün, O. (2005a). Avian and mammalian prefrontal cortices: limited degrees of freedom in the evolution of the neural mechanisms of goal-state maintenance. Brain Res. Bull. 66, 311-316. doi: 10.1016/j.brainresbull.2005.02.004
86. Güntürkün, O. (2005b). The avian prefrontal cortex and cognition. Curr. Opin. Neurobiol. 15, 686-693. doi: 10.1016/j.conb.2005.10.003
87. Güntürkün, O. (2012). The convergent evolution of neural substrates for cognition. Psychol. Res. 76, 212-219. doi: 10.1007/s00426-011-0377-9
88. Hara, E., Kubikova, L., Hessler, N. A., and Jarvis, E. D. (2007). Role of the midbrain dopaminergic system in modulation of vocal brain activation by social context. Eur. J. Neurosci. 25, 3406-3416. doi: 10.1111/j.1460-9568.2007.05600.x
89. Hazy, T. E., Frank, M. J., and O'reilly, R. C. (2007). Towards an executive without a homunculus: computational models of the prefrontal cortex/basal ganglia system. Philos. Trans. R. Soc. Lond. B Biol. Sci. 362, 1601-1613. doi: 10.1098/rstb.2007.2055
90. Henze, D. A., González-Burgos, G. R., Urban, N. N., Lewis, D. A., and Barrionuevo, G. (2000). Dopamine increases excitability of pyramidal neurons in primate prefrontal cortex. J. Neurophysiol. 84, 2799-2809.
91. Herold, C., Diekamp, B., and Güntürkün, O. (2008). Stimulation of dopamine D1 receptors in the avian fronto-striatal system adjusts daily cognitive fluctuations. Behav. Brain Res. 194, 223-229. doi: 10.1016/j.bbr.2008.07.017
92. Herold, C., Joshi, I., Chehadi, O., Hollmann, M., and Güntürkün, O. (2012). Plasticity in D1-like receptor expression is associated with different components of cognitive processes. PLoS ONE 7:e36484. doi: 10.1371/journal.pone.0036484
93. Histed, M. H., Pasupathy, A., and Miller, E. K. (2009). Learning substrates in the primate prefrontal cortex and striatum: sustained activity related to successful actions. Neuron 63, 244-253. doi: 10.1016/j.neuron.2009.06.019
94. Honig, W. K. (1978). Studies of working memory in the pigeon, in Cognitive Processes in Animal Behavior (New York: Hillsdale), 211-248.
95. Horvitz, J. C. (2000). Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events. Neuroscience 96, 651-656. doi: 10.1016/S0306-4522(00)00019-1
96. Howe, M. W., Tierney, P. L., Sandberg, S. G., Phillips, P. E. M., and Graybiel, A. M. (2013). Prolonged dopamine signalling in striatum signals proximity and value of distant rewards. Nature 500, 575-579. doi: 10.1038/ nature12475
97. Humphries, M. D., Khamassi, M., and Gurney, K. (2012). Dopaminergic control of the exploration-exploitation trade-off via the basal ganglia. Front. Neurosci. 6:9. doi: 10.3389/fnins.2012.00009
98. Ilango, A., Kesner, A. J., Keller, K. L., Stuber, G. D., Bonci, A., and Ikemoto, S. (2014). Similar roles of substantia nigra and ventral tegmental dopamine neurons in reward and aversion. J. Neurosci. 34, 817-822. doi: 10.1523/JNEUROSCI.1703-13.2014
99. Ingvar, D. H., and Franzén, G. (1974). Abnormalities of cerebral blood flow distribution in patients with chronic schizophrenia. Acta Psychiatr. Scand. 50, 425-462. doi: 10.1111/j.1600-0447.1974.tb09707.x
100. Jarvis, E. D. (2009). Evolution of the pallium in birds and reptiles, in New Encyclopedia of Neuroscience, ed. A. B. Butler (New York: Elsevier), 15.
101. Jarvis, E. D., Güntürkün, O., Bruce, L., Csillag, A., Karten, H., Kuenzel, W., et al. (2005). Avian brains and a new understanding of vertebrate brain evolution. Nat. Rev. Neurosci. 6, 151-159. doi: 10.1038/nrn1606
102. Jarvis, E. D., Yu, J., Rivas, M. V., Horita, H., Feenders, G., Whitney, O., et al. (2013). Global view of the functional molecular organization of the avian cerebrum: mirror images and functional columns. J. Comp. Neurol. 521, 3614-3665. doi: 10.1002/cne.23404
103. Jo, Y. S., Lee, J., and Mizumori, S. J. Y. (2013). Effects of prefrontal cortical inactivation on neural activity in the ventral tegmental area. J. Neurosci. 33, 8159-8171. doi: 10.1523/JNEUROSCI.0118-13.2013
104. Joshua, M., Adler, A., Mitelman, R., Vaadia, E., and Bergman, H. (2008). Midbrain dopaminergic neurons and striatal cholinergic interneurons encode the difference between reward and aversive events at different epochs of probabilistic classical conditioning trials. J. Neurosci. 28, 11673-11684. doi: 10.1523/JNEUROSCI.3839-08.2008
105. Kalenscher, T., Windmann, S., Diekamp, B., Rose, J., Güntürkün, O., and Colombo, M. (2005). Single units in the pigeon brain integrate reward amount and time-to-reward in an impulsive choice task. Curr. Biol. 15, 594-602. doi: 10.1016/j.cub.2005.02.052
106. Kalkstein, S., Hurford, I., and Gur, R. C. (2010). Neurocognition in schizophrenia, in Behavioral Neurobiology of Schizophrenia and Its Treatment Current Topics in Behavioral Neurosciences, ed. N. R. Swerdlow (Berlin Heidelberg: Springer), 373-390. doi: 10.1007/7854_2010_42
107. Karakuyu, D., Herold, C., Güntürkün, O., and Diekamp, B. (2007). Differential increase of extracellular dopamine and serotonin in the prefrontal cortex and striatum of pigeons during working memory. Eur. J. Neurosci. 26, 2293-2302. doi: 10.1111/j.1460-9568.2007.05840.x
108. Kehagia, A. A., Barker, R. A., and Robbins, T. W. (2010). Neuropsychological and clinical heterogeneity of cognitive impairment and dementia in patients with Parkinson's disease. Lancet Neurol. 9, 1200-1213. doi: 10.1016/S1474-4422(10)70212-X
109. Kellendonk, C., Simpson, E. H., Polan, H. J., Malleret, G., Vronskaya, S., Winiger, V., et al. (2006). Transient and selective overexpression of dopamine D2 receptors in the striatum causes persistent abnormalities in prefrontal cortex functioning. Neuron 49, 603-615. doi: 10.1016/j.neuron.2006.01.023
110. Kimberg, D. Y., D'Esposito, M., and Farah, M. J. (1997). Effects of bromocriptine on human subjects depend on working memory capacity. Neuroreport 8, 3581-3585. doi: 10.1097/00001756-199711100-00032
111. Kirsch, J. A., Güntürkün, O., and Rose, J. (2008). Insight without cortex: lessons from the avian brain. Conscious. Cogn. 17, 475-483. doi: 10.1016/j.concog.2008.03.018
112. Kirsch, J. A., Vlachos, I., Hausmann, M., Rose, J., Yim, M. Y., Aertsen, A., et al. (2009). Neuronal encoding of meaning: establishing category-selective response patterns in the avian prefrontal cortex. Behav. Brain Res. 198, 214-223. doi: 10.1016/j.bbr.2008.11.010
113. Kravitz, A. V., Tye, L. D., and Kreitzer, A. C. (2012). Distinct roles for direct and indirect pathway striatal neurons in reinforcement. Nat. Neurosci. 15, 816-818. doi: 10.1038/nn.3100
114. Kröner, S., and Güntürkün, O. (1999). Afferent and efferent connections of the caudolateral neostriatum in the pigeon (Columba livia): a retro-and anterograde pathway tracing study. J. Comp. Neurol. 407, 228-260. doi: 10.1002/(SICI)1096-9861(19990503)407:2<228::AID-CNE6>3.0.CO;2-2
115. Kubikova, L., Wada, K., and Jarvis, E. D. (2010). Dopamine receptors in a songbird brain. J. Comp. Neurol. 518, 741-769. doi: 10.1002/cne.22255
116. Lammel, S., Lim, B. K., Ran, C., Huang, K. W., Betley, M. J., Tye, K. M., et al. (2012). Input-specific control of reward and aversion in the ventral tegmental area. Nature 491, 212-217. doi: 10.1038/ nature11527
117. Lange, K. W., Robbins, T. W., Marsden, C. D., James, M., Owen, A. M., and Paul, G. M. (1992). L-dopa withdrawal in Parkinson's disease selectively impairs cognitive performance in tests sensitive to frontal lobe dysfunction. Psychopharmacology (Berl.) 107, 394-404. doi: 10.1007/ BF02245167
118. Lataster, J., Collip, D., Ceccarini, J., Haas, D., Booij, L., van Os, J., et al. (2011). Psychosocial stress is associated with in vivo dopamine release in human ventromedial prefrontal cortex: a positron emission tomography study using [18F]fallypride. Neuroimage 58, 1081-1089. doi: 10.1016/j.neuroimage.2011.07.030
119. Lauzon, N. M., Bishop, S. F., and Laviolette, S. R. (2009). Dopamine D1 versus D4 receptors differentially modulate the encoding of salient versus nonsalient emotional information in the medial prefrontal cortex. J. Neurosci. 29, 4836-4845. doi: 10.1523/JNEUROSCI.0178-09.2009
120. Lavin, A., Nogueira, L., Lapish, C. C., Wightman, R. M., Phillips, P. E. M., and Seamans, J. K. (2005). Mesocortical dopamine neurons operate in distinct temporal domains using multimodal signaling. J. Neurosci. 25, 5013-5023. doi: 10.1523/JNEUROSCI.0557-05.2005
121. Laviolette, S. R., Lipski, W. J., and Grace, A. A. (2005). A subpopulation of neurons in the medial prefrontal cortex encodes emotional learning with burst and frequency codes through a dopamine D4 receptor-dependent basolateral amygdala input. J. Neurosci. 25, 6066-6075. doi: 10.1523/JNEUROSCI.1168-05.2005
122. Lee, B., Groman, S., London, E. D., and Jentsch, J. D. (2007). Dopamine D2/D3 receptors play a specific role in the reversal of a learned visual discrimination in monkeys. Neuropsychopharmacology 32, 2125-2134. doi: 10.1038/sj.npp.1301337
123. Lee, T., Cai, L. X., Lelyveld, V. S., Hai, A., and Jasanoff, A. (2014). Molecular-level functional magnetic resonance imaging of dopaminergic signaling. Science 344, 533-535. doi: 10.1126/science.1249380
124. Lewis, D. A., and Sesack, S. R. (1997). Chapter VI: dopamine systems in the primate brain, in Handbook of Chemical Neuroanatomy, Vol. 15, The Primate Nervous System, Part I, eds F. E. Bloom, A. Björklund, and T. Hökfelt (Amsterdam: Elsevier), 263-375. doi: 10.1016/S0924-8196(97)80008-5
125. Li, Y. C., Kellendonk, C., Simpson, E. H., Kandel, E. R., and Gao, W. J. (2011). D2 receptor overexpression in the striatum leads to a deficit in inhibitory transmission and dopamine sensitivity in mouse prefrontal cortex. Proc. Natl. Acad. Sci. U.S.A. 108, 12107-12112. doi: 10.1073/pnas.1109718108
126. Lidow, M. S., Goldman-Rakic, P. S., Gallager, D. W., and Rakic, P. (1991). Distribution of dopaminergic receptors in the primate cerebral cortex: quantitative autoradiographic analysis using [3H]raclopride, [3H]spiperone and [3H]SCH23390. Neuroscience 40, 657-671. doi: 10.1016/0306-4522(91)90003-7
127. Lindvall, O., Björklund, A., and Divac, I. (1978). Organization of catecholamine neurons projecting to the frontal cortex in the rat. Brain Res. 142, 1-24. doi: 10.1016/0006-8993(78)90173-7
128. Luciana, M., and Collins, P. F. (1997). Dopaminergic modulation of working memory for spatial but not object cues in normal humans. J. Cogn. Neurosci. 9, 330-347. doi: 10.1162/jocn.1997.9.3.330
129. Malhotra, A. K., Kestler, L. J., Mazzanti, C., Bates, J. A., Goldberg, T., and Goldman, D. (2002). A functional polymorphism in the COMT gene and performance on a test of prefrontal cognition. Am. J. Psychiatry 159, 652-654. doi: 10.1176/appi.ajp.159.4.652
130. Mante, V., Sussillo, D., Shenoy, K. V., and Newsome, W. T. (2013). Contextdependent computation by recurrent dynamics in prefrontal cortex. Nature 503, 78-84. doi: 10.1038/nature12742
131. Matsumoto, M., and Hikosaka, O. (2009). Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459, 837-841. doi: 10.1038/nature08028
132. Mattay, V. S., Tessitore, A., Callicott, J. H., Bertolino, A., Goldberg, T. E., Chase, T. N., et al. (2002). Dopaminergic modulation of cortical function in patients with Parkinson's disease. Ann. Neurol. 51, 156-164. doi: 10.1002/ana.10078
133. Miller, E. K., Erickson, C. A., and Desimone, R. (1996). Neural mechanisms of visual working memory in prefrontal cortex of the macaque. J. Neurosci. 16, 5154-5167.
134. Mizoguchi, K., Shoji, H., Tanaka, Y., Maruyama, W., and Tabira, T. (2009). Age-related spatial working memory impairment is caused by prefrontal cortical dopaminergic dysfunction in rats. Neuroscience 162, 1192-1201. doi: 10.1016/j.neuroscience.2009.05.023
135. Mizumori, S. J., Channon, V., Rosenzweig, M. R., and Bennett, E. L. (1987). Short-and long-term components of working memory in the rat. Behav. Neurosci. 101, 782-789. doi: 10.1037/0735-7044.101.6.782
136. Mogensen, J., and Divac, I. (1982). The prefrontal cortex in the pigeon. Behavioral evidence Brain Behav. Evol. 21, 60-66. doi: 10.1159/000121617
137. Morris, G., Arkadir, D., Nevet, A., Vaadia, E., and Bergman, H. (2004). Coincident but distinct messages of midbrain dopamine and striatal tonically active neurons. Neuron 43, 133-143. doi: 10.1016/j.neuron.2004.06.012
138. Morris, G., Nevet, A., Arkadir, D., Vaadia, E., and Bergman, H. (2006). Midbrain dopamine neurons encode decisions for future action. Nat. Neurosci. 9, 1057-1063. doi: 10.1038/nn1743
139. Morris, G., Schmidt, R., and Bergman, H. (2010). Striatal action-learning based on dopamine concentration. Exp. Brain Res. 200, 307-317. doi: 10.1007/s00221-009-2060-6
140. Moustafa, A. A., and Gluck, M. A. (2011). Computational cognitive models of prefrontal-striatal-hippocampal interactions in Parkinson's disease and schizophrenia. Neural Netw. 24, 575-591. doi: 10.1016/j.neunet.2011.02.006
141. Müller, U., von Cramon, D. Y., and Pollmann, S. (1998). D1versus D2-receptor modulation of visuospatial working memory in humans. J. Neurosci. 18, 2720-2728.
142. Murphy, B. L., Arnsten, A. F., Goldman-Rakic, P. S., and Roth, R. H. (1996). Increased dopamine turnover in the prefrontal cortex impairs spatial working memory performance in rats and monkeys. Proc. Natl. Acad. Sci. U.S.A. 93, 1325-1329. doi: 10.1073/pnas.93.3.1325
143. Narayanan, N. S., Rodnitzky, R. L., and Uc, E. (2013). Prefrontal dopamine signaling and cognitive symptoms of Parkinson's Disease. Rev. Neurosci. 24, 267-278. doi: 10.1515/revneuro-2013-0004
144. O'Reilly, R. C., and Frank, M. J. (2006). Making working memory work: a computational model of learning in the prefrontal cortex and basal ganglia. Neural Comput. 18, 283-328. doi: 10.1162/089976606775093909
145. O'Reilly, R. C., Noelle, D. C., Braver, T. S., and Cohen, J. D. (2002). Pre-frontal cortex and dynamic categorization tasks: representational organization and neuromodulatory control. Cereb. Cortex 12, 246-257. doi: 10.1093/cercor/12.3.246
146. Okubo, Y., Suhara, T., Suzuki, K., Kobayashi, K., Inoue, O., Terasaki, O., et al. (1997). Decreased prefrontal dopamine D1 receptors in schizophrenia revealed by PET. Nature 385, 634-636. doi: 10.1038/385634a0
147. Olver, J. S., Pinney, M., Maruff, P., and Norman, T. R. (2014). Impairments of spatial working memory and attention following acute psychosocial stress. Stress Health doi: 10.1002/smi.2533 [Epub ahead of print].
148. Pan, W.-X., Schmidt, R., Wickens, J. R., and Hyland, B. I. (2005). Dopamine cells respond to predicted events during classical conditioning: evidence for eligibility traces in the reward-learning network. J. Neurosci. 25, 6235-6242. doi: 10.1523/JNEUROSCI.1478-05.2005
149. Pan, W.-X., Schmidt, R., Wickens, J. R., and Hyland, B. I. (2008). Tripartite mechanism of extinction suggested by dopamine neuron activity and temporal difference model. J. Neurosci. 28, 9619-9631. doi: 10.1523/JNEUROSCI.0255-08.2008
150. Parush, N., Tishby, N., and Bergman, H. (2011). Dopaminergic balance between reward maximization and policy complexity. Front. Syst. Neurosci. 5:22. doi: 10.3389/fnsys.2011.00022
151. Pasupathy, A., and Miller, E. K. (2005). Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature 433, 873-876. doi: 10.1038/nature03287
152. Phillips, A. G., Ahn, S., and Floresco, S. B. (2004). Magnitude of dopamine release in medial prefrontal cortex predicts accuracy of memory on a delayed response task. J. Neurosci. 24, 547-553. doi: 10.1523/JNEUROSCI.4653-03.2004
153. Phillips, P. E. M., Stuber, G. D., Heien, M. L. A. V., Wightman, R. M., and Carelli, R. M. (2003). Subsecond dopamine release promotes cocaine seeking. Nature 422, 614-618. doi: 10.1038/nature01476
154. Puig, M. V., and Miller, E. K. (2012). The role of prefrontal dopamine D1 receptors in the neural mechanisms of associative learning. Neuron 74, 874-886. doi: 10.1016/j.neuron.2012.04.018
155. Puig, M. V., and Miller, E. K. (2014). Neural substrates of dopamine D2 receptor modulated executive functions in the monkey prefrontal cortex. Cereb. Cortex doi: 10.1093/cercor/bhu096 [Epub ahead of print].
156. Ramayya, A. G., Misra, A., Baltuch, G. H., and Kahana, M. J. (2014). Microstimulation of the human substantia nigra alters reinforcement learning. J. Neurosci. 34, 6887-6895. doi: 10.1523/JNEUROSCI.5445-13.2014
157. Redgrave, P., Gurney, K., and Reynolds, J. (2008). What is reinforced by phasic dopamine signals? Brain Res. Rev. 58, 322-339. doi: 10.1016/j.brainresrev.2007.10.007
158. Reiner, A., Yamamoto, K., and Karten, H. J. (2005). Organization and evolution of the avian forebrain. Anat. Rec. A Discov. Mol. Cell. Evol. Biol. 287A, 1080-1102. doi: 10.1002/ar.a.20253
159. Rieke, G. K. (1980). Kainic acid lesions of pigeon paleostriatum: a model for study of movement disorders. Physiol. Behav. 24, 683-687. doi: 10.1016/0031-9384(80)90397-2
160. Rieke, G. K. (1981). Movement disorders and lesions of pigeon brain stem analogues of basal ganglia. Physiol. Behav. 26, 379-384. doi: 10.1016/0031-9384(81)90162-1
161. Rigotti, M., Barak, O., Warden, M. R., Wang, X.-J., Daw, N. D., Miller, E. K., et al. (2013). The importance of mixed selectivity in complex cognitive tasks. Nature 497, 585-590. doi: 10.1038/nature12160
162. Robbins, T. W. (2000). Chemical neuromodulation of frontal-executive functions in humans and other animals. Exp. Brain Res. 133, 130-138. doi: 10.1007/s002210000407
163. Robbins, T. W., and Roberts, A. C. (2007). Differential regulation of fronto-executive function by the monoamines and acetylcholine. Cereb. Cortex 17, i151-i160. doi:10.1093/cercor/bhm066
164. Rose, J., and Colombo, M. (2005). Neural correlates of executive control in the avian brain. PLoS Biol. 3:e190. doi: 10.1371/journal.pbio.0030190
165. Rose, J., Güntürkün, O., and Kirsch, J. (2009a). Evolution of association pallial areas: in birds, in Encyclopedia of Neuroscience, eds M. D. Binder, N. Hirokawa, and U. Windhorst (Berlin, Heidelberg: Springer), 1215-1219.
166. Rose, J., Schmidt, R., Grabemann, M., and Güntürkün, O. (2009b). Theory meets pigeons: the influence of reward-magnitude on discrimination-learning. Behav. Brain Res. 198, 125-129. doi: 10.1016/j.bbr.2008.10.038
167. Rose, J., Schiffer, A.-M., Dittrich, L., and Güntürkün, O. (2010). The role of dopamine in maintenance and distractability of attention in the prefrontal cortex of pigeons. Neuroscience 167, 232-237. doi: 10.1016/j.neuroscience.2010.02.004
168. Rose, J., Schiffer, A.-M., and Güntürkün, O. (2013). Striatal dopamine D1 receptors are involved in the dissociation of learning based on reward-magnitude. Neuroscience 230, 132-138. doi: 10.1016/j.neuroscience.2012.10.064
169. Rosenberg, D. R., and Lewis, D. A. (1994). Changes in the dopaminergic innervation of monkey prefrontal cortex during late postnatal development: a tyrosine hydroxylase immunohistochemical study. Biol. Psychiatry 36, 272-277. doi: 10.1016/0006-3223(94)90610-6
170. Rothmond, D. A., Weickert, C. S., and Webster, M. J. (2012). Developmental changes in human dopamine neurotransmission: cortical receptors and terminators. BMC Neurosci. 13:18. doi: 10.1186/1471-2202-13-18
171. Šagud, M., Mück-Šeler, D., Mihaljević-Peleš, A., Vuksan-ćusa, B., Živković, M., Jakovljević, M., et al. (2010). Catechol-O-methyl transferase and schizophrenia. Psychiatr. Danub. 22, 270-274.
172. Santana, N., Mengod, G., and Artigas, F. (2009). Quantitative analysis of the expression of dopamine D1 and D2 receptors in pyramidal and GABAergic neurons of the rat prefrontal cortex. Cereb. Cortex 19, 849-860. doi: 10.1093/cercor/ bhn134
173. Sawaguchi, T., and Goldman-Rakic, P. S. (1991). D1 dopamine receptors in prefrontal cortex: involvement in working memory. Science 22, 947-950. doi: 10.1126/science.1825731
174. Sawaguchi, T., and Goldman-Rakic, P. S. (1994). The role of D1-dopamine receptor in working memory: local injections of dopamine antagonists into the prefrontal cortex of rhesus monkeys performing an oculomotor delayed-response task. J. Neurophysiol. 71, 515-528.
175. Scatton, B., Javoy-Agid, F., Rouquier, L., Dubois, B., and Agid, Y. (1983). Reduction of cortical dopamine, noradrenaline, serotonin and their metabolites in Parkinson's disease. Brain Res. 275, 321-328. doi: 10.1016/0006-8993(83) 90993-9
176. Schultz, W. (1997). Dopamine neurons and their role in reward mechanisms. Curr. Opin. Neurobiol. 7, 191-197. doi: 10.1016/S0959-4388(97)80007-4
177. Schultz, W. (1998). Predictive reward signal of dopamine neurons. J. Neurophysiol. 80, 1-27.
178. Schultz, W. (2002). Getting formal with dopamine and reward. Neuron 36, 241-263. doi: 10.1016/S0896-6273(02)00967-4
179. Schultz, W. (2007). Multiple dopamine functions at different time courses. Annu. Rev. Neurosci. 30, 259-288. doi: 10.1146/annurev.neuro.28.061604.135722
180. Schultz, W. (2013). Updating dopamine reward signals. Curr. Opin. Neurobiol. 23, 229-238. doi: 10.1016/j.conb.2012.11.012
181. Schultz, W., Apicella, P., and Ljungberg, T. (1993). Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. J. Neurosci. 13, 900-913.
182. Seamans, J. K., Floresco, S. B., and Phillips, A. G. (1998). D1 receptor modulation of hippocampal-prefrontal cortical circuits integrating spatial memory with executive functions in the rat. J. Neurosci. 18, 1613-1621.
183. Seamans, J. K., and Yang, C. R. (2004). The principal features and mechanisms of dopamine modulation in the prefrontal cortex. Prog. Neurobiol. 74, 1-58. doi: 10.1016/j.pneurobio.2004.05.006
184. Seeman, P. (1987). Dopamine receptors and the dopamine hypothesis of schizophrenia. Synapse 1, 133-152. doi: 10.1002/syn.890010203
185. Seidman, L. J., Valera, E. M., and Makris, N. (2005). Structural brain imaging of attention-deficit/hyperactivity disorder. Biol. Psychiatry 57, 1263-1272. doi: 10.1016/j.biopsych.2004.11.019
186. Seong, H. J., and Carter, A. G. (2012). D1 receptor modulation of action potential firing in a subpopulation of layer 5 pyramidal neurons in the prefrontal cortex. J. Neurosci. 32, 10516-10521. doi: 10.1523/JNEUROSCI.1367-12.2012
187. Servan-Schreiber, D., Printz, H., and Cohen, J. D. (1990). A network model of catecholamine effects: gain, signal-to-noise ratio, and behavior. Science 249, 892-895. doi: 10.1126/science.2392679
188. Shanahan, M., Bingman, V. P., Shimizu, T., Wild, M., and Güntürkün, O. (2013). Large-scale network organization in the avian forebrain: a connectivity matrix and theoretical analysis. Front. Comput. Neurosci. 7:89. doi: 10.3389/fncom.2013.00089
189. Sheynikhovich, D., Otani, S., and Arleo, A. (2013). Dopaminergic control of long-term depression/long-term potentiation threshold in prefrontal cortex. J. Neurosci. 33, 13914-13926. doi: 10.1523/JNEUROSCI.0466-13.2013
190. Simon, H. (1981). Dopaminergic A10 neurons and the frontal system. J. Physiol. 77, 81-95.
191. Simonyan, K., Horwitz, B., and Jarvis, E. D. (2012). Dopamine regulation of human speech and bird song: a critical review. Brain Lang. 122, 142-150. doi: 10.1016/j.bandl.2011.12.009
192. Smith, Y., Bevan, M. D., Shink, E., and Bolam, J. P. (1998). Microcircuitry of the direct and indirect pathways of the basal ganglia. Neuroscience 86, 353-387.
193. Sutton, R. S. (1998). Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press.
194. Swanson, L. W. (1982). The projections of the ventral tegmental area and adjacent regions: a combined fluorescent retrograde tracer and immunofluorescence study in the rat. Brain Res. Bull. 9, 321-353. doi: 10.1016/0361-9230(82)90145-9
195. Takahashi, H., Kato, M., Takano, H., Arakawa, R., Okumura, M., Otsuka, T., et al. (2008). Differential contributions of prefrontal and hippocampal dopamine D1 and D2 receptors in human cognitive functions. J. Neurosci. 28, 12032-12038. doi: 10.1523/JNEUROSCI.3446-08.2008
196. Takahashi, Y. K., Roesch, M. R., Wilson, R. C., Toreson, K., O'Donnell, P., Niv, Y., et al. (2011). Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex. Nat. Neurosci. 14, 1590-1597. doi: 10.1038/ nn.2957
197. Thierry, A. M., Blanc, G., Sobel, A., Stinus, L., and Golwinski, J. (1973). Dopaminergic terminals in the rat cortex. Science 182, 499-501. doi: 10.1126/science.182.4111.499
198. Thompson, J. L., Rosell, D. R., Slifstein, M., Girgis, R. R., Xu, X., Ehrlich, Y., et al. (2014). Prefrontal dopamine D1 receptors and working memory in schizotypal personality disorder: a PET study with [(11)C]NNC112. Psychopharmacology (Berl.) doi: 10.1007/s00213-014-3566-6 [Epub ahead of print].
199. Tobler, P. N., Dickinson, A., and Schultz, W. (2003). Coding of predicted reward omission by dopamine neurons in a conditioned inhibition paradigm. J. Neurosci. 23, 10402-10410.
200. Tseng, K. Y., and O'Donnell, P. (2004). Dopamine-glutamate interactions controlling prefrontal cortical pyramidal cell excitability involve multiple signaling mechanisms. J. Neurosci. 24, 5131-5139. doi: 10.1523/JNEUROSCI.1021-04.2004
201. Veit, L., Hartmann, K., and Nieder, A. (2014). Neuronal correlates of visual working memory in the corvid endbrain. J. Neurosci. 34, 7778-7786. doi: 10.1523/JNEUROSCI.0612-14.2014
202. Veit, L., and Nieder, A. (2013). Abstract rule neurons in the endbrain support intelligent behaviour in corvid songbirds. Nat. Commun. 4, 2878. doi: 10.1038/ncomms3878
203. Vereczkei, A., and Mirnics, K. (2011). Genetic predisposition to schizophrenia: what did we learn and what does the future hold? Neuropsychopharmacol. Hung. 13, 205-210.
204. Vijayraghavan, S., Wang, M., Birnbaum, S. G., Williams, G. V., and Arnsten, A. F. T. (2007). Inverted-U dopamine D1 receptor actions on prefrontal neurons engaged in working memory. Nat. Neurosci. 10, 376-384. doi: 10.1038/nn1846
205. Waldmann, C., and Güntürkün, O. (1993). The dopaminergic innervation of the pigeon caudolateral forebrain: immunocytochemical evidence for a prefrontal cortex in birds? Brain Res. 600, 225-234. doi: 10.1016/0006-8993(93)91377-5
206. Walker, S. C., Robbins, T. W., and Roberts, A. C. (2009). Differential contributions of dopamine and serotonin to orbitofrontal cortex function in the marmoset. Cereb. Cortex 19, 889-898. doi: 10.1093/cercor/ bhn136
207. Wallis, J. D., Anderson, K. C., and Miller, E. K. (2001). Single neurons in prefrontal cortex encode abstract rules. Nature 411, 953-956. doi: 10.1038/35082081
208. Wang, M., Vijayraghavan, S., and Goldman-Rakic, P. S. (2004). Selective D2 receptor actions on the functional circuitry of working memory. Science 303, 853-856. doi: 10.1126/science.1091162
209. Watabe-Uchida, M., Zhu, L., Ogawa, S. K., Vamanrao, A., and Uchida, N. (2012). Whole-brain mapping of direct inputs to midbrain dopamine neurons. Neuron 74, 858-873. doi: 10.1016/j.neuron.2012.03.017
210. Watanabe, M., Kodama, T., and Hikosaka, K. (1997). Increase of extracellular dopamine in primate prefrontal cortex during a working memory task. J. Neurophysiol. 78, 2795-2798.
211. Wickens, J. R., Horvitz, J. C., Costa, R. M., and Killcross, S. (2007). Dopaminergic mechanisms in actions and habits. J. Neurosci. 27, 8181-8183. doi: 10.1523/JNEUROSCI.1671-07.2007
212. Williams, G. V., and Castner, S. A. (2006). Under the curve: critical issues for elucidating D1 receptor function in working memory. Neuroscience 139, 263-276. doi: 10.1016/j.neuroscience.2005.09.028
213. Williams, G. V., and Goldman-Rakic, P. S. (1995). Modulation of memory fields by dopamine D1 receptors in prefrontal cortex. Nature 376, 572-575. doi: 10.1038/376572a0
214. Wynne, B., and Güntürkün, O. (1995). Dopaminergic innervation of the telencephalon of the pigeon (Columba livia): a study with antibodies against tyrosine hydroxylase and dopamine. J. Comp. Neurol. 357, 446-464. doi: 10.1002/cne.903570309
215. Yanagihara, S., and Hessler, N. A. (2006). Modulation of singing-related activity in the songbird ventral tegmental area by social context. Eur. J. Neurosci. 24, 3619-3627. doi: 10.1111/j.1460-9568.2006. 05228.x
216. Yang, C. R., and Seamans, J. K. (1996). Dopamine D1 receptor actions in layers V-VI rat prefrontal cortex neurons in vitro: modulation of dendritic-somatic signal integration. J. Neurosci. 16, 1922-1935.
217. Zahrt, J., Taylor, J. R., Mathew, R. G., and Arnsten, A. F. (1997). Supra-normal stimulation of D1 dopamine receptors in the rodent prefrontal cortex impairs spatial working memory performance. J. Neurosci. 17, 8528-8535.
218. Zipser, D., Kehoe, B., Littlewort, G., and Fuster, J. (1993). A spiking network model of short-term active memory. J. Neurosci. 13, 3406-3420.