Computational models of basal-ganglia pathway functions: Focus on functional neuroanatomy

Frontiers in Systems Neuroscience

Volumn 7, Issue DEC, 2013, Pages

  Schroll, Henning ^a,b,c   Hamker, Fred H ^a,c  

^a CHARITÉ UNIVERSITÄTSMEDIZIN BERLIN   (Germany)

^b HUMBOLDT UNIVERSITY   (Germany)

^c CHEMNITZ UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

Dopamine; Gating; Reinforcement learning; Response selection; Response timing; Stimulus response association; Working memory

Indexed keywords

EID: 84892589014     PISSN: 16625137     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnsys.2013.00122     Document Type: Review

References (143)

1. Afsharpour, S. (1985). Topographical projections of the cerebral cortex to the subthalamic nucleus. J. Comp. Neurol. 236, 14-28. doi: 10.1002/cne.902360103
2. Alberts, J. L., Voelcker-Rehage, C., Hallahan, K., Vitek, M., Bamzai, R., and Vitek, J. L. (2008). Bilateral subthalamic stimulation impairs cognitive- motor performance in Parkinson's disease patients. Brain 131, 3348-3360. doi: 10.1093/brain/awn238
3. Albin, R. L., Young, A. B., and Penney, J. B. (1989). The functional anatomy of basal ganglia disorders. Trends Neurosci. 12, 366-375. doi: 10.1016/0166-2236(89)90074-X
4. Aldridge, J. W., Anderson, R. J., and Murphy, J. T. (1980). The role of the basal ganglia in controlling a movement initiated by a visually presented cue. Brain Res. 192, 3-16. doi: 10.1016/0006-8993(80) 91003-3
5. Alexander, G. E., DeLong, M. R., and Strick, P. L. (1986). Parallel organization of functionally segregated circuits linking the basal ganglia and cortex. Ann. Rev. Neurosci. 9, 357-381. doi: 10.1146/annurev.ne.09.030186.002041
6. Antzoulatos, E. G., and Miller, E. K. (2011). Differences between neural activity in prefrontal cortex and striatum during learning of novel abstract categories. Neuron 71, 243-249. doi: 10.1016/j.neuron.2011.05.040
7. Aron, A. R. (2011). From reactive to proactive and selective control: developing a richer model for stopping inappropriate responses. Biol. Psychiatry 69, e55-e68. doi: 10.1016/j.biopsych.2010.07.024
8. Aron, A. R., and Poldrack, R. A. (2006). Cortical and subcortical contributions to stop signal response inhibition: role of the subthalamic nucleus. J. Neurosci. 26, 2424-2433. doi: 10.1523/JNEUROSCI.4682-05.2006
9. Ashby, F. G., and Crossley, M. J. (2011). A computational model of how cholin-ergic interneurons protect striatal-dependent learning. J. Cogn. Neurosci. 23, 1549-1566. doi: 10.1162/jocn.2010.21523
10. Ashby, F. G., Ell, S. W., Valentin, V. V., and Casale, M. B. (2005). FROST. A distributed neurocomputational model of working memory maintenance. J. Cogn. Neurosci. 17, 1728-1743. doi: 10.1162/089892905774589271
11. Ashby, F. G., Ennis, J. M., and Spiering, B. J. (2007). A neurobiological theory of automaticity in perceptual categorization. Psychol. Rev. 114, 632. doi: 10.1037/0033-295X.114.3.632
12. Baizer, J. S., Desimone, R., and Ungerleider, L. G. (1993). Comparison of subcorti-cal connections of inferior temporal and posterior parietal cortex in monkeys. Vis. Neurosci. 10, 59-59. doi: 10.1017/S0952523800003229
13. Bar-Gad, I., Havazelet-Heimer, G., Goldberg, J. A., Ruppin, E., and Bergman, H. (2000). Reinforcement-driven dimensionality reduction-a model for information processing in the basal ganglia. J. Basic Clin. Physiol. Pharmacol. 11, 305-320. doi: 10.1515/JBCPP.2000.11.4.305
14. Berendse, H. W., and Groenewegen, H. J. (1990). Organization of the thalamos-triatal projections in the rat, with special emphasis on the ventral striatum. J. Comp. Neurol. 299, 187-228. doi: 10.1002/cne.902990206
15. Berns, G. S., and Sejnowski, T. J. (1998). A computational model of how the basal ganglia produce sequences. J. Cogn. Neurosci. 10, 108-121. doi: 10.1162/089892998563815
16. Berridge, K. C., and Whishaw, I. Q. (1992). Cortex, striatum and cerebellum: control of serial order in a grooming sequence. Exp. Brain Res. 90, 275-290. doi: 10.1007/BF00227239
17. Bloxham, C. A., Mindel, T. A., and Frith, C. D. (1984). Initiation and execution of predictable and unpredictable movements in Parkinson's disease. Brain 107, 371-384. doi: 10.1093/brain/107.2.371
18. Boecker, H., Dagher, A., Ceballos-Baumann, A. O., Passingham, R. E., Samuel, M., Friston, K. J., et al. (1998). Role of the human rostral supplementary motor area and the basal ganglia in motor sequence control: investigations with H2 15O PET. J. Neurophysiol. 79, 1070-1080.
19. Bolam, J. P., Hanley, J. J., Booth, P. A. C., and Bevan, M. D. (2000). Synaptic organisation of the basal ganglia. J. Anat. 196, 527-542. doi: 10.1046/j.1469-7580.2000.19640527.x
20. Bordi, F., and LeDoux, J. (1992). Sensory tuning beyond the sensory system: an initial analysis of auditory response properties of neurons in the lateral amygdaloid nucleus and overlying areas of the striatum. J. Neurosci. 12, 2493-2503.
21. Boyson, S. J., McGonigle, P., and Molinoff, P. B. (1986). Quantitative autoradio-graphic localization of the D1 and D2 subtypes of dopamine receptors in rat brain. J. Neurosci. 6, 3177-3188.
22. Brainard, M. S., and Doupe, A. J. (2000). Interruption of a basal ganglia-forebrain circuit prevents plasticity of learned vocalizations. Nature 404, 762-766. doi: 10.1038/35008083
23. Bromberg-Martin, E. S., Matsumoto, M., and Hikosaka, O. (2010). Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 68, 815-834. doi: 10.1016/j.neuron.2010.11.022
24. Brown, J. W., Bullock, D., and Grossberg, S. (2004). How laminar frontal cortex and basal ganglia circuits interact to control planned and reactive saccades. Neural Netw. 17, 471-510. doi: 10.1016/j.neunet.2003.08.006
25. Calabresi, P., Mercuri, N., Stanzione, P., Stefani, A., and Bernardi, G. (1987). Intracellular studies on the dopamine-induced firing inhibition of neostri-atal neurons in vitro: evidence for D1 receptor involvement. Neuroscience 20, 757-771. doi: 10.1016/0306-4522(87)90239-9
26. Calabresi, P., Picconi, B., Tozzi, A., and Di Filippo, M. (2007). Dopamine-mediated regulation of corticostriatal synaptic plasticity. Trends Neurosci. 30, 211-219. doi: 10.1016/j.tins.2007.03.001
27. Calzavara, R., Mailly, P., and Haber, S. N. (2007). Relationship between the corti-costriatal terminals from areas 9 and 46, and those from area 8A, dorsal and rostral premotor cortex and area 24c: an anatomical substrate for cognition to action. Eur. J. Neurosci. 26, 2005-2024. doi: 10.1111/j.1460-9568.2007.05825.x
28. Canteras, N. S., Shammah-Lagnada, S. J., Silva, B. A., and Ricardo, J. A. (1988). Somatosensory inputs to the subthalamic nucleus: a combined retrograde and anterograde horseradish peroxidase study in the rat. Brain Res. 458, 53-64. doi: 10.1016/0006-8993(88)90495-7
29. Canteras, N. S., Shammah-Lagnado, S. J., Silva, B. A., and Ricardo, J. A. (1990). Afferent connections of the subthalamic nucleus: a combined retrograde and anterograde horseradish peroxidase study in the rat. Brain Res. 513, 43-59. doi: 10.1016/0006-8993(90)91087-W
30. Carli, M., Evenden, J. L., and Robbins, T. W. (1985). Depletion of unilateral striatal dopamine impairs initiation of contralateral actions and not sensory attention. Nature 313, 679-682. doi: 10.1038/313679a0
31. Cavanagh, J. F., Wiecki, T. V., Cohen, M. X., Figueroa, C. M., Samanta, J., Sherman, S. J., et al. (2011). Subthalamic nucleus stimulation reverses mediofrontal influence over decision threshold. Nat. Neurosci. 14, 1462-1467. doi: 10.1038/nn.2925
32. Chersi, F., Mirolli, M., Pezzulo, G. and Baldassare, G. (2013). A spiking neuron model of the cortico-basal ganglia circuits for goal-directed and habitual action learning. Neural Netw 41, 212-224. doi: 10.1016/j.neunet.2012.11.009
33. Cossette, M., Lévesque, M., and Parent, A. (1999). Extrastriatal dopamin-ergic innervation of human basal ganglia. Neurosci. Res. 34, 51-54. doi: 10.1016/S0168-0102(99)00029-2
34. Cromwell, H. C., and Schultz, W. (2003). Effects of expectations for different reward magnitudes on neuronal activity in primate striatum. J. Neurophysiol. 89, 2823-2838. doi: 10.1152/jn.01014.2002
35. Darian-Smith, C., Tan, A., and Edwards, S. (1999). Comparing thalamocortical and corticothalamic microstructure and spatial reciprocity in the macaque ventral posterolateral nucleus (VPLc) and medial pulvinar. J. Comp. Neurol. 410, 211-234. doi: 10.1002/(SICI)1096-9861(19990726)410:2<211::AID-CNE4>3.3.CO;2-O
36. DeLong, M. R. (1990). Primate models of movement disorders of basal ganglia origin. Trends Neurosci. 13, 281-285. doi: 10.1016/0166-2236(90)90110-V
37. Donoghue, J. P., and Kitai, S. T. (1981). A collateral pathway to the neostriatum from corticofugal neurons of the rat sensory-motor cortex: an intracellular HRP study. J. Comp. Neurol. 201, 1-13. doi: 10.1002/cne.902010102
38. Doyon, J., Gaudreau, D., Castonguay, M., Bedard, P. J., Bédard, F., and Bouchard, J. P. (1997). Role of the striatum, cerebellum, and frontal lobes in the learning of a visuomotor sequence. Brain Cogn. 34, 218-245. doi: 10.1006/brcg. 1997.0899
39. El Massioui, N., Chéruel, F., Faure, A., and Conde, F. (2007). Learning and memory dissociation in rats with lesions to the subthalamic nucleus or to the dorsal striatum. Neuroscience 147, 906-918. doi: 10.1016/j.neuroscience. 2007.05.015
40. Farries, M. A., Kita, H., and Wilson, C. J. (2010). Dynamic spike threshold and zero membrane slope conductance shape the response of subthalamic neurons to cortical input. J. Neurosci. 30, 13180-13191. doi: 10.1523/JNEUROSCI.1909-10.2010
41. Featherstone, R. E., and McDonald, R. J. (2004). Dorsal striatum and stimulus-response learning: lesions of the dorsolateral, but not dorsomedial, striatum impair acquisition of a stimulus-response-based instrumental discrimination task, while sparing conditioned place preference learning. Neuroscience 124, 23-31. doi: 10.1016/j.neuroscience.2003.10.038
42. Flaherty, A. W., and Graybiel, A. M. (1993). Two input systems for body representations in the primate striatal matrix: experimental evidence in the squirrel monkey. J. Neurosci. 13, 1120-1137.
43. Flores, G., Liang, J. J., Sierra, A., Martinez-Fong, D., Quirion, R., Aceves, J., et al. (1999). Expression of dopamine receptors in the subthalamic nucleus of the rat: characterization using reverse transcriptase-polymerase chain reaction and autoradiography. Neuroscience 91, 549-556. doi: 10.1016/S0306-4522(98)00633-2
44. Frank, M. J. (2005). Dynamic dopamine modulation in the basal ganglia: a neu-rocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism. J. Cogn. Neurosci. 17, 51-72. doi: 10.1162/0898929052880093
45. Frank, M. J. (2006). Hold your horses: a dynamic computational role for the subthalamic nucleus in decision making. Neural Netw. 19, 1120-1136. doi: 10.1016/j.neunet.2006.03.006
46. Frank, M. J., Loughry, B., and O'Reilly, R. C. (2001). Interactions between frontal cortex and basal ganglia in working memory: a computational model. Cogn. Affect. Behav. Neurosci. 1, 137-160. doi: 10.3758/CABN.1.2.137
47. Frank, M. J., Samanta, J., Moustafa, A. A., and Sherman, S. J. (2007). Hold your horses: impulsivity, deep brain stimulation, and medication in parkinsonism. Science 318, 1309-1312. doi: 10.1126/science.1146157
48. Frank, M. J., Seeberger, L. C., and O'Reilly, R. C. (2004). By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 306, 1940-1943. doi: 10.1126/science.1102941
49. Gauggel, S., Rieger, M., and Feghoff, T. A. (2004). Inhibition of ongoing responses in patients with Parkinson's disease. J. Neurol. Neurosurg. Psychiatry 75, 539-544. doi: 10.1136/jnnp.2003.016469
50. Gauthier, J., Parent, M., Lévesque, M., and Parent, A. (1999). The axonal arborization of single nigrostriatal neurons in rats. Brain Res. 834, 228-232. doi: 10.1016/S0006-8993(99)01573-5
51. Gerfen, C. R., Engber, T. M., Mahan, L. C., Susel, Z., Chase, T. N., Monsma, F. J., et al. (1990). D1 and D2 dopamine receptor-regulated gene expression of striatonigral and striatopallidal neurons. Science 250, 1429-1432. doi: 10.1126/science.2147780
52. Giuffrida, R., Li Volsi, G., Maugeri, G., and Perciavalle, V. (1985). Influences of pyramidal tract on the subthalamic nucleus in the cat. Neurosci. Lett. 54, 231-235. doi: 10.1016/S0304-3940(85)80084-7
53. Gradinaru, V., Mogri, M., Thompson, K. R., Henderson, J. M., and Deisseroth, K. (2009). Optical deconstruction of parkinsonian neural circuitry. Science 324, 354-359. doi: 10.1126/science.1167093
54. Gruber, A. J., Dayan, P., Gutkin, B. S., and Solla, S. A. (2006). Dopamine modulation in the basal ganglia locks the gate to working memory. J. Comput. Neurosci. 20, 153-166. doi: 10.1007/s10827-005-5705-x
55. Gurney, K., Prescott, T. J., and Redgrave, P. (2001a). A computational model of action selection in the basal ganglia. I. A new functional anatomy. Biol. Cybern. 84, 401-410. doi: 10.1007/PL00007984
56. Gurney, K., Prescott, T. J., and Redgrave, P. (2001b). A computational model of action selection in the basal ganglia. II. Analysis and simulation of behaviour. Biol. Cybern. 84, 411-423. doi: 10.1007/PL00007985
57. Guthrie, M., Myers, C. E., and Gluck, M. A. (2009). A neurocomputational model of tonic and phasic dopamine in action selection: a comparison with cognitive deficits in Parkinson's disease. Behav. Brain Res. 200, 48-59. doi: 10.1016/j.bbr. 2008.12.036
58. Haber, S. N. (2003). The primate basal ganglia: parallel and integrative networks. J. Chem. Neuroanat. 26, 317-330. doi: 10.1016/j.jchemneu.2003.10.003
59. Hartmann-von Monakow, K., Akert, K., and Künzle, H. (1978). Projections of the precentral motor cortex and other cortical areas of the frontal lobe to the subthalamic nucleus in the monkey. Exp. Brain Res. 33, 395-403.
60. Hazrati, L. N., and Parent, A. (1992a). Convergence of subthalamic and stri-atal efferents at pallidal level in primates: an anterograde double-labeling study with biocytin and PHA-L. Brain Res. 569, 336-340. doi: 10.1016/0006-8993(92)90648-S
61. Hazrati, L. N., and Parent, A. (1992b). The striatopallidal projection displays a high degree of anatomical specificity in the primate. Brain Res. 592, 213-227. doi: 10.1016/0006-8993(92)91679-9
62. Hazrati, L. N., and Parent, A. (1992c). Differential patterns of arborization of stri-atal and subthalamic fibers in the two pallidal segments in primates. Brain Res. 598, 311-315. doi: 10.1016/0006-8993(92)90199-J
63. Heinz, A., Sander, T., Harms, H., Finckh, U., Kuhn, S., Dufeu, P., et al. (1996). Lack of allelic association of dopamine D1 and D2 (TaqIA) receptor gene polymorphisms with reduced dopaminergic sensitivity in alcoholism. Alcohol.Clin. Exp. Res. 20, 1109-1113. doi: 10.1111/j.1530-0277.1996.tb01954.x
64. Hershey, T., Wu, J., Weaver, P. M., Perantie, D. C., Karimi, M., Tabbal, S. D., et al. (2008). Unilateral vs. bilateral STN DBS effects on working memory and motor function in Parkinson disease. Exp. Neurol. 210, 402-408. doi: 10.1016/j.expneurol.2007.11.011
65. Hikida, T., Kimura, K., Wada, N., Funabiki, K., and Nakanishi, S. (2010). Distinct roles of synaptic transmission in direct and indirect striatal pathways to reward and aversive behavior. Neuron 66, 896-907. doi: 10.1016/j.neuron.2010.05.011
66. Hikosaka, O., Matsumura, M., Kojima, J., and Gardiner, T. W. (1993). Role of basal ganglia in initiation and suppression of saccadic eye movements. Role Cerebellum Basal Ganglia Volunt. Mov. 213-219.
67. Hikosaka, O., Sakamoto, M., and Usui, S. (1989). Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward. J. Neurophysiol. 61, 814-832.
68. Hikosaka, O., Takikawa, Y., and Kawagoe, R. (2000). Role of the basal ganglia in the control of purposive saccadic eye movements. Physiol. Rev. 80, 953-978.
69. Hollerman, J. R., and Schultz, W. (1998). Dopamine neurons report an error in the temporal prediction of reward during learning. Nat. Neurosci. 1, 304-309. doi: 10.1038/1124
70. Horvitz, J. C., Stewart, T., and Jacobs, B. L. (1997). Burst activity of ventral tegmen-tal dopamine neurons is elicited by sensory stimuli in the awake cat. Brain Res. 759, 251-258. doi: 10.1016/S0006-8993(97)00265-5
71. Houk, J. C., Adams, J. L., and Barto, A. G. (1995). "A model of how the basal ganglia generate and use neural signals that predict reinforcement," in Models of Information Processing in the Basal Ganglia, eds J. C. Houk, J. L. Davis, and D. G. Beiser (Cambridge, MA: MIT Press), 249-270.
72. Huang, C., Tang, C., Feigin, A., Lesser, M., Ma, Y., Pourfar, M., et al. (2007). Changes in network activity with the progression of Parkinson's disease. Brain 130, 1834-1846. doi: 10.1093/brain/awm086
73. Humphries, M. D., Lepora, N., Wood, R., and Gurney, K. (2009). Capturing dopaminergic modulation and bimodal membrane behaviour of striatal medium spiny neurons in accurate, reduced models. Front. Comput. Neurosci. 3:26. doi: 10.3389/neuro.10.026.2009
74. Humphries, M. D., Stewart, R. D., and Gurney, K. N. (2006). A physiologically plausible model of action selection and oscillatory activity in the basal ganglia. J. Neurosci. 26, 12921-12942. doi: 10.1523/JNEUROSCI.3486-06.2006
75. Ibañez-Sandoval, O., Hernández, A., Florán, B., Galarraga, E., Tapia, D., Valdiosera, R., et al. (2006). Control of the subthalamic innervation of substantia nigra pars reticulata by D1 and D2 dopamine receptors. J. Neurophysiol. 95, 1800-1811. doi: 10.1152/jn.01074.2005
76. Inase, M., Sakai, S. T., and Tanji, J. (1996). Overlapping corticostriatal projections from the supplementary motor area and the primary motor cortex in the macaque monkey: an anterograde double labeling study. J. Comp. Neurol. 373, 283-296.
77. Jaeger, D., Gilman, S., and Wayne Aldridge, J. (1995). Neuronal activity in the stria-tum and pallidum of primates related to the execution of externally cued reaching movements. Brain Res. 694, 111-127. doi: 10.1016/0006-8993(95)00780-T
78. Joel, D., and Weiner, I. (1994). The organization of the basal ganglia-thalamocortical circuits: open interconnected rather than closed segregated. Neuroscience 63, 363-379. doi: 10.1016/0306-4522(94)90536-3
79. Kao, M. H., Doupe, A. J., and Brainard, M. S. (2005). Contributions of an avian basal ganglia-forebrain circuit to real-time modulation of song. Nature 433, 638-643. doi: 10.1038/nature03127
80. Kawaguchi, Y. (1993). Physiological, morphological, and histochemical characterization of three classes of interneurons in rat neostriatum. J. Neurosci. 13, 4908-4923.
81. Kita, H., Chiken, S., Tachibana, Y., and Nambu, A. (2006). Origins of GABAA and GABAB receptor-mediated responses of globus pallidus induced after stimulation of the putamen in the monkey. J. Neurosci. 26, 6554-6562. doi: 10.1523/JNEUROSCI.1543-06.2006
82. Kita, H., and Kita, T. (2011). Cortical stimulation evokes abnormal responses in the dopamine-depleted rat basal ganglia. J. Neurosci. 31, 10311-10322. doi: 10.1523/JNEUROSCI.0915-11.2011
83. Kita, T., and Kita, H. (2012). The subthalamic nucleus is one of multiple innerva-tion sites for long-range corticofugal axons: a single-axon tracing study in the rat. J. Neurosci. 32, 5990-5999. doi: 10.1523/JNEUROSCI.5717-11.2012
84. Kolomiets, B. P., Deniau, J. M., Mailly, P., Menetrey, A., Glowinski, J., and Thierry, A. M. (2001). Segregation and convergence of information flow through the cortico-subthalamic pathways. J. Neurosci. 21, 5764-5772.
85. Kravitz, A. V., Freeze, B. S., Parker, P. R., Kay, K., Thwin, M. T., Deisseroth, K., et al. (2010). Regulation of parkinsonian motor behaviours by optogenetic control of basal ganglia circuitry. Nature 466, 622-626. doi: 10.1038/nature09159
86. Kreiss, D. S., Mastropietro, C. W., Rawji, S. S., and Walters, J. R. (1997). The response of subthalamic nucleus neurons to dopamine receptor stimulation in a rodent model of Parkinson's disease. J. Neurosci. 17, 6807-6819.
87. Lanciego, J. L., Gonzalo, N., Castle, M., Sanchez-Escobar, C., Aymerich, M. S., and Obeso, J. A. (2004). Thalamic innervation of striatal and subthalamic neurons projecting to the rat entopeduncular nucleus. Eur. J. Neurosci. 19, 1267-1277. doi: 10.1111/j.1460-9568.2004.03244.x
88. Landau, S. M., Lal, R., O'Neil, J. P., Baker, S., and Jagust, W. J. (2009). Striatal dopamine and working memory. Cereb. Cortex 19, 445-454. doi: 10.1093/cer-cor/bhn095
89. Lapper, S. R., and Bolam, J. P. (1992). Input from the frontal cortex and the parafas-cicular nucleus to cholinergic interneurons in the dorsal striatum of the rat. Neuroscience 51, 533-545. doi: 10.1016/0306-4522(92)90293-B
90. Lapper, S. R., Smith, Y., Sadikot, A. F., Parent, A., and Bolam, J. P. (1992). Cortical input to parvalbumin-immunoreactive neurones in the putamen of the squirrel monkey. Brain Res. 580, 215-224. doi: 10.1016/0006-8993(92)90947-8
91. Lawrence, A. D., Sahakian, B. J., Rogers, R. D., Hodges, J. R., and Robbins, T. W. (1999). Discrimination, reversal, and shift learning in Huntington's disease: mechanisms of impaired response selection. Neuropsychologia 37, 1359-1374. doi: 10.1016/S0028-3932(99)00035-4
92. LeDoux, J. E., Farb, C. R., and Romanski, L. M. (1991). Overlapping projections to the amygdala and striatum from auditory processing areas of the thalamus and cortex. Neurosci. Lett. 134, 139-144. doi: 10.1016/0304-3940(91) 90526-Y
93. Lee, B., Groman, S., London, E. D., and Jentsch, J. D. (2007). Dopamine D2/D3 receptors play a specific role in the reversal of a learned visual discrimination in monkeys. Neuropsychopharmacology 32, 2125-2134. doi: 10.1038/sj.npp.1301337
94. Lei, W., Jiao, Y., Del Mar, N., and Reiner, A. (2004). Evidence for differential cortical input to direct pathway versus indirect pathway striatal projection neurons in rats. J. Neurosci. 24, 8289-8299. doi: 10.1523/JNEUROSCI. 1990-04.2004
95. Lévesque, M., and Parent, A. (2005). The striatofugal fiber system in primates: a reevaluation of its organization based on single-axon tracing studies. Proc. Natl. Acad. Sci. U.S.A. 102, 11888-11893. doi: 10.1073/pnas.0502710102
96. Levey, A. I., Hersch, S. M., Rye, D. B., Sunahara, R. K., Niznik, H. B., Kitt, C. A., et al. (1993). Localization of D1 and D2 dopamine receptors in brain with subtype-specific antibodies. Proc. Natl. Acad. Sci. U.S.A. 90, 8861-8865. doi: 10.1073/pnas.90.19.8861
97. Levy, R., Friedman, H. R., Davachi, L., and Goldman-Rakic, P. S. (1997). Differential activation of the caudate nucleus in primates performing spatial and nonspatial working memory tasks. J. Neurosci. 17, 3870-3882.
98. Lewis, S. J., Dove, A., Robbins, T. W., Barker, R. A., and Owen, A. M. (2004). Striatal contributions to working memory: a functional magnetic resonance imaging study in humans. Eur. J. Neurosci. 19, 755-760. doi: 10.1111/j.1460-9568.2004.03108.x
99. Lin, Y. J., Greif, G. J., and Freedman, J. E. (1996). Permeation and block of dopamine-modulated potassium channels on rat striatal neurons by cesium and barium ions. J. Neurophysiol. 76, 1413-1422.
100. Marsden, C. D., and Obeso, J. A. (1994). The functions of the basal ganglia and the paradox of stereotaxic surgery in Parkinson's disease. Brain 117, 877-897. doi: 10.1093/brain/117.4.877
101. Matsumoto, M., and Hikosaka, O. (2009). Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459, 837-841. doi: 10.1038/nature08028
102. McFarland, N. R., and Haber, S. N. (2002). Thalamic relay nuclei of the basal ganglia form both reciprocal and nonreciprocal cortical connections, linking multiple frontal cortical areas. J. Neurosci. 22, 8117-8132.
103. Mehta, M. A., Swainson, R., Ogilvie, A. D., Sahakian, B., and Robbins, T. W. (2001). Improved short-term spatial memory but impaired reversal learning following the dopamine D2 agonist bromocriptine in human volunteers. Psychopharmacology 159, 10-20. doi: 10.1007/s002130100851
104. Mink, J. W. (1996). The basal ganglia: focused selection and inhibition of competing motor programs. Prog. Neurobiol. 50, 381-425. doi: 10.1016/S0301-0082(96)00042-1
105. Moustafa, A. A., Cohen, M. X., Sherman, S. J., and Frank, M. J. (2008a). A role for dopamine in temporal decision making and reward maximization in parkinsonism. J. Neurosci. 28, 12294-12304. doi: 10.1523/JNEUROSCI. 3116-08.2008
106. Moustafa, A. A., Sherman, S. J., and Frank, M. J. (2008b). A dopaminergic basis for working memory, learning and attentional shifting in Parkinsonism. Neuropsychologia 46, 3144-3156. doi: 10.1016/j.neuropsychologia.2008.07.011
107. Moustafa, A. A., and Gluck, M. A. (2011). A neurocomputational model of dopamine and prefrontal-striatal interactions during multicue category learning by Parkinson patients. J. Cogn. Neurosci. 23, 151-167. doi: 10.1162/jocn.2010.21420
108. Nakahara, H., Doya, K., and Hikosaka, O. (2001). Parallel cortico-basal ganglia mechanisms for acquisition and execution of visuomotor sequences-a computational approach. J. Cogn. Neurosci. 13, 626-647. doi: 10.1162/0898929017 50363208
109. Nambu, A. (2004). A new dynamic model of the cortico-basal ganglia loop. Prog. Brain Res. 143, 461-466. doi: 10.1016/S0079-6123(03)43043-4
110. Nambu, A., Tokuno, H., Hamada, I., Kita, H., Imanishi, M., Akazawa, T., et al. (2000). Excitatory cortical inputs to pallidal neurons via the subthalamic nucleus in the monkey. J. Neurophysiol. 84, 289-300.
111. Nambu, A., Tokuno, H., and Takada, M. (2002). Functional significance of the cortico-subthalamo-pallidal "hyperdirect" pathway. Neurosci. Res. 43, 111-117. doi: 10.1016/S0168-0102(02)00027-5
112. Nelson, J. I., Salin, P. A., Munk, M. H. J., Arzi, M., and Bullier, J. (1992). Spatial and temporal coherence in cortico-cortical connections: a cross-correlation study in areas 17 and 18 in the cat. Vis. Neurosci. 9, 21-37. doi: 10.1017/S0952523800006349
113. Nini, A., Feingold, A., Slovin, H., and Bergman, H. (1995). Neurons in the globus pallidus do not show correlated activity in the normal monkey, but phase-locked oscillations appear in the MPTP model of parkinsonism. J. Neurophysiol. 74, 1800-1805.
114. Ölveczky, B. P., Andalman, A. S., and Fee, M. S. (2005). Vocal experimentation in the juvenile songbird requires a basal ganglia circuit. PLoS Biol. 3:e153. doi: 10.1371/journal.pbio.0030153
115. Oorschot, D. E. (1996). Total number of neurons in the neostriatal, pallidal, subtha-lamic, and substantia nigral nuclei of the rat basal ganglia: a stereological study using the cavalieri and optical disector methods. J. Comp. Neurol. 366, 580-599.
116. O'Reilly, R. C., and Frank, M. J. (2006). Making working memory work: a computational model of learning in the prefrontal cortex and basal ganglia. Neural Comput. 18, 283-328. doi: 10.1162/089976606775093909
117. Packard, M. G., and Knowlton, B. J. (2002). Learning and memory functions of the basal ganglia. Annu. Rev. Neurosci. 25, 563-593. doi: 10.1146/annurev.neuro.25.112701.142937
118. Parent, M., and Parent, A. (2006). Single-axon tracing study of corticostriatal projections arising from primary motor cortex in primates. J. Comp. Neurol. 496, 202-213. doi: 10.1002/cne.20925
119. Prescott, I. A., Dostrovsky, J. O., Moro, E., Hodaie, M., Lozano, A. M., and Hutchison, W. D. (2009). Levodopa enhances synaptic plasticity in the substan-tia nigra pars reticulata of Parkinson's disease patients. Brain 132, 309-318. doi: 10.1093/brain/awn322
120. Ramanathan, S., Hanley, J. J., Deniau, J. M., and Bolam, J. P. (2002). Synaptic convergence of motor and somatosensory cortical afferents onto GABAergic interneurons in the rat striatum. J. Neurosci. 22, 8158-8169.
121. Ray Li, C. S., Yan, P., Sinha, R., and Lee, T. W. (2008). Subcortical processes of motor response inhibition during a stop signal task. Neuroimage 41, 1352-1363. doi: 10.1016/j.neuroimage.2008.04.023
122. Reading, P. J., Dunnett, S. B., and Robbins, T. W. (1991). Dissociable roles of the ventral, medial and lateral striatum on the acquisition and performance of a complex visual stimulus-response habit. Behav. Brain Res., 45, 147-161. doi: 10.1016/S0166-4328(05)80080-4
123. Rebec, G. V. (1998). Real-time assessments of dopamine function during behavior: single-unit recording, iontophoresis, and fast-scan cyclic voltammetry in awake, unrestrained rats. Alcohol. Clin. Exp. Res. 22, 32-40.
124. Redgrave, P., and Gurney, K. (2006). The short-latency dopamine signal: a role in discovering novel actions?. Nat. Rev. Neurosci. 7, 967-975. doi: 10.1038/nrn2022
125. Rosell, A., and Giménez-Amaya, J. M. (1999). Anatomical re-evaluation of the cor-ticostriatal projections to the caudate nucleus: a retrograde labeling study in the cat. Neurosci. Res. 34, 257. doi: 10.1016/S0168-0102(99)00060-7
126. Schönberg, T., Daw, N. D., Joel, D., and O'Doherty, J. P. (2007). Reinforcement learning signals in the human striatum distinguish learners from nonlearn-ers during reward-based decision making. J. Neurosci. 27, 12860-12867. doi: 10.1523/JNEUROSCI.2496-07.2007
127. Schroll, H., Vitay, J., and Hamker, F. H. (2012). Working memory and response selection: a computational account of interactions among cortico-basalganglio-thalamic loops. Neural Netw. 26, 59-74. doi: 10.1016/j.neunet.2011.10.008
128. Schroll, H., Vitay, J., and Hamker, F. H. (2013). Dysfunctional and compensatory synaptic plasticity in Parkinson's disease. Eur. J. Neurosci. doi: 10.1111/ejn.12434. [Epub ahead of print].
129. Shen, W., Flajolet, M., Greengard, P., and Surmeier, D. J. (2008). Dichotomous dopaminergic control of striatal synaptic plasticity. Science 321, 848-851. doi: 10.1126/science.1160575
130. Shepherd, G. M. (2013). Corticostriatal connectivity and its role in disease. Nat. Rev.Neurosci. 14, 278-291. doi: 10.1038/nrn3469
131. Shiner, T., Seymour, B., Wunderlich, K., Hill, C., Bhatia, K. P., Dayan, P., et al. (2012). Dopamine and performance in a reinforcement learning task: evidence from Parkinson's disease. Brain 135, 1871-1883. doi: 10.1093/brain/ aws083
132. Smith, Y., Bevan, M. D., Shink, E., and Bolam, J. P. (1998). Microcircuitry of the direct and indirect pathways of the basal ganglia. Neuroscience 86, 353.
133. Stocco, A., Lebiere, C., and Anderson, J. R. (2010). Conditional routing of information to the cortex: a model of the basal ganglia's role in cognitive coordination. Psychol. Rev. 117, 541. doi: 10.1037/a0019077
134. Suri, R. E., Bargas, J., and Arbib, M. A. (2001). Modeling functions of striatal dopamine modulation in learning and planning. Neuroscience 103, 65-85. doi: 10.1016/S0306-4522(00)00554-6
135. Takada, M., Tokuno, H., Nambu, A., and Inase, M. (1998). Corticostriatal projections from the somatic motor areas of the frontal cortex in the macaque monkey: segregation versus overlap of input zones from the primary motor cortex, the supplementary motor area, and the premotor cortex. Exp. Brain Res. 120, 114-128. doi: 10.1007/s002210050384
136. Tanaka, S. C., Doya, K., Okada, G., Ueda, K., Okamoto, Y., and Yamawaki, S. (2004). Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops. Nat. Neurosci. 7, 887-893. doi: 10.1038/nn1279
137. Tepper, J. M. (2010). "GABAergic interneurons of the striatum," in Handbook of Basal Ganglia Structure and Function, eds H. Steiner and K. Tseng (Amsterdam: Academic Press), 151-166.
138. Trapp, S., Schroll, H., and Hamker, F. H. (2012). Open and closed loops: a computational approach to attention and consciousness. Adv. Cogn. Psychol. 8, 1-8. doi: 10.2478/v10053-008-0096-y
139. Vitay, J., and Hamker, F. H. (2010). A computational model of basal ganglia and its role in memory retrieval in rewarded visual memory tasks. Front. Comput. Neurosci. 4:13. doi: 10.3389/fncom.2010.00013.
140. Waldschmidt, J. G., and Ashby, F. G. (2011). Cortical and striatal contributions to automaticity in information-integration categorization. Neuroimage 56, 1791-1802. doi: 10.1016/j.neuroimage.2011.02.011
141. Wichmann, T., and DeLong, M. R. (1996). Functional and pathophysiologi-cal models of the basal ganglia. Curr. Opin. Neurobiol. 6, 751-758. doi: 10.1016/S0959-4388(96)80024-9
142. Wiecki, T. V., and Frank, M. J. (2013). A computational model of inhibitory control in frontal cortex and basal ganglia. Psychol. Rev. 120, 329. doi: 10.1037/a0031542
143. Wylie, S. A., van den Wildenberg, W. P. M., Ridderinkhof, K. R., Bashore, T. R., Powell, V. D., Manning, C. A., et al. (2009). The effect of Parkinson's disease on interference control during action selection. Neuropsychologia 47, 145-157. doi: 10.1016/j.neuropsychologia.2008.08.001