A computational model of basal ganglia and its role in memory retrieval in rewarded visual memory tasks

Frontiers in Computational Neuroscience

Volumn 4, Issue , 2010, Pages 1-38

  Vitay, Julien ^a   Hamker, Fred H ^a,b  

^a UNIVERSITY OF MÜNSTER   (Germany)

^b CHEMNITZ UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

Attention; Basal ganglia; Delayed rewarded tasks; Memory retrieval; Perirhinal cortex; Reinforcement learning; Visual working memory

Indexed keywords

COMPUTATION THEORY; COMPUTATIONAL METHODS;

ATTENTION; BASAL GANGLIA; DELAYED REWARDED TASKS; MEMORY RETRIEVAL; PERIRHINAL CORTEX; WORKING MEMORY;

REINFORCEMENT LEARNING;

ARTICLE; BASAL GANGLION; BRAIN CORTEX; BRAIN DEPTH STIMULATION; BRAIN FUNCTION; CORPUS STRIATUM; DOPAMINERGIC NERVE CELL; INFORMATION RETRIEVAL; LEARNING; MATHEMATICAL ANALYSIS; MATHEMATICAL MODEL; MENTAL TASK; REWARD; SUBSTANTIA NIGRA; THALAMUS; VISUAL MEMORY; WORKING MEMORY;

EID: 77953450687     PISSN: 16625188     EISSN: None     Source Type: Journal    
DOI: 10.3389/fncom.2010.00013     Document Type: Article

References (89)

1. Albin, R.L., Young, A.B., Penney, J.B. (1989). The functional anatomy of basal ganglia disorders. Trends Neurosci 12, 366-375.
2. Alexander, G.E., DeLong, M.R., Strick, P.L. (1986). Parallel organization of functionally segregated circuits linking the basal ganglia and cortex. Ann Rev Neurosci 9, 357-381.
3. Ashby, F.G., Ell, S.W., Valentin, V.V., Casale, M.B. (2005). FROST: a distributed neurocomputational model of working memory maintenance. J Cogn Neurosci 17, 1728-1743.
4. Bar-Gad, I., Morris, G., Bergman, H. (2003). Information processing, dimensionality reduction and reinforcement learning in the basal ganglia. Prog Neurobiol 71, 439-473.
5. Bienenstock, E.L., Cooper, L.N., Munroe, P.W. (1982). Theory of the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex. J Neurosci 2, 32-48.
6. Brown, J., Bullock, D., Grossberg, S. (1999). How the basal ganglia use parallel excitatory and inhibitory learning pathways to selectively respond to unexpected rewarding cues. J Neurosci 19, 10502-10511.
7. Calabresi, P., Picconi, B., Tozzi, A., Filippo, M.D. (2007). Dopamine-mediated regulation of corticostriatal synaptic plasticity. Trends Neurosci 30, 211-219.
8. Chang, C., Crottaz-Herbette, S., Menon, V. (2007). Temporal dynamics of basal ganglia response and connectivity during verbal working memory. Neuroimage 34, 1253-1269.
9. Chang, J.Y., Chen, L., Luo, F., Shi, L.H., Woodward, D.J. (2002). Neuronal responses in the frontal cortico-basal ganglia system during delayed matching-to-sample task: ensemble recording in freely moving rats. Exp Brain Res 142, 67-80.
10. Chevalier, G., Deniau, J.M. (1990). Disinhibition as a basic process in the expression of striatal functions. Trends Neurosci 13, 277-280.
11. DeLong, M.R. (1990). Primate models of movement disorders of basal ganglia origin. Trends Neurosci 13, 281-285.
12. Desimone, R., Duncan, J. (1995). Neural mechanisms of selective visual attention. Ann Rev Neurosci 18, 193-222.
13. D'Esposito, M., Cooney, J.W., Gazzaley, A., Gibbs, S.E.B., Postle, B.R. (2006). Is the prefrontal cortex necessary for delay task performance? Evidence from lesion and FMRI data. J Int Neuropsychol Soc 12, 248-260.
14. Di Filippo, M., Picconi, B., Tantucci, M., Ghiglieri, V., Bagetta, V., Sgobio, C., Tozzi, A., Parnetti, L., Calabresi, P. (2009). Short-term and long-term plasticity at corticostriatal synapses: implications for learning and memory. Behav Brain Res 199, 108-18.
15. Elliott, R., Dolan, R.J. (1999). Differential neural responses during performance of matching and nonmatching to sample tasks at two delay intervals. J Neurosci 19, 5066-5073.
16. Flaherty, A.W., Graybiel, A.M. (1994). Input-output organization of the sensorimotor striatum in the squirrel monkey. J Neurosci 14, 599-610.
17. Frank, M.J., Loughry, B., O'Reilly, R.C. (2001). Interactions between frontal cortex and basal ganglia in working memory: a computational model. Cogn Affect Behav Neurosci 1, 137-160.
18. Funahashi, S., Bruce, C.J., Goldman-Rakic, P.S. (1989). Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. J Neurophysiol 61, 331-349.
19. Fuster, J.M., Alexander, G.E. (1971). Neuron activity related to short-term memory. Science 173, 652-654.
20. Fuster, J.M., Bauer, R.H., Jervey, J.P. (1981). Effects of cooling inferotemporal cortex on performance of visual memory tasks. Exp Neurol 71, 398-409.
21. Fuster, J.M., Bauer, R.H., Jervey, J.P. (1985). Functional interactions between inferotemporal and prefrontal cortex in a cognitive task. Brain Res 330, 299-307.
22. Gisiger, T., Kerszberg, M. (2006). A model for integrating elementary neural functions into delayed-response behavior. PLoS Comput Biol 2, e25.
23. Gruber, A.J., Dayan, P., Gutkin, B.S., Solla, S.A. (2006). Dopamine modulation in the basal ganglia locks the gate to working memory. J Comput Neurosci 20, 153-166.
24. Gulley, J.M., Kosobud, A.E.K., Rebec, G.V. (2002). Behavior-related modulation of substantia nigra pars reticulata neurons in rats performing a conditioned reinforcement task. Neuroscience 111, 337-349.
25. Gurney, K., Prescott, T.J., Redgrave, P. (2001). A computational model of action selection in the basal ganglia. I. A new functional anatomy. Biol Cybern 84, 401-410.
26. Gutnikov, S.A., Ma, Y.Y., Gaffan, D. (1997). Temporo-frontal disconnection impairs visualvisual paired association learning but not configural learning in macaca monkeys. Eur J Neurosci 9, 1524-1529.
27. Haber, S.N. (2003). The primate basal ganglia: parallel and integrative networks. J Chem Neuroanat 26, 317-330.
28. Hamker, F. (2003). A dynamic model of how feature cues guide spatial attention. Vis Res 44, 501-521.
29. Hamker, F.H. (2005a). The emergence of attention by population-based inference and its role in distributed processing and cognitive control of vision. J Comput Vis Image Underst 100, 64-106.
30. Hamker, F.H. (2005b). The reentry hypothesis: the putative interaction of the frontal eye field, ventrolateral prefrontal cortex, and areas V4, IT for attention and eye movement. Cereb Cortex 15, 431-447.
31. Hikosaka, O., Sakamoto, M., Usui, S. (1989). Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward. J Neurophysiol 61, 814-832.
32. Ibañez-Sandoval, O., Hernández, A., Florán, B., Galarraga, E., Tapia, D., Valdiosera, R., Erlij, D., Aceves, J., Bargas, J. (2006). Control of the subthalamic innervation of substantia nigra pars reticulata by D1 and D2 dopamine receptors. J Neurophysiol 95, 1800-1811.
33. Ishikawa, M., Mu, P., Moyer, J.T., Wolf, J.A., Quock, R.M., Davies, N.M., Hu, X.T., Schlter, O.M., Dong, Y. (2009). Homeostatic synapse-driven membrane plasticity in nucleus accumbens neurons. J Neurosci 29, 5820-5831.
34. Lawrence, A.D., Sahakian, B.J., Robbins, T.W. (1998). Cognitive functions and corticostriatal circuits: insights from Huntington's disease. Trends in Cognitive Sciences 2, 379-388.
35. Lehky, S.R., Tanaka, K. (2007). Enhancement of object representations in primate perirhinal cortex during a visual working-memory task. J Neurophysiol 97, 1298-1310.
36. Levy, R., Friedman, H.R., Davachi, L., Goldman-Rakic, P.S. (1997). Differential activation of the caudate nucleus in primates performing spatial and nonspatial working memory tasks. J Neurosci 17, 3870-3882.
37. Lewis, S.J.G., Dove, A., Robbins, T.W., Barker, R.A., Owen, A.M. (2004). Striatal contributions to working memory: a functional magnetic resonance imaging study in humans. Eur J Neurosci 19, 755-760.
38. Luck, S.J., Vogel, E.K. (1997). The capacity of visual working memory for features and conjunctions. Nature 390, 279-281.
39. Mailly, P., Charpier, S., Menetrey, A., Deniau, J.M. (2003). Three-dimensional organization of the recurrent axon collateral network of the substantia nigra pars reticulata neurons in the rat. J Neurosci 23, 5247-5257.
40. Middleton, F.A., Strick, P.L. (1996). The temporal lobe is a target of output from the basal ganglia. Proc Natl Acad Sci U S A 93, 8683-8687.
41. Miller, E., Erickson, C., Desimone, R. (1996). Neural mechanisms of visual working memory in prefrontal cortex of the macaque. J Neurosci 16, 5154-5167.
42. Miller, E.K., Gochin, P.M., Gross, C.G. (1993). Suppression of visual responses of neurons in inferior temporal cortex of the awake macaque monkey by addition of a second stimulus. Brain Res 616, 25-29.
43. Miller, E., Cohen, J. (2001). An integrative theory of prefrontal cortex function. Annu Rev Neurosci 24, 167-202.
44. Mirenowicz, J., Schultz, W. (1994). Importance of unpredictability for reward responses in primate dopamine neurons. J Neurophysiol 72, 1024-1027.
45. Mogami, T., Tanaka, K. (2006). Reward association affects neuronal responses to visual stimuli in macaque TE and perirhinal cortices. J Neurosci 26, 6761-6770.
46. Mongillo, G., Amit, D.J., Brunel, N. (2003). Retrospective and prospective persistent activity induced by hebbian learning in a recurrent cortical network. Eur J Neurosci 18, 2011-2024.
47. Morita, M., Suemitsu, A. (2002). Computational modeling of pair-association memory in inferior temporal cortex. Brain Res Cogn Brain Res 13, 169-178.
48. Murray, Bussey (1999). Perceptual-mnemonic functions of the perirhinal cortex. Trends Cogn Sci 3, 142-151.
49. Mushiake, H., Strick, P.L. (1995). Pallidal neuron activity during sequential arm movements. J Neurophysiol 74, 2754-2758.
50. Nakamura, K., Kubota, K. (1995). Mnemonic firing of neurons in the monkey temporal pole during a visual recognition memory task. J Neurophysiol 74, 162-178.
51. Nakamura, K., Matsumoto, K., Mikami, A., Kubota, K. (1994). Visual response properties of single neurons in the temporal pole of behaving monkeys. J Neurophysiol 71, 1206-1221.
52. Nambu, A., Kaneda, K., Tokuno, H., Takada, M. (2002). Organization of corticostriatal motor inputs in monkey putamen. J Neurophysiol 88, 1830-1842.
53. Naya, Y., Yoshida, M., Takeda, M., Fujimichi, R., Miyashita, Y. (2003). Delay-period activities in two subdivisions of monkey inferotemporal cortex during pair association memory task. Eur J Neurosci 18, 2915-2918.
54. Nicola, S.M., Surmeier, J., Malenka, R.C. (2000). Dopaminergic modulation of neuronal excitability in the striatum and nucleus accumbens. Annu Rev Neurosci 23, 185-215.
55. Oja, E. (1982). A simplified neuron model as a principal component analyze. J Math Biol 15, 267-273.
56. O'Reilly, R.C., Frank, M.J. (2006). Making working memory work: a computational model of learning in the prefrontal cortex and basal ganglia. Neural Comput 18, 283-328.
57. O'Reilly, R.C., Frank, M.J., Hazy, T.E., Watz, B. (2007). PVLV: the primary value and learned value pavlovian learning algorithm. Behav Neurosci 121, 31-49.
58. Pan, W.X., Schmidt, R., Wickens, J.R., Hyland, B.I. (2005). Dopamine cells respond to predicted events during classical conditioning: evidence for eligibility traces in the rewardlearning network. J Neurosci 25, 6235-6242.
59. Parent, A., Hazrati, L.N. (1995). Functional anatomy of the basal ganglia. I. The corticobasal ganglia-thalamo-cortical loop. Brain Res Brain Res Rev 20, 91-127.
60. Parker, A., Eacott, M.J., Gaffan, D. (1997). The recognition memory deficit caused by mediodorsal thalamic lesion in non-human primates: a comparison with rhinal cortex lesion. Eur J Neurosci 9, 2423-2431.
61. Partiot, A., Vrin, M., Pillon, B., Teixeira-Ferreira, C., Agid, Y., Dubois, B. (1996). Delayed response tasks in basal ganglia lesions in man: further evidence for a striato-frontal cooperation in behavioural adaptation. Neuropsychologia 34, 709-721.
62. Petrides, M. (2000). Dissociable roles of mid-dorsolateral prefrontal and anterior inferotemporal cortex in visual working memory. J Neurosci 20, 7496-7503.
63. Plenz, D., Aertsen, A. (1996). Neural dynamics in cortex-striatum co-cultures-i. anatomy and electrophysiology of neuronal cell types. Neuroscience 70, 861-891.
64. Ranganath, C. (2006). Working memory for visual objects: complementary roles of inferior temporal, medial temporal, and prefrontal cortex. Neurosci 139, 277-289.
65. Ranganath, C., D'Esposito, M. (2005). Directing the mind's eye: prefrontal, inferior and medial temporal mechanisms for visual working memory. Curr Opin Neurobiol 15, 175-182.
66. Redgrave, P., Gurney, K. (2006). The short-latency dopamine signal: a role in discovering novel actions? Nat Rev Neurosci 7, 967-975.
67. Reynolds, J.N., Wickens, J.R. (2000). Substantia nigra dopamine regulates synaptic plasticity and membrane potential fluctuations in the rat neostriatum, in vivo. Neuroscience 99, 199-203.
68. Rolls, E.T. (2000). Hippocampo-cortical and cortico-cortical backprojections. Hippocampus 10, 380-388.
69. Romanski, L.M. (2007). Representation and integration of auditory and visual stimuli in the primate ventral lateral prefrontal cortex. Cereb Cortex 17 Suppl 1, i61-i69.
70. Rougier, N.P. (2009). Implicit and explicit representations. Neural Netw 22, 155-160.
71. Rougier, N.P., Noelle, D.C., Braver, T.S., Cohen, J.D., O'Reilly, R.C. (2005). Prefrontal cortex and flexible cognitive control: rules without symbols. Proc Natl Acad Sci U S A 102, 7338-7343.
72. Rougier, N.P., Vitay, J. (2006). Emergence of attention within a neural population. Neural Netw 19, 573-581.
73. Sakai, K., Miyashita, Y. (1991). Neural organization for the long-term memory of paired associates. Nature 354, 152-155.
74. Schultz, W., Dayan, P., Montague, P.R. (1997). A neural substrate of prediction and reward. Science 275, 1593-1599.
75. Seger, C.A. (2008). How do the basal ganglia contribute to categorization? Their roles in generalization, response selection, and learning via feedback. Neurosci Biobehav Rev 32, 265-278.
76. Selemon, L.D., Goldman-Rakic, P.S. (1985). Longitudinal topography and interdigitation of corticostriatal projections in the rhesus monkey. J Neurosci 5, 776-794.
77. Suri, R.E., Schultz, W. (1999). A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task. Neuroscience 91, 871-90.
78. Suzuki, W.A., Miller, E.K., Desimone, R. (1997). Object and place memory in the macaque entorhinal cortex. J Neurophysiol 78, 1062-1081.
79. Takeda, M., Naya, Y., Fujimichi, R., Takeuchi, D., Miyashita, Y. (2005). Active maintenance of associative mnemonic signal in monkey inferior temporal cortex. Neuron 48, 839-848.
80. Tepper, J.M., Wilson, C.J., Kos, T. (2008). Feedforward and feedback inhibition in neostriatal GABAergic spiny neurons. Brain Res Rev 58, 272-281.
81. Tomita, H., Ohbayashi, M., Nakahara, K., Hasegawa, I., Miyashita, Y. (1999). Top-down signal from prefrontal cortex in executive control of memory retrieval. Nature 401, 699-703.
82. Turrigiano, G.G., Nelson, S.B. (2004). Homeostatic plasticity in the developing nervous system. Nat Rev Neurosci 5, 97-107.
83. Ungerleider, L.G., Mishkin, M. (1982). Two cortical visual systems. In Analysis of Visual Behavior, eds. D.J. Ingle, M.A. Goodale, R.J.W. Mansfield (Cambridge, MA: The MIT Press), 549-586.
84. Vitay, J., Hamker, F.H. (2008). Sustained activities and retrieval in a computational model of the perirhinal cortex. J Cogn Neurosci 20, 1993-2005.
85. Watanabe, Y., Funahashi, S. (2004). Neuronal activity throughout the primate mediodorsal nucleus of the thalamus during oculomotor delayed-responses. I. Cue-, delay-, and response-period activity. J Neurophysiol 92, 1738-1755.
86. Webster, M.J., Bachevalier, J., Ungerleider, L.G. (1994). Connections of inferior temporal areas TEO and TE with parietal and frontal cortex in macaque monkeys. Cereb Cortex 4, 470-483.
87. Wickens, J., Oorschot, D. (2000). Neuronal dynamics and surround inhibition in the neostriatum: a possible connection. In Brain Dynamics and the Striatal Complex, eds. R. Miller, J. Wickens (Australia: Harwood Academic Publishers), 141-150.
88. Woodman, G.F., Luck, S.J., Schall, J.D. (2007). The role of working memory representations in the control of attention. Cereb Cortex 17, 118-124.
89. Zheng, T., Wilson, C.J. (2002). Corticostriatal combinatorics: the implications of corticostriatal axonal arborizations. J Neurophysiol 87, 1007-1017.