A Neural Circuit Model of Flexible Sensorimotor Mapping: Learning and Forgetting on Multiple Timescales

Neuron

Volumn 54, Issue 2, 2007, Pages 319-333

  Fusi, Stefano ^a,b   Asaad, Wael F ^c,d   Miller, Earl K ^c   Wang, Xiao Jing ^e  

^a Columbia University College of Physicians and Surgeons ^*  (United States)

^b UNIVERSITY OF ZURICH   (Switzerland)

^c MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^d MASSACHUSETTS GENERAL HOSPITAL   (United States)

^e YALE UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

SYSNEURO

Indexed keywords

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARTICLE; ASSOCIATION; BRAIN MAPPING; CONTROLLED STUDY; DECISION MAKING; MATHEMATICAL MODEL; MONKEY; NERVE CELL NETWORK; NEUROMODULATION; NONHUMAN; PRIORITY JOURNAL; SENSORIMOTOR INTEGRATION; SPIKE;

ALGORITHMS; ANIMALS; ASSOCIATION LEARNING; CUES; DECISION MAKING; HAPLORHINI; LEARNING; MEMORY; MENTAL RECALL; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); NEURONS; PREFRONTAL CORTEX; PSYCHOMOTOR PERFORMANCE; SYNAPSES;

EID: 34147179944     PISSN: 08966273     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuron.2007.03.017     Document Type: Article

References (47)

1. Amit D.J., and Fusi S. Learning in neural networks with material synapses. Neural Comput. 6 (1994) 957-982
2. Asaad W.F., Rainer G., and Miller E.K. Neural activity in the primate prefrontal cortex during associative learning. Neuron 21 (1998) 1399-1407
3. Asaad W.F., Rainer G., and Miller E.K. Task-specific neural activity in the primate prefrontal cortex. J. Neurophysiol. 84 (2000) 451-459
4. Boettiger A., Charlotte A., and D'Esposito M. Frontal networks for learning and executing arbitrary stimulus-response associations. J. Neurosci. 25 (2005) 2723-2732
5. Brasted P.J., and Wise S.P. Comparison of learning-related neuronal activity in the dorsal premotor cortex and striatum. Eur. J. Neurosci. 19 (2004) 721-740
6. Brunel N., and Wang X.J. Effects of neuromodulation in a cortical network model of object working memory dominated by recurrent inhibition. J. Comput. Neurosci. 11 (2001) 63-85
7. Chen L.L., and Wise S.P. Neuronal activity in the supplementary eye field during acquisition of conditional oculomotor associations. J. Neurophysiol. 73 (1995) 1101-1121
8. Chen L.L., and Wise S.P. Supplementary eye field contrasted with the frontal eye field during acquisition of conditional oculomotor associations. J. Neurophysiol. 73 (1995) 1122-1134
9. Chen L.L., and Wise S.P. Evolution of directional preferences in the supplementary eye field during acquisition of conditional oculomotor associations. J. Neurosci. 16 (1996) 3067-3081
10. Corrado G.S., Sugrue L.P., Seung H.S., and Newsome W.T. Linear-Nonlinear-Poisson models of primate choice dynamics. J. Exp. Anal. Behav. 84 (2006) 581-617
11. Daw N.D., Niv Y., and Dayan P. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 8 (2005) 1704-1711
12. Deco G., and Rolls E.T. Attention and working memory: a dynamical model of neuronal activity in the prefrontal cortex. Eur. J. Neurosci. 18 (2003) 2374-2390
13. Deco G., and Rolls E.T. Synaptic and spiking dynamics underlying reward reversal in the orbitofrontal cortex. Cereb. Cortex 15 (2005) 15-30
14. Fusi S. Hebbian spike-driven synaptic plasticity for learning patterns of mean firing rates. Biol. Cybern. 87 (2002) 459-470
15. Fusi S., Drew P.J., and Abbott L.F. Cascade models of synaptically stored memories. Neuron 45 (2005) 599-611
16. Herrnstein R.J. The Matching Law: Papers in Psychology and Economics. In: Rachlin H., and Laibson D.I. (Eds) (1997), Harvard University Press, Cambridge, MA
17. Huang Y.-Y., Simpson E., Kellendonk C., and Kandel E.R. Genetic evidence for the bidirectional modulation of synaptic plasticity in the prefrontal cortex by D1 receptors. Proc. Natl. Acad. Sci. USA 101 (2004) 3236-3241
18. Kennerley S.W., Walton M.E., Behrens T.E.J., Buckley M.J., and Rush-worth M.F.S. Optimal decision making and the anterior cingulate cortex. Nat. Neurosci. 9 (2006) 940-947
19. Loewenstein Y., and Seung H.S. Operant matching is a generic outcome of synaptic plasticity based on the covariance between reward and neural activity. Proc. Natl. Acad. Sci. USA 103 (2006) 15224-15229
20. Mansouri F.A., and Tanaka K. Behavioral evidence for working memory of sensory dimension in macaque monkeys. Behav. Brain Res. 136 (2002) 415-426
21. Matsumoto K., Suzuki W., and Tanaka K. Neuronal correlates of goal-based motor selection in the prefrontal cortex. Science 301 (2003) 229-232
22. Meyer P.L. Introductory Probability and Statistical Applications (1965), Addison-Wesley, Reading, MA
23. Murray E.A., Bussey T.J., and Wise S.P. Role of prefrontal cortex in a network for arbitrary visuomotor mapping. Exp. Brain Res. 133 (2000) 114-129
24. Otani S., Daniel H., Roisin M.-P., and Crepel F. Dopaminergic modulation of long-term synaptic plasticity in rat prefrontal neurons. Cereb. Cortex 13 (2003) 1251-1256
25. Parisi G. A memory which forgets. J. Phys. A Math. Gen. 19 (1986) L617-L620
26. Passingham R. The Frontal Lobes and Voluntary Action (1993), Oxford University Press, Oxford
27. Pasupathy A., and Miller E.K. Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature 433 (2005) 873-876
28. Petrides M. Motor conditional associative-learning after selective prefrontal lesions in the monkey. Behav. Brain Res. 5 (1982) 407-413
29. Petrides M. Deficits on conditional associative-learning tasks after frontal-and temporal-lobe lesions in man. Neuropsychologia 23 (1985) 601-614
30. Renart A., Song P., and Wang X.-J. Robust spatial working memory through homeostatic synaptic scaling in heterogeneous cortical networks. Neuron 38 (2003) 473-485
31. Reynolds J.N., Hyland B.I., and Wickens J.R. A cellular mechanism of reward-related learning. Nature 413 (2001) 67-70
32. Reynolds J.N.J., and Wickens J.R. Dopamine-dependent plasticity of corticostriatal synapses. Neural Netw. 15 (2002) 507-521
33. Salinas E. Context-dependent selection of visuomotor maps. BMC Neurosci. 5 (2004) 47
34. Schweighofer N., and Doya K. Meta-learning in reinforcement learning. Neural Netw. 16 (2003) 5-9
35. Soltani A., Lee D., and Wang X.-J. Neural mechanism for stochastic behaviour during a competitive game. Neural Netw. 19 (2006) 1075-1090
36. Soltani A., and Wang X.-J. A biophysically-based neural model of matching law behavior: melioration by stochastic synapses. J. Neurosci. 26 (2006) 3731-3744
37. Sugrue L.P., Corrado G.C., and Newsome W.T. Matching behavior and representation of value in parietal cortex. Science 304 (2004) 1782-1787
38. Sutton R., and Barto A. Reinforcement Learning: An Introduction (1998), MIT Press, Cambridge, MA
39. Tanaka S.C., Doya K., Okada G., Ueda K., Okamoto Y., and Yamawaki S. Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops. Nat. Neurosci. 7 (2004) 887-893
40. Turrigiano G.G. Homeostatic plasticity in neuronal networks: the more things change, the more they stay the same. Trends Neurosci. 22 (1999) 221-227
41. Wallis J.D., Anderson K.C., and Miller E.K. Single neurons in prefrontal cortex encode abstract rules. Nature 411 (2001) 953-956
42. Wang X.-J. Probabilistic decision making by slow reverberation in cortical circuits. Neuron 36 (2002) 955-968
43. White I.M., and Wise S.P. Rule-dependent neuronal activity in the prefrontal cortex. Exp. Brain Res. 126 (1999) 315-335
44. Williams R. Simple statistical gradient-following algorithms learning by stochastic hill climbing on discounted reward. Mach. Learn. 8 (1992) 229-256
45. Wirth S., Yanike M., Frank L.M., Smith A.C., Brown E.N., and Suzuki W.A. Single neurons in the monkey hippocampus and learning of new associations. Science 300 (2003) 1578-1581
46. Wixted J.T., and Ebbesen E.B. Genuine power curves in forgetting: a quantitative analysis of individual subject forgetting functions. Mem. Cognit. 25 (1997) 731-739
47. Yu A.J., and Dayan P. Uncertainty, neuromodulation, and attention. Neuron 46 (2005) 681-692