Attractor concretion as a mechanism for the formation of context representations

NeuroImage

Volumn 52, Issue 3, 2010, Pages 833-847

  Rigotti, Mattia ^a,b   Ben Dayan Rubin, Daniel ^a,b   Morrison, Sara E ^a   Salzman, C Daniel ^a,c,d   Fusi, Stefano ^a,b  

^a New York Presbyterian Columbia University Medical Center   (United States)

^b Institute of Neuroinformatics Zurich   (Switzerland)

^c Department of Medicine   (United States)

^d NEW YORK STATE PSYCHIATRIC INSTITUTE   (United States)

Author keywords

Computational methods; Reinforcement learning

Indexed keywords

AMYGDALOID NUCLEUS; ARTICLE; ARTIFICIAL NEURAL NETWORK; BRAIN FUNCTION; BRAIN NERVE CELL; LEARNING ALGORITHM; MEMORY CONSOLIDATION; MENTAL FUNCTION; ORBITAL CORTEX; PRIORITY JOURNAL; REINFORCEMENT; REWARD; STATISTICAL MODEL; ANIMAL; BIOLOGICAL MODEL; BRAIN; COGNITION; HUMAN; LEARNING; NERVE CELL; PHYSIOLOGY;

ANIMALS; BRAIN; COGNITION; HUMANS; LEARNING; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); NEURONS; REINFORCEMENT (PSYCHOLOGY);

EID: 77954383122     PISSN: 10538119     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2010.01.047     Document Type: Article

References (46)

1. Amit D.J. Modeling Brain Function 1989, Cambridge Univ. Press.
2. Amit D., Brunel N. Learning internal representations in an attractor neural network with analogue neurons. Network: Comput. Neural Syst. 1995, 6(3):359-388.
3. Asaad W.F., Rainer G., Miller E.K. Neural activity in the primate prefrontal cortex during associative learning. Neuron 1998, 21(6):1399-1407.
4. Belova M.A., Paton J.J., Morrison S.E., Salzman C.D. Expectation modulates neural responses to pleasant and aversive stimuli in primate amygdala. Neuron 2007, 55(6):970-984.
5. Belova M.A., Paton J.J., Salzman C.D. Moment-to-moment tracking of state value in the amygdala. J. Neurosci. 2008, 28(40):10023-10030.
6. Brader J.M., Senn W., Fusi S. Learning real-world stimuli in a neural network with spike-driven synaptic dynamics. Neural Comput. 2007, 19(11):2881-2912.
7. Brunel N. Hebbian learning of context in recurrent neural networks. Neural Comput. 1996, 8(8):1677-1710.
8. Dasgupta S., Gupta A. An elementary proof of the Johnson-Lindenstrauss lemma. Random Struct. Algorithms 2002, 22:60-65.
9. Dayan P. Bilinearity, rules, and prefrontal cortex. Front. Comput. Neurosci. 2007, 1:1.
10. Deco G., Rolls E.T. Synaptic and spiking dynamics underlying reward reversal in the orbitofrontal cortex. Cereb. Cortex 2005, 15(1):15-30.
11. Weinan E., Li T., Vanden-Eijnden E. Optimal partition and effective dynamics of complex networks. Proc. Natl. Acad. Sci. U. S. A. 2008, 105:7907-7912.
12. Fusi S., Asaad W.F., Miller E.K., Wang X.J. A neural circuit model of flexible sensorimotor mapping: learning and forgetting on multiple timescales. Neuron 2007, 54(2):319-333.
13. Gardner E. Maximum storage capacity in neural networks. Europhys. Lett. 1987, 4:481-485.
14. Genovesio A., Brasted P.J., Mitz A.R., Wise S.P. Prefrontal cortex activity related to abstract response strategies. Neuron 2005, 47(2):307-320.
15. Griniasty M., Tsodyks M.V., Amit D.J. Conversion of temporal correlations between stimuli to spatial correlations between attractors. Neural. Comput. 1993, 5:1-17.
16. Hopfield J.J. Neural networks and physical systems with emergent collective computational abilities. Proc. Natl. Acad. Sci. U. S. A. 1982, 79(8):2554-2558.
17. Kaelbling L., Littman M., Cassandra A. Planning and acting in partially observable stochastic domains. Artif. Intell. J. 1998, 101:99-134.
18. Krauth W., Nadal J.P., Mézard M. The roles of stability and symmetry in the dynamics of neural networks. J. Phys. A:. Math. Gen. 1988, 21:2995-3011.
19. Li N., DiCarlo J.J. Unsupervised natural experience rapidly alters invariant object representation in visual cortex. Science 2008, 321(5895):1502-1507.
20. Loh M., Deco G. Cognitive flexibility and decision-making in a model of conditional visuomotor associations. Eur. J. Neurosci. 2005, 22:2927-2936.
21. Mansouri F.A., Matsumoto K., Tanaka K. Prefrontal cell activities related to monkeys' success and failure in adapting to rule changes in a Wisconsin card sorting test analog. J. Neurosci. 2006, 26(10):2745-2756.
22. Mansouri F.A., Buckley M.J., Tanaka K. Mnemonic function of the dorsolateral prefrontal cortex in conflict-induced behavioral adjustment. Science 2007, 318(5852):987-990.
23. Minsky M.L., Papert S. Perceptrons 1969.
24. Miyashita Y., Chang H.S. Neuronal correlate of pictorial short-term memory in the primate temporal cortex. Nature 1988, 331(6151):68-70.
25. Mongillo G., Barak O., Tsodyks M. Synaptic theory of working memory. Science 2008, 319(5869):1543-1546.
26. Morrison S., Salzman C.D. The convergence of information about rewarding and aversive stimuli in single neurons. J. Neurosci. 2009, 29(37):11471-11483.
27. O'Reilly R., Munakata Y. Computational explorations in cognitive neuroscience: Understanding the mind by simulating the brain 2000, The MIT Press.
28. O'Reilly R.C., Frank M.J. Making working memory work: a computational model of learning in the prefrontal cortex and basal ganglia. Neural Comput. 2006, 18(2):283-328.
29. Pasupathy A., Miller E.K. Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature 2005, 433(7028):873-876.
30. Paton J.J., Belova M.A., Morrison S.E., Salzman C.D. The primate amygdala represents the positive and negative value of visual stimuli during learning. Nature 2006, 439(7078):865-870.
31. Rabiner L.R. A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE 1989, 77(2):257-286.
32. Rigotti M., Ben Dayan Rubin D., Wang X.J., Fusi S. Mixed neuronal selectivity is important in recurrent neural networks implementing context dependent tasks. Society for Neuroscience Annual Meeting (Washington, DC, Society for Neuroscience) 2008, 929.3/TT11.
33. Rigotti, M., Ben Dayan Rubin, D., Wang, X.J., and Fusi, S., (submitted for publication). Internal representation of task rules by recurrent dynamics: the importance of the diversity of neural responses. Submitted to Nature Neuroscience.
34. Rolls E.T., Milward T. A model of invariant object recognition in the visual system: learning rules, activation functions, lateral inhibition, and information-based performance measures. Neural Comput. 2000, 12(11):2547-2572.
35. Rosenblatt, F., 1958. The perceptron: A probabilistic model for information storage and organization in the brain, volume 65.
36. Rosenthal O., Fusi S., Hochstein S. Forming classes by stimulus frequency: behavior and theory. Proc. Natl. Acad. Sci. U. S. A. 2001, 98(7):4265-4270.
37. Rougier N.P., Noelle D.C., Braver T.S., Cohen J.D., O'Reilly R.C. Prefrontal cortex and flexible cognitive control: rules without symbols. Proc. Natl. Acad. Sci. U. S. A. 2005, 102(20):7338-7343.
38. Salzman, C.D. and Fusi, S., (in press). Emotion, cognition and mental state representation in amygdala and prefrontal cortex. Annual Review of Neuroscience.
39. Salzman C.D., Paton J.J., Belova M.A., Morrison S.E. Flexible neural representations of value in the primate brain. Ann. N. Y. Acad. Sci. 2007, 1121:336-354.
40. Senn W., Fusi S. Learning only when necessary: better memories of correlated patterns in networks with bounded synapses. Neural Comput. 2005, 17(10):2106-2138.
41. Soltani A., Wang X.J. A biophysically based neural model of matching law behavior: melioration by stochastic synapses. J. Neurosci. 2006, 26(14):3731-3744.
42. Sompolinsky H., Kanter I. Temporal association in asymmetric neural networks. Phys. Rev. Lett. 1986, 57(22):2861-2864.
43. Sutton R., Barto A. Introduction to reinforcement learning 1998, MIT Press Cambridge, MA, USA.
44. Wallis J.D., Anderson K.C., Miller E.K. Single neurons in prefrontal cortex encode abstract rules. Nature 2001, 411(6840):953-956.
45. Wang X.J. Probabilistic decision making by slow reverberation in cortical circuits. Neuron 2002, 36(5):955-968.
46. Yakovlev V., Fusi S., Berman E., Zohary E. Inter-trial neuronal activity in inferior temporal cortex: a putative vehicle to generate long-term visual associations. Nat. Neurosci. 1998, 1(4):310-317.