A balanced memory network

PLoS Computational Biology

Volumn 3, Issue 9, 2007, Pages 1679-1700

  Roudi, Yasser ^a   Latham, Peter E ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

NEURAL NETWORKS;

ATTRACTOR NETWORKS; ATTRACTOR NEURAL NETWORKS; CANDIDATE MECHANISMS; MEAN FIELD ANALYSIS; MEMORY NETWORK; MOST LIKELY; NEURONAL NETWORKS; REALISTIC CONDITIONS; TIME-SCALES; WORKING MEMORY;

NEURONS;

ARTICLE; EXCITATION; INHIBITION KINETICS; MATHEMATICAL ANALYSIS; MEMORY; NERVE CELL NETWORK; PREDICTION; SIMULATION; WORKING MEMORY;

EID: 34848842793     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.0030141     Document Type: Article

References (73)

1. Miyashita Y, Chang HS (1988) Neuronal correlate of pictorial short-term memory in the primate temporal cortex. Nature 331: 68-70.
2. Sakai K, Miyashita Y (1991) Neural organization for the long-term memory of paired associates. Nature 354: 152-155.
3. Miyashita Y (1988) Neuronal correlate of visual associative long-term memory in the primate temporal cortex. Nature 335: 817-820.
4. Fuster JM, Alexander GE (1971) Neuron activity related to short-term memory. Science 173: 652-654.
5. Kubota K, Niki H (1971) Prefrontal cortical unit activity and delayed alternation performance in monkeys. J Neurophysiol 34: 337-347.
6. Funahashi S, Bruce CJ, Goldman-Rakic P (1989) Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. J Neurophysiol 61: 331-349.
7. Miller EK, Erickson CA, Desimone R (1996) Neural mechanisms of visual working memory in prefrontal cortex of the macaque. J Neurosci 16: 5154-5167.
8. Rainer G, Asaad WF, Miller EK (1998) Memory fields of neurons in the primate prefrontal cortex. Proc Nat Acad Sci U S A 95: 15008-15013.
9. Rao SC, Rainer G, Miller EK (1997) Integration of what and where in the primate prefrontal cortex. Science 276: 821-824.
10. Leutgeb JK, Leutgeb S, Treves A, Meyer R, Barnes CA, et al. (2005) Progressive transformation of hippocampal neuronal representations in "morphed" environments. Neuron 48: 345-358.
11. Wills T, Lever C, Cacucci F, Burgess N, O'Keefe J (2005) Attractor dynamics in the hippocampal representation of the local environment. Science 308: 873-876.
12. Hopfield JJ (1982) Neural networks and physical systems with emergent collective computational abilities. Proc Nat Acad Sci U S A 79: 2554-2558.
13. Amit DJ (1989) Modeling brain function. Cambridge: Cambridge University Press.
14. Amit DJ, Brunel N (1997) Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. Cereb Cortex 7: 237-252.
15. Nakamura K, Kubota K (1995) Mnemonic firing of neurons in the monkey temporal pole during a visual recognition memory task. J Neurophys 74: 162-178.
16. Sompolinsky H (1986) Neural networks with nonlinear synapses and a static noise. Phys Rev A 34: 2571-2574.
17. Burkitt AN (1996) Retrieval properties of attractor neural networks that obey dale's law using a self-consistent signal-to-noise analysis. Network: Comp Neur Sys 7: 517-531.
18. Amit DJ, Treves A (1989) Associative memory neural network with low temporal spiking rates. Proc Natl Acad Sci U S A 86: 7871-7875.
19. Treves A, Amit DJ (1989) Low firing rates: An effective hamiltonian for excitatory neurons. J Phys A: Math Gen 22: 2205-2226.
20. Rubin N, Sompolinsky H (1989) Neural networks with low local firing rates. Europhys Lett 10: 465-470.
21. Golomb D, Rubin N, Sompolinsky H (1990) Willshaw model: Associative memory with sparse coding and low firing rates. Phys Rev A 41: 1843-1854.
22. Brunel N (2000) Persistent activity and the single-cell frequency-current curve in a cortical network model. Network: Computa Neural Sys 11: 261-280.
23. Latham PE, Nirenberg S (2004) Computing and stability in cortical networks. Neural Comput 16: 1385-1412.
24. Compte A, Constantinidis C, Tegner J, Raghavachari S, Chafee MV, et al. (2003) Temporally irregular mnemonic persistent activity in prefrontal neurons of monkeys during a delayed response task. J Neurophysiol 90: 3441-3454.
25. van Vreeswijk C, Sompolinsky H (1996) Chaos in neuronal networks with balanced excitatory and inhibitory activity. Science 274: 1724-1726.
26. Ma W, Beck J, Latham P, Pouget A (2006) Bayesian inference with probabilistic population codes. Nat Neurosci 9: 1432-1438.
27. van Vreeswijk C, Sompolinsky H (2005) Irregular activity in large networks of neurons. In: Chow C, Gutkin B, Hansel D, Meunier C, Dalibard J, editors. Methods and models in neurophysics. Amsterdam: Elsevier.
28. Renart A, Moreno-Bote R, Wang XJ, Parga N (2006) Mean-driven and fluctuation-driven persistent activity in recurrent networks. Neural Comp 19: 1-46.
29. Brunel N, Wang X (2001) Effects of neuromodulation in a cortical network model of object working memory dominated by recurrent inhibition. J Comput Neurosci 11: 63-85.
30. Rolls ET, Tovee MJ (1995) Sparseness of the neuronal representation of stimuli in the primate temporal visual cortex. J Neurophys 73: 713-726.
31. Amit DJ, Gutfreund H, Sompolinsky H (1985) Storing infinite numbers of patterns in a spin-glass model of neural networks. Phys Rev Lett 55: 1530-1533.
32. Derrida B, Gardner E, Zippelius A (1987) An exactly solvable asymmetric neural network model. Europhys Lett 4: 167-173.
33. Tsodyks MV, Feigelman MV (1988) The enhanced storage capacity in neural networks with low activity level. Europhys Lett 6.
34. Treves A, Rolls ET (1991) What determines the capacity of autoassociative memories in the brain? Network: Comp Neural Syst 2: 371-397.
35. Treves A (1991) Dilution and sparse coding in threshold-linear nets. J Phys A: Math Gen 24: 327.
36. Curti E, Mongillo G, La Camera G, Amit DJ (2004) Mean field and capacity in realistic networks of spiking neurons storing sparsely coded random memories. Neural Comp 16: 2597-2637.
37. Buhmann J, Divko R, Schulten K (1989) Associative memory with high information content. Phys Rev A 39: 2689-2692.
38. Treves A (1990) Graded-response neurons and information encodings in autoassociative memories. Phys Rev A 42: 2418-2430.
39. Treves A (1993) Mean-field analysis of neuronal spike dynamics. Network 4: 259-284.
40. Shriki O, Hansel D, Sompolinsky H (2003) Rate models for conductance-based cortical neuronal networks. Neural Comput 15: 1809-1841.
41. Tuckwell H (1988) Introduction to theoretical neurobiology. Cambridge: Cambridge University Press.
42. Fourcaud N, Brunel N (2002) Dynamics of firing probability of noisy integrate-&-fire neurons. Neural Comput 14: 2057-2110.
43. Brunel N, Latham PE (2003) Firing rate of the noisy quadratic integrate- and-fire neuron. Neural Comput 15: 2281-2306.
44. Hertz J, Lerchner A, Ahmadi M (2004) Mean field methods for cortical network dynamics. In: Érdi P, Esposito A, Marinaro M, Scarpetta S, editors. Cortical dynamics. Lect Notes Comp Sci. Berlin/Heidelberg: Springer.
45. Turrigiano G, Leslie K, Desai N, Rutherford L, Nelson S (1998) Activity-dependent scaling of quantal amplitude in neocortical neurons. Nature 391: 892-896.
46. Desai N, Rutherford L, Turrigiano G (1999) Plasticity in the intrinsic excitability of cortical pyramidal neurons. Nat Neurosi 2: 515-520.
47. Braitenberg V, Schuz A (1998) Cortex: Statistics and geometry of neuronal connectivity. Berlin: Springer.
48. Shiino M, Fukai T (1992) Self-consistent signal-to-noise analysis and its application to analogue neural network with asymmetric connections. J Phys A: Math Gen 25: L375.
49. Shiino M, Fukai T (1993) Self-consistent signal-to-noise analysis of the statistical behavior of analog neural networks and enhancement of the storage capacity. Phys Rev E 48: 867-897.
50. Noda H, Adey R (1970) Firing variability in cat association cortex during sleep and wakefulness. Brain Res 18: 513-526.
51. Burns B, Webb A (1976) The spontaneous activity of neurones in the cat's cerebral cortex. Proc Royal Soc Lond B 194: 211-223.
52. Softky W, Koch C (1993) The highly irregular firing of cortical cells is inconsistent with temporal integration of random epsps. J Neurosci 13: 334-350.
53. Holt GR, Softky WR, Koch C, Douglas RJ (1996) Comparison of discharge variability in vitro and in vivo in cat visual cortex neurons. J Neurophysiol 75: 1806-1814.
54. van Vreeswijk C, Sompolinsky H (1998) Chaotic balanced state in a model of cortical circuits. Neural Comput 10: 1321-1371.
55. Shu Y, Hasenstaub A, McCormick DA (2003) Turning on and off recurrent balanced cortical activity. Nature 423: 288-293.
56. Haider B, Duque A, Hasenstaub AR, McCormick DA (2006) Neocortical network activity in vivo is generated through a dynamic balance of excitation and inhibition. J Neurosci 26: 4535-4545.
57. Lerchner A, Ahmadi M, Hertz J (2004) High-conductance states in a meanfield cortical network model. Neurocomputing 58-60: 935-940.
58. Latham PE, Richmond BJ, Nelson P, Nirenberg S (2000) Intrinsic dynamics in neuronal networks: I. Theory. J Neurophysiol 83: 808-827.
59. Lennie P (2003) The cost of cortical computation. Curr Biol 13: 493-497.
60. Dingledine R, Borges K, Bowie D, Traynelis S (1999) The glutamate receptor ion channels. Pharmacol Rev 51: 7-61.
61. Tsodyks M, Kenet T, Grinvald A, Arieli A (1999) Linking spontaneous activity of single cortical neurons and the underlying functional architecture. Science 286: 1943-1946.
62. Kenet T, Bibitchkov D, Tsodyks M, Grinvald A, Arieli A (2003) Spontaneously emerging cortical representations of visual attributes. Nature 425: 954-956.
63. Chen Y, Geisler W, Seidemann E (2006) Optimal decoding of correlated neural population responses in the primate visual cortex. Nat Neurosci 9: 1412-1420.
64. Fiser J, Chiu C, Weliky M (2004) Small modulation of ongoing cortical dynamics by sensory input during natural vision. Nature 431: 573-578.
65. Fuster JM, Jervey JP (1982) Neuronal firing in the inferotemporal cortex of the monkey in a visual memory task. J Neurosci 2: 361-437.
66. Monasson R (1993) Storage of spatially correlated patterns in autoassociative memories. J Phys I France 3: 1141-1152.
67. O'Kane C, Treves A (1992) Short- and long-range connections in associative memory. J Phys A: Math Gen 25: 5055-5069.
68. Levy N, Horn D, Ruppin E (1999) Associative memory in a multimodular network. Neual Comp 11: 1717-1737.
69. Kropff E, Treves A (2005) The storage capacity of potts models for semantic memory retrieval. J Stat Mech: Theo Exp 2: P08010.
70. Evans MR (1989) Random dilution in a neural network for biased patterns. J Phys A: Math Gen 22: 2103-2118.
71. Roudi Y, Treves A (2004) An associative network with spatially organized connectivity. J Stat Mech: Theo Exp 1: P070102.
72. Mehta ML (1991) Random matrices. New York: Academic Press.
73. Coolen ACC (2001) Statistical mechanics of recurrent neural networks ii: Dynamics. In: Moss F, Gielen S, editors. Handbook of biological physics. Amsterdam: Elsevier. pp. 597-662.