Inhomogeneities in heteroassociative memories with linear learning rules

Neural Computation

Volumn 20, Issue 2, 2008, Pages 311-344

  Sterratt, David C ^a   Willshaw, David ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL; ARTICLE; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; CYTOLOGY; HIPPOCAMPUS; MEMORY; NERVE CELL; PHYSIOLOGY; STATISTICS; SYNAPSE; SYNAPTIC TRANSMISSION; ULTRASTRUCTURE;

ANIMALS; HIPPOCAMPUS; MEMORY; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); NEURONS; STOCHASTIC PROCESSES; SYNAPSES; SYNAPTIC TRANSMISSION;

EID: 38649129810     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/neco.2007.08-06-301     Document Type: Article

References (61)

1. Abraham, W. C., Logan, B., Greenwood, J. M., & Dragunow, M. (2002). Induction and experience-dependent consolidation of stable long-term potentiation lasting months in the hippocampus. J. Neurosci., 22(21), 9626-9634.
2. Amit, D. J., Gutfreund, H., & Sompolinsky, H. (1985). Storing infinite numbers of patterns in a spin-glass model of neural networks Phys. Rev. Lett., 55, 1530-1533.
3. Anderson, J. A. (1972). A simple neural network generating an interactive memory. Math. Biosci., 14, 197-220.
4. Anderson, R. B., & Tweney, R. D. (1997). Artifactual power curves in forgetting. Mem. Cognit., 25(5), 724-730.
5. Andrásfalvy, B. K., & Magee, J. C. (2001). Distance-dependent increase in AMPA receptor number in the dendrites of adult hippocampal CA1 pyramidal neurons. J. Neurosci., 21(23), 9151-9159.
6. Barnes, C. A., McNaughton, B. L., Mizumori, S. J. Y., Leonard, B. W., & Lin, L.-H. (1990). Comparison of spatial and temporal characteristics of neuronal activity in sequential stages of hippocampal processing. Prog. Brain Res., 83,287-300.
7. Bennett, M. R., Gibson, W. G., & Robinson, J. (1994). Dynamics of the CA3 pyramidal neuron autoassociative memory network in the hippocampus. Philos. Trans. R. Soc. Lond., B, Biol. Sci., 343(1304), 167-187.
8. Bolshakov, V. Y., Golan, H., Kandel, E. R., & Siegelbaum, S. A. (1997). Recruitment of new sites of synaptic transmission during the cAMP-dependent late phase of LTP at CA3-CA1 synapses in the hippocampus. Neuron, 19, 635-651.
9. Chechik, G., Meilijson, I., & Ruppin, E. (2001). Effective neuronal learning with ineffective Hebbian learning rules. Neural Comput., 13, 817-840.
10. Dayan, P., & Willshaw, D. J. (1991). Optimising synaptic learning rules in linear associative memories. Biol. Cybern., 65, 253-265.
11. Desai, N. S., Rutherford, L. C., & Turrigiano, G. G. (1999). Plasticity in the intrinsic excitability of cortical pyramidal neurons. Nat. Neurosci., 2, 515-520.
12. Destexhe, A., Rudolph, M., & Paré, D. (2003). The high-conductance state of neocortical neurons in vivo. Nat. Rev. Neurosci., 4, 739-751.
13. Forti, L., Bossi, M., Bergamaschi, A., Villa, A., & Malgaroli, A. (1997). Loose-patch recordings of single quanta at individual hippocampal synapses. Nature, 388, 874-878.
14. Fusi, S., Drew, P. J., & Abbott, L. F. (2005). Cascade models of synaptically stored memories. Neuron, 45, 599-611.
15. Geszti, T., & Pázmándi, F. (1987). Learning within bounds and dream sleep. J. Phys. A Math. Gen., 20, L1299-L1303.
16. 2+ channels in apical dendrites of rat CAl pyramidal neurons. J. NeurophysioL, 77(3), 1639-1643.
17. Gordon, M. B. (1987). Memory capacity of neural network learning within bounds. J. Phys. (Paris), 48, 2053-2058.
18. Graham, B. P. (2001). Pattern recognition in a compartmental model of a CAl pyramidal neuron. Netxvork Comp. Neural Syst., 12, 473-492.
19. Graham, B., & Willshaw, D. (1997). Capacity and information efficiency of the associative net. Network Comp. Neural Syst., 8,35-54.
20. Haberly, L. B., & Bower, J. M. (1989). Olfactory cortex: Model circuit for study of associative memory? Trends Neurosci., 22(7), 258-264.
21. Henson, R., & Willshaw, D. J. (1995). Short-term associative memory. In Proceedings of the INNS World Congress on Neural Networks, 1995. Washington, DC: INNS Press.
22. Hertz, J. A., Krogh, A. S., & Palmer, R. G. (1991). Introduction to the theory of neural computation. Reading, MA: Addison-Wesley.
23. Hessler, N. A., Shirke, A. M., & Malinow, R. (1993). The probability of transmitter release at a mammalian central synapse. Nature, 366, 569-572.
24. Hopfield, J. J. (1982). Neural networks and physical systems with emergent collective computational abilities. Proc. Natl. Acad. Sci. U.S.A., 79, 2554-2558.
25. Huerta, R., Nowotny, T., García-Sanchez, M., Abarbanel, H. D., & Rabinovich, M. I. (2004). Learning classification in the olfactory system of insects. Neural Comput., 16(8), 1601-1640.
26. Kohonen, T. (1972). Correlation matrix memories. IEEE Trans. Comput., C-27, 353-359.
27. Laurent, G., & Naraghi, M. (1994). Odorant-induced oscillations in the mushroom bodies of the locust. J. Neurosci., 14, 2993-3004.
28. Leutgeb, S., Leutgeb, J. K., Treves, A., Moser, M.-B., & Moser, E. I. (2004). Distinct ensemble codes in hippocampal areas CA3 and CAl. Science, 305(5688), 1295-1298.
29. Levy, W. B. (1989). A computational approach to hippocampal function. In R. D. Hawkins & G. H. Bower (Eds.), Computational models of learning in simple neural systems (pp. 243-305). San Diego, CA: Academic Press.
30. + channels amplify EPSPs in hippocampal CAl pyramidal cells. J. Neurophysiol., 76(4), 2181-2191.
31. Lisman, J. E. (1997). Bursts as a unit of neural information: Making unreliable synapses reliable. Trends Neurosci., 20, 38-43.
32. London, M., & Segev, I. (2001). Synaptic scaling in vitro and in vivo. Nat. Neurosci., 4(9), 853-854.
33. Lynch, G. S., Dunwiddie, T., & Gribkoff, V. (1977). Heterosynaptic depression: A postsynaptic correlate of long-term depression. Nature, 266, 737-739.
34. Magee, J. C., & Cook, E. P. (2000). Somatic EPSP amplitude is independent of synapse location in hippocampal pyramidal neurons. Nat. Neurosci., 3, 895-903.
35. Magee, J. C., & Cook, E. P. (2001). Reply to "Synaptic scaling in vitro and in vivo." Nat. NeuroscL, 4(9), 854-855.
36. Magee, J. C., & Johnston, D. (1995). Synaptic activation of voltage-activated channels in the dendrites of hippocampal pyramidal neurons. Science, 268, 301-304.
37. McNaughton, B. L., & Morris, R. G. M. (1987). Hippocampal synaptic enhancement and information storage within a distributed memory system. Trends Neurosci., 20(10), 408-415.
38. Megfas, M., Emri, Z., Freund, T. F., & Gulyás, A. I. (2001). Total number and distribution of inhibitory and excitatory synapses on hippocampal CAl pyramidal cells. Neuroscience, 202(3), 527-540.
39. Mézard, M., Nadal, J. P., & Toulouse, G. (1986). Solvable models of working memories. J. Phys. (Paris), 47, 1457-1462.
40. Nadal, J. P., Toulouse, G., Changeux, J. P., & Dehaene, S. (1986). Networks of formal neurons and memory palimpsests. Europhys. Lett., 1, 535-542.
41. Palm, G. (1988). On the asymptotic information storage capacity of neural networks. In R. Eckmiller & C. von der Malsburg (Eds.), Neural computers (pp. 271-280). New York: Springer-Verlag.
42. Palm, G., & Sommer, F. T. (1996). Associative data storage and retrieval in neural networks. In E. Domany, J. L. van Hemmen, & K. Shulten (Eds.), Models of neural networks 111: Association, generalization and representation (pp. 79-118). New York: Springer-Verlag.
43. Parisi, G. (1986). A memory which forgets. J. Phys. A Math. Gen., 19, L617-L620.
44. Racine, R. J., Milgram, N. W., & Hafner, S. (1983). Long-term potentiation phenomena in the rat limbic forebrain. Brain Res., 260, 217-231.
45. Rall, W. (1964). Theoretical significance of dendritic trees for neuronal input-output relations. In I. Segev, J. Rinzel, & G. M. Shepherd (Eds.). (1995). The theoretical foundation of dendritic function: Selected papers of Wilfrid Rail with commentaries. Cambridge, MA: MIT Press.
46. Rudolph, M., & Destexhe, A. (2003). A fast-conducting, stochastic integrative mode for neocortical neurons in vivo. J. Neurosci., 23(6), 2466-2476.
47. Sanes, J. R., & Lichtman, J. W. (1999). Can molecules explain long-term potentiation? Nat. Neurosci., 2, 597-604.
48. Sejnowski, T. J. (1977a). Statistical constraints on synaptic plasticity. J. Theor. Biol., 69, 385-389.
49. Sejnowski, T. J. (1977b). Storing covariance with nonlinearly interacting neurons. J. Math. Biol., 4, 303-321.
50. Shors, T. J., Seib, T. B., Levine, S., & Thompson, R. F. (1989). Inescapable versus escapable shock modulates long-term potentiation in the rat hippocampus. Science, 244, 224-226.
51. Stevens, C. F., & Wang, Y (1994). Changes in reliability of synaptic function as a mechanism for plasticity. Nature, 371, 704-707.
52. Strieker, C., Field, A. C., & Redman, S. J. (1996). Statistical analysis of amplitude fluctuations in EPSCs evoked in rat CAl pyramidal neurons in vitro. J. Physiol., 490(2), 419-441.
53. Treves, A., & Rolls, E. T. (1994). Computational analysis of the role of the hippocampus in memory. Hippocampus, 4(3), 374-391.
54. Turrigiano, C. G., Leslie, K. R., Desai, N. S., Rutherford, L. C., & Nelson, S. B. (1998). Activity-dependent scaling of quantal amplitude in neocortical neurons. Nature, 392, 892-896.
55. van Hemmen, J. L., Keller, G., & Kühn, R. (1988). Forgetful memories. Europhys. Lett., 5(7), 663-668.
56. van Hemmen, J. L., & Zagrebnov, V. A. (1987). Storing extensively many weighted patterns in a saturated neural network. J. Phys. A Math. Gen., 20, 3989-3999.
57. Willshaw, D. (1971). Models of distributed associative memory. Unpublished doctoral dissertation, University of Edinburgh.
58. Willshaw, D. J., Buneman, O. P., & Longuet-Higgins, H. C. (1969). Non-holographic associative memory. Nature, 222, 960-962.
59. Willshaw, D. J., & Dayan, P. (1990). Optimal plasticity in matrix memories: What goes up must come down. Neural Comput., 2, 85-93.
60. Wixted, J. T., & Ebbesen, E. B. (1997). Genuine power curves in forgetting: A quantitative analysis of individual subject forgetting functions. Mem. Cognit., 25(5), 731-739.
61. Xu, L., Anwyl, R., & Rowan, M. J. (1997). Behavioural stress facilitates the induction of long-term depression in the hippocampus. Nature, 387, 497-500.