On the storage capacity of nonlinear neural networks

Neural Networks

Volumn 10, Issue 4, 1997, Pages 593-597

  Mazza, Christian ^a,b  

^a Section de Mathématiques   (Switzerland)

^b UNIVERSITY OF GENEVA   (Switzerland)

Author keywords

Memory size; Neural networks; Nonlinear

Indexed keywords

HOPFIELD ASSOCIATIVE MEMORY; NONLINEAR NEURAL NETWORKS;

DATA STORAGE EQUIPMENT; FUNCTIONS; MATHEMATICAL MODELS; MATRIX ALGEBRA;

NEURAL NETWORKS;

ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; CALCULATION; MATHEMATICAL MODEL; MEMORY; PRIORITY JOURNAL;

EID: 0031171661     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0893-6080(97)00017-8     Document Type: Article

References (15)

1. Amit, D. J. (1992). Modeling brain function. The world of attractor neural networks. Cambridge: Cambridge University Press.
2. Billingsley, P. (1968). Convergence of probability measures. New York: Wiley.
3. Feller, W. (1971). An introduction to probability theory and its applications, Vols I and II. New York: Wiley.
4. Kamp, Y., & Hasler, M. (1990). Recursive neural networks for associative memory. New York: Wiley.
5. Hebb, D. (1949). The organization of behavior. New York: Wiley.
6. van Hemmen, J. L. (1987). Nonlinear neural networks near saturation. Physical Review A, 35, 1959-1962.
7. van Hemmen, J. L., & Kühn, R. ( 1991 ). Collective phenomena in neural networks. In E. Domany, J.L. van Hemmen & K. Schulten (Eds.), Models of neural networks (pp. 1-101). New York: Springer-Verlag.
8. Hopfield, J. (1982). Neural networks and physical systems with emergent collective computational abilities. Proceedings of the National Academy of Sciences, 79, 2554-2558.
9. Loukianova, D. (1994). Capacité de mëmoire dans le modèle de Hopfield. Comptes Rendus de l'Académie des Sciences de Paris, Série I, 318, 157-160.
10. Mazza, C. ( 1994). On the storage capacity of nonlinear neural networks. Institute for Mathematics and its Applications, Preprint Series (p. 1266). MN: University of Minnesota.
11. Mazza, C. (1996). Neural net inference and content addressable memory. IEEE Transactions on Neural Networks, to appear.
12. McEliece, R., Posner, E., Rodemich, E., & Venkatesh, S. (1987). The capacity of the Hopfield associative memory. IEEE Transactions on Information Theory. 33, 461-482.
13. Newman, C. (1988). Memory capacity in neural network models: rigorous lower bounds. Neural Networks, 1, 223-238.
14. Piret, P. (1990). Analysis of a modified Hebbian rule. IEEE Transactions on Information Theory, 36, 1391-1397.
15. Sompolinsky, H. (1986). Neural networks with nonlinear synapses and a static noise. Physical Review A, 34, 2571-2574.