Information theoretical approach to the storage capacity of neural networks with binary weights

Physical Review E - Statistical Physics, Plasmas, Fluids, and Related Interdisciplinary Topics

Volumn 60, Issue 4, 1999, Pages 4576-4579

  Suyari, Hiroki ^a   Matsuba, Ikuo ^a  

^a CHIBA UNIVERSITY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL NEURAL NETWORK; BIOPHYSICS; STATISTICAL MODEL;

BIOPHYSICAL PHENOMENA; BIOPHYSICS; MODELS, STATISTICAL; NEURAL NETWORKS (COMPUTER);

EID: 0033215621     PISSN: 1063651X     EISSN: None     Source Type: Journal    
DOI: 10.1103/PhysRevE.60.4576     Document Type: Article

References (28)

1. D.J. Amit, Modeling Brain Function (Cambridge University Press, Cambridge, 1989).
2. J. Hertz, A. Krogh, and R.G. Palmer, Introduction to the Theory of Neural Computation (Addison-Wesley, Reading, PA 1991).
3. E. Domany, J.L. van Hemmen, and K. Schulten, Models of Neural Networks III (Springer, New York, 1995), Chap. 5.
4. T.L.H. Watkin, A. Rau, and M. Biehl, Rev. Mod. Phys. 65, 499 (1993).
5. E. Gardner, Europhys. Lett. 4, 481 (1987).
6. E. Gardner, J. Phys. A 21, 271 (1988).
7. E. Gardner and B. Derrida, J. Phys. A 21, 271 (1988).
8. W. Krauth and M. Opper, J. Phys. A 22, L519 (1989).
9. H. Gutfreund and D. Stein, J. Phys. A 23, 2613 (1990).
10. B. Derrida, R.B. Griffith, and A. Prügel-Bennett, J. Phys. A 24, 4907 (1991).
11. D. Haussler and A.R. Barron, in Proceedings of the Third NEC Symposium on Comp. and Cogni., edited by E. Baum (SIAM, Philadelphia, PA, 1993).
12. D. Haussler, M. Kearns, and R. Schapire, Machine Learning 14, 83 (1994).
13. S. Mertens and A. Engel, Phys. Rev. E 55, 4478 (1997).
14. M. Opper, Phys. Rev. E 51, 3613 (1995).
15. V. Vapnik and A. Chervonenkis, Theor. Probab. Appl. 16, 264 (1971).
16. V. Vapnik, Estimation of Dependences Based on Empirical Data (Springer-Verlag, Berlin, 1982).
17. E.B. Baum and D. Haussler, Neural Comput. 1, 151 (1989).
18. A. Blumer, A. Ehrenfeucht, D. Haussler, and M.K. Warmuth, J. Assoc. Comput. Mach. 36, 929 (1989).
19. D. Cohn and G. Tesauro, Neural Comput. 4, 249 (1992).
20. P.L. Bartlett, Neural Comput. 5, 371 (1993).
21. W. Maass, Neural Comput. 6, 877 (1994).
22. S. Floyd and M. Warmuth, Machine Learning 21, 269 (1995).
23. A. Sakurai, Theor. Comput. Sci. 137, 109 (1995).
24. P. Koiran and E.D. Sontag, Discrete Appl. Math. 86, 63 (1998).
25. F.J. MacWilliams and N.J.A. Sloane, The Theory of Error-Correcting Codes (North-Holland, Amsterdam, 1977), Chap. 17.
26. N. Sauer, J. Comb. Theory, Ser. A 13, 145 (1972).
27. W. Krauth and M. Mézard, J. Phys. (Paris), Colloq. 50, 3057 (1989).
28. H. Suyari and I. Matsuba (unpublished).