Generalization learning in a perceptron with binary synapses

Journal of Statistical Physics

Volumn 136, Issue 5, 2009, Pages 902-916

  Baldassi, Carlo ^a,b  

^a POLITECNICO DI TORINO   (Italy)

^b ISI FOUNDATION   (Italy)

Author keywords

Binary synapses; Generalization; Learning; Online; Perceptron; SBPI

Indexed keywords

EID: 70350425218     PISSN: 00224715     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10955-009-9822-1     Document Type: Article

References (20)

1. Baldassi, C., Braunstein, A., Brunel, N., Zecchina, R.: Efficient supervised learning in networks with binary synapses. Proc. Natl. Acad. Sci. USA 104, 2079-2084 (2007).
2. Bhalla, U.S., Iyengar, R.: Emergent properties of networks of biological signaling pathways. Science 283, 381-387 (1999).
3. Bialek, W.: Stability and noise in biochemical switches. Adv. Neural Inf. Process. Syst. 13, 103-109 (2000).
4. Blum, A.L., Rivest, R.L.: Training a 3-node network is np-complete. Neural Netw. 5, 117-127 (1992).
5. Braunstein, A., Zecchina, R.: Learning by message-passing in networks of discrete synapses. Phys. Rev. Lett. 96, 030,201 (2006).
6. Engel, A., van den Broeck, C.: Statistical Mechanics of Learning. Cambridge University Press, Cambridge (2001).
7. Fusi, S., Drew, P.J., Abbott, L.F.: Cascade models of synaptically stored memories. Neuron 45(4), 599-611 (2005).
8. Golea, M., Marchand, M.: On learning perceptrons with binary weights. Neural Comput. 78, 333-342 (1993).
9. Gutfreund, H., Stein, Y.: Capacity of neural networks with discrete synaptic couplings. J. Phys. A Math. Gen. 23, 2613-2630 (1990).
10. Hayer, A., Bhalla, U.S.: Molecular switches at the synapse emerge from receptor and kinase traffic. PLoS Comput. Biol. 1(2), e20 (2005).
11. Kabashima, Y., Uda, S.: A BP-based algorithm for performing Bayesian inference in large perceptron-type networks. In: Algorithmic Learning Theory. Lecture Notes in Computer Science, vol. 3244, pp. 479-493. Springer, Berlin (2004).
12. Kinouchi, O., Caticha, N.: Optimal generalization in perceptrons. J. Phys. A 25, 6243 (1992).
13. Krauth, W., Mézard, M.: Storage capacity of memory networks with binary couplings. J. Phys. 50, 3057 (1989).
14. Miller, P., Zhabotinsky, A.M., Lisman, J.E., Wang, X.J.: The stability of a stochastic camkii switch: dependence on the number of enzyme molecules and protein turnover. PLoS Biology 3(4), e107 (2005).
15. O'Connor, D.H., Wittenberg, G.M., Wang, S.S.H.: Graded bidirectional synaptic plasticity is composed of switch-like unitary events. Proc. Natl. Acad. Sci. USA 102, 9679-9684 (2005).
16. Petersen, C.C., Malenka, R.C., Nicoll, R.A., Hopfield, J.J.: All-or-none potentiation at CA3-CA1 synapses. Proc. Natl. Acad. Sci. USA 95, 4732-4737 (1998).
17. Rosenblatt, F.: Principles of Neurodynamics. Spartan Books, New York (1962).
18. Rosen-Zvi, M.: On-line learning in the ising perceptron. J. Phys. A 33, 7277-7287 (2000).
19. Solla, S.A., Winther, O.: Optimal perceptron learning: an online Bayesian approach. In: On-Line Learning in Neural Networks. Cambridge University Press, Cambridge (1998).
20. Yedidia, J.S., Freeman, W.T., Weiss, Y.: Understanding belief propagation and its generalizations. In: Exploring Artificial Intelligence in the New Millennium, pp. 236-239. Morgan Kaufman, San Mateo (2003). Chap. 8.