Message passing algorithms for the Hopfield network reconstruction: Threshold behavior and limitation

Physical Review E - Statistical, Nonlinear, and Soft Matter Physics

Volumn 82, Issue 5, 2010, Pages

  Huang, Haiping ^a  

^a INSTITUTE OF THEORETICAL PHYSICS   (China)

Author keywords

[No Author keywords available]

Indexed keywords

ABSOLUTE VALUES; HOPFIELD NETWORKS; ISING PROBLEM; ITERATIVE ALGORITHM; LOW TEMPERATURES; MEAN-FIELD; MESSAGE PASSING ALGORITHM; NETWORK SIZE; PROPAGATION ALGORITHM; THRESHOLD BEHAVIOR; TYPE METHODS;

MESSAGE PASSING;

ALGORITHMS;

EID: 78651378935     PISSN: 15393755     EISSN: 15502376     Source Type: Journal    
DOI: 10.1103/PhysRevE.82.056111     Document Type: Article

References (43)

1. M. Mézard, G. Parisi, and R. Zecchina, Science 297, 812 (2002). 10.1126/science.1073287
2. A. Braunstein and R. Zecchina, Phys. Rev. Lett. 96, 030201 (2006). 10.1103/PhysRevLett.96.030201
3. T. J. Richardson and R. L. Urbanke, IEEE Trans. Inf. Theory 47, 599 (2001). 10.1109/18.910577
4. H. Huang and H. Zhou, Phys. Rev. E 80, 056113 (2009). 10.1103/PhysRevE.80.056113
5. M. Mézard and T. Mora, J. Physiol. Paris 103, 107 (2009). 10.1016/j.jphysparis.2009.05.013
6. E. Aurell, C. Ollion, and Y. Roudi, e-print arXiv:1005.3694, Eur. Phys. J. B (to be published).
7. E. Marinari and V. V. Kerrebroeck, J. Stat. Mech.: Theory Exp. 2010, P02008. 10.1088/1742-5468/2010/02/P02008
8. J. Shlens, G. D. Field, J. L. Gauthier, M. I. Grivich, D. Petrusca, A. Sher, A. M. Litke, and E. J. Chichilnisky, J. Neurosci. 26, 8254 (2006). 10.1523/JNEUROSCI.1282-06.2006
9. J. W. Pillow, J. Shlens, L. Paninski, A. Sher, A. M. Litke, E. J. Chichilnisky, and E. P. Simoncelli, Nature (London) 454, 995 (2008). 10.1038/nature07140
10. J. Shlens, G. D. Field, J. L. Gauthier, M. Greschner, A. Sher, A. M. Litke, and E. J. Chichilnisky, J. Neurosci. 29, 5022 (2009). 10.1523/JNEUROSCI.5187-08.2009
11. A. Tang, J. Neurosci. 28, 505 (2008). 10.1523/JNEUROSCI.3359-07.2008
12. I. E. Ohiorhenuan, F. Mechler, K. P. Purpura, A. M. Schmid, Q. Hu, and J. D. Victor, Nature (London) 466, 617 (2010). 10.1038/nature09178
13. T. R. Lezon, J. R. Banavar, M. Cieplak, A. Maritan, and N. V. Fedoroff, Proc. Natl. Acad. Sci. U.S.A. 103, 19033 (2006). 10.1073/pnas.0609152103
14. F. Seno, A. Trovato, J. R. Banavar, and A. Maritan, Phys. Rev. Lett. 100, 078102 (2008). 10.1103/PhysRevLett.100.078102
15. T. Mora, A. M. Walczak, W. Bialek, and J. C. G. Callan, Proc. Natl. Acad. Sci. U.S.A. 107, 5405 (2010). 10.1073/pnas.1001705107
16. E. Schneidman, M. J. Berry, R. Segev, and W. Bialek, Nature (London) 440, 1007 (2006). 10.1038/nature04701
17. G. Tkacik, E. Schneidman, M. Berry, and W. Bialek, e-print arXiv:0912.5409.
18. S. Cocco, S. Leibler, and R. Monasson, Proc. Natl. Acad. Sci. U.S.A. 106, 14058 (2009). 10.1073/pnas.0906705106
19. M. Weigt, R. A. White, H. Szurmant, J. A. Hoch, and T. Hwa, Proc. Natl. Acad. Sci. U.S.A. 106, 67 (2009). 10.1073/pnas.0805923106
20. Y. Roudi, E. Aurell, and J. Hertz, Front. Comput. Neurosci 3, 1 (2009). 10.3389/neuro.10.022.2009
21. D. H. Ackley, G. E. Hinton, and T. J. Sejnowski, Cogn. Sci. 9, 147 (1985). 10.1207/s15516709cog0901-7
22. G. E. Hinton and T. J. Sejnowski, in Parallel Distributed Processing: Explorations in the Microstructure of Cognition, edited by, D. E. Rumelhart,,, J. L. McClelland,, and PDP Research Group (MIT Press, Cambridge, 1986), Vol. 1, pp. 282-317.
23. J. Hertz, A. Krogh, and R. G. Palmer, Introduction to the Theory of Neural Computation (Addison-Wesley, Redwood City, 1991).
24. F. R. Kschischang, B. J. Frey, and H.-A. Loeliger, IEEE Trans. Inf. Theory 47, 498 (2001). 10.1109/18.910572
25. S. Higuchi and M. Mézard, J. Phys.: Conf. Ser. 233, 012003 (2010). 10.1088/1742-6596/233/1/012003
26. H. Huang, Phys. Rev. E 81, 036104 (2010). 10.1103/PhysRevE.81.036104
27. Y. Roudi, J. Tyrcha, and J. Hertz, Phys. Rev. E 79, 051915 (2009). 10.1103/PhysRevE.79.051915
28. P. Zhang, A. Ramezanpour, and R. Zecchina (unpublished).
29. J. J. Hopfield, Proc. Natl. Acad. Sci. U.S.A. 79, 2554 (1982). 10.1073/pnas.79.8.2554
30. D. J. Amit, Modeling Brain Function: The World of Attractor Neural Networks (Cambridge University Press, Cambridge, 1989).
31. D. J. Amit, H. Gutfreund, and H. Sompolinsky, Phys. Rev. Lett. 55, 1530 (1985). 10.1103/PhysRevLett.55.1530
32. D. J. Amit, H. Gutfreund, and H. Sompolinsky, Phys. Rev. A 32, 1007 (1985). 10.1103/PhysRevA.32.1007
33. K. Tokita, J. Phys. A 26, 6915 (1993). 10.1088/0305-4470/26/23/032
34. B. Wemmenhove and A. C. C. Coolen, J. Phys. A 36, 9617 (2003). 10.1088/0305-4470/36/37/302
35. I. P. Castillo and N. S. Skantzos, J. Phys. A 37, 9087 (2004). 10.1088/0305-4470/37/39/003
36. T. L. H. Watkin and D. Sherrington, Europhys. Lett. 14, 791 (1991). 10.1209/0295-5075/14/8/012
37. A. Canning and J. P. Naef, J. Phys. I 2, 1791 (1992). 10.1051/jp1:1992245
38. L. Zdeborová, Acta Phys. Slov. 59, 169 (2009).
39. L. Zdeborová and M. Mézard, Phys. Rev. Lett. 101, 078702 (2008). 10.1103/PhysRevLett.101.078702
40. O. Rivoire, G. Biroli, O. C. Martin, and M. Mézard, Eur. Phys. J. B 37, 55 (2004). 10.1140/epjb/e2004-00030-4
41. B. Wemmenhove and H. J. Kappen, J. Phys. A 39, 1265 (2006). 10.1088/0305-4470/39/6/004
42. V. Sessak and R. Monasson, J. Phys. A 42, 055001 (2009). 10.1088/1751-8113/42/5/055001
43. M. Mézard, G. Parisi, and M. A. Virasoro, Spin Glass Theory and Beyond (World Scientific, Singapore, 1987).