Adaptive cluster expansion for inferring Boltzmann machines with noisy data

Physical Review Letters

Volumn 106, Issue 9, 2011, Pages

  Cocco, S ^a,b   Monasson, R ^a,b  

^a INSTITUTE FOR ADVANCED STUDY   (United States)

^b LABORATOIRE DE PHYSIQUE STATISTIQUE   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE CLUSTERS; BINARY VARIABLES; BOLTZMANN MACHINES; LOW TEMPERATURE PHASE; NOISY DATA; PAIRWISE CORRELATION; SAMPLING NOISE;

ISING MODEL;

EID: 79952216403     PISSN: 00319007     EISSN: 10797114     Source Type: Journal    
DOI: 10.1103/PhysRevLett.106.090601     Document Type: Article

References (23)

1. E.T. Jaynes, Proc. IEEE 70, 939 (1982). IEEPAD 0018-9219 10.1109/PROC.1982.12425
2. E. Schneidman, M.J. Berry II, R. Segev, and W. Bialek, Nature (London) NATUAS 0028-0836 440, 1007 (2006); 10.1038/nature04701
3. G. Tkacik, E. Schneidman, M.J. Berry II, and W. Bialek, arXiv:q-bio/0611072.
4. O. Marre, S. El Boustani, Y. Frégnac, and A. Destexhe, Phys. Rev. Lett. 102, 138101 (2009); PRLTAO 0031-9007 10.1103/PhysRevLett.102.138101
5. Y. Roudi, J. Tyrcha, and J. Hertz, Phys. Rev. E PLEEE8 1539-3755 79, 051915 (2009). 10.1103/PhysRevE.79.051915
6. S. Cocco, S. Leibler, and R. Monasson, Proc. Natl. Acad. Sci. U.S.A. PNASA6 0027-8424 106, 14058 (2009). 10.1073/pnas.0906705106
7. D.H. Ackley, G.E. Hinton, and T.J. Sejnowski, Cogn. Sci. 9, 147 (1985). COGSD5 0364-0213 10.1207/s15516709cog0901-7
8. Advanced Mean Field Methods: Theory and Practice, edited by, M. Opper, and, D. Saad, (MIT Press, Cambridge, MA, 2001).
9. (Pubitemid 41149047)
10. M. Mézard and T. Mora, J. Physiol. (Paris) JHYSEM 0928-4257 103, 107 (2009); 10.1016/j.jphysparis.2009.05.013
11. E. Marinari and V. Van Kerrebroeck, J. Stat. Mech. 1742-5468 (2010) P02008. 10.1088/1742-5468/2010/02/P02008
12. P. Ravikumar, M.J. Wainwright, and J. Lafferty, Ann. Stat. 38, 1287 (2010). ASTSC7 0090-5364 10.1214/09-AOS691
13. J. Bento and A. Montanari, in Proceedings of the 23rd Annual Conference on Neural Information Processing Systems, Vancouver, 2009, edited by, Y. Bengio, http://books.nips.cc/papers/files/nips22/NIPS2009-0870.pdf.
14. R.H. Swendsen, Phys. Rev. Lett. 52, 1165 (1984). PRLTAO 0031-9007 10.1103/PhysRevLett.52.1165
15. See supplemental material at http://link.aps.org/supplemental/10.1103/ PhysRevLett.106.090601 for a brief description of the algorithm and the regularization.
16. T.M. Cover and J.A. Thomas, Elements of Information Theory (Wiley, New York, 2006).
17. L. Viana and A.J. Bray, J. Phys. C 18, 3037 (1985). JPSOAW 0022-3719 10.1088/0022-3719/18/15/013
18. A. Peyrache, Nat. Neurosci. NANEFN 1097-6256 12, 919 (2009). 10.1038/nn.2337
19. V. Sessak and R. Monasson, J. Phys. A JPHAC5 0305-4470 42, 055001 (2009). 10.1088/1751-8113/42/5/055001
20. A. d'Aspremont, O. Banerjee, and L. El Ghaoui, SIAM J. Matrix Anal. Appl. SJMAEL 0895-4798 30, 56 (2008). 10.1137/060670985
21. C. Borzi, G. Ord, and J.K. Percus, J. Stat. Phys. 46, 51 (1987). JSTPSB 0022-4715 10.1007/BF01010330
22. M. Fisher, J. Math. Phys. (N.Y.) JMAPAQ 0022-2488 5, 944 (1964). 10.1063/1.1704197
23. D. Zobin, Phys. Rev. B PRBMDO 0163-1829 18, 2387 (1978). 10.1103/PhysRevB.18.2387