Beyond Inverse Ising Model: Structure of the Analytical Solution

Journal of Statistical Physics

Volumn 150, Issue 4, 2013, Pages 658-670

  Mastromatteo, Iacopo ^a  

^a Capital Fund Management   (France)

Author keywords

Complex systems; Inverse Ising problem; Maximum entropy models; Statistical learning

Indexed keywords

EID: 84874239118     PISSN: 00224715     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10955-013-0707-y     Document Type: Article

References (34)

1. Ackley, D., Hinton, G., Sejnowski, T.: A learning algorithm for Boltzmann machines. Cogn. Sci. 9, 147 (1985).
2. Aurell, E., Ekeberg, M.: Inverse Ising inference using all the data. Phys. Rev. Lett. 108(9), 090201 (2012).
3. Aurell, E., Ollion, C., Roudi, Y.: Dynamics and performance of susceptibility propagation on synthetic data. Eur. Phys. J. B 77(4), 587-595 (2010).
4. Bailly-Bechet, M., Braunstein, A., Pagnani, A., Weigt, M., Zecchina, R.: Inference of sparse combinatorial-control networks from gene-expression data: a message passing approach. BMC Bioinform. 11(1), 355 (2010).
5. Braunstein, A., Pagnani, A., Weigt, M., Zecchina, R.: Inference algorithms for gene networks: a statistical mechanics analysis. J. Stat. Mech. 2008(12), P12001 (2008).
6. Cocco, S., Leibler, S., Monasson, R.: Neuronal couplings between retinal ganglion cells inferred by efficient inverse statistical physics methods. Proc. Natl. Acad. Sci. USA 106, 14058 (2009).
7. Cocco, S., Monasson, R.: Adaptive cluster expansion for inferring Boltzmann machines with noisy data. Phys. Rev. Lett. 106(9), 090601 (2011).
8. Cocco, S., Monasson, R.: Adaptive cluster expansion for the inverse Ising problem: convergence, algorithm and tests. J. Stat. Phys. 147(2), 252-314 (2012).
9. Cover, T., Thomas, J.: Elements of Information Theory, vol. 6. Wiley, New York (1991).
10. Gori, G., Trombettoni, A.: The inverse Ising problem for one-dimensional chains with arbitrary finite-range couplings. J. Stat. Mech. 2011, P10021 (2011).
11. Higuchi, S., Mézard, M.: 2009, Susceptibility propagation for constraint satisfaction problems. ArXiv preprint. http://arxiv. org/abs/0903. 1621v1.
12. Jaynes, E.: Information theory and statistical mechanics. Phys. Rev. 106(4), 620-630 (1957).
13. Jaynes, E.: Information theory and statistical mechanics. II. Phys. Rev. 108(2), 171 (1957).
14. Kappen, H., Rodriguez, F.: Efficient learning in Boltzmann machines using linear response theory. Neural Comput. 10, 1137-1156 (1998).
15. de Lachapelle, D., Challet, D.: Turnover, account value and diversification of real traders: evidence of collective portfolio optimizing behavior. New J. Phys. 12, 075039 (2010).
16. Lillo, F., Moro, E., Vaglica, G., Mantegna, N.: Specialization and herding behavior of trading firms in a financial market. New J. Phys. 10, 043019 (2008).
17. Marinari, E., van Kerrebroeck, V.: Intrinsic limitations of the susceptibility propagation inverse inference for the mean field Ising spin glass. J. Stat. Mech. 2010, P02008 (2010).
18. Mézard, M., Montanari, A.: Information, Physics and Computation. Oxford University Press, London (2009).
19. Mézard, M., Mora, T.: Constraint satisfaction problems and neural networks: a statistical physics perspective. J. Physiol. Paris 103, 107-113 (2009).
20. Moro, E., Vicente, J., Moyano, L., Gerig, A., Farmer, J. D., Vaglica, G., Lillo, F., Mantegna, N.: Market impact and trading profile of hidden orders in stock markets. Phys. Rev. E 80, 066102 (2009).
21. Nguyen, H., Berg, J.: Bethe-Peierls approximation and the inverse Ising problem. J. Stat. Mech. Theory Exp. 2012(03), P03, 004 (2012).
22. Ricci-Tersenghi, F.: The Bethe approximation for solving the inverse Ising problem: a comparison with other inference methods. J. Stat. Mech. 2012(08), P08015 (2012).
23. Roudi, Y., Aurell, E., Hertz, J.: Statistical physics of pairwise probability models. Front. Comput. Neurosci. 3(22), 1-15 (2009).
24. Roudi, Y., Hertz, J.: Mean field theory for nonequilibrium network reconstruction. Phys. Rev. Lett. 106(4), 048702 (2011).
25. Schneidman, E., Berry, M. II, Segev, R., Bialek, W.: Weak pairwise correlations imply strongly correlated network states in a neural population. Nature 440, 1007-1012 (2006).
26. Sessak, V., Monasson, R.: Small-correlation expansions for the inverse Ising problem. J. Phys. A, Math. Theor. 42, 055, 001 (2009).
27. Shlens, J., Field, G., Gauthier, J., Grivich, M., Petrusca, D., Sher, A., Litke, A., Chichilnisky, E.: The structure of multi-neuron firing patterns in primate retina. J. Neurosci. 26(32), 8254-8266 (2006).
28. Socolich, M., Lockless, S., Russ, W., Lee, H., Gardner, K., Ranganathan, R.: Evolutionary information for specifying a protein fold. Nature 437, 512-518 (2005).
29. Tanaka, T.: Mean field theory of Boltzmann machine learning. Phys. Rev. E 58, 2302 (1998).
30. Tarantola, A.: Inverse Problem Theory and Methods for Model Parameter Estimation. SIAM, Philadelphia (2005).
31. Wainwright, M., Jordan, M.: Graphical models, exponential families, and variational inference. Found. Trends Mach. Learn. 1(1-2), 1-305 (2008).
32. Wainwright, M., Ravikumar, P., Lafferty, J.: High-dimensional graphical model selection using ℓ1-regularized logistic regression. Adv. Neural Inf. 19, 1465-1472 (2006).
33. Weigt, M., White, R., Szurmant, H., Hoch, J., Hwa, T.: Identification of direct residue contacts in protein-protein interaction by message passing. Proc. Natl. Acad. Sci. USA 106, 67 (2009).
34. Welling, M., Teh, Y.: Approximate inference in Boltzmann machines. Artif. Intell. 143(1), 19-50 (2003).