Statistical physics of pairwise probability models

Frontiers in Computational Neuroscience

Volumn 3, Issue NOV, 2009, Pages

  Roudi, Yasser ^a   Aurell, Erik ^b,c   Hertz, John A ^a,d  

^a NORDITA   (Denmark)

^b ALBANOVA UNIVERSITY CENTER   (Sweden)

^c ROYAL INSTITUTE OF TECHNOLOGY   (Sweden)

^d UNIVERSITY OF COPENHAGEN   (Denmark)

Author keywords

Inference; Inverse ising problem; Maximum entropy distribution; Pairwise model

Indexed keywords

APPROXIMATE METHODS; CORTICAL NETWORK; DIMENSIONAL REDUCTION; INFERENCE; ISING PROBLEM; MAXIMUM ENTROPY DISTRIBUTION; PAIRWISE PROBABILITIES; STATISTICAL PHYSICS;

BIOLOGICAL SYSTEMS; INVERSE PROBLEMS; PHYSICS; PROBABILITY DISTRIBUTIONS;

COMPUTER SIMULATION;

EID: 77949406582     PISSN: 16625188     EISSN: None     Source Type: Journal    
DOI: 10.3389/neuro.10.022.2009     Document Type: Article

References (33)

1. Bethge, M., and Berens, P. (2008). Near-maximum entropy models for binary neural representations of natural images. In Advances in Neural Information Processing Systems, Vol. 20, J. Platt, D. Koller, Y. Singer and S Roweis, eds (Cambridge, MA, MIT Press), pp. 97-104.
2. Broderick, T., Dudik, M., Tkacik, G., Schapire, R. E., and Bialek, W. (2007). Faster solutions of the inverse pairwise ising problem. arXiv:07122437v2 [q-bioQM].
3. Crisanti, A., and Sompolinsky, H. (1988). Dynamics of spin systems with randomly asymmetric bonds: ising spins and Glauber dynamics. Phys. Rev. A 37, 4865-4874.
4. Ginzburg, I., and Sompolinsky, H. (1994). Theory of correlations in stochastic neural networks. Phys. Rev. E 50, 3171-3191.
5. Glauber, R. J. (1963). Time-dependent statistics of the ising model. J. Math. Phys. 4, 294-307.
6. Hinton, G. E. (2007). Boltzmann machine. Scholarpedia 2, 1668.
7. Hinton, G. E., and Sejnowski, T. J. (1983). Analyzing cooperative computation. In Proceedings of the 5th Annual Congress of the Cognitive Science Society, Rochester, NY.
8. Jordan, M. I. (1998). Learning in Graphical Models. Norwell, MA, Kluwer Academic Publishers.
9. Kappen, H. J., and Rodriguez, F. B. (1998). Efficient learning in Boltzmann machines using linear response theory. Neural Comput. 10, 1137-1156.
10. Kropff, E., and Treves, A. (2005). The storage capacity of potts models for semantic memory retrieval. J. Stat. Mech. Theory Exp. 2, P08010.
11. Kschischang, F. R., Frey, B. J., and Loeliger, H. (2001). Factor graphs and the sum-product algorithm. IEEE Trans. Inf. Theory 47, 498-519.
12. Lancaster, H. (1958). The structure of bivariate distributions. Ann. Math. Stat. 29, 719-736.
13. Mezard, M., and Montanari, A. (2009). Information, Physics, and Computation. Oxford, Oxford University Press.
14. Mezard, M., and Mora, T. (2008). Constraint satisfaction problems and neural networks: a statistical physics perspective. arXiv:08033061v1 [q-bioNC].
15. Mora, T. (2007). G'eométrie et inférence dans l'optimisation et en théorie de l'information. Ph.D. thesis, Université Paris Sud-Paris XI. http://tel.archivesouvertes. fr/tel-00175221/en/
16. Nicolelis, M. A. L. (ed.) (2007). Methods for Neural Ensemble Recordings. New York, CRC Press.
17. Okatan, M., Wilson, M. A., and Brown, E. N. (2005). Analyzing functional connectivity using a network likelihood model of ensemble neural spiking activity. Neural Comput. 17, 1927-1961.
18. Pillow, J. W., Shlens, J., Paninski, L., Sher, A., Litke, A. M., Chichilnisky, E. J., and Simoncelli, E. P. (2008). Spatiotemporal correlations and visual signalling in a complete neuronal population. Nature 45, 995-999.
19. Roudi, Y., Nirenberg, S., and Latham, P. E. (2009a). Pairwise maximum entropy models for studying large biological systems: when they can work and when they can't. PLoS Comput. Biol. 5: e1000380. doi:10.1371/journal. pcbi.1000380.
20. Roudi, Y., Tyrcha, J., and Hertz, J. (2009b). The ising model for neural data: model quality and approximate methods for extracting functional connectivity. Phys. Rev. E. 79, 051915.
21. Russo, E., Namboodiri, V. M. K., Treves, A., and Kropff, E. (2008). Free association transitions in models of cortical latching dynamics. New J. Phys. 10, 015008.
22. Sarmanov, O. (1963). Maximum correlation coefficient (nonsymmetric case). In: Selected Translations in Mathematical Statistics and Probability, Vol. 4 (Providence, RI, American Mathematical Society), pp. 271-275.
23. Schneidman, E., Berry, M., Segev, R., and Bialek, W. (2006). Weak pairwise correlations imply strongly correlated network states in a neural population. Nature 440, 1007-1012.
24. Sessak, V., and Monasson, R. (2009). Small-correlation expansions for the inverse ising problem. J. Phys. A 42, 055001.
25. Shlens, J., Field, G. D., Gauthier, J. L., Grivich, M. I., Petrusca, D., Sher, A., Litke, A. M., and Chichilnisky, E. J. (2009). Spatial organization of large-scale concerted activity in the primate retina. J. Neurosci. 29, 5022-5031.
26. Shlens, J., Field, G. D., Gauthier, J. L., Greschner, M., Sher, A., Litke, A. M., and Chichilnisky, E. J. (2006). The structure of multi-neuron firing patterns in primate retina. J. Neurosci. 26, 8254-8266.
27. Tanaka, T. (1998). Mean-field theory of Boltzmann machine learning. Phys. Rev. E 58, 2302-2310.
28. Tang, A., Jackson, D., Hobbs, J., Chen, W., Smith, J. L., Patel, H., Prieto, A., Petrusca, D., Grivich, M. I., Sher, A., Hottowy, P., Dabrowski, W., Litke, A. M., and Beggs, J. M. (2008). A maximum entropy model applied to spatial and temporal correlations from cortical networks in vitro. J. Neurosci. 28, 505-518.
29. Thouless, D. J., Anderson, P. W., and Palmer, R. G. (1977). Solution of ' solvable model of a spin glass'. Philos. Mag. 35, 593-601.
30. Tkacik, G., Schneidman, E., Berry, M. J. II, and Bialek, W. (2006). Ising models for networks of real neurons. arXiv: q-bio/0611072v1 [q-bioNC].
31. Truccolo, W., Eden, U. T., Fellows, M. R., Donoghue, J. P., and Brown, E. N. (2005). A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects. J. Neurophysiol. 93, 1074-1089.
32. Yedidia, J. S., Freeman, W. T., and Weiss, Y. (2003). Understanding belief propagation and its generalizations. In Exploring Artificial Intelligence in the New Millennium, G. Lakemeyer and B. Nebel, eds (San Francisco, CA, Morgan Kaufmann Publishers).
33. Yu, S., Huang, D., Singer, W., and Nikolic, D. (2008). A small world of neuronal synchrony. Cereb. Cortex 18, 2891-2901.