The simplest maximum entropy model for collective behavior in a neural network

Journal of Statistical Mechanics: Theory and Experiment

Volumn 2013, Issue 3, 2013, Pages

  Tkačik, Gašper ^a   Marre, Olivier ^b,c   Mora, Thierry ^d   Amodei, Dario ^c   Berry Ii, Michael J ^c   Bialek, William ^c  

^a INSTITUTE OF SCIENCE AND TECHNOLOGY AUSTRIA   (Austria)

^b INSTITUT DE LA VISION   (France)

^c PRINCETON UNIVERSITY   (United States)

^d CNRS   (France)

Author keywords

neuronal networks (experiment); neuronal networks (theory); phase diagrams (theory)

Indexed keywords

EID: 84875334398     PISSN: None     EISSN: 17425468     Source Type: Journal    
DOI: 10.1088/1742-5468/2013/03/P03011     Document Type: Article

References (37)

1. Hopfield J J 1982 Neural networks and physical systems with emergent collective computational abilities Proc. Nat. Acad. Sci. 79 2554
2. Amit D J 1989 Modeling Brain Function: The World of Attractor Neural Networks (Cambridge: Cambridge University Press)
3. Hertz J, Krogh A and Palmer R G 1991 Introduction to the Theory of Neural Computation (Redwood City: Addison Wesley)
4. Toner J and Tu Y 1995 Long-range order in a two-dimensional XY model: how birds fly together Phys. Rev. Lett. 75 4326
5. Toner J and Tu Y 1998 Flocks, herds, and schools: a quantitative theory of flocking Phys. Rev. E 58 4828
6. Jaynes E T 1957 Information theory and statistical mechanics Phys. Rev. 106 620
7. Schneidman E, Berry M J II, Segev R and Bialek W 2006 Weak pairwise correlations imply strongly correlated network states in a neural population Nature 440 1007
8. Bialek W, Cavagna A, Giardina I, Mora T, Silvestri E, Viale M and Walczak A 2012 Statistical mechanics for natural flocks of birds Proc. Nat. Acad. Sci. 109 4786
9. Bialek W, Cavagna A, Giardina I, Mora T, Silvestri E, Viale M and Walczak A 2011 arXiv:1107.0604 [physics.bio-ph]
10. Shlens J, Field G D, Gaulthier J L, Grivich M I, Petrusca D, Sher A, Litke A M and Chichilnisky E J 2006 The structure of multi-neuron firing patterns in primate retina J. Neurosci. 26 8254 (Pubitemid 44309839)
11. Tkačik G, Schneidman E, Berry M J II and Bialek W 2006 Ising models for networks of real neurons arXiv:q-bio/0611072
12. Yu S, Huang D, Singer W and Nikolic D 2008 A small world of neuronal synchrony Cerebral Cortex 18 2891
13. Tang A et al 2008 A maximum entropy model applied to spatial and temporal correlations from cortical networks in vitro J. Neurosci. 28 505
14. Tkačik G, Schneidman E, Berry M J II and Bialek W 2009 Spin-glass models for a network of real neurons arXiv:0912.5409
15. Shlens J, Field G D, Gaulthier J L, Greschner M, Sher A, Litke A M and Chichilnisky E J 2009 The structure of large-scale synchronized firing in primate retina J. Neurosci. 29 5022
16. Ohiorhenuan I E, Mechler F, Purpura K P, Schmid A M, Hu Q and Victor J D 2010 Sparse coding and higher-order correlations in fine-scale cortical networks Nature 466 617
17. Ganmor E, Segev R and Schniedman E 2011 Sparse low-order interaction network underlies a highly correlated and learnable neural population code Proc. Nat. Acad. Sci. 108 9679
18. Lezon T R, Banavar J R, Cieplak M, Maritan A and Federoff N V 2006 Using the principle of entropy maximization to infer genetic interaction networks from gene expression patterns Proc. Nat. Acad. Sci. 103 19033 (Pubitemid 350002823)
19. Tkačik G 2007 Information flow in biological networks Dissertation Princeton University
20. Bialek W and Ranganathan R 2007 Rediscovering the power of pairwise interactions arXiv:0712.4397 [q-bio.QM]
21. Seno F, Trovato A, Banavar J R and Maritan A 2008 Maximum entropy approach for deducing amino acid interactions in proteins Phys. Rev. Lett. 100 078102 (Pubitemid 351393571)
22. Weigt M, White R A, Szurmant H, Hoch J A and Hwa T 2009 Identification of direct residue contacts in protein-protein interaction by message passing Proc. Nat. Acad. Sci. 106 67
23. Halabi N, Rivoire O, Leibler S and Ranganathan R 2009 Protein sectors: evolutionary units of three-dimensional structure Cell 138 774
24. Mora T, Walczak A M, Bialek W and Callan C G 2010 Maximum entropy models for antibody diversity Proc. Nat. Acad. Sci. 107 5405
25. Mora T, Walczak A M, Bialek W and Callan C G 2009 arXiv:0912.5175 [q-bio.GN]
26. Marks D S, Colwell L J, Sheridan R, Hopf T A, Pagnani A, Zecchina R and Sander C 2011 Protein 3D structure computed from evolutionary sequence variation PLoS One 6 e28766
27. Sulkowska J I, Morocos F, Weigt M, Hwa T and Onuchic J N 2012 Genomics-aided structure prediction Proc. Nat. Acad. Sci. 109 10340
28. Stephens G J and Bialek W 2010 Statistical mechanics of letters in words Phys. Rev. E 81 066119
29. Stephens G J and Bialek W 2008 arXiv:0801.0253 [q-bio.NC]
30. Macke J H, Opper M and Bethge M 2011 Common input explains higher-order correlations and entropy in a simple model of neural population activity Phys. Rev. Lett. 106 208102
31. Derrida B 1981 Random-energy model: an exactly solvable model of disordered systems Phys. Rev. B 24 2613
32. Mora T and Bialek W 2011 Are biological systems poised at criticality? J. Stat. Phys. 144 268
33. Mora T and Bialek W 2010 arXiv:1012.2242 [q-bio.QM]
34. Puchalla J L, Schneidman E, Harris R A and Berry M J II 2005 Redundancy in the population code of the retina Neuron 46 493 (Pubitemid 40616892)
35. Amodei D 2011 Network-scale electrophysiology: measuring and understanding the collective behavior of neural circuits Dissertation Princeton University
36. Segev R, Goodhouse J, Puchalla J and Berry M J II 2004 Recording spikes from a large fraction of the ganglion cells in a retinal patch Nature Neurosci. 7 1155 (Pubitemid 41184457)
37. Marre O, Amodei D, Deshmukh N, Sadeghi K, Soo F, Holy T E and Berry M J II 2012 Recording from a neural complete population in the retina J. Neurosci. 32 14859