High-dimensional inference with the generalized Hopfield model: Principal component analysis and corrections

Physical Review E - Statistical, Nonlinear, and Soft Matter Physics

Volumn 83, Issue 5, 2011, Pages

  Cocco, S ^a,b   Monasson, R ^a,b   Sessak, V ^b  

^a INSTITUTE FOR ADVANCED STUDY   (United States)

^b SORBONNE UNIVERSITÉ   (France)

Author keywords

[No Author keywords available]

Indexed keywords

BINARY VARIABLES; BIOLOGICAL DATA; FIRST ORDER; HIGH-DIMENSIONAL; HOPFIELD MODELS; INFER NETWORKS; INTERACTION MATRICES; PAIRWISE CORRELATION; SAMPLING NOISE; STRONG INTERACTION; SYSTEM SIZE; VARIABLE SPACE;

ISING MODEL; MAXIMUM LIKELIHOOD ESTIMATION; STATISTICAL MECHANICS;

PRINCIPAL COMPONENT ANALYSIS;

EID: 79961062866     PISSN: 15393755     EISSN: 15502376     Source Type: Journal    
DOI: 10.1103/PhysRevE.83.051123     Document Type: Article

References (44)

1. I. T. Jolliffe, Principal Component Analysis (Springer-Verlag, Berlin, 2002).
2. A. K. Seth and G. M. Edelman, Neural Comput. NEUCEB 0899-7667 10.1162/neco.2007.19.4.910 19, 910 (2007).
3. E. T. Jaynes, Proc. IEEE IEEPAD 0018-9219 10.1109/PROC.1982.12425 70, 939 (1982).
4. T. Hastie, R. Tibshirani, and J. Friedman, Elements of Statistical Learning: Data Mining, Inference and Prediction, 2nd ed. (Springer-Verlag, New York, 2009).
5. D. H. Ackley, G. E. Hinton, and T. J. Sejnowski, Cognit. Sci. COGSD5 0364-0213 10.1207/s15516709cog0901-7 9, 147 (1985).
6. Advanced Mean Field Methods: Theory and Practice, edited by, M. Opper, and, D. Saad, (MIT, Cambridge, MA, 2001).
7. Y. Roudi, J. Tyrcha, and J. Hertz, Phys. Rev. E COGSD5 1539-3755 10.1103/PhysRevE.79.051915 79, 051915 (2009).
8. M. Mézard and T. Mora, J. Physiol. Paris JHYSEM 0928-4257 10.1016/j.jphysparis.2009.05.013 103, 107 (2009);
9. E. Marinari, and V. Van Kerrebroeck, J. Stat. Mech. JHYSEM 1742-5468 10.1088/1742-5468/2010/02/P02008 (2010) P02008.
10. H. P. Huang, Phys. Rev. E JHYSEM 1539-3755 10.1103/PhysRevE.82.056111 82, 056111 (2010).
11. S. Cocco, S. Leibler, and R. Monasson, Proc. Natl. Acad. Sci. U.S.A. PNASA6 0027-8424 10.1073/pnas.0906705106 106, 14058 (2009).
12. S. Cocco and R. Monasson, Phys. Rev. Lett. PRLTAO 0031-9007 10.1103/PhysRevLett.106.090601 106, 090601 (2011).
13. P. Ravikumar, M. J. Wainwright, and J. Lafferty, Ann. Stat. ASTSC7 0090-5364 10.1214/09-AOS691 38, 1287 (2010).
14. Z. Bai and J. W. Silverstein, Spectral Analysis of Large Dimensional Random Matrices (Springer, New York, 2009).
15. A. d'Aspremont, L. El Ghaoui, M. I. Jordan, and G. R. G. Lanckriet, SIAM Rev. SIREAD 0036-1445 10.1137/050645506 49, 434 (2007). (Pubitemid 47377693)
16. J. J. Hopfield, Proc. Natl. Acad. Sci. U.S.A. PNASA6 0027-8424 10.1073/pnas.79.8.2554 79, 2554 (1982).
17. D. J. Amit, Modelling Brain Function: The World of Attractor Neural Networks (Cambridge University Press, Cambridge, England, 1992).
18. K. Nokura, J. Phys. A JPHAC5 0305-4470 10.1088/0305-4470/31/37/007 31, 7447 (1998). (Pubitemid 128129785)
19. A. Engel and C. van den Broeck, Statistical Mechanics of Learning (Cambridge University Press, Cambridge, England, 2001).
20. I. M. Johnstone, Proc. ICM 1, 307 (2006).
21. D. J. C. MacKay, Neural Comput. NEUCEB 0899-7667 10.1162/neco.1992.4.3. 415 4, 415 (1991).
22. L. Viana and A. J. Bray, J. Phys. C JPSOAW 0022-3719 10.1088/0022-3719/ 18/15/013 18, 3037 (1985).
23. A. Peyrache, Nat. Neurosci. NANEFN 1097-6256 10.1038/nn.2337 12, 919 (2009).
24. i.
25. S. W. Lockless and R. Ranganathan, Science SCIEAS 0036-8075 10.1126/science.286.5438.295 286, 295 (1999). (Pubitemid 29484693)
26. N. Halabi, O. Rivoire, S. Leibler, and R. Ranganathan, Cell CELLB5 0092-8674 10.1016/j.cell.2009.07.038 138, 774 (2009).
27. G. Schwarz, Ann. Stat. ASTSC7 0090-5364 10.1214/aos/1176344136 6, 461 (1978).
28. D. J. Amit, H. Gutfreund, and H. Sompolinsky, Phys. Rev. A PLRAAN 1050-2947 10.1103/PhysRevA.32.1007 32, 1007 (1985).
29. M. Biehl and A. Mietzner, J. Phys. A JPHAC5 0305-4470 10.1088/0305-4470/27/6/015 27, 1885 (1994).
30. P. Reimann, C. Van den Broek, and G. J. Bex, J. Phys. A JPHAC5 0305-4470 10.1088/0305-4470/29/13/021 29, 3521 (1996). (Pubitemid 126088717)
31. T. L. H. Watkin and J.-P. Nadal, J. Phys. A JPHAC5 0305-4470 10.1088/0305-4470/27/6/016 27, 1899 (1994).
32. H. J. Sommers and W. Dupont, J. Phys. C JPSOAW 0022-3719 10.1088/0022-3719/17/32/012 17, 5785 (1984);
33. A. Crisanti and T. Rizzo, Phys. Rev. E JPSOAW 1539-3755 10.1103/PhysRevE.65.046137 65, 046137 (2002). (Pubitemid 40618938)
34. D. S. Dean and F. Ritort, Phys. Rev. B PRBMDO 1098-0121 10.1103/PhysRevB.65.224209 65, 224209 (2002).
35. D. C. Hoyle and M. Rattray, Europhys. Lett. EULEEJ 0295-5075 10.1209/epl/i2003-00370-1 62, 117 (2003); (Pubitemid 36420421)
36. D. C. Hoyle and M. Rattray, Phys. Rev. E EULEEJ 1539-3755 10.1103/PhysRevE.69.026124 69, 026124 (2004);
37. D. C. Hoyle and M. Rattray, Europhys. Lett. EULEEJ 1539-3755 10.1103/PhysRevE.75.016101 75, 016101 (2007). (Pubitemid 46134178)
38. D. C. Hoyle, J. Stat. Mech. EULEEJ 1742-5468 10.1088/1742-5468/2010/04/ P04009 (2010) P04009.
39. J. Baik, G. Ben Arous, and S. Péché, Ann. Probab. APBYAE 0091-1798 10.1214/009117905000000233 33, 1643 (2005). (Pubitemid 41560766)
40. J. Sinova, G. Canright, and A. H. MacDonald, Phys. Rev. Lett. PRLTAO 0031-9007 10.1103/PhysRevLett.85.2609 85, 2609 (2000);
41. J. Sinova, G. Canright, H. E. Castillo, and A. H. MacDonald, Phys. Rev. B PRBMDO 1098-0121 10.1103/PhysRevB.63.104427 63, 104427 (2001).
42. M. Weigt, Proc. Natl. Acad. Sci. U.S.A. PNASA6 0027-8424 10.1073/pnas.0805923106 106, 67 (2009).
43. M. Weigt (private communication).
44. R. Tibshirani, J. R. Statist. Soc. B 58, 267 (1996).