A measure of statistical complexity based on predictive information with application to finite spin systems

Physics Letters, Section A: General, Atomic and Solid State Physics

Volumn 376, Issue 4, 2012, Pages 275-281

  Abdallah, Samer A ^a   Plumbley, Mark D ^a  

^a QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

Entropy; Information theory; Ising model; Spin glasses; Statistical complexity

Indexed keywords

EID: 84855200460     PISSN: 03759601     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.physleta.2011.10.066     Document Type: Article

References (27)

1. T.M. Cover, and J.A. Thomas Elements of Information Theory 1991 John Wiley and Sons New York
2. P. Grassberger Int. J. Theor. Phys. 25 1986 907
3. J.P. Crutchfield, and K. Young Phys. Rev. Lett. 63 1989 105
4. K. Lindgren, and M. Nordahl Comp. Syst. 2 1988 409
5. R. Lopez-Ruiz, H. Mancini, and X. Calbet Phys. Lett. A 209 1995 321
6. D.P. Feldman, and J.P. Crutchfield Phys. Lett. A 238 1998 244
7. J.S. Shiner, M. Davison, and P.T. Landsberg Phys. Rev. E 59 1999 1459
8. W. Bialek, I. Nemenman, and N. Tishby Neural Comput. 13 2001 2409
9. S.A. Abdallah, and M.D. Plumbley Connection Sci. 21 2009 89
10. W. McGill Trans. IRE Professional Group on Inform. Theory 4 1954 93
11. J. Crutchfield, and N. Packard Physica D: Nonlinear Phenom. 7 1983 201
12. J.P. Crutchfield Physica D: Nonlinear Phenom. 75 1994 11
13. W. Li Complex Syst. 5 1991 381
14. M. Studenỳ, and J. Vejnarovà M.I. Jordan, Learning in Graphical Models 1998 MIT Press 261 297
15. I. Erb, and N. Ay J. Statist. Phys. 115 2004 949
16. J.P. Crutchfield, and D.P. Feldman Phys. Rev. E 55 1997 1239R
17. S.A. Abdallah, M.D. Plumbley, Predictive Information, Multi-information and Binding Information, Technical Report C4DM-TR-10-10, Queen Mary University of London, 2010.
18. S. Verdú, T. Weissman, in: IEEE International Symposium on Information Theory (ISIT 2006), pp. 98-102.
19. C.H. Bennett W.H. Zurek, Complexity, Entropy, and the Physics of Information 1990 Addison-Wesley 137 148
20. J.P. Crutchfield, D.P. Feldman, and C.R. Shalizi Phys. Rev. E 62 2000 2996
21. T. Han Inform. Control 36 1978 133
22. S. Watanabe IBM J. Res. Develop. 4 1960 66
23. D. Sherrington, and S. Kirkpatrick Phys. Rev. Lett. 35 1975 1792
24. Y. Xiang, S. Wong, N. Cercone, in: Proc. 12th Conf. on Uncertainty in Artificial Intelligence, pp. 564-571.
25. A. Van Enter, and E. Verbitskiy arXiv:1001.3122 2010
26. P. Grassberger Phys. Lett. A 128 1988 369
27. J. Yu, and S. Verdú IEEE Trans. Inform. Theory 55 2009 350