Transfer entropy and transient limits of computation

Scientific Reports

Volumn 4, Issue , 2014, Pages

  Prokopenko, Mikhail ^a,b,c   Lizier, Joseph T ^a  

^a CSIRO   (Australia)

^b MACQUARIE UNIVERSITY   (Australia)

^c UNIVERSITY OF SYDNEY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84903166254     PISSN: None     EISSN: 20452322     Source Type: Journal    
DOI: 10.1038/srep05394     Document Type: Article

References (47)

1. Schreiber, T. Measuring information transfer. Phys. Rev. Lett. 85, 461-464 (2000).
2. Shannon, C. E. A mathematical theory of communication. Bell Syst. Tech. J. 27, 379-423 and 623-656 (1948).
3. MacKay, D. J. Information Theory, Inference, and Learning Algorithms (Cambridge University Press, Cambridge, 2003).
4. Cover, T. M. & Thomas, J. A. Elements of Information Theory (John Wiley & Sons, 1991).
5. Baek, S. K., Jung, W.-S., Kwon, O. & Moon, H.-T. Transfer entropy analysis of the stock market. (2005). ArXiv:physics/0509014v2.
6. Moniz, L. J., Cooch, E. G., Ellner, S. P., Nichols, J. D. & Nichols, J. M. Application of information theory methods to food web reconstruction. Ecol. Model. 208, 145-158 (2007).
7. Chávez, M., Martinerie, J. & Le Van Quyen, M. Statistical assessment of nonlinear causality: application to epileptic EEG signals. J. Neurosci. Methods 124, 113-128 (2003).
8. Wibral, M. et al. Transfer entropy in magnetoencephalographic data: quantifying information flow in cortical and cerebellar networks. Prog. Biophys. Mol. Bio. 105, 80-97 (2011).
9. Pahle, J., Green, A. K., Dixon, C. J. & Kummer, U. Information transfer in signaling pathways: a study using coupled simulated and experimental data. BMC Bioinformatics 9, 139 (2008).
10. Lizier, J. T., Prokopenko, M. & Zomaya, A. Y. Local information transfer as a spatiotemporal filter for complex systems. Phys. Rev. E 77, 026110 (2008).
11. Lizier, J. T., Prokopenko, M. & Zomaya, A. Y. Information modification and particle collisions in distributed computation. Chaos 20, 037109 (2010).
12. Lizier, J. T., Prokopenko, M. & Zomaya, A. Y. Local measures of information storage in complex distributed computation. Inform. Sciences 208, 39-54 (2012).
13. Barnett, L. & Bossomaier, T. Transfer entropy as a log-likelihood ratio. Phys. Rev. Lett. 109, 138105 (2012).
14. Wang, X. R., Miller, J. M., Lizier, J. T., Prokopenko, M. & Rossi, L. F. Quantifying and tracing information cascades in swarms. PLoS ONE 7, e40084 (2012).
15. Lizier, J. T., Pritam, S. & Prokopenko, M. Information dynamics in small-world Boolean networks. Artif. Life 17, 293-314 (2011).
16. Ceguerra, R. V., Lizier, J. T. & Zomaya, A. Y. Information storage and transfer in the synchronization process in locally-connected networks. In 2011 IEEE Symposium on Artificial Life (ALIFE), April 1315, 2011, Paris, France 54-61 (IEEE, New York, 2011).
17. Lungarella, M. & Sporns, O. Mapping information flow in sensorimotor networks. PLoS Comput. Biol. 2, e144 (2006).
18. Lizier, J. T., Prokopenko, M. & Zomaya, A. Y. The information dynamics of phase transitions in random Boolean networks. In Bullock, S., Noble, J., Watson, R. & Bedau, M. A. (eds.) Proceedings of the Eleventh International Conference on the Simulation and Synthesis of Living Systems (ALife XI), Winchester, UK 374-381 (MIT Press, Cambridge, MA, 2008).
19. Barnett, L., Lizier, J. T., Harré, M., Seth, A. K. & Bossomaier, T. Information flow in a kinetic Ising model peaks in the disordered phase. Phys. Rev. Lett. 111, 177203 (2013).
20. Bennett, C. H. Notes on Landauer's principle, reversible computation, and Maxwell's Demon. Stud. Hist. Phil. Sci. B 34, 501-510 (2003).
21. Piechocinska, B. Information erasure. Phys. Rev. A 61, 062314 (2000).
22. Lloyd, S. Programming the Universe (Vintage Books, New York, 2006).
23. Parrondo, J. M. R., den Broeck, C. V. & Kawai, R. Entropy production and the arrow of time. New J. Phys. 11, 073008 (2009).
24. Prokopenko, M., Lizier, J. T., Obst, O. & Wang, X. R. Relating Fisher information to order parameters. Phys. Rev. E 84, 041116 (2011).
25. Landauer, R. Irreversibility and heat generation in the computing process. IBM J. Res. Dev. 5, 183-191 (1961).
26. Goyal, P. Information physics - towards a new conception of physical reality. Information 3, 567-594 (2012).
27. Landauer, R. Information is physical. Phys. Today 44, 23-29 (1991).
28. Prokopenko, M., Lizier, J. T. & Price, D. C. On thermodynamic interpretation of transfer entropy. Entropy 15, 524-543 (2013).
29. Deffner, S. & Jarzynski, C. Information processing and the second law of thermodynamics: an inclusive, Hamiltonian approach. (2013). ArXiv:1308.5001v1.
30. Margolus, N. & Levitin, L. B. Themaximum speed of dynamical evolution. Phys. D 120, 188-195 (1998).
31. Bremermann, H. J. Minimum energy requirements of information transfer and computing. Int. J. Theor. Phys. 21, 203-217 (1982).
32. Anandan, J. & Aharonov, Y. Geometry of quantum evolution. Phys. Rev. Lett. 65, 1697-1700 (1990).
33. Lloyd, S. Ultimate physical limits to computation. Nature 406, 1047-1054 (2000).
34. Bekenstein, J. D. Universal upper bound on the entropy-to-energy ratio for bounded systems. Phys. Rev. D 23, 287-298 (1981).
35. Bekenstein, J. D. Entropy content and information flow in systems with limited energy. Phys. Rev. D 30, 1669-1679 (1984).
36. Bérut, A. et al. Experimental verification of Landauer's principle linking information and thermodynamics. Nature 483, 187-189 (2012).
37. Schrödinger, E. What is life? The Physical Aspect of the Living Cell. (Cambridge University Press, 1944).
38. Schellman, J. A. Temperature, stability, and the hydrophobic interaction. Biophys. J. 73, 2960-2964 (1997).
39. Takens, F. Detecting strange attractors in turbulence. In Rand, D. & Young, L.-S. (eds.) Dynamical Systems and Turbulence, Warwick 1980 Lecture Notes in Mathematics, 366-381 (Springer, Berlin/Heidelberg, 1981).
40. Smirnov, D. A. Spurious causalities with transfer entropy. Phys. Rev. E 87, 042917 (2013).
41. Fano, R. M. The Transmission of Information: A Statistical Theory of Communication (MIT Press, Cambridge, Massachussets, 1961).
42. Lizier, J. T. Measuring the dynamics of information processing on a local scale in time and space. In Wibral, M., Vicente, R. & Lizier, J. T. (eds.) Directed Information Measures in Neuroscience Understanding Complex Systems, 161-193 (Springer Berlin Heidelberg, 2014).
43. Einstein, A. Über einen die Erzeugung und Verwandlung des Lichtes betreffenden heuristischen Gesichtspunkt. Ann. Phys. 322, 132-148 (1905).
44. Huang, K. Introduction to Statistical Physics. A Chapman & Hall book (Taylor & Francis Group, 2009).
45. Szilárd, L. Über die entropieverminderung in einem thermodynamischen system bei eingriffen intelligenter wesen (On the reduction of entropy in a thermodynamic system by the intervention of intelligent beings). Zeitschrift für Physik 53, 840-856 (1929).
46. Magnasco, M. O. Szilard's heat engine. Europhys. Lett. 33, 583-588 (1996).
47. Maroney, O. Information processing and thermodynamic entropy. In Zalta, E. N. (ed.) The Stanford Encyclopedia of Philosophy (2009), Fall 2009 edn, Date of access: 08/10/2013, URL 5 http://plato.stanford.edu/archives/fall2009/ entries/information-entropy/.