Quantifying 'causality' in complex systems: Understanding transfer entropy

PLoS ONE

Volumn 9, Issue 6, 2014, Pages

  Abdul Razak, Fatimah ^a,b   Jensen, Henrik Jeldtoft ^a  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b UNIVERSITI KEBANGSAAN MALAYSIA   (Malaysia)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; AMENDED ISING MODEL; ARTICLE; CAUSAL RELATION; EFFECTIVE RATE OF CHANGE; ENTROPY; NONLINEAR SYSTEM; PHASE TRANSITION; PREDICTION; PROBABILITY; QUANTITATIVE ANALYSIS; RANDOM TRANSITION MODEL; RELIABILITY; STATISTICAL ANALYSIS; STATISTICAL MODEL; STATISTICAL PARAMETERS; TEMPERATURE DEPENDENCE; TIME SERIES ANALYSIS; TRANSFER ENTROPY; EPIDEMIOLOGY; TEMPERATURE; THEORETICAL MODEL; TIME;

CAUSALITY; ENTROPY; MODELS, THEORETICAL; TEMPERATURE; TIME FACTORS;

EID: 84903545823     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0099462     Document Type: Article

References (35)

1. Bak P (1996) How Nature Works: The Science of Self Organized Criticality. New York: Springer-Verlag.
2. Christensen K, Moloney RN (2005) Complexity and Criticality. London: Imperial College Press.
3. Jensen HJ (1998) Self Organized Criticality: Emergent Complex Behavior in Physical and Biological Systems. Cambridge: Cambridge University Press.
4. Pruessner G (2012) Self-Organised Criticality: Theory, Models and Characterisation. Cambridge: Cambridge University Press.
5. Jensen HJ (2009) Probability and statistics in complex systems, introduction to. In: Encyclopedia of Complexity and Systems Science. pp. 7024-7025.
6. Runge J, Heitzig J, Marwan N, Kurths J (2012) Quantifying causal coupling strength: A lag-specific measure for multivariate time series related to transfer entropy. Phys Rev E 86: 061121.
7. Wiener N (1956) I am Mathematician: The later life of a prodigy. Massachusetts: MIT Press.
8. Granger CWJ (1969) Investigating causal relations by econometric models and cross-spectral methods. Econometrica 37: 424-438.
9. Bressler SL, Seth A (2011) Wiener-granger causality: A well established methodolgy. NeuroImage 58: 323-329.
10. Sauer N (2010) Causality and causation: What we learn from mathematical dynamic systems theory. Transactions of the Royal Society of South Africa 65: 65-68.
11. Hausman DM (1999) The mathematical theory of causation. Brit J Phil Sci 3: 151-162.
12. Friston K (2011) Dynamic causal modeling and Granger causality comments on: The identification of interacting networks in the brain using fMRI: Model selection, causality and deconvolution. NeuroImage 58: 303-305.
13. Vicente R, Wibral M, Lindner M, Pipa G (2011) Transfer entropy: a model-free measure of effective connectivity for the neurosciences. J Comput Neurosci 30: 45-67.
14. Martini M, Kranz TA, Wagner T, Lehnertz K (2011) Inferring directional interactions from transient signals with symbolic transfer entropy. Phys Rev E 83: 011919.
15. Marschinski R, Kantz H (2002) Analysing the information flow between financial time series: An improved estimator for transfer entropy. Eur Phys J B 30: 275-281.
16. Schreiber T (2000) Measuring information transfer. Phys Rev Lett 85: 461-464.
17. Kaiser A, Schreiber T (2002) Information transfer in continuous process. Physica D 166: 43-62.
18. Pompe B, Runge J (2011) Momentary information transfer as a coupling of measure of time series. Phys Rev E 83: 051122.
19. Hlavackova-Schindler K, Paluš M, Vejmelka M, Bhattacharya J (2007) Causality detection based on information-theoretic approachesin time series analysis. PhysicsReport 441: 1-46.
20. Vejmelka M, Palus M (2008) Inferring the directionality of coupling with conditional mutual information. Phys Rev E 77: 026214.
21. Lungarella M, Ishiguro K, Kuniyoshi Y, Otsu N (2007) Methods for quantifying the causal structure of bivariate time series. J Bifurcation Chaos 17: 903-921. (Pubitemid 46782057)
22. Wibral M, Pampu N, Priesemann V, Siebenhuhner F, Seiwert H, et al. (2013) Measuring information-transfer delays. PLoS ONE 8.
23. Shannon CE (1948) A mathematical theory of communication. The Bell Systems Technical Journal 27: 379-423, 623-656.
24. Cover T, Thomas J (1999) Elements of information theory. New York: Wiley.
25. Kraskov A, Stögbauer H, Grassberger P (2004) Estimating mutual information. Phys Rev E 69: 066138.
26. Nichols JM, Seaver M, Trickey ST (2005) Detecting nonlinearity in structural systems using the transfer entropy. Phys Rev E 72: 046217.
27. Li Z, Ouyang G, Li D, Li X (2011) Characterization of the causality between spike trains with permutation conditional mutual information. Phys Rev E 84: 021929.
28. Cipra BA (1987) An introduction to the Ising model. The American Mathematical Monthly 94: 937-959.
29. Krauth W(2006) Statistical Mechanics: Algorithms and Computations. Oxford: Oxford University Press.
30. Norris JR (2008) Markov Chains. Cambridge: Cambridge University Press.
31. Witthauer L, Dieterle M (2007). The phase transition of the 2D-Ising model. Available: http://quantumtheory.physik.unibas.ch/bruder/ Semesterprojekte2007/p1/index.htmlx1-110002.1.6. (refer to Figure 9).
32. Abdul Razak F (2013) Mutual Information based measures on complex interdependent networks of neuro data sets. Ph.D. thesis, Department of Mathematics, Imperial College London.
33. Theiler J (1986) Spurious dimension from correlation algorithms applied to limited time-series data. Phys Rev A 34: 2427-2432.
34. Papana A, Kugiumtzis D, Larsson PG (2011) Reducing the bias of causality measures. Phys Rev E 83: 036207.
35. Palus M, Stefanovska A (2003) Direction of coupling from phases of interacting oscillators: An information-theoretic approach. Phys Rev E 67: 055201.