Identifying the coupling structure in complex systems through the optimal causation entropy principle

Entropy

Volumn 16, Issue 6, 2014, Pages 3416-3433

  Sun, Jie ^a   Cafaro, Carlo ^a   Bollt, Erik M ^a  

^a CLARKSON UNIVERSITY   (United States)

Author keywords

Complex and dynamical systems; Coupling structure; Optimal causation entropy

Indexed keywords

EID: 84985018992     PISSN: None     EISSN: 10994300     Source Type: Journal    
DOI: 10.3390/e16063416     Document Type: Article

References (59)

1. Fitzpatrick, R. An Introduction to Celestial Mechanics; Cambridge University Press: New York, NY, USA, 2012.
2. Atkins, P.; de Paula, J. Physical Chemistry, 9th ed.; W. H. Freeman Publishers: New York, NY, USA, 2010.
3. Mankiw, N.G. Principles of Economics, 6th ed.; Cengage Learning: Stamford, CT, USA, 2011.
4. Crutchfield, J.P.; McNamara, B.S. Equations of motions from a data series. Complex Syst. 1987, 1, 417.
5. Yao, C.; Bollt, E.M. Modeling and nonlinear parameter estimation with Kronecker product representation for coupled oscillators and spatiotemporal systems. Phys. Nonlinear Phenom. 2007, 227, 78-99.
6. Sun, J.; Bollt, E.M.; Nishikawa, T. Judging model reduction of complex systems. Phys. Rev. E 2011, 83, 046125.
7. Wang,W.-X.; Yang, R.; Lai, Y.-C.; Kovanis, V.; Harrison, M.A.F. Time-series based prediction of complex oscillator networks via compressive sensing. Europhys. Lett. 2011, 94, 48006.
8. Cubitt, T.S.; Eisert, J.; Wolf, M.W. Extracting dynamical equations from experimental data is NP hard. Phys. Rev. Lett. 2012, 108, 120503.
9. Heider, F. Social perception and phenomenal causality. Psychol. Rev. 1944, 51, 358-374.
10. Granger, C.W.J. Investigating causal relations by econometric models and cross-spectral methods. Econometrica 1969, 37, 425-438.
11. Granger, C.W.J. Some recent developments in a concept of causality. J. Econom. 1988, 39, 199-211.
12. Spirtes, P.; Glymour, C.N.; Scheines, R. Causation, Prediction, and Search, 2nd ed.; MIT Press: Cambridge, MA, USA, 2000.
13. Rothman, K.J.; Greenland, S. Causation and causal inference in epidemiology. Am. J. Public Health 2005, 95, S144-S150.
14. Caticha, A.; Cafaro, C. From information geometry to Newtonian dynamics. In Proceedings of the 27th InternationalWorkshop on Bayesian Inference and Maximum Entropy Methods, Saratoga Springs, NY, USA, 8-13 July 2007; Volume 954, pp. 165-174.
15. Frenzel, S.; Pompe, B. Partial mutual information for coupling analysis of multivariate time series. Phys. Rev. Lett. 2007, 99, 204101.
16. Hlaváčková-Schindlera, K.; Paluš, M.; Vejmelka, M.; Bhattacharya, J. Causality detection based on information-theoretic approaches in time series analysis. Phys. Rep. 2007, 441, 1-46.
17. Guo, S.; Seth, A.K.; Kendrick, K.M.; Zhou, C.; Feng, J. Partial Granger causality-Eliminating exogenous inputs and latent variables. J. Neurosci. Methods 2008, 172, 79-93.
18. Heckman, J.J. Econometric causality. Int. Stat. Rev. 2008, 76, 1-27.
19. Pearl, J. Causality: Models, Reasoning and Inference, 2nd ed.; Cambridge University Press: Cambridge, UK, 2009.
20. Gao, Q.; Duan, X.; Chen, H. Evaluation of effective connectivity of motor areas during motor imagery and execution using conditional Granger causality. NeuroImage 2011, 54, 1280-1288.
21. Vicente, R.; Wibral, M.; Lindner, M.; Pipa, G. Transfer entropy-A model-free measure of effective connectivity for the neurosciences. J. Comput. Neurosci. 2011, 30, 45-67.
22. Runge, J.; Heitzig, J.; Petoukhov, V.; Kurths, J. Escaping the curse of dimensionality in estimating multivariate transfer entropy. Phys. Rev. Lett. 2012, 108, 258701.
23. Runge, J.; Heitzig, J.; Marwan, N.; Kurths, J. Quantifying causal coupling strength: A lag-specific measure for multivariate time series related to transfer entropy. Phys. Rev. E 2012, 86, 061121.
24. Sun, J.; Bollt, E.M. Causation entropy identifies indirect influences, dominance of neighbors and anticipatory couplings. Phys. Nonlinear Phenom. 2014, 267, 49-57.
25. Sun, J.; Taylor, D.; Bollt, E.M. Causal network inference by optimal causation entropy. 2014, arXiv: 1401.7574.
26. Schreiber, T. Measuring information transfer. Phys. Rev. Lett. 2000, 85, 461-464.
27. Kaiser, A.; Schreiber, T. Information transfer in continuous processes. Phys. Nonlinear Phenom. 2002, 166, 43-62.
28. Palus, M.; Komarek, V.; Hrncir, Z.; Sterbova, K. Synchronization as adjustment of information rates: Detection from bivariate time series. Phys. Rev. E 2001, 63, 046211.
29. Vejmelka, M.; Palus, M. Inferring the directionality of coupling with conditional mutual information. Phys. Rev. E 2008, 77, 026214.
30. Bollt, E.M. Synchronization as a process of sharing and transferring information. Int. J. Bifurc. Chaos 2012, 22, 1250261.
31. Smirnov, D.A. Spurious causalities with transfer entropy. Phys. Rev. E 2013, 87, 042917.
32. Nevill, A.M; Balmer, N.J; Mark Williams, A. The influence of crowd noise and experience upon refereeing decisions in football. Psychol. Sport Exer. 2002, 3, 261-272.
33. Barrett, A.B.; Barnett, L.; Seth, A.K. Multivariate granger causality and generalized variance. Phys. Rev. E 2010, 81, 041907.
34. Papana, A.; Kyrtsou, C.; Kugiumtzis, D.; Diks, C. Simulation study of direct causality measures in multivariate time series. Entropy 2013, 15, 2635-2661.
35. Marinazzo, D.; Pellicoro, M.; Stramaglia, S. Causal information approach to partial conditioning in multivariate data sets. Comput. Math. Methods Med. 2012, 2012, 303601:1-303601:8.
36. Bazzani, A.; Bassi, G.; Turchetti, G. Diffusion and memory effects for stochastic processes and fractional Langevin equations. Phys. A 2003, 324, 530-550.
37. Doukhan, P.; Wintenberger, O. Weakly dependent chains with infinite memory. Stoch. Processes Appl. 2008, 118, 1997-2013.
38. Eichler, M. Graphical modelling of multivariate time series. Probab. Theor. Relat. Field. 2012, 153, 233-268.
39. Van Kampen, N.G. Remarks on non-Markov processes. Braz. J. Phys. 1998, 28, 90-96.
40. Shannon, C.E. A mathematical theory of communication. Bell Syst. Tech. J. 1948, 27, 379-423.
41. Cover, T.M.; Thomas, J.A. Elements of Information Theory, 2nd ed.; John Wiley & Son, Inc.: Hoboken, NJ, USA, 2006.
42. Kraskov, A.; Stogbauer, H.; Grassberger, P. Estimating mutual information. Phys. Rev. E 2004, 69, 066138.
43. Vlachos, I.; Kugiumtzis, D. Nonuniform state-space reconstruction and coupling detection. Phys. Rev. E 2010, 82, 016207.
44. Tsimpiris, A.; Vlachos, I.; Kugiumtzis, D. Nearest neighbor estimate of conditional mutual information in feature selection. Expert Syst. Appl. 2012, 39, 12697.
45. Murray, J.D. Mathematical Biology: I. An Introduction; Springer: New York, NY, USA, 2002.
46. Garfinkel, A.; Spano, M.L.; Ditto, W.L.; Weiss, J.N. Controlling cardiac chaos. Science 1992, 257, 1230-1235.
47. Schiff, S.J.; Jerger, K.; Duong, D.H.; Chang, T.; Spano, M.L.; Ditto, W.L. Controlling chaos in the brain. Nature 1994, 370, 615-620.
48. Lesne, A. Chaos in biology. Riv. Biol. 2006, 99, 467-482.
49. Pompe, B.; Runge, J. Momentary information transfer as a coupling measure of time series. Phys. Rev. E 2011, 83, 051122.
50. Ahmed, N.A.; Gokhale, D.V. Entropy expressions and their estimators for multivariate distributions. IEEE Trans. Inf. Theory 1989, 35, 688.
51. Barnett, L.; Barrett, A.B.; Seth, A.K. Granger causality and transfer entropy are equivalent for gaussian variables. Phys. Rev. Lett. 2009, 103, 238701.
52. Ellner, S.P.; Guckenheimer, J. Dynamic Models in Biology; Princeton University Press: Princeton, NJ, USA, 2006.
53. Elowitz, M.B.; Leibler, S. A synthetic oscillatory network of transcriptional regulators. Nature 2000, 403, 335-338.
54. Ullner, E.; Zaikin, A.; Volkov, E.I.; García-Ojalvo, J. Multistability and clustering in a population of synthetic genetic oscillators via phase-repulsive cell-to-cell communication. Phys. Rev. Lett. 2007, 99, 148103.
55. Gallager, R.G. Stochastic Processes, Theory for Applications; Cambridge University Press: Cambridge, UK, 2013.
56. Harris, T.E. On chains of infinite order. Pac. J. Math. 1955, 5, 707-724.
57. Berbee, H. Chains with infinite connections: Uniqueness and Markov representation. Probab. Theor. Relat. Field. 1987, 76, 243-253.
58. Fernández, R.; Galves, A. Markov approximations of chains of infinite order. Bull. Braz. Math. Soc. 2002, 33, 1-12.
59. Fernández, R.; Maillard, G. Chains with complete connections: General theory, uniqueness, loss of memory and mixing properties. J. Stat. Phys. 2005, 118, 555-588.