Mutual Information Rate and Bounds for It

PLoS ONE

Volumn 7, Issue 10, 2012, Pages

  Baptista, Murilo S ^a   Rubinger, Rero M ^b   Viana, Emilson R ^c   Sartorelli, José C ^d   Parlitz, Ulrich ^e,f   Grebogi, Celso ^a,g  

^a UNIVERSITY OF ABERDEEN   (United Kingdom)

^b FEDERAL UNIVERSITY OF ITAJUBÁ   (Brazil)

^c FEDERAL UNIVERSITY OF MINAS GERAIS   (Brazil)

^d UNIVERSITY OF SÃO PAULO   (Brazil)

^e MAX PLANCK INSTITUTE FOR DYNAMICS AND SELF ORGANIZATION   (Germany)

^f UNIVERSITY OF GÖTTINGEN   (Germany)

^g UNIVERSITY OF FREIBURG   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; DYNAMICS; INFORMATION PROCESSING; INFORMATION SCIENCE; INFORMATION SYSTEM; MATHEMATICAL COMPUTING; MUTUAL INFORMATION RATE; OSCILLATOR; PROBABILITY; RANDOMIZATION; STATISTICAL ANALYSIS; TIME SERIES ANALYSIS;

ALGORITHMS; COMPUTER SIMULATION; INFORMATION THEORY; MODELS, BIOLOGICAL; STOCHASTIC PROCESSES;

EID: 84868089458     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0046745     Document Type: Article

References (40)

1. Shannon CE, (1948) A Mathematical Theory of Communication. Bell System Technical Journal 27: 379-423.
2. Strong SP, Koberle R, de Ruyter van Steveninck RR, Bialek W, (1998) Entropy and Information in Neural Spike Trains. Phys. Rev. Lett. 80: 197-200.
3. Sporns O, Chialvo DR, Kaiser M, Hilgetag CC, (2004) Organization, development and function of complex brain networks. Trends in Cognitive Sciences. 8: 418-425.
4. Palus M, Komárek V, Procházka T, Hrncir Z, Sterbova K (2001) Synchronization and information ow in EEGs of epileptic patients. IEEE Engineering in Medicice and Biology Sep/Oct: 65-71.
5. Donges JF, Zou Y, Marwan N, Kurths J, (2009) Complex networks in climate dynamics. Eur. Phys. J. 174: 157-179.
6. Fraser AM, Swinney HL, (1986) Independent coordinates for strange attractors from mutual information. Phys. Rev. A 33: 1134-1140.
7. Kantz H, Schreiber T (2004) Nonlinear Time Series Analysis. Cambridge: Cambridge University Press.
8. Parlitz U (1998) Nonlinear Time-Series Analysis, in Nonlinear Modelling- Advanced Black-Box techniques. The Netherlands: Kluwer Academic Publishers.
9. Haykin S (2001) Communication Systems. New York: John Wiley & Sons.
10. Rossi F, Lendasse A, François D, Wertz V, Verleysen M, (2006) Mutual information for the selection of relevant variables in spectrometric nonlinear modelling. Chemometrics and Intelligent Laboratory Systems 80: 215-226.
11. Paninski L, (2003) Estimation of entropy and mutual information. Neural Computation 15: 1191-1253.
12. Steuer R, Kurths J, Daub CO, Weckwerth W, (2002) The Mutual Information: Detecting and evaluating dependencies between variables. Bioinformatics 18: S231-S240.
13. Papana A, Kugiumtzis D, (2009) Evaluation of Mutual Information Estimators for Time Series. Int. J. Bifurcation and Chaos 19: 4197-4215.
14. Baptista MS, Kurths J, (2008) Information transmission in active channels. Phys. Rev. E 77: 026205-1-026205-13.
15. Baptista MS, de Carvalho JX, Hussein MS, (2008) Optimal network topologies for information transmission in active networks. PloS ONE 3: e3479.
16. Blanc JL, Pezard L, Lesne A, (2011) Delay independence of mutual-information rate of two symbolic sequences. Phys. Rev. E 84: 036214-1-036214-9.
17. Dobrushin RL, (1959) General formulation of Shannon's main theorem of information theory. Usp. Mat. Nauk. 14: 3-104; transl: Amer. Math. Soc. Translations, series 2 33: 323-438.
18. Gray RM, Kieffer JC, (1980) Asymptotically mean stationary measures. IEEE Transations on Information theory IT-26: 412-421.
19. Verdú S, Han TS, (1994) A general formula for channel capacity. IEEE Trans. Information Theory 40: 1147-1157.
20. Kolmogorov AN, (1958) A new metric invariant of transient dynamical systems and automorphisms in Lebesgue spaces. Dokl. Akad. Nauk SSSR 119: 861-864; (1959) Entropy per unit time as a metric invariant of automorphisms. Dokl. Akad. Nauk SSSR 124: 754-755.
21. Ruelle D, (1978) An inequality for the entropy of differentiable maps. Bol. Soc. Bras. Mat. 9: 83-87.
22. Pesin YaB, (1977) Characteristic Lyapunov exponents and smooth ergodic theory. Russ. Math. Surveys 32: 55-114.
23. Ledrappier F, Strelcyn JM, (1982) A proof of the estimate from below in Pesin's entropy formula. Ergod. Theory Dyn. Syst. 2: 203-219.
24. Wissman BD, McKay-Jones LC, Binder PM, (2011) Entropy rate estimates from mutual information. Phys. Rev. E 84: 046204-1-046204-5.
25. Gao JB, (1999) Recurrence Time Statistics for Chaotic Systems and Their Applications. Phys. Rev. Lett. 83: 3178-3181.
26. Baptista MS, Eulalie N, Pinto PRF, Brito M, Kurths J, (2010) Density of first Poincaré returns, periodic orbits, and Kolmogorov-Sinai entropy. Phys. Lett. A 374: 1135-1140.
27. Eckmann JP (2003) Non-equilibrium steady states. arXiv:math-ph/0304043.
28. Sinai YaG, (1970) Dynamical systems with elastic reections. Ergodic properties of dispersing billiards. Russ. Math. Surv. 25: 137-189.
29. Chernov N, Young LS, (2001) Decay of correlations for Lorentz gases and hard balls. Encycl. Of Math. Sc., Math. Phys. II 101: 89-120.
30. Baptista MS, Caldas IL, Heller MVAP, Ferreira AA, (2001) Onset of symmetric plasma turbulence. Physica A 301: 150-162.
31. Dawson S, Grebogi C, Sauer T, Yorke JA, (1994) Obstructions to Shadowing When a Lyapunov Exponent Fluctuates about Zero. Phys. Rev. Lett. 73: 1927-1930.
32. Albuquerque HA, Rubinger RM, Rech PC, (2007) Theoretical and experimental time series analysis of an inductorless Chuas circuit. Physics D 233: 66-72.
33. Kraskov A, Stogbauer H, Grassberger P, (2004) Estimating mutual information. Phys. Rev. E 69: 066138-1-066138-16.
34. Femat R, Soís-Perales G, (1999) On the chaos synchronization phenomena. Phys. Lett. A 262: 50-60.
35. Pikovsky A, Rosenblum M, Kurths J (2001) Synchronization: A Universal Concept in Nonlinear Sciences. Cambridge: Cambridge University Press.
36. Baptista MS, Pereira T, Kurths J, (2006) Upper bounds in phase synchronous weak coherent chaotic attractors. Physica D 216: 260-268.
37. Pereira T, Baptista MS, Kurths J, (2007) General framework for phase synchronization through localized sets. Phys. Rev. E 75: 026216-1-026216-12.
38. Mera ME, Morán M, (2009) Reduction of noise of large amplitude through adaptive neighborhoods. Phys. Rev E 80: 016207-1-016207-8.
39. Gao JB, Hu J, Tung WW, Cao YH, Distinguishing chaos from noise by scale-dependent Lyapunov exponent. Phys. Rev. E 74: 066204-1-066204-9.
40. Stefański A, (2008) Lyapunov exponents of systems with noise and uctuating parameters. Journal of Theoretical and Applied Mechanics 46: 665-678.