Estimating mutual information

Physical Review E - Statistical Physics, Plasmas, Fluids, and Related Interdisciplinary Topics

Volumn 69, Issue 6, 2004, Pages 16-

  Kraskov, Alexander ^a   Stögbauer, Harald ^a   Grassberger, Peter ^a  

^a FORSCHUNGSZENTRUM JÜLICH   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84913560692     PISSN: 1063651X     EISSN: None     Source Type: Journal    
DOI: 10.1103/PhysRevE.69.066138     Document Type: Article

References (41)

1. T. M. Cover and J. A. Thomas, Elements of Information Theory (Wiley, New York, 1991).
2. A. Renyi, Probability Theory (North Holland, Amsterdam, 1971).
3. Independent Component Analysis: Principles and Practice, edited by S. Roberts and R. Everson (Cambridge Univ. Press, Cambridge, 2001).
4. A. Hyvärinen, J. Karhunen, and E. Oja, Independent Component Analysis (Wiley, New York, 2001).
5. Y.-I. Moon, B. Rajagopalan, and U. Lall, Phys. Rev. EPLEEE81063-651X10.1103/PhysRevE.52.2318 52, 2318 (1995).
6. R. Steuer, J. Kurths, C. O. Daub, J. Weise, and J. Selbig, BioinformaticsBOINFP1367-4803 18 (Suppl. 2), S231 (2002).
7. A. M. Fraser and H. L. Swinney, Phys. Rev. APLRAAN1050-294710.1103/PhysRevA.33.1134 33, 1134 (1986).
8. G. A. Darbellay and I. Vajda, IEEE Trans. Inf. TheoryIETTAW0018-944810.1109/18.761290 45, 1315 (1999).
9. P. Grassberger, Phys. Lett. APYLAAG0375-960110.1016/0375-9601(88)90193-4 128, 369 (1988).
10. M. S. Roulston, Physica DPDNPDT0167-278910.1016/S0167-2789(98)00269-3 125, 285 (1999).
11. R. L. Dobrushin, Theor. Probab. Appl.TPRBAU0040-585X 3, 462 (1958).
12. O. Vasicek, J. R. Stat. Soc. Ser. B. Methodol.JSTBAJ0035-9246 38, 54 (1976).
13. A. Kaiser and T. Schreiber, Physica DPDNPDT0167-278910.1016/S0167-2789(02)00432-3 166, 43 (2002).
14. E. S. Dudewicz and E. C. van der Meulen, J. Am. Stat. Assoc.JSTNAL0003-1291 76, 967 (1981).
15. B. van Es, Scand. J. Stat.SJSADG0303-6898 19, 61 (1992).
16. N. Ebrahimi, K. Pflughoeft, and E. S. Soofi, Stat. Probab. Lett.SPLTDC0167-715210.1016/0167-7152(94)90046-9 20, 225 (1994).
17. J. C. Correa, Commun. Stat: Theory Meth.CSTMDC0361-0926 24, 2439 (1995).
18. A. B. Tsybakov and E. C. van der Meulen, Scand. J. Stat.SJSADG0303-6898 23, 75 (1996).
19. R. Wieczorkowski and P. Grzegorzewksi, Commun. Stat.-Simul. Comput.CSSCDB0361-0918 28, 541 (1999).
20. L. F. Kozachenko and N. N. Leonenko, Probl. Inf. Transm.PRITA90032-9460 23, 95 (1987).
21. P. Grassberger, Phys. Lett.PYLAAG0375-960110.1016/0375-9601(85)90724-8 107A, 101 (1985).
22. R. L. Somorjai, Methods for Estimating the Intrinsic Dimensionality of High-Dimensional Point Sets, in Dimensions and Entropies in Chaotic Systems, edited by G. Mayer-Kress (Springer, Berlin, 1986).
23. J. D. Victor, Phys. Rev. EPLEEE81063-651X10.1103/PhysRevE.66.051903 66, 051903 (2002).
24. G. A. Darbellay and I. Vajda, IEEE Trans. Inf. TheoryIETTAW0018-944810.1109/18.825848 46, 709 (2000).
25. W. H. Press, Numerical Recipes (Cambridge Univ. Press, New York, 1993).
26. P. Grassberger, Phys. Lett. APYLAAG0375-960110.1016/0375-9601(90)90577-B 148, 63 (1990).
27. R. Hegger, H. Kantz, and T. Schreiber, TISEAN: Nonlinear Time Series Analysis Software Package (ULR: www.mpipks-dresden.mpg.de//̃tisean).
28. G. A. Darbellay, Comput. Stat. Data Anal.CSDADW0167-947310.1016/S0167-9473(99)00020-1 32, 1 (1999).
29. G. A. Darbellay and I. Vajda, Inst. of Information Theory and Automation, Technical Rep. No. 1921 (1998), to be obtained from http://siprint.utia.cas.cz/darbellay
30. G. A. Darbellay, 3rd IEEE European Workshop on Computer-intensive Methods in Control and Data Processing, Prague, 1998 (IEEE, Piscataway, NJ, 1999), p. 83.
31. T. R. Hughes, CellCELLB50092-867410.1016/S0092-8674(00)00015-5 102, 109 (2000);
32. H. Stögbauer, A. Kraskov, S. A. Astakhov, and P. Grassberger, e-print physics/0405044.
33. B. W. Silverman, Density Estimation for Statistics and Data Analysis (Chapman and Hall, London, 1986).
34. F. Meinecke, A. Ziehe, M. Kawanabe, and K.-R. Mller, IEEE Trans. Biomed. Eng.IEBEAX0018-929410.1109/TBME.2002.805480 49, 1514 (2002).
35. J.-F. Cardoso, Multidimensional Independent Component Analysis, Proceedings of ICASSP ’98 (IEEE, Piscataway, NJ, 1998).
36. J.-F. Cardoso and A. Souloumiac, IEE Proc. F, Radar Signal Process.IPFPEV0956-375X 140, 362 (1993).
37. Daisy: Database for the identification of systems, edited by B. L. R. De Moor, www.esat.kuleuven.ac.be/sista/daisy (1997).
38. A. Ziehe and K.-R. Mller, TDSEP—An Efficient Algorithm for Blind Separation Using Time Structure, in Proceedings of the 8th International Conferences on Artificial Neural Networks, ICANN’98, edited by L. Niklasson (Springer, Berlin, 1998), p. 675.
39. In Figs. 18 19 20 we used (Formula presented), since the time sequences were sufficiently long to give very small statistical errors. To find components as independent as possible, we should have used much larger (Formula presented), since this would reduce statistical errors at the cost of increased but nevertheless very small systematic errors. We checked that basically the same results were obtained with (Formula presented) up to 100.
40. B. Pompe, P. Blidh, D. Hoyer, and M. Eiselt, IEEE Eng. Med. Biol. Mag.IEMBDE0739-517510.1109/51.731318 17, 32 (1998).
41. H. Matsuda, Phys. Rev. EPLEEE81063-651X10.1103/PhysRevE.62.3096 62, 3096 (2000).