An approximation to the distribution of finite sample size mutual information estimates

IEEE International Conference on Communications

Volumn 2, Issue , 2005, Pages 1102-1106

  Goebel, Bernhard ^a   Dawy, Zaher ^a,c   Hagenauer, Joachim ^a   Mueller, Jakob C ^b  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^b INSTITUTE OF EPIDEMIOLOGY   (Germany)

^c AMERICAN UNIVERSITY OF BEIRUT   (Lebanon)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION THEORY; FUNCTIONS; INFORMATION ANALYSIS;

COMMUNICATIONS ENGINEERING; MUTUAL INFORMATION (MI); RANDOM VARIABLES; TAYLOR SERIES;

RANDOM PROCESSES;

EID: 24344496951     PISSN: 05361486     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. C. E. Shannon, "A mathematical theory of communication," Bell Systems Tech. J., vol. 27, pp. 379-423, 623-656, Jul., Oct. 1948.
2. T. Cover and J. Thomas, Elements of Information Theory, ser. Wiley series in telecommunications. New York: John Wiley & Sons, 1991.
3. D. Wolpert and D. Wolf, "Estimating fruitions of probability distributions from a finite set of samples," Phys. Rev. E, vol. 52, no. 6, pp. 6841-6854, Dec. 1995.
4. M. Hutter, "Distribution of mutual information," Advances in Neural Information Processing Systems, vol. 14, pp. 399-406, Sept. 2002.
5. W. Li, "Mutual information functions versus correlation functions," J. Stat. Physics, vol. 60, no. 5-6, pp. 823-837, 1990.
6. L. Paninski, "Estimation of entropy and mutual information," Neural Comput., vol. 15, no. 6, pp. 1191-1253, June 2003.
7. R. Moddemeijer, "The variance of the mutual information estimator," Univ. Groningen, Dep. Comput. Sci., Tech. Rep. CS-R9701, 1997.
8. K. Pearson, On the theory of contingency and its relation to association and normal correlation, ser. Biometrie series no. 1. London: Drapers' Co. Memoirs, 1904.
9. S. Kullback, Information theory and statistics. New York: John Wiley & Sons, 1959.
10. H. Sahai and A. Khurshid, Pocket dictionary of statistics. McGraw-HiMrwin, 2002. [Online]. Available: http://www.mhhe.com/business/opsci/ bstat/keyterm.mhtml
11. M. Schervish, Theory of statistics. New York: Springer, 1995.
12. L. Knüsel and B. Bablok, "Computation of the noncentral gamma distribution," SIAM J. Sci. Comput., vol. 17, no. 5, pp. 1224-1231, Sept. 1996.
13. J. Hagenauer, Z. Dawy, B. Goebel, P. Hanus, and J. Mueller, "Genomic analysis using methods from information theory," in Proc. IEEE Inform, Theory Workshop, San Antonio, USA, Oct. 2004.
14. M. Steinbacher, A. Molisch, A. Burr, and R. Thoma, "MIMO channel capacity based on measurement results," in Proc. Europ. Conf. Wireless Tech., ECWT, Paris, France, Oct. 2000, pp. 52-55.
15. J. Hagenauer, 'The EXIT chart," in Proc. 12th Europ. Signal Proc. Conf., EUSIPCO'04, Vienna, Austria, Sept. 2004.