A mutual information estimator with exponentially decaying bias

Statistical Applications in Genetics and Molecular Biology

Volumn 14, Issue 3, 2015, Pages 243-252

  Zhang, Zhiyi ^a   Zheng, Lukun ^a  

^a UNIVERSITY OF NORTH CAROLINA AT CHARLOTTE   (United States)

Author keywords

62F12; 62G05; 62G20; Primary 62F10

Indexed keywords

ARTICLE; ERROR; MAXIMUM LIKELIHOOD METHOD; MEDICAL INFORMATION; NONPARAMETRIC TEST; PROBABILITY; PRODUCTIVITY; SAMPLE SIZE; SIMULATION; ALGORITHM; THEORETICAL MODEL;

ALGORITHMS; MODELS, THEORETICAL;

EID: 84930733410     PISSN: None     EISSN: 15446115     Source Type: Journal    
DOI: 10.1515/sagmb-2014-0047     Document Type: Article

References (19)

1. Beirlant, J., E. J. Dudewicz, L. Gyrfi and E. C. Meulen (2001): Nonparametric entropy estimation: an overview, Int. J. Math. Stat. Sci., 6, 17-39.
2. Casella, G. and R. L. Berger (2002): Statistical inference, 2nd edition. CA, USA: Duxbury, Pacific Grove.
3. Chao, A., Y. T. Wang and L. Jost (2013): Entropy and the species accumulation curve: a novel entropy estimator via discovery rates of new species, Method. Ecol. Evol., 4, 1091-1100.
4. Cover, T. M. and J. A. Thomas (2006): Elements of information theory, 2nd edition. Hoboken: John Wiley & Son, Inc.
5. Dave, S. S., G. Wright, B. Tan, A. Rosenwald, R. D. Gascoyne, W. C. Chan, R. I. Fisher, R. M. Braziel, L. M. Rimsza, T. M. Grogan, T. P. Miller, M. LeBlanc, T. C. Greiner, D. D. Weisenburger, J. C. Lynch, J. Vose, J. O. Armitage, E. B. Smeland, S. Kvaloy, H. Holte, J. Delabie, J. M. Connors, P. M. Lansdorp, Q. Ouyang, T. A. Lister, A. J. Davies, A. J. Norton, H. K. Muller-Hermelink, G. Ott, E. Campo, E. Montserrat, W. H. Wilson, E. S. Jaffe, R. Simon, L. Yang, J. Powell, H. Zhao, N. Goldschmidt, M. Chiorazzi and L. M. Staudt (2004): Prediction of survival in follicular lymphoma based on molecular features of tumor-infiltrating immune cells, New Engl. J. Med., 351(21), 2159-2169.
6. Efron, B. and C. Stein (1981): The jackknife estimate of variance, Ann. Stat., 9, 586-596.
7. Grassberger, P. (2003): Entropy estimates from insufficient samplings, URL: www.arxiv.org. arXiv:physics/0307138v2. Updated 2008. Accessed on 29 July, 2003.
8. Harris, B. (1975): The statistical estimation of entropy in the non-parametric case, Topics Inf. Theory, 16, 323-355.
9. Kraskov, A., H. Stgbauer and P. Grassberger (2004): Estimating mutual information, Phys. Rev. E 69, 066138.
10. Leonenko, N., L. Pronzato and V. Savani (2008): A class of Renyi information estimators for multidimensional densities, Ann. Stat., 6, 2153-2182.
11. Miller, G. (1955) Note on the bias of information estimates. In: Quastler, H. (Ed.), Information theory in psychology: problems and methods, Glencoe, IL: Free Press, pp. 95-100.
12. Nemenman, I., F. Shafee and W. Bialek (2002): Entropy and inference, revisited. Advances in Neural Information Processing Systems 14, Cambridge, MA: MIT Press.
13. Paninski, L. (2003): Estimation of entropy and mutual information, Neural Comput., 15, 1191-1253.
14. Schrmann, T. (2004): Bias analysis in entropy estimation, J. Phys. A: Math. Gen., 37, 295-301.
15. Shannon, C. E. (1948): A mathematical theory of communication, Bell Syst. Tech. J., 27, 379-423, 623-656.
16. Zhang, Z. (2012): Entropy estimation in turings perspective, Neural Comput., 24(5), 1368-1389.
17. Zhang, Z. (2013): Asymptotic normality of an entropy estimator with exponentially decaying bias, IEEE Trans. Inform. Theory, 59(1), 504-508.
18. Zhang, Z. and M. Grabchak (2013): Bias adjustment for a nonparametric entropy estimator, Entropy, 15(6), 1999-2011.
19. Zhang, Z. and X. Zhang (2012): A normal law for the plug-in estimator of entropy, IEEE Trans. Inform. Theory, 58(5), 2745-2747.