K-nearest neighbor based consistent entropy estimation for hyperspherical distributions

Entropy

Volumn 13, Issue 3, 2011, Pages 650-667

  Li, Shengqiao ^a   Mnatsakanov, Robert M ^a,b   Andrew, Michael E ^a  

^a NATIONAL INSTITUTE FOR OCCUPATIONAL SAFETY AND HEALTH   (United States)

^b WEST VIRGINIA UNIVERSITY   (United States)

Author keywords

Cross entropy; Differential entropy; Directional data; Hyperspherical distribution; K nearest neighbor; Kullback Leibler divergence

Indexed keywords

EID: 79953752369     PISSN: None     EISSN: 10994300     Source Type: Journal    
DOI: 10.3390/e13030650     Document Type: Article

References (24)

1. Mack, Y.; Rosenblatt, M. Multivariate k-nearest neighbor density estimates. J. Multivar. Anal. 1979, 9, 1-15.
2. Penrose, M.D.; Yukich, J.E. Laws of large numbers and nearest neighbor distances. In Advances in Directional and Linear Statistics; Wells, M.T., SenGupta, A., Eds.; Physica-Verlag: Heidelberg, Germany, 2011; pp. 189-199.
3. Kozachenko, L.; Leonenko, N. On statistical estimation of entropy of a random vector. Probl. Inform. Transm. 1987, 23, 95-101.
4. Singh, H.; Misra, N.; Hnizdo, V.; Fedorowicz, A.; Demchuk, E. Nearest neighbor estimates of entropy. Am. J. Math. Manag. Sci. 2003, 23, 301-321.
5. Leonenko, N.; Pronzato, L.; Savani, V. A class of Rényi information estimators for multidimensional densities. Ann. Stat. 2008, 36, 2153-2182; Correction: 2010, 38, 3837-3838.
6. n-Nearest neighbor estimators of entropy. Math. Meth. Stat. 2008, 17, 261-277.
7. Eggermont, P.P.; LaRiccia, V.N. Best asymptotic normality of the kernel density entropy estimator for smooth densities. IEEE Trans. Inf. Theor. 1999, 45, 1321-1326.
8. Li, S.; Mnatsakanov, R.; Fedorowicz, A.; Andrew, M.E. Entropy estimation of multimodal circular distributions. In Proceedings of Joint Statistical Meetings, Denver, CO, USA, 3-7 August 2008; pp. 1828-1835.
9. Misra, N.; Singh, H.; Hnizdo, V. Nearest neighbor estimates of entropy for multivariate circular distributions. Entropy 2010, 12, 1125-1144.
10. Mnatsakanov, R.M.; Li, S.; Harner, E.J. Estimation of multivariate Shannon entropies using moments. Aust. N. Z. J. Stat. 2011, in press.
11. Li, S. Concise formulas for the area and volume of a hyperspherical cap. Asian J. Math. Stat. 2011, 4, 66-70.
12. Gray, A. Tubes, 2nd ed.; Birkhäuser-Verlag: Basel, Switzerland, 2004.
13. Yfantis, E.; Borgman, L. An extension of the von Mises distribution. Comm. Stat. Theor. Meth. 1982, 11, 1695-1076.
14. Gatto, R.; Jammalamadaka, R. The generalized von Mises distribution. Stat. Methodol. 2007, 4, 341-353.
15. Mardia, K.; Jupp, P. Directional Statistics; John Wiley & Sons, Ltd.: New York, NY, USA, 2000.
16. Watamori, Y. Statistical inference of Langevin distribution for directional data. Hiroshima Math. J. 1995, 26, 25-74.
17. Knutsson, H. Producing a continuous and distance preserving 5-D vector representation of 3-D orientation. In Proceedings of IEEE Computer Society Workshop on Computer Architecture for Pattern Analysis and Image Database Management, Miami Beach, FL, November, 1985; pp. 175-182.
18. Rieger, B.; van Vliet, L. Representing orientation in n-dimensional spaces. Lect. Notes Comput. Sci. 2003, 2756, 17-24.
19. McGraw, T.; Vemuri, B.; Yezierski, R.; Mareci, T. Segmentation of high angular resolution diffusion MRI modeled as a field of von Mises-Fisher mixtures. Lect. Notes Comput. Sci. 2006, 3953, 463-475.
20. Bhalerao, A.; Westin, C.F. Hyperspherical von Mises-Fisher mixture (HvMF) modelling of high angular resolution diffusion MRI. Lect. Notes Comput. Sci. 2007, 4791, 236-243.
21. Özarslan, E.; Vemuri, B.C.; Mareci, T.H. Generalized scalar measures for diffusion MRI using trace, variance, and entropy. Magn. Reson. Med. Sci. 2005, 53, 866-876.
22. Leow, A.; Zhu, S.; McMahon, K.; de Zubicaray, G.; Wright, M.; Thompson, P. A study of information gain in high angular resolution diffusion imaging (HARDI). In Proceedings of 2008 MICCAI Workshop on Computational Diffusion MRI, New York, NY, USA, 10 September 2008.
23. Loève, M. Probability Theory I, 4th ed.; Springer-Verlag: New York, NY, USA, 1977.
24. Wang, Q.; Kulkarni, S.R.; Verdú, S. Divergence estimation for multidimensional densities via k-nearest-neighbor distances. IEEE Trans. Inf. Theor. 2009, 55, 2392-2405.