On the statistical estimation of Rényi entropies

Machine Learning for Signal Processing XIX - Proceedings of the 2009 IEEE Signal Processing Society Workshop, MLSP 2009

Volumn , Issue , 2009, Pages

  Liitiäinen, Elia ^a   Lendasse, Amaury ^a   Corona, Francesco ^a  

^a AALTO UNIVERSITY   (Finland)

Author keywords

[No Author keywords available]

Indexed keywords

MACHINE-LEARNING; STATISTICAL ESTIMATION; STATISTICAL PHYSICS;

ENTROPY; LEARNING SYSTEMS; SIGNAL PROCESSING; TECHNICAL PRESENTATIONS;

ESTIMATION;

EID: 77950925139     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/MLSP.2009.5306242     Document Type: Conference Paper

References (14)

1. C. E. Shannon, "A mathematical theory of communication," Bell System Technical Journal , vol. 27, pp. 379-423,623-656, 1948.
2. A. Rényi, "On measures of information and entropy," in Proceedings of the 4th Berkeley Symposium on Mathematics, 1960, pp. 547-561.
3. L. Brillouin, Science and Information Theory, Academic Press , 1962.
4. H. Neemuchwala, A.O. Hero, and P.L. Carson, "Image matching using alpha-entropy measures and entropic graphs," Signal Processing (Special Issue on Content-based Visual Information Retrieval), vol. 85, pp. 277-296, 2005.
5. A.G. Bashkirov, "Renyi entropy as a statistical entropy for complex systems," Theoretical and Mathematical Physics, vol.149, no.2, pp. 1559-1573, 2006. (Pubitemid 44798020)
6. D. Erdogmus and J.C. Principe, "An error-entropy minimization algorithm for supervised training of non-linear adaptive systems," IEEE Transaction On Signal Processing, vol. 50, no. 7, pp. 1780-1786, 2002.
7. N. Leonenko, L. Pronzato, and V. Savani, "A class of Rényi information estimators for multidimensional densities," Annals of Statistics, vol. 36, no. 5, pp. 2153-2182, 2008.
8. Elia Liitiäinen, Francesco Corona, and Amaury Lendasse, "A boundary corrected expansion of the moments of nearest neighbor distributions," Tech. Rep. TKK-ICS-R9, Helsinki University of Technology, TKK Reports in Information and Computer Science, Espoo, Finland, 2008.
9. C. Redmond and J.E. Yukich, "Limit theorems and rates of convergence for euclidean functionals," Annals of Applied Probability, vol. 4, no. 4, pp. 1057-1073, 1994.
10. D. Evans, A. Jones, and W. M. Schmidt, "Asymptotic moments of near neighbour distance distributions," Proceedings of the Royal Society A, vol. 458, no. 2028, pp. 2839-2849, 2008.
11. M. D. Penrose and J. E. Yukich, "Weak laws of large numbers in geometric probability," Annals of Applied Probability, vol. 13, no. 1, pp . 277-303, 2003.
12. A. R. Wade, "Explicit laws of large numbers for random nearest-neighbour type graphs," Advances in Applied Probability, vol. 39, no. 2, pp. 326-342, 2007.
13. D. Evans, "A law of large numbers for nearest neighbour statistics," Proceedings of the Royal Society A, vol. 464, no. 2100, pp. 3175-3192, 2008.
14. M. D. Penrose, "Gaussian limits for random geometric measures," Electronic Journal of Probability, vol. 12, pp. 989-1035, 2007.