Density-free convergence properties of various estimators of entropy

Computational Statistics and Data Analysis

Volumn 5, Issue 4, 1987, Pages 425-436

  Györfi, László ^a   van der Meulen, Edward C ^b  

^a BUDAPEST UNIVERSITY OF TECHNOLOGY AND ECONOMICS   (Hungary)

^b UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

Differential entropy; Histogram based density estimates; L1 and almost sure convergence; Nonparametric entropy estimation

Indexed keywords

EID: 38249035701     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/0167-9473(87)90065-X     Document Type: Article

References (33)

1. A nonparametric estimation of the entropy for absolutely continuous distributions
2. Maximum entropy spectral analysis
3. Informationtheoretische Konvergenzbegriffe im Raum der Wahrscheinlichkeitsverteilungen
4. Information-type measures of difference of probability distributions and indirect observations
5. On generalized entropy
6. Informational quantities in abstract spaces, Technical Report
7. Generalized entropy and quantization problems
8. On the estimation of functions of the probability density and its derivatives
9. On a class of nonparametric estimates of nonlinear functionals of a density and its derivatives
10. Entropy-based tests of uniformity
11. The empiric entropy, a new approach to nonparametric entropy estimation
12. Maximum entropy characterizations of some distributions
13. On entropy-based goodness-of-fit tests
14. Properties of the statistical estimate of the entropy of a random vector with a probability density (in Russian)
15. Information theory and statistical mechanics I
16. On the optimum rate of transmitting information
17. A lower bound for discrimination in terms of variation
18. On a test for normality based on sample entropy
19. On the dimension and entropy of probability distributions
20. Large sample properties of maximum entropy histograms
21. On the evaluation of an unknown probability density function the direct estimation of the entropy from independent observations of a continuous random variable and the distribution-free entropy test of goodness-of-fit
22. The entropy of the maximum entropy distribution
23. Singular moment matrices in applied econometrics
24. A test for normality based on sample entropy
25. On the entropy of continuous probability distributions