Root-n consistent estimators of entropy for densities with unbounded support

Scandinavian Journal of Statistics

Volumn 23, Issue 1, 1996, Pages 75-83

  Tsybakov, A B ^a   Van Der Meulen, E C ^b  

^a SORBONNE UNIVERSITÉ   (France)

^b UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

n consistency; Densities with unbounded support; Entropy; Spacings

Indexed keywords

EID: 0030547960     PISSN: 03036898     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (18)

1. Beirlant, J. (1986). Limit theory for spacings of order statistics from general univariate distributions. Publ. Inst. Stat. Univ. Paris XXXI, fasc. 1, 27-57.
2. Beirlant, J. & van Zuijlen, M. C. A. (1985). The empirical distribution function and strong laws for functions of order statistics of uniform spacings. J. Multivar. Anal. 16, 300-317.
3. Bickel, P. J. & Breiman, L. (1983). Sums of functions of nearest neighbor distances, moment bounds, limit theorems and a goodness of fit test. Ann. Probab. 11, 185-214.
4. Cressie, N. (1976). On the logarithms of high-order spacings. Biometrika 63, 343-355.
5. Dobrushin, R. L. (1958). The simplified method of experimental estimation of the entropy of stationary sequence. Theory Probab. Appl. 3, 462-464.
6. Dudewicz, E. J. & van der Meulen, E. C. (1981). Entropy-based tests of uniformity. J. Amer. Statist. Assoc. 76, 967-974.
7. Dudewicz, E. J. & van der Meulen, E. C. (1987). The empiric entropy, a new approach to nonparametric entropy estimation. In New perspectives in theoretical and applied statistics (eds. M. L. Puri et al.), 207-227, Wiley, New York.
8. Györfi, L. & van der Meulen, E. C. (1987). Density-free convergence properties of various estimators of entropy. Computat. Statist. Data Anal. 5, 425-436.
9. Györfi, L. & van der Meulen, E. C. (1990). An entropy estimate based on a kernel density estimation. In Colloquia mathematica societatis János Bolyai, Vol. 57, Limit theorems in probability and statistics, 229-240.
10. Hall, P. (1984). Limit theorems for sums of general functions of m-spacings. Math. Proc. Camb. Phil. Soc. 96, 517-532.
11. Hall, P. (1986). On powerful distributional tests based on sample spacings. J. Multivar. Anal. 19, 201-225.
12. Khashimov, Sh. A. (1989). Asymptotic properties of functions of spacings. Theory Probab. Appl. 34, 298-307.
13. Kozachenko, L. F. & Leonenko, N. N. (1987). Sample estimate of the entropy of a random vector. Problems Inform. Transmission. 23, 95-101.
14. Levit, B. Ya. (1978). Asymptotically efficient estimation of nonlinear functional. Problems Inform. Transmiss. 14, 204-209.
15. Tarasenko, F. P. (1968). On the evaluation of an unknown probability density function, the direct estimation of the entropy from independent observations of a continuous random variable and the distribution-free entropy test of goodness of fit. Proc. IEEE 56, 2052-2953.
16. Tsybakov, A. B. & van der Meulen, E. C. (1992). Root-n consistent estimators of entropy for densities with unbounded support. Discussion paper 9206, Institut de Statistique, Université Catholique de Louvain.
17. van Es, B. (1992). Estimating functionals related to a density by a class of statistics based on spacings. Sound. J. Statist. 19, 61-72.
18. Vasicek, O. (1976). A test for normality based on entropy. J. Roy. Statist. Soc. Ser. B 38, 54-59.