About the asymptotic accuracy of barron density estimates

IEEE Transactions on Information Theory

Volumn 44, Issue 3, 1998, Pages 999-1009

  Berlinet, Alain ^a   Vajda, Igor ^b   Van Der Meulen, Edward C ^c  

^a IEEE   (France)

^b INSTITUTE OF INFORMATION THEORY AND AUTOMATION   (Czech Republic)

^c UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

Barron density estimate; Consistency in divergences and expected divergences; Divergences of csisz r; Nonparametric density estimates; R nyi distances

Indexed keywords

ESTIMATION; FUNCTIONS; MATHEMATICAL MODELS; PROBLEM SOLVING; STATISTICAL METHODS; TOPOLOGY;

BARRON DENSITY ESTIMATE; CONSISTENCY IN DIVERGENCE; CSISZAR DIVERGENCE; NONPARAMETRIC DENSITY ESTIMATE; RENYI DISTANCE;

INFORMATION THEORY;

EID: 0032073299     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/18.669143     Document Type: Article

References (38)

1. 1 en probabilité de l'histogramme pour une densité," Ann, l'Inst. Henri Poincaré, vol. 12, pp. 213-231.
2. A. R. Barron, "The convergence in information of probability density estimators," in IEEE Int. Symp. Information Theory (Kobe, Japan, June 19-24, 1988).
3. A. R. Barren and C. H. Sheu, "Approximation of density functions by sequences of exponential families," Ann. Statist., vol. 19, pp. 1347-1369, 1991.
4. A. R. Barron, L. Györfi, and E. van der Meulen, "Distribution estimation consistent in total variation and in two types of information divergence," IEEE Trans. Inform. Theory, vol. 38, pp. 1437-1454, 1992.
5. 1error in density estimation," Statistics, vol. 26, pp. 329-343, 1995.
6. A. Berlinet, L. Györfi, and E. van der Meulen, "Asymptotic normality of relative entropy in multivariate density estimation," Publ. I'Inst. Statist. I'Univ. Paris, vol. 41, pp. 3-27, 1997.
7. P. J. Bickel and M. Rosenblatt, "On some global measures of the deviations of density function estimates," Ann. Statist., vol. 1, pp. 1071-1095, 1973.
8. B. S. Clarke and A. R. Barron, "Information-theoretic asymptotics of Bayes methods," IEEE Trans. Inform. Theory, vol. 36, pp. 453-471, 1990.
9. T. M. Cover and J. B. Thomas, Elements of Information Theory. New York: Wiley, 1991.
10. I. Csiszár, "Eine Informationstheoretische Ungleichung und ihre Anwendung auf den Beweis der Ergodizitât on Markoffschen Ketten," Publ. Math. Inst. Hungar. Acad. Sci., ser. A, vol. 8, pp. 84-108, 1963.
11. _, "Information-type measures of difference of probability distributions and indirect observations," Studio Sci. Math. Hungar., vol. 2, pp. 299-318, 1967.
12. _, "Generalized cutoff rates and Rényi's information measures, IEEE Trans. Inform. Theory, vol. 41, pp. 26-34, Jan. 1995.
13. L. D. Davisson, "Universal noiseless coding," IEEE Trans. Inform. Theory, vol. IT-19, pp. 783-795, 1973.
14. L. Devroye, L. Györfi, and G. Lugosi, A Probabilistic Theory of Pattern Recognition. New York: Springer-Verlag, 1996.
15. M. de Prycker, Asynchronous Transfer Mode Solution for Broadband ISDN. London, U.K.: Ellis Harwood, 1991.
16. 1-View. New York: Wiley, 1985.
17. L. Györfi, I. Vajda, and E. van der Meulen, "Minimum Kolmogorov distance estimates of parameters and parametrized distributions," Metrika, vol. 42, pp. 237-255, 1995.
18. 2-divergence," Statistics, vol. 31, 1998, in print.
19. J. Hui, Switching and Traffic Theory for Integrated Broadband Networks in Telecommunications. Boston, MA: Kluwer, 1990.
20. R. S. Liptser, F. Pukelheim, and A. N. Shiryayev, "On necessary and sufficient conditions for contiguity and entire separation of probability measures," Uspekhi Maternat. Nauk, vol. 37, pp. 97-124, 1982.
21. F. Liese and I. Vajda, Convex Statistical Distances. Leipzig, Germany: Teubner, 1987.
22. J. Lin, "Divergence measures based on Shannon entropy," IEEE Trans. Inform. Theory, vol. 37, pp. 145-151, 1991.
23. K. Matusita, "Distances and decision rules," Ann. Inst. Statist. Math., vol. 16, pp. 305-320, 1964.
24. M. L. Menéndez, D. Morales, L. Pardo, and I. Vajda, "Asymptotic distributions of φ-divergences of hypothetical and observed frequencies on refined partitions," Statist. Nederland., to be published.
25. F. Österreicher, "On a class of perimeter-type distances of probability distributions," Kybernetika, vol. 32, pp. 389-393, 1996.
26. F. Österreicher and I. Vajda, "Statistical information and discrimination," IEEE Trans. Inform. Theory, vol. 39, pp. 1036-1039, 1993.
27. M. C. Pardo and I. Vajda, "About distances of discrete distributions satisfying the data processing theorem on information theory," IEEE Trans. Inform. Theory, vol. 43, pp. 1288-1293, 1997.
28. E. Parzen, "On estimation of a probability density function and mode," Ann. Math. Statist., vol. 33, pp. 1065-1076, 1962.
29. R. C. Read and N. A. C. Cressie, Goodness-of-Fit Statistics for Discrete Multivariate Data. New York: Springer, 1988.
30. A. Renyi, "On measures of entropy and information," in Proc. 4th Berkeley Symp. Probability Theory and Mathematical Statistics vol. 1, pp. 547-561, 1961.
31. M. Rosenblatt, "Remarks on some nonparametric estimates of a density function," Ann. Math. Statist., vol. 47, pp. 832-837, 1956.
32. G. G. Roussas, Contiguity of Probability Measures. Cambridge, U.K.: Cambridge Univ. Press, 1972.
33. A. L. Rukhin, "Optimal estimator of the mixture parameter by the method of moments and information affinity," in Trans. 12th Prague Conf. Information Theory, Statistical Decision Functions and Random Processes (Prague: Czech Acad. Sci. and Charles Univ., 1994), pp. 214-219.
34. D. W. Scott, Multivariate Density Estimation. New York: Wiley, 1992.
35. I. Vajda, "On the f-divergence and singularity of probability measures," Period. Math. Hungar., vol. 2, pp. 223-234, 1972.
36. α-divergence and generalized Fisher's information," in Trans. 6th Prague Conf. Information Theory, Statistical Decision Functions and Random Processes Prague, Czechoslovakia: Academia, 1972, pp. 873-886.
37. _, Theory of Statistical Inference and Information. Boston, MA: Kluwer, 1989.
38. I. Vajda and V. Kus, "Adaptive density estimates for ATM networks," Prague, Czech Rep., Inst. Inform. Theory and Automation, Res. Rep. 1893, Dec. 1996.