Convergence rates for density estimation with Bernstein polynomials

Annals of Statistics

Volumn 29, Issue 5, 2001, Pages 1264-1280

  Ghosal, Subhashis ^a  

^a UNIVERSITY OF MINNESOTA   (United States)

Author keywords

Bayesian bootstrap; Bernstein polynomial; Entropy; Maximum likelihood estimate; Mixture of beta; Posterior distribution; Rate of convergence; Sieve; Strong approximation

Indexed keywords

EID: 0035470891     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/aos/1013203453     Document Type: Article

References (36)

1. BICKEL, P. J. and ROSENBLATT, M. (1973). On some global measures of the deviations of density estimates. Ann. Statist. 1 1071-1095.
2. BIRGÉ, L. and MASSART, P. (1998). Minimum contract estimators on sieves: exponential bounds and rates of convergence. Bernoulli 4 329-375.
3. CHOUDHURI, N. (1998). Bayesian bootstrap credible sets for multidimensional mean functional. Ann. Statist. 26 2104-2127.
4. CSÖRGÖ, M. and RÉVÉSZ, R. (1981). Strong Approximations in Probability and Statistics. Academic Press, New York.
5. DIACONIS, P. (1993). Seminar at the University of Minnesota.
6. ESCOBAR, M. and WEST, M. (1995). Bayesian density estimation and inference using mixtures. J. Amer. Statist. Assoc. 90 577-588.
7. FERGUSON, T. S. (1983). Bayesian density estimation by mixtures of Normal distributions. In Recent Advances in Statistics (M. Rizvi, J. Rustagi and D. Siegmund, eds.) 287-302. Academic Press, New York.
8. GEMAN, S. and HWANG, C. (1982). Nonparametric maximum likelihood estimation by the method of sieves. Ann. Statist. 10401-414.
9. GENOVESE, C. and WASSERMAN, L. (2000). Rates of convergence for the Gaussian mixture sieve. Ann. Statist. 28 1105-1127.
10. GHOSAL, S., GHOSH, J. K. and RAMAMOORTHI, R. V. (1999a). Posterior consistency of Dirichlet mixtures in density estimation. Ann. Statist. 27 143-158.
11. GHOSAL, S., GHOSH, J. K. and RAMAMOORTHI, R. V. (1999b). Consistency issues in Bayesian non-parametrics. In Asymptotics, Nonparametrics end Time Series: A Tribute to Madan Lal Puri (S. Ghosh, ed.) 639-668. Dekker, New York.
12. GHOSAL, S., GHOSH, J. K. and VAN DER VAART, A. W. (2000). Convergence rates of posterior distributions. Ann. Statist. 28 500-531.
13. GHOSAL, S. and VAN DER VAART, A. W. (2001). Entropies and rates of convergence of maximum likelihood and Bayes estimation for mixtures of normal densities. Ann. Statist. 29 1233-1263.
14. GRENANDER, U. (1981). Abstract Inference. Wiley, New York.
15. KOLMOGOROV, A. N. and TIHOMIROV. V. M. (1961). ε-entropy and ε-capacity of sets in function spaces. Amer. Math. Soc. Transl. Ser. 2 17 277-364. [Translated from Russian: Uspekhi Mat. Nauk 14 (1959) 3-86.]
16. KOLMOGOROV, A. N. and TIHOMIROV. V. M. (1961). ε-entropy and ε-capacity of sets in function spaces. Amer. Math. Soc. Transl. Ser. 2 17 277-364. [Translated from Russian: Uspekhi Mat. Nauk 14 (1959) 3-86.]
17. KOMLÓS, J., MAJOR, P. and TUSNÁDY, G. (1975). An approximation of partial sums of independent R. V.'s and the sample DF. I. Z. Wahrsch. Verw. Gebiete 32 111-131.
18. LINDSAY, B. (1995). Mixture Models: Theory, Geometry and Applications. IMS, Hayward, CA.
19. LO, A. Y. (1984). On a class of Bayesian nonparametric estimates I: Density estimates. Ann. Statist. 12 351-357.
20. LO, A. Y. (1987). A large sample study of the Bayesian bootstrap. Ann. Statist. 15 360-375.
21. LORENZ, G. G. (1953). Bernstein Polynomials. Univ. Toronto Press.
22. MCLACHLAN, G. and BASFORD, K. (1988). Mixture Models: Inference and Applications to Clustering. Dekker, New York.
23. PETRONE, S. (1999a). Random Bernstein polynomials. Scand. J. Statist. 26 373-393.
24. PETRONE, S. (1999b). Bayesian density estimation using Bernstein polynomials. Canad. J. Statist. 26 373-393.
25. PETRONE, S. and WASSERMAN, L. (2001). Consistency of Bernstein polynomial posteriors. J. Roy. Statist. Soc. Ser. B. To appear.
26. RUBIN, D. (1981). The Bayesian bootstrap. Ann. Statist. 9 130-134.
27. SCHWARTZ, L. (1965). On Bayes procedures. Z. Wahrsch. Verw. Gebiete 4 10-26.
28. SHEN, X. and WASSERMAN, L. (2001). Rates of convesrgence of posterior distributions. Ann. Statist. 29 687-714.
29. SHEN, X. and WONG, W. H. (1994). Convergence rate of sieve estimates. Ann. Statist. 22 580-615.
30. TENBUSCH, A. (1994). Two-dimensional Bernstein polynomial density estimators. Metrika 41 233-253.
31. VAN DE GEER, S. (1993). Hellinger consistency of certain nonparametric maximum likelihood estimators. Ann. Statist. 21 14-44.
32. VAN DE GEER, S. (1996). Rates of convergence for the maximum likelihood estimator in mixture models. J. Nonparametr. Statist. 6 293-310.
33. VAN DER VAART, A. W. and WELLNER, J. A. (1996). Weak Convergence and Empirical Processes. Springer, New York.
34. VITALE, R. A. (1975). A Bernstein polynomial approach to density estimation. In Statistical Inference and Related Topics (M. L. Puri, ed.) 2 87-100. Academic Press, New York.
35. WASSERMAN, L. (1998). Asymptotic properties of nonparametric Bayesian procedures. Practical Nonparametric and Semiparametric Bayesian Statistics. Lecture Notes in Statist. 133 293-304. Springer, New York.
36. WONG, W. H. and SHEN, X. (1995). Probability inequalities for likelihood ratios and convergence rates of sieve MLEs. Ann. Statist. 23 339-362.