Rates of convergence of posterior distributions

Annals of Statistics

Volumn 29, Issue 3, 2001, Pages 687-714

  Shen, Xiaotong ^a   Wasserman, Larry ^b  

^a OHIO STATE UNIVERSITY   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Asymptotic inference; Bayesian inference; Non parametric models; Sieves

Indexed keywords

EID: 0035539848     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/aos/1009210686     Document Type: Article

References (35)

1. BARRON, A. (1988). The exponential convergence of posterior probabilities with implications for Bayes estimators of density functions. Technical Report 7, Dept. Statistics, Univ. Illinois, Champaign.
2. BARRON, A., SCHERVISH, M. and WASSERMAN, L. (1999). The consistency of posterior distributions in nonparametric problems. Ann. Statist. 27 536-561.
3. BARRON, A. and YANG, Y. (1998). An asymptotic property of model selection criteria. IEEE Trans. Inform. Theory 44 95-116.
4. BARRON, A., BIRGÉ, L. and MASSART, P. (1999). Risk bounds for model selection via penalization. Probab. Theory Related Fields 113 301-413.
5. BERGER, J. O. (1986). Discussion on the consistency of Bayes estimates (with discussion). Ann. Statist. 14 1-67.
6. p. Mat. Sbornik 73 295-317.
7. BROWN, L. and LOW, M. (1996). Asymptotic equivalence of non-parametric regression and white noise model. Ann. Statist. 24 2384-2398.
8. Cox, D. D. (1993). An analysis of Bayesian inference for non-parametric regression. Ann. Statist. 21 903-924.
9. DEMBO, D., MAYER-WOLF, E. and ZEITOUNI, O. (1995). Exact behavior of Gaussian seminorms. Statist. Probab. Lett. 23 275-280.
10. DEY, D., MÜLLER, P. and SINHA, D. (1998). Practical Nonparametric and Semiparametric Bayesian Statistics. Springer, New York.
11. DIACONIS, P. and FREEDMAN, D. (1986). On the consistency of Bayes estimates (with discussion). Ann. Statist. 14 1-67.
12. DIACONIS, P. and FREEDMAN, D. (1993). Non-parametric binary regression: A Bayesian approach. Ann. Statist. 21 2108-2137.
13. DIACONIS, P. and FREEDMAN, D. (1997a). On the Bernstein-von Mises Theorem with infinite dimensional parameters. Unpublished manuscript.
14. DIACONIS, P. and FREEDMAN, D. (1997b). Consistency of Bayes estimates for nonparametric regression: A review. In Festschrift for Lucien Le Cam (D. Pollard, E. Torgersen and G. Yang, eds.) Springer, New York.
15. DIACONIS, P. and FREEDMAN, D. (1998). Consistency of Bayes estimates for nonparametric regression: normal theory. Bernoulli 4 411-444.
16. DOOB, J. L. (1948). Application of the theory of martingales. Coll. Int. du C. N. R. S. Paris 22-28.
17. FREEDMAN, D. (1963). On the asymptotic behavior of Bayes estimates in the discrete case I. Ann. Math. Statist. 34 1386-1403.
18. FREEDMAN, D. (1999). On the Bernstein-Von Mises theorem with infinite dimensional parameters. Ann. Statist. 27.
19. GHOSAL, S., GHOSH, J. K. and RAMAMOORTHI, R. V. (1997). Non-informative priors via sieves and packing numbers. In Advances in Statistical Decision Theory and Applications (S. Panchapakesan and N. Balakrishnan, eds.) 119-132. Birkhäuser, Boston.
20. GHOSAL, S., GHOSH, J. K. and RAMAMOORTHI, R.V. (1999a). Consistency issues in Bayesian non-parametrics. In Asymptotics, Nonparametrics and Time Series: A Tribute to Madan Lal Puri (S. Ghosh, ed.) 639-667. Dekker, New York
21. GHOSAL, S., GHOSH, J. K. and RAMAMOORTHI, R.V. (1999b). Posterior consistency of Dirichlet mixtures in density estimation. Ann. Statist. 27 143-158.
22. GHOSAL, S., GHOSH, J. K. and VAN DER VAART, A. (1998). Convergence rates of posterior distributions. Technical report, Free Univ. Amsterdam.
23. GRENANDER U. (1981) Abstract Inference. Wiley, New York.
24. KUO, H. H. (1975). Gaussian Measures on Banach Spaces. Lecture Notes in Math. 463. Springer, Berlin.
25. SHEN, X. (1995). On the properties of Bayes procedures in general parameter spaces. Technical report, Ohio State Univ.
26. SHEN, X. and WONG, W. H. (1994). Convergence rate of sieve estimates. Ann. Statist. 22 580-615.
27. STONE, C. (1982). Optimal global rates of convergence for non-parametric regression. Ann. Statist. 10 1040-1053.
28. SCHWARTZ, L. (1965). On Bayes' procedures. Z. Wahrsch. Verw. Gebiete 4 10-26.
29. TRIEBEL, H. (1983). Theory of Function Spaces. Birkhäuser, Boston.
30. VAN DE GEER, S. (2000). Empirical Processes in M-Estimation. Cambridge Univ. Press.
31. WASSERMAN, L. (1998). Asymptotic properties of nonparametric Bayesian procedures. In Practical Nonparametric and Semiparametric Bayesian Statistics (D. Dey, P. Müller and D. Sinha, eds.) 293-304. Springer, New York.
32. WONG, W. H. and SHEN, X. (1995). A probability inequality for the likelihood surface and convergence rate of the maximum likelihood estimate. Ann. Statist. 23 339-362.
33. ZEIDLER, E. (1990). Nonlinear Functional Analysis and its Applications II/A. Springer, New York.
34. ZHAO, L. (1993). Frequentist and Bayesian aspects of some nonparametric estimation. Ph.D. dissertation, Cornell Univ.
35. ZHAO, L. (1998). A hierarchical Bayesian approach in nonparametric function estimation. Technical report, Dept. Statistics, Univ. Pennsylvania.