The consistency of posterior distributions in nonparametric problems

Annals of Statistics

Volumn 27, Issue 2, 1999, Pages 536-561

  Barron, Andrew ^a   Schervish, Mark J ^b   Wasserman, Larry ^b  

^a YALE UNIVERSITY   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Exponential families; Hellinger distance; Nonparametric Bayesian inference; P lya trees

Indexed keywords

EID: 0033438067     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (27)

1. ALEXANDER, K. (1984). Probability inequalities for empirical processes and a law of the iterated logarithm. Ann. Probab. 12 1041-1067.
2. BARRON, A. (1998). Information-theoretic characterization of Bayes performance and the choice of priors in parametric and nonparametric problems. In Bayesian Statistics 6 (J. Bernardo, J. Berger, A. Dawid and A. Smith, eds.) 27-52. Oxford, New York.
3. BARRON, A. R. (1988). The exponential convergence of posterior probabilities with implications for Bayes estimators of density functions. Technical Report 7, Dept. Statistics, Univ. Illinois, Champaign.
4. DIACONIS, P. and FREEDMAN, D. A. (1986). On the consistency of Bayes estimates (with discussion). Ann. Statist. 14 1-26.
5. DIACONIS, P. and FREEDMAN, D. A. (1997). Consistency of Bayes estimates for nonparametric regression: a review. In Festschrift for Lucien Le Cam (D. Pollard, E. Torgersen and G. Yang, eds.) 157-165. Springer, New York.
6. DIACONIS, P. and FREEDMAN, D. A. (1998). Consistency of Bayes estimates for nonparametric regression: normal theory. Bernoulli 4 411-444.
7. DOOB, J. L. (1949). Application of the theory of martingales. In Le Calcul des Probabilités et ses Applications 23-27. Colloques Internationaux du Centre National de la Recherche Scientifique, Paris.
8. FABIUS, J. (1964). Asymptotic behavior of Bayes estimates. Ann. Math. Statist. 35 846-856.
9. FREEDMAN, D. A. (1963). On the asymptotic behavior of Bayes' estimates in the discrete case. Ann. Math. Statist. 34 1194-1216.
10. GEMAN, S. and HWANG, C. (1982). Nonparametric maximum likelihood estimation by the method of sieves. Ann. Statist. 10 401-414.
11. GHOSHAL, S., GHOSH, J. K. and RAMAMOORTHI, R. V. (1999A). Consistency issues in Bayesian nonparametrics. In Asymptotics, Nonparametrics and Time series (S. Ghosh, ed.) 639-667. Dekker, New York.
12. GHOSAL, S., GHOSH, J. K. and RAMAMOORTHI, R. V. (1999B). Consistent semiparametric Bayesian inference about a location parameter. J. Statist. Plann. Inference. To appear.
13. GHOSHAL, S., GHOSH, J. and VAN DER VAART, A. (1998). Convergence rates of posterior distribution. Technical Report 504, Dept. Mathematics, Free University, Amsterdam.
14. GRENANDER, U. (1981). Abstract Inference. Wiley, New York.
15. KRAFT, C. H. (1964). A class of distribution function processes which have derivatives. J. Appl. Probab. 1 385-388.
16. LAVINE, M. (1992). Some aspects of Pólya tree distributions for statistical modelling. Ann. Statist. 20 1222-1235.
17. LAVINE, M. (1994). More aspects of Pólya tree distributions for statistical modelling. Ann. Statist. 22 1161-1176.
18. LENK, P. J. (1988). The logistic normal distribution for Bayesian, nonparametric, predictive densities. J. Amer. Statist. Assoc. 83 509-516.
19. LENK, P. J. (1991). Towards a practicable Bayesian nonparametric density estimator. Biometrika 78 531-543.
20. LEONARD, T. (1978). Density estimation, stochastic processes, and prior information. J. Roy. Statist. Soc. Ser. B 40 113-146.
21. MAULDIN, R. D., SUDDERTH, W. D. and WILLIAMS, S. C. (1992). Pólya trees and random distributions. Ann. Statist. 20 1203-1221.
22. POLLARD, D. (1991). Bracketing methods in statistics and econometrics. In Nonparametric and Semiparametric Methods in Econometrics and Statistics: Proceedings of the Fifth International Symposium in Economic Theory and Econometrics (W. A. Barnett, J. Powell and G. E. Tauchen, eds.) 337-355. Cambridge Univ. Press.
23. SCHERVISH, M. J. (1995). Theory of Statistics. Springer, New York.
24. SCHWARTZ, L. (1965). On Bayes procedures. Z. Wahrsch. Verw. Gabiete 4 10-26.
25. SHEN, X. and WASSERMAN, L. (1998). Rates of convergence of posterior distribution. Technical Report 678, Dept. Statistics, Carnegie Mellon Univ.
26. VAN DE GEER, S. (1993). Hellinger-consistency of certain nonparametric maximum likelihood estimators. Ann. Statist. 21 14-44.
27. WONG, W. H. and SHEN, X. (1995). Probability inequalities for likelihood ratios and convergence rates of sieve MLE's. Ann. Statist. 23 339-362.