Convergence rates of posterior distributions for noniid observations

Annals of Statistics

Volumn 35, Issue 1, 2007, Pages 192-223

  Ghosal, Subhashis ^a   Van Der Vaart, Aad ^b  

^a NORTH CAROLINA STATE UNIVERSITY   (United States)

^b VU UNIVERSITY AMSTERDAM   (Netherlands)

Author keywords

Covering numbers; Hellinger distance; Independent nonidentically distributed observations; Infinite dimensional model; Markov chains; Posterior distribution; Rate of convergence; Tests

Indexed keywords

EID: 49449093584     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/009053606000001172     Document Type: Article

References (34)

1. AMEWOU-ATISSO, M., GHOSAL, S., GHOSH, J. K. and RAMAMOORTHI, R. V. (2003). Posterior consistency for semiparametric regression problems. Bernoulli 9 291-312.
2. BARRON, A., SCHERVISH, M. and WASSERMAN, L. (1999). The consistency of posterior distributions in nonparametric problems. Ann. Statist. 27 536-561.
3. BIRGÉ, L. (1983). Approximation dans les espaces métriques et théorie de l'estimation. Z. Wahrsch. Verw. Gebiete 65 181-237.
4. BIRGÉ, L. (1983). Robust testing for independent non-identically distributed variables and Markov chains. In Specifying Statistical Models. From Parametric to Non-Parametric. Using Bayesian or Non-Bayesian Approaches. Lecture Notes in Statist. 16 134-162. Springer, New York.
5. BIRGÉ, L. (2006). Model selection via testing: An alternative to (penalized) maximum likelihood estimators. Ann. Inst. H. Poincaré Probab. Statist. 42 273-325.
6. BROCKWELL, P. J. and DAVIS, R. A. (1991). Time Series: Theory and Methods, 2nd ed. Springer, New York.
7. CHOUDHURI, N., GHOSAL, S. and ROY, A. (2004). Bayesian estimation of the spectral density of a time series. J. Amer. Statist. Assoc. 99 1050-1059.
8. CHOUDHURI, N., GHOSAL, S. and ROY, A. (2004). Contiguity of the Whittle measure for a Gaussian time series. Biometrika 91 211-218.
9. CHOW, Y. S. and TEICHER, H. (1978). Probability Theory. Independence, Interchangeability, Martingales. Springer, New York.
10. DAHLHAUS, R. (1988). Empirical spectral processes and their applications to time series analysis. Stochastic Process. Appl. 30 69-83.
11. DE BOOR, C. (1978). A Practical Guide to Splines. Springer, New York.
12. GHOSAL, S. (2001). Convergence rates for density estimation with Bernstein polynomials. Ann. Statist. 29 1264-1280.
13. GHOSAL, S., GHOSH, J. K. and SAMANTA, T. (1995). On convergence of posterior distributions. Ann. Statist. 23 2145-2152.
14. GHOSAL, S., GHOSH, J. K. and VAN DER VAART, A. W. (2000). Convergence rates of posterior distributions. Ann. Statist. 28 500-531.
15. GHOSAL, S., LEMBER, J. and VAN DER VAART, A. W. (2003). On Bayesian adaptation. Acta Appl. Math. 79 165-175.
16. GHOSAL, S. and VAN DER VAART, A. W. (2001). Entropies and rates of convergence for maximum likelihood and Bayes estimation for mixtures of normal densities. Ann. Statist. 29 1233-1263.
17. GHOSAL, S. and VAN DER VAART, A. W. (2007). Posterior convergence rates of Dirichlet mixtures at smooth densities. Ann. Statist. 35. To appear. Available at www4.stat.ncsu. edu/~sghosal/papers.html.
18. IBRAGIMOV, I. A. (1962). Some limit theorems for stationary processes. Theory Probab. Appl. 7 349-382.
19. IBRAGIMOV, I. A. and HAS'MINSKII, R. Z. (1981). Statistical Estimation: Asymptotic Theory. Springer, New York.
20. LE CAM, L. M. (1973). Convergence of estimates under dimensionality restrictions. Ann. Statist. 1 38-53.
21. LE CAM, L. M. (1975). On local and global properties in the theory of asymptotic normality of experiments. In Stochastic Processes and Related Topics (M. L. Puri, ed.) 13-54. Academic Press, New York.
22. LE CAM, L. M. (1986). Asymptotic Methods in Statistical Decision Theory. Springer, New York.
23. MEYN, S. P. and TWEEDIE, R. L. (1993). Markov Chains and Stochastic Stability. Springer, New York.
24. PETRONE, S. (1999). Bayesian density estimation using Bernstein polynomials. Canad. J. Statist. 27 105-126.
25. POLLARD, D. (1990). Empirical Processes: Theory and Applications. IMS, Hayward, CA.
26. SHEN, X. (2002). Asymptotic normality of semiparametric and nonparametric posterior distributions. J. Amer. Statist. Assoc. 97 222-235.
27. SHEN, X. and WASSERMAN, L. (2001). Rates of convergence of posterior distributions. Ann. Statist. 29 687-714.
28. STONE, C. J. (1990). Large-sample inference for log-spline models. Ann. Statist. 18 717-741.
29. STONE, C. J. (1994). The use of polynomial splines and their tensor products in multivariate function estimation (with discussion). Ann. Statist. 22 118-184.
30. VAN DER MEULEN, F., VAN DER VAART, A. W. and VAN ZANTEN, J. H. (2006). Convergence rates of posterior distributions for Brownian semimartingale models. Bernoulli 12 863-888.
31. VAN DER VAART, A. W. and WELLNER, J. A. (1996). Weak Convergence and Empirical Processes. With Applications to Statistics. Springer, New York.
32. WHITTLE, P. (1957). Curve and periodogram smoothing (with discussion). J. Roy. Statist. Soc. Ser. B 19 38-63.
33. WONG, W. H. and SHEN, X. (1995). Probability inequalities for likelihood ratios and convergence rates of sieve MLEs. Ann. Statist. 23 339-362.
34. ZHAO, L. H. (2000). Bayesian aspects of some nonparametric problems. Ann. Statist. 28 532-552.