Adaptive nonparametric Bayesian inference using location-scale mixture priors

Annals of Statistics

Volumn 38, Issue 6, 2010, Pages 3300-3320

  De Jonge, R ^a   Van Zanten, J H ^a  

^a EINDHOVEN UNIVERSITY OF TECHNOLOGY   (Netherlands)

Author keywords

Adaptation; Bayesian inference; Kernel mixture priors; Nonparametric regression; Posterior distribution; Rate of convergence

Indexed keywords

EID: 78650114664     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/10-AOS811     Document Type: Article

References (29)

1. BANERJEE, S., GELFAND, A. E., FINLEY, A. O. and SANG, H. (2008). Gaussian predictive process models for large spatial data sets. J. R. Stat. Soc. Ser. B Stat. Methodol. 70 825-848. MR2523906
2. BELITSER, E. and GHOSAL, S. (2003). Adaptive Bayesian inference on themean of an infinite-dimensional normal distribution. Ann. Statist. 31 536-559. MR1983541
3. GHOSAL, S., GHOSH, J. K. and RAMAMOORTHI, R. V. (1999). Posterior consistency of Dirichlet mixtures in density estimation. Ann. Statist. 27 143-158. MR1701105
4. GHOSAL, S. (2001). Convergence rates for density estimation with Bernstein polynomials. Ann. Statist. 29 1264-1280. MR1873330
5. GHOSAL, S. and VAN DER VAART, A. W. (2001). Entropies and rates of convergence for maximum likelihood and Bayes estimation for mixtures of normal densities. Ann. Statist. 29 1233-1263. MR1873329
6. GHOSAL, S. and VAN DER VAART, A. (2007). Posterior convergence rates of Dirichlet mixtures at smooth densities. Ann. Statist. 35 697-723. MR2336864
7. GHOSAL, S. and VAN DER VAART, A. W. (2007). Convergence rates for posterior distributions for noniid observations. Ann. Statist. 35 192-223. MR2332274
8. GHOSAL, S., GHOSH, J. K. and VAN DER VAART, A. W. (2000). Convergence rates of posterior distributions. Ann. Statist. 28 500-531. MR1790007
9. GHOSAL, S., LEMBER, J. and VAN DER VAART, A. (2003). On Bayesian adaptation. In Proceedings of the Eighth Vilnius Conference on Probability Theory and Mathematical Statistics, Part II (2002). Acta Appl. Math. 79 165-175. MR2021886
10. GHOSAL, S., LEMBER, J. and VAN DER VAART, A. (2008). Nonparametric Bayesian model selection and averaging. Electron. J. Stat. 2 63-89. MR2386086
11. HIGDON, D. (2002). Space and space-time modeling using process convolutions. In Quantitative Methods for Current Environmental Issues 37-56. Springer, London. MR2059819
12. HUANG, T.-M. (2004). Convergence rates for posterior distributions and adaptive estimation. Ann. Statist. 32 1556-1593. MR2089134
13. KOLMOGOROV, A. N. and TIHOMIROV, V. M. (1961). ε-entropy and ε-capacity of sets in functional space. Amer. Math. Soc. Transl. Ser. 2 17 277-364. MR0124720
14. KRUIJER, W. and VAN DER VAART, A. (2008). Posterior convergence rates for Dirichlet mixtures of beta densities. J. Statist. Plann. Inference 138 1981-1992. MR2406419
15. KRUIJER, W., ROUSSEAU, J. and VAN DER VAART, A. W. (2009). Adaptive Bayesian density estimation with location-scale mixtures. Preprint, Univ. Paris Dauphine.
16. KUELBS, J. and LI, W. V. (1993). Metric entropy and the small ball problem for Gaussian measures. J. Funct. Anal. 116 133-157. MR1237989
17. LEMBER, J. and VAN DER VAART, A. W. (2007). On universal Bayesian adaptation. Statist. Decisions 25 127-152. MR2388859
18. LI, W. V. and LINDE, W. (1999). Approximation, metric entropy and small ball estimates for Gaussian measures. Ann. Probab. 27 1556-1578. MR1733160
19. LIFSHITS, M. A. (1995). Gaussian Random Functions. Mathematics and Its Applications 322. Kluwer Academic, Dordrecht. MR1472736
20. PETRONE, S. and WASSERMAN, L. (2002). Consistency of Bernstein polynomial posteriors. J. R. Stat. Soc. Ser. B Stat. Methodol. 64 79-100. MR1881846
21. ROUSSEAU, J. (2010). Rates of convergence for the posterior distributions of mixtures of betas and adaptive nonparametric estimation of the density. Ann. Statist. 38 146-180. MR2589319
22. SHORT, M. B., HIGDON, D. M. and KRONBERG, P. P. (2007). Estimation of Faraday rotation measures of the near galactic sky using Gaussian process models. Bayesian Anal. 2 665-680. MR2361969
23. TOKDAR, S. T. (2006). Posterior consistency of Dirichlet location-scale mixture of normals in density estimation and regression. Sankhya 68 90-110. MR2301566
24. VAN DER MEULEN, F. H., VAN DER VAART, A. W. and VAN ZANTEN, J. H. (2006). Convergence rates of posterior distributions for Brownian semimartingale models. Bernoulli 12 863-888. MR2265666
25. VAN DER VAART, A. W. and WELLNER, J. A. (1996). Weak Convergence and Empirical Processes. Springer, New York. MR1385671
26. VAN DER VAART, A. W. and VAN ZANTEN, J. H. (2009). Adapative Bayesian estimation using a Gaussian random field with inverse gamma bandwidth. Ann. Statist. 37 2655-2675. MR2541442
27. VAN DER VAART, A. W. and VAN ZANTEN, J. H. (2008). Rates of contraction of posterior distributions based on Gaussian process priors. Ann. Statist. 36 1435-1463. MR2418663
28. VAN DER VAART, A. W. and VAN ZANTEN, J. H. (2008). Reproducing kernel Hilbert spaces of Gaussian priors. In Pushing the Limits of Contemporary Statistics: Contributions in Honor of Jayanta K. Ghosh (B. Clarke and S. Ghosal, eds.) 200-222. IMS, Beachwood, OH. MR2459226
29. WU, Y. and GHOSAL, S. (2008). Kullback Leibler property of kernel mixture priors in Bayesian density estimation. Electron. J. Stat. 2 298-331. MR2399197