Posterior consistency in conditional distribution estimation

Journal of Multivariate Analysis

Volumn 116, Issue , 2013, Pages 456-472

  Pati, Debdeep ^a   Dunson, David B ^b   Tokdar, Surya T ^b  

^a FLORIDA STATE UNIVERSITY   (United States)

^b DUKE UNIVERSITY   (United States)

Author keywords

Asymptotics; Bayesian nonparametrics; Density regression; Dependent Dirichlet process; Large support; Probit stick breaking process

Indexed keywords

EID: 84873946268     PISSN: 0047259X     EISSN: 10957243     Source Type: Journal    
DOI: 10.1016/j.jmva.2013.01.011     Document Type: Article

References (52)

1. Adler R. An Introduction to Continuity, Extrema, and Related Topics for General Gaussian Processes, Vol. 12 1990, Institute of Mathematical Statistics.
2. Barrientos F., Jara A., Quintana F. On the support of MacEachern's dependent Dirichlet processes. Bayesian Analysis 2012, 7:1-34.
3. Barron A., Schervish M., Wasserman L. The consistency of posterior distributions in nonparametric problems. The Annals of Statistics 1999, 27:536-561.
4. Bhattacharya A., Dunson D. Strong consistency of nonparametric Bayes density estimation on compact metric spaces with applications to specific manifolds. Annals of the Institute of Statistical Mathematics 2011, 1-28.
5. I. Castillo, R. Nickl, Nonparametric bernstein-von mises theorems, 2012. Preprint. arxiv:1208.3862.
6. Chung Y., Dunson D. Nonparametric Bayes conditional distribution modeling with variable selection. Journal of the American Statistical Association 2009, 104:1646-1660.
7. De Iorio M., Johnson W., Müller P., Rosner G. Bayesian nonparametric nonproportional hazards survival modeling. Biometrics 2009, 65:762-771.
8. De Iorio M., Mueller P., Rosner G., MacEachern S. An ANOVA model for dependent random measures. Journal of the American Statistical Association 2004, 99:205-215.
9. Dunson D., Park J. Kernel stick-breaking processes. Biometrika 2008, 95:307-323.
10. Dunson D., Pillai N., Park J. Bayesian density regression. Journal of the Royal Statistical Society: Series B 2007, 69:163-183.
11. Fan J., Yao Q., Tong H. Estimation of conditional densities and sensitivity measures in nonlinear dynamical systems. Biometrika 1996, 83:189-206.
12. Ferguson T. A Bayesian analysis of some nonparametric problems. The Annals of Statistics 1973, 1:209-230.
13. Ferguson T. Prior distributions on spaces of probability measures. The Annals of Statistics 1974, 2:615-629.
14. Freedman D. Wald lecture: on the Bernstein-von Mises theorem with infinite-dimensional parameters. The Annals of Statistics 1999, 27:1119-1141.
15. Gelfand A., Kottas A., MacEachern S. Bayesian nonparametric spatial modeling with Dirichlet process mixing. Journal of the American Statistical Association 2005, 100:1021-1035.
16. Ghosal S., Ghosh J., Ramamoorthi R. Posterior consistency of Dirichlet mixtures in density estimation. The Annals of Statistics 1999, 27:143-158.
17. Ghosal S., van der Vaart A. Entropies and rates of convergence for maximum likelihood and Bayes estimation for mixtures of normal densities. The Annals of Statistics 2001, 29:1233-1263.
18. Ghosal S., van der Vaart A. Posterior convergence rates of Dirichlet mixtures at smooth densities. The Annals of Statistics 2007, 35:697-723.
19. Griffin J., Steel M. Order-based dependent Dirichlet processes. Journal of the American Statistical Association 2006, 101:179-194.
20. Griffin J., Steel M. Bayesian nonparametric modelling with the dirichlet process regression smoother. Statistica Sinica 2010, 20:1507-1527.
21. Ishwaran H., James L. Gibbs sampling methods for stick-breaking priors. Journal of the American Statistical Association 2001, 96:161-173.
22. Jain S., Neal R. A split-merge Markov Chain Monte Carlo procedure for the dirichlet process mixture model. Journal of Computational and Graphical Statistics 2004, 13:158-182.
23. Jara A., Lesaffre E., De Iorio M., Quintana F. Bayesian semiparametric inference for multivariate doubly-interval-censored data. The Annals of Applied Statistics 2010, 4:2126-2149.
24. Kalli M., Griffin J., Walker S. Slice sampling mixture models. Statistics and computing 2010, 1-13.
25. Kruijer W., Rousseau J., Van Der Vaart A. Adaptive Bayesian density estimation with location-scale mixtures. Electronic Journal of Statistics 2010, 4:1225-1257.
26. Lo A. On a class of Bayesian nonparametric estimates: I. Density estimates. The Annals of Statistics 1984, 12:351-357.
27. MacEachern S.N. Dependent nonparametric processes. ASA Proceedings of the Section on Bayesian Statistical Science 1999, 50-55. American Statistical Association, Alexandria, VA.
28. Minka T.P. Expectation propagation for approximate Bayesian inference. Proceedings of the Seventeenth conference on Uncertainty in artificial intelligence 2001, 362-369. Morgan Kaufmann Publishers Inc.
29. Müller P., Erkanli A., West M. Bayesian curve fitting using multivariate normal mixtures. Biometrika 1996, 83:67-79.
30. Norets A. Approximation of conditional densities by smooth mixtures of regressions. The Annals of Statistics 2010, 38:1733-1766.
31. A. Norets, J. Pelenis, Posterior consistency in conditional density estimation by covariate dependent mixtures, Unpublished Manuscript, Princeton Univ, 2010.
32. O. Papaspiliopoulos, A note on posterior sampling from Dirichlet mixture models, Technical Report, 2008.
33. Papaspiliopoulos O., Roberts G. Retrospective Markov chain Monte Carlo methods for Dirichlet process hierarchical models. Biometrika 2008, 95:169.
34. Papaspiliopoulos O., Roberts G. Retrospective Markov Chain Monte Carlo methods for Dirichlet process hierarchical models. Biometrika 2008, 95:169-183.
35. D. Pati, D. Dunson, Bayesian nonparametric regression with varying residual density, Unpublished Paper, 2009.
36. Rivoirard V., Rousseau J. Bernstein-von Mises theorem for linear functionals of the density. The Annals of Statistics 2012, 40:1489-1523.
37. Rodriguez A., Dunson D. Nonparametric Bayesian models through probit stick-breaking processes. Bayesian Analysis 2011, 6:145-178.
38. A. Rojas, C. Genovese, C. Miller, R. Nichol, L. Wasserman, Conditional density estimation using finite mixture models with an application to astrophysics, 2005.
39. Scricciolo C. Posterior rates of convergence for dirichlet mixtures of exponential power densities. Electronic Journal of Statistics 2011, 5:270-308.
40. W. Shen, S. Tokdar, S. Ghosal, Adaptive Bayesian multivariate density estimation with Dirichlet mixtures, 2011. Preprint. arxiv:1109.6406.
41. Tang Y., Ghosal S. A consistent nonparametric Bayesian procedure for estimating autoregressive conditional densities. Computational Statistics & Data Analysis 2007, 51:4424-4437.
42. Tang Y., Ghosal S. Posterior consistency of Dirichlet mixtures for estimating a transition density. Journal of Statistical Planning and Inference 2007, 137:1711-1726.
43. Tokdar S. Posterior consistency of Dirichlet location-scale mixture of normals in density estimation and regression. Sankhyā: The Indian Journal of Statistics 2006, 67:90-110.
44. S. Tokdar, Adaptive convergence rates in Dirichlet process mixtures of multivariate normals, 2011. Preprint. arxiv:1111.4148.
45. Tokdar S., Ghosh J. Posterior consistency of logistic Gaussian process priors in density estimation. Journal of Statistical Planning and Inference 2007, 137:34-42.
46. Tokdar S., Zhu Y., Ghosh J. Bayesian density regression with logistic Gaussian process and subspace projection. Bayesian Analysis 2010, 5:1-26.
47. van der Vaart A., van Zanten J. Reproducing kernel Hilbert spaces of Gaussian priors. IMS Collections 2008, 3:200-222.
48. van der Vaart A., van Zanten J. Adaptive Bayesian estimation using a Gaussian random field with inverse Gamma bandwidth. The Annals of Statistics 2009, 37:2655-2675.
49. Walker S. Sampling the Dirichlet mixture model with slices. Communications in Statistics-Simulation and Computation 2007, 36:45-54.
50. Wu Y., Ghosal S. Kullback Leibler property of kernel mixture priors in Bayesian density estimation. Electronic Journal of Statistics 2008, 2:298-331.
51. Wu Y., Ghosal S. The L1-consistency of Dirichlet mixtures in multivariate Bayesian density estimation. Journal of Multivariate Analysis 2010, 2411-2419.
52. J. Yoon, Bayesian analysis of conditional density functions: a limited information approach, Unpublished Manuscript, Claremont Mckenna College, 2009.