Block Gibbs sampling for Bayesian random effects models with improper priors: Convergence and regeneration

Journal of Computational and Graphical Statistics

Volumn 18, Issue 4, 2009, Pages 861-878

  Tan, Aixin ^a   Hobert, James P ^a  

^a University of Florida   (United States)

Author keywords

Asymptotic variance; Central limit theorem; Convergence rate; Geometric ergodicity; Minorization condition; One way model

Indexed keywords

EID: 72449129941     PISSN: 10618600     EISSN: None     Source Type: Journal    
DOI: 10.1198/jcgs.2009.08153     Document Type: Article

References (24)

1. Chan, K. S., and Geyer, C. J. (1994), Discussion of "Markov Chains for Exploring Posterior Distributions," by L. Tierney, The Annals of Statistics, 22, 1747-1758.
2. Daniels, M. J. (1999), "A Prior for the Variance in Hierarchical Models," The Canadian Journal of Statistics, 27, 567-578.
3. Diaconis, P., Khare, K., and Saloff-Coste, L. (2008), "Gibbs Sampling, Exponential Families and Orthogonal Polynomials" (with discussion), Statistical Science, 23, 151-200.
4. Gelfand, A. E., and Smith, A. F. M. (1990), "Sampling-Based Approaches to Calculating Marginal Densities," Journal of the American Statistical Association, 85, 398-409.
5. Gelman, A. (2006), "Prior Distributions for Variance Parameters in Hierarchical Models," Bayesian Analysis, 1, 515-533.
6. Geyer, C. J. (1992), "Practical Markov Chain Monte Carlo" (with discussion), Statistical Science, 7, 473-511.
7. Hill, B. M. (1965), "Inference About Variance Components in the One-Way Model," Journal of the American Statistical Association, 60, 806-825.
8. Hobert, J. P., and Casella, G. (1996), "The Effect of Improper Priors on Gibbs Sampling in Hierarchical Linear Mixed Models," Journal of the American Statistical Association, 91, 1461-1473.
9. Hobert, J. P., and Geyer, C. J. (1998), "Geometric Ergodicity of Gibbs and Block Gibbs Samplers for a Hierarchical Random Effects Model," Journal of Multivariate Analysis, 67, 414-430.
10. Hobert, J. P., Jones, G. L., Presnell, B., and Rosenthal, J. S. (2002), "On the Applicability of Regenerative Simulation in Markov Chain Monte Carlo," Biometrika, 89, 731-743.
11. Johnson, A. A., and Jones, G. L. (2008), "Gibbs Sampling for a Bayesian Hierarchical Version of the General Linear Mixed Model," techical report, University of Minnesota.
12. Jones, G. L., and Hobert, J. P. (2001), "Honest Exploration of Intractable Probability Distributions via Markov Chain Monte Carlo," Statistical Science, 16, 312-334.
13. - (2004), "Sufficient Burn-in for Gibbs Samplers for a Hierarchical Random Effects Model," The Annals of Statistics, 32, 784-817.
14. Jones, G. L., Haran, M., Caffo, B. S., and Neath, R. (2006), "Fixed-Width Output Analysis for Markov Chain Monte Carlo," Journal of the American Statistical Association, 101, 1537-1547.
15. Liu, J. S., Wong, W. H., and Kong, A. (1994), "Covariance Structure of the Gibbs Sampler With Applications to Comparisons of Estimators and Augmentation Schemes," Biometrika, 81, 27-40.
16. Lyles, R. H., Kupper, L. L., and Rappaport, S. M. (1997), "Assessing Regulatory Compliance of Occupational Exposures via the Balanced One-Way Random Effects ANOVA Model," Journal of Agricultural, Biological, and Environmental Statistics, 2, 417-439.
17. Meyn, S. P., and Tweedie, R. L. (1993), Markov Chains and Stochastic Stability, London: Springer-Verlag.
18. Mykland, P., Tierney, L., and Yu, B. (1995), "Regeneration in Markov Chain Samplers," Journal of the American Statistical Association, 90, 233-241.
19. Papaspiliopoulos, O., and Roberts, G. (2008), "Stability of the Gibbs Sampler for Bayesian Hierarchical Models," The Annals of Statistics, 36, 95-117.
20. Roberts, G. O., and Rosenthal, J. S. (2001), "Markov Chains and De-Initializing Processes," Scandinavian Journal of Statistics, 28, 489-504.
21. - (2004), "General State Space Markov Chains and MCMC Algorithms," Probability Surveys, 1, 20-71.
22. Tan, A. (2008), "Analysis of Markov Chain Monte Carlo Algorithms for Random Effects Models," Ph.D. thesis, University of Florida, Dept. of Statistics.
23. Tiao, G. C., and Tan, W. Y. (1965), "Bayesian Analysis of Random-Effect Models in the Analysis of Variance. I. Posterior Distribution of Variance Components," Biometrika, 52, 37-53.
24. van Dyk, D. A., and Meng, X.-L. (2001), "The Art of Data Augmentation" (with discussion), Journal of Computational and Graphical Statistics, 10, 1-50.