Stability relationships among the gibbs sampler and its subchains

Journal of Computational and Graphical Statistics

Volumn 10, Issue 2, 2001, Pages 185-205

  Hobert, James P ^a  

^a University of Florida   (United States)

Author keywords

Data augmentation; Improper posterior; Linear state space model; Markov chain; Monte carlo; Null recurrence; Positive recurrence; Random walk; Transience

Indexed keywords

EID: 0035609584     PISSN: 10618600     EISSN: 15372715     Source Type: Journal    
DOI: 10.1198/10618600152628130     Document Type: Article

References (29)

1. Arnold, B. C., andPress, S. J. (1989), “Compatible ConditionalDistributions,” Journalof theAmerican Statistical Association, 84, 152-156.
2. Berger, J. O. (1985), StatisticalDecision Theory and Bayesian Analysis (2nd ed.), New York: Springer-Verlag.
3. Berger, J. O. (1996), Comments on “Statistical Inference and MonteCarlo Algorithms”by G. Casella, Test, 5, 293-295.
4. Casella, G. (1996), “Statistical Inference and Monte Carlo Algorithms” (with discussion), Test, 5, 249-34
5. Casella, G., and George, E. I. (1992), “Explaining the Gibbs Sampler,” The American Statistician, 46, 167-174.
6. Diebolt, J., and Robert, C. P. (1994), “Estimation ofFinite Mixture Distributionsby Bayesian Sampling,” Journal of the Royal StatisticalSociety, Series B, 56, 363-375.
7. Eaton, M. L. (1992), “A Statistical Diptych: Admissible Inferences-Recurrence of Symmetric Markov Chains,” The Annals of Statistics, 20, 1147-1179.
8. Eaton, M. L. (1997), “Admissibility in Quadratically Regular Problems and Recurrence of Symmetric Markov Chains: Why the Connection?” Journal ofStatistical Planning and Inference, 64, 231-247.
9. Feller, W. (1971), An Introduction to Probability Theory and its Applications (vol. II), New York: Wiley.
10. Gelfand, A. E., and Sahu, S. K. (1999), “Identifiability, Improper Priors and Gibbs Sampling for Generalized Linear Models,” Journal of the American Statistical association, 94, 247-253.
11. Gelfand, A. E., and Smith, A. F. M. (1990), “Sampling-Based Approaches to Calculating Marginal Densities,” Journal of the American Statistical association, 85, 398-409.
12. George, E. I. (1996), Comments on “Statistical Inference and Monte Carlo Algorithms” by G. Casella, Test, 5, 304-305.
13. Hobert, J. P., and Casella, G. (1996), “The Effect of Improper Priors on Gibbs Sampling in Hierarchical Linear Mixed Models,” Journal of the American Statistical Association, 91, 1461-1473.
14. Hobert, J. P., and Casella, G. (1998), “Functional Compatibility, Markov Chains, and Gibbs Sampling with ImproperPosteriors,” Jour nal of Computationaland Graphical Statistics, 7, 42-60.
15. Hobert, J. P., and Robert, C. P. (1999), “Eaton’s Markov Chain, its ConjugatePartner and P-admissibility,” The Annals of Statistics, 27, 361-373.
16. Liu, C. (1999), “Compatibility Conditions for a Set of Conditional Gaussian Distributions,” Statistics and Proba bility Letters, 42, 127-130.
17. Liu, J. S., Wong, W. H., and Kong, A. (1994), “Covariance Structure of the Gibbs Sampler with Applications to the Comparisons of Estimators and Augmentation Schemes,” Biometrika, 81, 27-40.
18. Liu, J. S., Wong, W. H., and Kong, A. (1995), “Covariance Structure and Convergence Rate of the Gibbs Sampler with Various Scans,” Journal of the Royal StatisticalSociety, Series B, 57, 157-169.
19. Liu, J. S., andWu, Y. N. (1999), “ParameterExpansionforDataAugmentation,” Journalof theAmericanStatistical Association, 94, 1264-1274.
20. Lyons, T. (1983), “A Simple Criterion for Transience of a Reversible Markov Chain,” The Annals ofProbability, 11, 393-402.
21. Meng, X. -L., and van Dyk, D. A. (1999), “Seeking Efficient Data Augmentation Schemes Via Conditional and Marginal Augmentation,” Biometrika, 86, 301-320.
22. Meyn, S. P., and Tweedie, R. L. (1993), Markov Chains and Stochastic Stability, London: Springer-Verlag.
23. Robert, C. P. (1995), “Convergence Control Methods for Markov Chain Monte Carlo Algorithms,” Statistical Science, 10, 231-253.
24. Roberts, G. O., and Rosenthal, J. S. (2001), “Markov Chains and De-initialising Processes,” to appear in Scandi navian Journal of Statistics.
25. Roberts, G. O., and Sahu, S. K. (1997), “Updating Schemes, Correlation Structure, Blocking and Parameterization for the Gibbs Sampler,” Journal of the Royal Statistical Society, Series B, 59, 291-317.
26. Roberts, G. O., Sahu, S. K., andGilks, W. R. (1995), Comments on“Bayesian ComputationandStochsticSystems” by J. Besag, P. Green, D. Higdon, and K. Mengersen, Statistical Science, 10, 49-51.
27. Tanner, M. A., andWong, W. H. (1987), “The CalculationofPosteriorDistributionsby Data Augmentation” (with discussion), Journal of the American Statistical association, 82, 528-550.
28. Tierney, L. (1994), “Markov Chains for Exploring Posterior Distributions” (with discussion), The Annals of Statistics, 22, 1701-1762.
29. van Dyk, D. A., and Meng, X. -L. (2001), “The Art of Data Augmentation” (with discussion), Journal ofCompu- tationalandGraphicalStatistics, 10, 1-111