Functional compatibility, markov chains, and gibbs sampling with improper posteriors

Journal of Computational and Graphical Statistics

Volumn 7, Issue 1, 1998, Pages 42-60

  Hobert, James P ^a   Casella, George ^b  

^a University of Florida ^*  (United States)

^b Department of Obstetrics Gynecology   (United States)

Author keywords

Bayesian hierarchical model; Compatible conditional densities; Improper prior; Markov transition function; Monte Carlo; Null Markov chain

Indexed keywords

EID: 0032221034     PISSN: 10618600     EISSN: 15372715     Source Type: Journal    
DOI: 10.1080/10618600.1998.10474760     Document Type: Article

References (38)

1. Arnold, B. C., and Press, S. (1989), “Compatible Conditional Distributions,” Journal of the American Statistical Association, 84, 152-156.
2. Bartle, R. G. (1976), The Elements of Real Analysis, (2nd ed.), New York: Wiley.
3. Berger, J. O. (1985), Statistical Decision Theory and Bayesian Analysis, New York: Springer-Verlag.
4. Besag, J. (1974), “Spatial Interaction and the Statistical Analysis of Lattice Systems” (with discussion), Journal of the Royal Statistical Society, Series B, 36, 192-236.
5. Billingsley, P. (1986), Probability and Measure, (2nd ed.), New York: Wiley.
6. Casella, G., and George, E. I. (1992), “Explaining the Gibbs Sampler,” The American Statistician, 46, 167-174.
7. Chaloner, K. (1987), “A Bayesian Approach to the Estimation of Variance Components for the Unbalanced One-way Random Model,” Technometrics, 29, 323-337.
8. Chan, K. S. (1993), “Asymptotic Behavior of the Gibbs Sampler,” Journal of the American Statistical Association, 88, 320-326.
9. Chan, K. S., and Geyer, C. J. (1994), Comments on “Markov Chains for Exploring Posterior Distributions,” The Annals of Statistics, 22, 1747-1757.
10. Cowles, M. K., and Carlin, B. P. (1996), “Markov Chain Monte Carlo Convergence Diagnostics: A Comparative Review,” Journal of the American Statistical Association, 91, 883-904.
11. Gelfand, A. E., Hills, S. E., Racine-Poon, A., and Smith, A. F. M. (1990), “Illustration of Bayesian Inference in Normal Data Models Using Gibbs Sampling,” Journal of the American Statistical Association, 85, 972-985.
12. Gelfand, A. E., and Sahu, S. K. (1996), “Identifiability, Propriety and Parameterization with Regard to Simulation-Based Fitting of Generalized Linear Mixed Models,” technical report, University of Connecticut, Dept, of Statistics.
13. Gelfand, A. E., and Smith, A. F. M. (1990), “Sampling-Based Approaches to Calculating Marginal Densities,” Journal of the American Statistical Association, 85, 398-409.
14. Gelman, A., and Rubin, D. B. (1992), “Inference from Iterative Simulation Using Multiple Sequences” (with discussion), Statistical Science, 1, 457-472.
15. Gelman, A., and Speed, T. P. (1993), “Characterizing a Joint Probability Distribution by Conditionals,” Journal of the Royal Statistical Society, Series B, 55, 185-188.
16. Geweke, J. (1996), Handbook of Computational Economics, Amsterdam: North-Holland, chap. 15.
17. Geyer, C. J. (1992), “Practical Markov Chain Monte Carlo” (with discussion), Statistical Science, 7, 473-483.
18. Gourieroux, C., and Monfort, A. (1979), “On the Characterization of a Joint Probability Distribution by Conditional Distributions,” Journal of Econometrics, 10, 115-118.
19. Hill, B. M. (1965), “Inference about Variance Components in the One-Way Model,” Journal of the American Statistical Association, 60, 806-825.
20. Hill, B. M. (1975), “A Simple General Approach to Inference about the Tail of a Distribution,” The Annals of Statistics, 3, 1163-1174.
21. Hoben, J. P. (1994), “Occurrences and Consequences of Nonpositive Markov Chains in Gibbs Sampling,” unpublished PhD thesis, Cornell University, Biometrics Unit.
22. Hoben, J. P., and Casella, G. (1996), “The Effect of Improper Priors on Gibbs Sampling in Hierarchical Linear Mixed Models,” Journal of the American Statistical Association, 91, 1461-1473.
23. Ibrahim, J. G., and Laud, P. W. (1991), “On Bayesian Analysis of Generalized Linear Models Using Jeffreys’s Prior,” Journal of the American Statistical Association, 86, 981-986.
24. Kass, R. E., and Steffey, D. (1989), “Approximate Bayesian Inference in Conditionally Independent Hierarchical Models (Parametric Empirical Bayes Models),” Journal of the American Statistical Association, 84, 717- 726.
25. Lehmann, E. L. (1983), Theory of Point Estimation, Pacific Grove, CA: Wadsworth & Brook/Cole.
26. Liu, J. S., Wong, W. H., and Kong, A. (1994), “Covariance Structure of the Gibbs Sampler with Applications to the Comparisons of Estimators and Augmentation Schemes,” Biometrika, 81, 27-40.
27. Meyn, S. P., and Tweedie, R. L. (1993), Markov Chains and Stochastic Stability, London: Springer-Verlag.
28. Natarajan, R., and McCulloch, C. E. (1995), “A Note on the Existence of the Posterior Distribution for a Class of Mixed Models for Binomial Responses,” Biometrika, 82, 639-643.
29. Raftery, A. E., and Banfield, J. D. (1991), Comment on “Bayesian Image Restoration, with Two Applications in Spatial Statistics,” Annals of the Institute of Statistical Mathematics, 43, 32-43.
30. Roberts, G. O. (1992), “Convergence Diagnostics of the Gibbs Sampler,” in Bayesian Statistics 4. Proceedings of the Fourth Valencia International Meeting, eds. J. M. Bernardo, J. O. Berger, A. P. Dawid, and A. F. M. Smith, Oxford: Oxford University Press, pp. 775-782.
31. Robert, C. P. (1995), “Convergence Control Methods for Markov chain Monte Carlo Algorithms,” Statistical Science, 10, 231-253.
32. Roberts, G. O., and Poison, N. G. (1994), “On the Geometric Convergence of the Gibbs Sampler,” Journal of the Royal Statistical Society, Series B, 56, 377-384.
33. Roberts, G. O., Sahu, S. K., and Gilks, W. R. (1995), Comments on “Bayesian Computation and Stochastic Systems,” Statistical Science, 10, 49-51.
34. Tanner, M. A. (1996), Tools for Statistical Inference: Methods for the Exploration of Posterior Distributions and Likelihood Functions, (3rd ed.), New York: Springer.
35. Tiao, G. C., and Tan, W. Y. (1965), “Bayesian Analysis of Random-Effect Models in the Analysis of Variance. I: Posterior Distribution of Variance Components,” Biometrika, 52, 37-53.
36. Tierney, L. (1994), “Markov Chains for Exploring Posterior Distributions,” The Annals of Statistics, 22, 1701- 1762.
37. Tierney, L., Kass, R. E., and Kadane, J. B. (1989), “Fully Exponential Laplace Approximations to Expectations and Variances of Nonpositive Functions,” Journal of the American Statistical Association, 84, 710-716.
38. Wang, C. S., Rutledge, J. J., and Gianola, D. (1993), “Marginal Inferences about Variance Components in a Mixed Linear Model using Gibbs Sampling,” Genetique, Selection, Evolution, 25, 41-62.