The Effect of Improper Priors on Gibbs Sampling in Hierarchical Linear Mixed Models

Journal of the American Statistical Association

Volumn 91, Issue 436, 1996, Pages 1461-1473

  Hobert, James P ^a   Casella, George ^b  

^a University of Florida ^*  (United States)

^b Department of Obstetrics Gynecology   (United States)

Author keywords

Animal breeding; Compatibility; Functional compatibility; Improper posterior; Markov chain; Monte Carlo; Variance components

Indexed keywords

EID: 0030327881     PISSN: 01621459     EISSN: 1537274X     Source Type: Journal    
DOI: 10.1080/01621459.1996.10476714     Document Type: Article

References (36)

1. Arnold, B. C., and Press, S. J. (1989), "Compatible Conditional Distributions," Journal of the American Statistical Association, 84, 152-156.
2. Berger, J. O. (1985), Statistical Decision Theory and Bayesian Analysis (2nd ed.), New York: Springer-Verlag.
3. Besag, J. (1974), "Spatial Interaction and the Statistical Analysis of Lattice Systems" (with discussion), Journal ofthe Royal Statistical Society, Ser. B, 36, 192-236.
4. Brook, D. (1964), "On the Distinction Between the Conditional Probability and the Joint Probability Approaches in the Specification of NearestNeighbour Systems," Biometrika, 51, 481-483.
5. Casella, G., and Berger, R. L. (1994), "Estimation With Selected Binomial Information or, Do You Really Believe That Dave Winfield is Batting.471 ?," Journal of the American Statistical Association, 89, 1080-1090.
6. Casella, G., and George, E. I. (1992), "Explaining the Gibbs Sampler," The American Statistician, 46, 167-174.
7. Datta, G. S. (1992), "A Unified Bayesian Prediction Theory for Mixed Linear Models With Application," Statistics and Decisions, 10, 337-365.
8. Datta, G. S., and Ghosh, M. (1991), "Bayesian Prediction in Linear Models: Applications to Small Area Estimation," The Annals of Statistics, 19, 1748-1770.
9. Dey, D. K., Gelfand, A. E., and Peng, F. (l994), "Overdispersed Generalized Linear Models," technical report, University of Connecticut, Dept. of Statistics.
10. Gelfand, A. E., and Smith, A. F. M. (1990), "Sampling-Based Approaches to Calculating Marginal Densities," Journal of the American Statistical Association, 85, 398-409.
11. Gelfand, A. E., Hills, S. E., Racine-Poon, A., and Smith, A. F. M. (1990), "lllustration of Bayesian Inference in Normal Data Models Using Gibbs Sampling," Journal ofthe American Statistical Association, 85, 972-985.
12. Gelman, A., and Speed, T. P. (1993), "Characterizing a Joint Probability Distribution by Conditionals," Journal of the Royal Statistical Society, Ser. B, 55, 185-188.
13. Geman, S., and Geman, D. (1984), "Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images," IEEE Transactions on Pattern Analysis and Machine Intelligence, 6, 721-741.
14. Geyer, C. J. (1991), "Markov Chain Monte Carlo Maximum Likelihood," in Computing Science and Statistics: Proceedings ofthe 23rd Symposium on the Interface, ed. E. M. Keramides, Fairfax, VA: Interface Foundation.
15. Geyer, C. J. (1992), "Practical Markov Chain Monte Carlo" (with discussion), Statistical Science, 7, 473-511.
16. Geyer, C. J., and Thompson, E. A. (1992), "Constrained Monte Carlo Maximum Likelihood for Dependent Data" (with discussion), Journal of the Royal Statistical Society, Ser. B, 54, 657-499.
17. Ghosh, M., and Rao, J. N. K. (1994), "Small Area Estimation: An Appraisal" (with discussion), Statistical Science, 9, 55-93.
18. Hartigan, I. A. (1983), Bayes Theory, New York: Springer-Verlag.
19. Hill, B. M. (1965), "Inference About Variance Components in the One-Way Model," Journal of the American Statistical Association, 60, 806-825.
20. Hobert, J. P. (1994), "Occurrences and Consequences of Nonpositive Markov Chains in Gibbs Sampling," Ph.D. thesis, Cornell University.
21. Hobert, I. P., and Casella, G. (1995), "Functional Compatibility, Markov Chains and Gibbs Sampling with Improper Posteriors," Technical Report 481, University of Florida, Dept. of Statistics.
22. Ibrahim, I. G., and Laud, P. W (1991), "On Bayesian Analysis of Generalized Linear Models Using Jeffreys's Prior," Journal of the American Statistical Association, 86,981-986.
23. Kass, R. E., and Steffey, D. (1989), "Approximate Bayesian Inference in Conditionally Independent Hierarchical Models (Parametric Empirical Bayes Models)," Journal of the American Statistical Association, 84, 717-726.
24. Marshall, A. W, and Olkin, I. (1979), Inequalities: Theory ofMajorization 1473 and Its Applications, New York: Academic Press.
25. McCulloch, C. E. (1996), "Fixed and Random Effects and Best Prediction," to appear: Proceedings of the Kansas State Conference on Applied Statistics in Agriculture.
26. Meyn, S. P., and Tweedie, R L. (1993), Markov Chains and Stochastic Stability, New York: Springer-Verlag.
27. Natarajan, R, and McCulloch, C. E. (1995), "A Note on the Existence of the Posterior Distribution for a Class of Mixed Models for Binomial Responses," Biometrika, 82, 639-643.
28. Robert, C. P. (1995), "Convergence Control Methods for Markov Chain Monte Carlo Algorithms," Statistical Science, 10, 231-253.
29. Schervish, M. I., and Carlin, B. P. (1992), "On the Convergence of Successive Substitution Sampling," Journal of Computational and Graphical Statistics, 1, 111-127.
30. Searle, S. R (1982), Matrix Algebra Usefulfor Statistics, New York: Wiley.
31. Searle, S. R., Casella, G., and McCulloch, C. E. (1992), Variance Components, New York: Wiley.
32. Tiao, G. C., and Tan, W Y. (1965), "Bayesian Analysis of Random-Effect Models in the Analysis of Variance. I. Posterior Distribution of Variance Components," Biometrika, 52, 37-53.
33. Tierney, L. (1994), "Markov Chains for Exploring Posterior Distributions" (with discussion), The Annals of Statistics, 22, 1701-1762.
34. Wang, C. S., Rutledge, J. J., and Gianola, D. (1993), "Marginal Inferences About Variance Components in a Mixed Linear Model Using Gibbs Sampling," Genetique, Selection, Evolution, 25, 41-42.
35. Wang, C. S., Rutledge, J. J., and Gianola, D. (1994), "Bayesian Analysis of Mixed Linear Models via Gibbs Sampling With an Application to Litter Size of Iberian Pigs," Genetique, Selection, Evolution, 26, 1-25.
36. Zeger, S. L., and Karim, M. R. (1991), "Generalized Linear Models With Random Effects: A Gibbs Sampling Approach," Journal ofthe American Statistical Association, 86, 79-86.