Prior distributions for variance parameters in hierarchical models (Comment on Article by Browne and Draper)

Bayesian Analysis

Volumn 1, Issue 3, 2006, Pages 515-534

  Gelman, Andrew ^a  

^a Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

Bayesian inference; Conditional conjugacy; Folded noncentral t distribution; Half t distribution; Hierarchical model; Multilevel model; Noninformative prior distribution; Weakly informative prior distribution

Indexed keywords

EID: 84867086419     PISSN: 19360975     EISSN: 19316690     Source Type: Journal    
DOI: 10.1214/06-BA117A     Document Type: Note

References (50)

1. Barnard, J., McCulloch, R. E., and Meng, X. L. (2000). "Modeling covariance matrices in terms of standard deviations and correlations, with application to shrinkage." Statistica Sinica, 10: 1281-1311.
2. Bayarri, M. J. and Berger, J. (2000). "P-values for composite null models." Journal of the American Statistical Association, 95: 1127-1142. (with discussion).
3. Bernardo, J. M. (1979). "Reference posterior distributions for Bayesian inference." Journal of the Royal Statistical Society B, 41: 113-147. (with discussion).
4. Bickel, P. and Blackwell, D. (1967). "A note on Bayes estimates." Annals of Mathematical Statistics, 38: 1907-1911.
5. Box, G. E. P. (1980). "Sampling and Bayes inference in scientific modelling and robustness." Journal of the Royal Statistical Society A, 143: 383-430.
6. Box, G. E. P. and Tiao, G. C. (1973). Bayesian Inference in Statistical Analysis. Reading, Mass.: Addison-Wesley.
7. Browne, W. J. and Draper, D. (2005). "A comparison of Bayesian and likelihood-based methods for fitting multilevel models." Bayesian Analysis, This issue.
8. Carlin, B. P. and Louis, T. A. (2001). Bayes and Empirical Bayes Methods for Data Analysis. Chapman and Hall, second edition edition.
9. Christiansen, C. and Morris, C. (1997). "Hierarchical Poisson regression models." Journal of the American Statistical Association, 92: 618-632.
10. Daniel, C. (1959). "Use of half-normal plots in interpreting factorial two-level experiments." Technometrics, 1: 311-341.
11. Daniels, M. J. (1999). "A prior for the variance in hierarchical models." Canadian Journal of Statistics, 27: 569-580.
12. Daniels, M. J. and Kass, R. E. (1999)). "Nonconjugate Bayesian estimation of covariance matrices and its use in hierarchical models." Journal of the American Statistical Association, 94: 1254-1263.
13. Daniels, M. J. and Kass, R. E. (2001). "Shrinkage estimators for covariance matrices." Biometrics, 57: 1173-1184.
14. Efron, B. and Morris, C. (1975). "Data analysis using Stein's estimator and its generalizations." Journal of the American Statistical Association, 70: 311-319.
15. Gelfand, A. E. and Smith, A. F. M. (1990). "Sampling-based approaches to calculating marginal densities." Journal of the American Statistical Association, 85: 398-409.
16. Gelman, A. (2003). "Bugs.R: functions for calling Bugs from R." http://www.stat.columbia.edu/~gelman/bugsR/.
17. Gelman, A. (2004). "Parameterization and Bayesian modeling." Journal of the American Statistical Association, 99: 537 - 545.
18. Gelman, A. (2005). "Analysis of variance: why it is more important than ever." Annals of Statistics, 33: 1 - 53. With discussion.
19. Gelman, A., Carlin, J. B., Stern, H. S., and Rubin, D. B. (2003). Bayesian Data Analysis. London: Chapman and Hall, second edition edition.
20. Gelman, A., Huang, Z., van Dyk, D., and Boscardin, W. J. (2005). "Transformed and parameter-expanded Gibbs samplers for multilevel linear and generalized linear models." Technical report, Department of Statistics, Columbia University.
21. Gelman, A., Meng, X. L., and Stern, H. S. (1996). "Posterior predictive assessment of model fitness via realized discrepancies." Statistica Sinica, 6: 733-807. (with discussion).
22. Hill, B. M. (1965). "Inference about variance components in the one-way model." Journal of the American Statistical Association, 60: 806-825.
23. James, W. and Stein, C. (1960). "Estimation with quadratic loss." In Neyman, J. (ed.), Proceedings of the Fourth Berkeley Symposium, volume 1, 361-380. Berkeley: University of California Press.
24. Jaynes, E. T. (1983). Papers on Probability, Statistics, and Statistical Physics. Dordrecht, Netherlands: Reidel.
25. Jeffreys, H. (1961). Theory of Probability. Oxford University Press, third edition edition.
26. Johnson, N. L. and Kotz, S. (1972). Distributions in Statistics. New York: Wiley. 4 vols.
27. Kass, R. E. and Raftery, A. E. (1995). "Bayes factors and model uncertainty." Journal of the American Statistical Association, 90: 773-795.
28. Kass, R. E. and Wasserman, L. (1996). "The selection of prior distributions by formal rules." Journal of the American Statistical Association, 91: 1343-1370.
29. Kreft, I. and De Leeuw, J. (1998). Introducing Multilevel Modeling. Sage.
30. Liu, C. (2001). "Bayesian analysis of multivariate probit models. Discussion of "The art of data augmentation" by D. A. van Dyk and X. L. Meng." Journal of Computational and Graphical Statistics, 10: 75-81.
31. Liu, C., Rubin, D. B.,, and Wu, Y. N. (1998). "Parameter expansion to accelerate EM: the PX-EM algorithm." Biometrika, 85: 755-770.
32. Liu, J. and Wu, Y. N. (1999). "Parameter expansion for data augmentation." Journal of the American Statistical Association, 94: 1264-1274.
33. Meng, X. L. and Zaslavsky, A. M. (2002). "Single observation unbiased priors." Annals of Statistics, 30: 1345-1375.
34. Morris, C. (1983). "Parametric empirical Bayes inference: theory and applications (with discussion)." Journal of the American Statistical Association, 78: 47-65.
35. Natarajan, R. and Kass, R. E. (2000). "Reference Bayesian methods for generalized linear mixed models." Journal of the American Statistical Association, 95: 227-237.
36. O'Hagan, A. (1995). "Fractional Bayes factors for model comparison (with discussion)." Journal of the Royal Statistical Society B, 57: 99-138.
37. Pauler, D. K., Wakefield, J. C., and Kass, R. E. (1999). "Bayes factors for variance component models." Journal of the American Statistical Association, 94: 1242-1253.
38. Portnoy, S. (1971). "Formal Bayes estimation with applications to a random effects model." Annals of Mathematical Statistics, 42: 1379-1402.
39. R Development Core Team (2003). "R: a language and environment for statistical computing. Vienna: R Foundation for Statistical Computing." http://www.r-project.org.
40. Raudenbush, S. W. and Bryk, A. S. (2002). Hierarchical Linear Models. Thousand Oaks, Calif.: Sage., second edition.
41. Rubin, D. B. (1981). "Estimation in parallel randomized experiments." Journal of Educational Statistics, 6: 377-401.
42. Sargent, D. J. and Hodges, J. S. (1997). "Smoothed ANOVA with application to subgroup analysis." Technical report, Department of Biostatistics, University of Minnesota.
43. Savage, L. J. (1954). The Foundations of Statistics. New York: Dover.
44. Snijders, T. A. B. and Bosker, R. J. (1999). Multilevel Analysis. London: Sage.
45. Spiegelhalter, D. J., Abrams, K. R.,, and Myles, J. P. (2004). Bayesian Approaches to Clinical Trials and Health-Care Evaluation, chapter section 5.7.3. Chichester: Wiley.
46. Spiegelhalter, D. J., Thomas, A., Best, N. G., Gilks, W. R.,, and Lunn, D. (1994, 2003). "BUGS: Bayesian inference using Gibbs sampling." MRC Biostatistics Unit, Cambridge, England,http://www.mrc-bsu.cam.ac.uk/bugs/.
47. Stein, C. (1955). "Inadmissibility of the usual estimator for the mean of a multivariate normal distribution." In Neyman, J. (ed.), Proceedings of the Third Berkeley Symposium, volume 1, 197-206. Berkeley: University of California Press.
48. Stone, M. and Springer, B. G. F. (1965). "A paradox involving quasi-prior distributions." Biometrika, 52: 623-627.
49. Tiao, G. C. and Tan, W. Y. (1965). "Bayesian analysis of random-effect models in the analysis of variance. I: Posterior distribution of variance components." Biometrika, 52: 37-53.
50. van Dyk, D. A. and Meng, X. L. (2001). "The art of data augmentation (with discussion)." Journal of Computational and Graphical Statistics, 10: 1-111.