Gibbs sampling for marginal posterior expectations

Communications in Statistics - Theory and Methods

Volumn 20, Issue 5-6, 1991, Pages 1747-1766

  Gelfand, Alan E ^a   Smith, Adrian F ^b  

^a UNIVERSITY OF CONNECTICUT   (United States)

^b IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

Aggregated Multinomial Model; Bayesian inference; Gibbs sampler; LaPlace method; marginal posterior expectations; Normal Linear Hierarchical Model; Variance Components Model

Indexed keywords

EID: 0008069734     PISSN: 03610926     EISSN: 1532415X     Source Type: Journal    
DOI: 10.1080/03610929108830595     Document Type: Article

References (39)

1. Achcar, J.A. and Smith, A.F.M. (1990). Aspects of reparametrization in approximate Bayesian inference. In Essays in Honor of George A. Barnard, J. Hodges editor; North—Holland.
2. Besag, J. (1974). Spatial interaction and the statistical analysis of lattice systems (with Discussion). Journal of the Royal Statistical Society B, 36, 192-326.
3. Box, G.E.P. and Tiao, G.C. (1973). Bayesian inference in statistical analysis. Addison—Wesley, Reading, MA.
4. Debruijn, N.G. (1961). Asymptotic Methods In Analysis. Amsterdam, North Holland.
5. Dempster, A., Laird, N. and Rubin, D. (1977). Maximum Likelihood from Incomplete Data via the E-M Algorithm (with Discussion). Journal of the Royal Statistical Society, B, 39, 1-38.
6. Devroye, L. (1986). Non-uniform random variate generation. Springer-Verlag, NY.
7. Ferguson, T. (1967). Mathematical Statistics: A Decision Theoretic Approach. Academic Press, N.Y.
8. Gelfand, A.E. and Smith, A.F.M. (1990). Sampling based approaches to calculating marginal densities, Journal of the American Statistical Association, 85, 398-409.
9. Gelfand, A.E., Hills, S.E., Racine-Poon, A., Smith, A.F.M. (1990) Illustration of Bayesian Inference In Normal Data Models Using Gibbs Sampling. Journal of the American Statistical Association, 85, 972-985.
10. Geman, S. and Geman, D. (1984). Stochastic relaxation, Gibbs distributions and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 6, 721—741.
11. Geweke, J. (1988). Antithetic acceleration of Monte Carlo integration in Bayesian inference. Journal of Econometrics, 38, 73-90.
12. Geweke, J. (1989). Bayesian Inference In Econometric Models Using Monte Carlo Integration. Econometrica (to appear).
13. Hartigan, J.A. (1965). The asymptotically unbiased prior distribution. Annals of Mathematical Statistics, 36, 1137-1152.
14. Hartley, H.O. (1958). Maximum Likelihood Estimation from Incomplete Data. Biometrics, 14, 174-194.
15. Hsu, J.S., Leonard, T. and Tsui, K. (1987). Bayesian and likelihood marginal inference with applications to contingency table analysis. Technical Report, Department of Statistics, University of Wisconsin.
16. Johnson, R.A. (1970). Asymptotic Expansions for Posterior Distributions. Annals of Mathematical Statistics, 41, 1266-1272.
17. Kass, R., Tierney, L. and Kadane, J.B. (1988). Asymptotics in Bayesian Computation in Bayesian Statistics, 3, J.M. Bernardo et al, editors, Oxford University Press, 261-278.
18. Kass, R.E. and Steffey, D.L. (1989). Approximate Inference in Conditionally Independent Hierarchical Models. (Parametric Empirical Bayes Models) Journal of American Statistical Association, 84, 717-726.
19. Lindley, D.V. (1961). “The Use of Prior Probability Distributions In Statistical Inference and Decisions.” Proc. 4th Berkeley Symp. 1, 453-68.
20. Lindley, D.V. (1980). “Approximate Bayesian Methods”. In: Bayesian Statistics, J.M. Bernardo, M.H. DeGroot, D.V. Lindley, A.F.M. Smith, University Press, Valencia, Spain.
21. Morris, C. “Approximating Posterior Distributions and Posterior Moments” In: Bayesian Statistics 3, J.M. Bernardo, M.H. DeGroot, D.V. Lindley and A.F.M. Smith, Eds. Oxford University Press, p. 327-344.
22. Naylor, J.C. and Smith, A.F.M. (1982). Applications of a method for the efficient computation of posterior distribution. Applied Statistics, 31, 214-225.
23. Naylor, J.C. and Smith, A.F.M. (1988). Econometric illustrations of novel numerical integration strategies for Bayesian inference. Journal of Econometrics, 38, 103-126.
24. Odell, P.L. and Feiveson, A.H. (1966). A numerical procedure to generate a sample covariance matrix. Journal of the American Statistical Association, 61, 198-203.
25. Racine-Poon, A. and Smith, A.F.M. (1989). Population Models. To appear in Statistical methodology in the Pharmaceutical Sciences (Ed. D. Berry). M. Dekker, Inc., NY.
26. Rubin, D.B. (1987). The SIR Algorithm — A discussion of Tanner and Wong’s “The Calculation of Posterior Distribution by Data Augmentation”. Journal of the American Statistical Association, 82, 543-546.
27. Rubin, D.B. (1988). Using the SIR Algorithm to Simulate Posterior Distributions. In: Bayesian Statistics, 3. Ed: J.M. Bernardo, M.H. DeGroot, D.V. Lindley, A.F.M. Smith, Oxford University Press, 395-402.
28. Shaw, J.E.H. (1988). A quasirandom approach to integration in Bayesian statistics. Annals of Statistics, 16, 895—914.
29. Silverman, B.W. (1986). Density Estimation for Statistics and Data Analysis, Chapman and Hall, London.
30. Smith, A.F.M., Skene, A.M., Shaw, J.E.H., Naylor, J.C. and Dransfield, M. (1985). The implementation of the Bayesian paradigm. Communications in Statistics, Theory and Methods, 14, 1079—1102.
31. Smith, A.F.M., Skene, A.M., Shaw, J.E.H., Naylor, J.C. (1987). Progress with numerical and graphical methods for Bayesian statistics. Statistician, 36, 75—82.
32. Stewart, L. (1983). Bayesian Analysis Using Monte Carlo Integration — A Powerful Methodology for Handling Some Difficult Problems. In: Practical Bayesian Statistics, A.P. David and A.F.M. Smith, Eds., Harlow, England, Longman.
33. Stewart, L. (1984). Multiparameter Parameter Bayesian Inference Using Monte Carlo Integration — Some Techniques for Bivariate Analysis. In Bayesian Statistics, J.M. Bernardo, M.H. DeGroot, D.V. Lindley, and A.F.M. Smith, Eds., North Holland, Amsterdam.
34. Tanner, M. and Wong, W.H. (1987). The calculation of posterior distributions by data augmentation (with discussion). J. Am. Statist. Assoc. 82, 528-50.
35. Tierney, L. and Kadane, J.B. (1986). Accurate approximations for posterior moments and marginal densities. Journal of the American Statistical Association, 81, 82—86.
36. Tierney, L., Kass, R.E. and Kadane, J.B. (1989a). Fully exponential LaPlace approximations to expectations and variances of nonpositive functions. Journal of the American Statistical Association, 84, 710-716.
37. Tierney, L., Kass, R.E. and Kadane, J.B. (1989b). Approximate Marginal Densities of Nonlinear Functions, Biometrika, 76, 425-436.
38. Van Dijk, H.K. and Kloek, T. (1980). Further experience in Bayesian Analysis Using Monte Carlo Integration, Journal of Econometrics, 14, p. 307-328.
39. Van Dijk, H.K. and Kloek, T. (1984). Experiment with some alternative for simple importance sampling in Monte Carlo integration. In Bayesian Statistics, 2, J.M. Bernardo, M.H. DeGroot, D.V. Lindiey, A.F.M. Smith, Eds., North Holland, Amsterdam.