Inference from iterative simulation using multiple sequences

Statistical Science

Volumn 7, Issue 4, 1992, Pages 457-472

  Gelman, Andrew ^a   Rubin, Donald B ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b HARVARD UNIVERSITY   (United States)

Author keywords

Bayesian inference; Convergence of stochastic processes; ECM; EM; Gibbs sampler; Importance sampling; Metropolis algorithm; Multiple imputation; Random effects model; SIR

Indexed keywords

EID: 84972492387     PISSN: 08834237     EISSN: None     Source Type: Journal    
DOI: 10.1214/ss/1177011136     Document Type: Article

References (38)

1. BELIN, T. R. and RUBIN, D. B. (1990). Analysis of a finite mixture model with variance components. Proceedings of the Social Statistics Section 211-215. ASA, Alexandria, Va.
2. BELIN, T. R. and RUBIN, D. B. (1992). The analysis of repeated-measures data on Schizophrenic reaction times using mixture models. Technical report, Dept. Statistics, Harvard Univ.
3. BESAG, J. and GREEN, P. J. (1993). Spatial statistic and Bayesian computation. J. Roy. Statist. Soc. Ser. B 55. To appear.
4. CLOGG, C. C., RUBIN, D. B., SCHENKER, N., SCHULTZ, B. and WIDEMAN, L. (1991). Simple Bayesian methods for the analysis of logistic regression models. J. Amer. Statist. Assoc. 86 68-78.
5. DEMPSTER, A. P., LAIRD, N. M. and RUBIN, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm (with discussion). J. Roy. Statist. Soc. Ser. B 39 1-38.
6. FISHER, R. A. (1935). The Design of Experiments. Oliver and Boyd, Edinburgh.
7. FOSDICK, L. D. (1959). Calculation of order parameters in a binary alloy by the Monte Carlo method. Phys. Rev. 116 565-573.
8. GELFAND, A. E. and SMITH, A. F. M. (1990). Sampling-based approaches to calculating marginal densities. J. Amer. Statist. Assoc. 85 398-409.
9. GELFAND, A. E., HILLS, S. E., RACINE-POON, A. and SMITH, A. F. M. (1990). Illustration of Bayesian inference in normal data models using Gibbs sampling. J. Amer. Statist. Assoc. 85 398-409.
10. GELMAN, A. (1992). Iterative and non-iterative simulation algorithms. In Computing Science and Statistics: Proceedings of the 24th Symposium on the Interface. To appear.
11. GELMAN, A. and RUBIN, D. B. (1992). A single series from the Gibbs sampler provides a false sense of security. In Bayesian Statistics 4 (J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith, eds.) 625-632. Oxford Univ. Press.
12. GEMAN, S. and GEMAN, D. (1984). Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence 6 721-741.
13. GEWEKE, J. (1992). Evaluating the accuracy of sampling-based approaches to the calculation of posterior moments. In Bayesian Statistics 4 (J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith, eds.) 169-193. Oxford Univ. Press.
14. GILKS, W. R., CLAYTON, D. G., SPIEGELHALTER, D. J., BEST, N. G., MCNEIL, A. J., SHARPLES, L. D. and KIRBY, A. J. (1993). Modelling complexity: applications of Gibbs sampling in medicine. J. Roy. Statist. Soc. Ser. B 55. To appear.
15. GREEN, P. J. and HAN, X. (1991). Metropolis methods, Gaussian proposals, and antithetic variables. Lecture Notes in Statist. 74 142-164. Springer, New York.
16. HASTINGS, W. K. (1970). Monte-Carlo sampling methods using Markov chains and their applications. Biometrika 57 97-109.
17. HILLS, S. E. and SMITH, A. F. M. (1992). Parameterization issues in Bayesian inference. In Bayesian Statistics 4 (J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith, eds.) 627-633. Oxford Univ. Press.
18. KINDERMAN, R. and SNELL, J. L. (1980). Markov Random Fields and Their Applications. Amer. Math. Soc., Providence, R.I.
19. LIU, C. (1991). Qualifying paper, Dept. Statistics, Harvard Univ.
20. MCCULLOCH, R. and Rossi, P. E. (1992). An exact likelihood analysis of the multinomial probit model. Technical report.
21. MENG, X. L. and RUBIN, D. B. (1991). Using EM to obtain asymptotic variance-covariance matrices: The SEM algorithm. J. Amer. Statist. Assoc. 86 899-909.
22. MENG, X. L. and RUBIN, D. B. (1993). Maximum likelihood estimation via the ECM algorithm: A general framework. Biometrika, To appear.
23. METROPOLIS, N. and ULAM, S. (1949). The Monte Carlo method. J. Amer. Statist. Assoc. 44 335-341.
24. METROPOLIS, N., ROSENBLUTH, A. W., ROSENBLUTH, M. N., TELLER, A. H. and TELLER, E. (1953). Equation of state calculations by fast computing machines. J. Chem. Phys. 21 1087-1092.
25. MORRIS, C. N. (1988). Apprxomating posterior distributions and posterior moments. In Bayesian Statistics 3 (J. M. Bernardo, M. H. DeGroot, D. V. Lindley and A. F. M. Smith, eds.) 327-344. Oxford Univ. Press.
26. PRATT, J. W. (1965). Bayesian interpretation of standard inference statements. J. Roy. Statist. Soc. Ser. B 27 169-203.
27. RAFTERY, A. E. and LEWIS, S. (1992). How many iterations in the Gibbs sampler? In Bayesian Statistics 4 (J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith, eds.) 763-773. Oxford Univ. Press.
28. RIPLEY, B. D. (1987). Stochastic Simulation, chap. 6. Wiley, New York.
29. RUBIN, D. B. (1984). Bayesianly justifiable and relevant frequency calculations for the applied statistician. Ann. Statist. 12 1151-1172.
30. RUBIN, D. B. (1987a). Multiple Imputation for Nonresponse in Surveys. Wiley, New York.
31. RUBIN, D. B. (1987b). A noniterative sampling/importance resampling alternative to the data augmentation algorithm for creating a few imputations when fractions of missing information are modest: The SIR algorithm. Comment on “The calculation of posterior distributions by data augmentation,” by M. A. Tanner and W. H. Wong. J. Amer. Statist. Assoc. 82 543-546.
32. RUBIN, D. B. (1988). Using the SIR algorithm to simulate posterior distributions. In Bayesian Statistics 3 (J. M. Bernardo, M. H. DeGroot, D. V. Lindley and A. F. M. Smith, eds.) 395-402. Oxford Univ. Press.
33. SATTERTHWAITE, F. E. (1946). An approximate distribution of estimates of variance components Biometrics Bulletin 2 110-114.
34. SMITH, A. F. M. and ROBERTS, G. O. (1993). Bayesian computation via the Gibbs sampler and related Markov chain Monte Carlo methods. J. Roy. Statist. Soc. Ser. B 55. To appear.
35. TANNER, M. A. and WONG, W. H. (1987). The calculation of posterior distributions by data augmentation (with discussion). J. Amer. Statist. Assoc. 82 528-550.
36. TIERNEY, L. (1991). Exploring posterior distributions using Markov chains. In Computing Science and Statistics: Proceedings of the 23rd Symposium on the Interface (E. M. Keramidas, ed.) 563-570. Interface Foundation, Fairfax Station, Va.
37. TIERNEY, L. and KADANE, J. B. (1986). Accurate approximations for posterior moments and marginal densities. J. Amer. Statist. Assoc. 81 82-86.
38. ZEGER, S. L. and KARIM, M. R. (1991). Generalized linear models with random effects: A Gibbs sampling approach. J. Amer. Statist. Assoc. 86 79-86.