A noniterative sampling method for computing posteriors in the structure of EM-type algorithms

Statistica Sinica

Volumn 13, Issue 3, 2003, Pages 625-639

  Tan, Ming ^a   Tian, Guo Liang ^a   Ng, Kai Wang ^b  

^a UNIVERSITY OF MARYLAND   (United States)

^b UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Bayesian computation; Data augmentation; EM algorithm; Gibbs sampler; Inverse Bayes formulae; MCMC; Sampling importance resampling

Indexed keywords

EID: 0012546232     PISSN: 10170405     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (32)

1. Besag, J. (1974). Spatial interaction and the statistical analysis of lattice systems (with discussions). J. Roy. Statist. Soc. Ser. B 36, 192-236.
2. Casella, G., Lavine, M. and Robert, C. P. (2001). Explaining the Perfect Sampler. Amer. Statist. 55, 299-305.
3. Chen, M. H., Shao, Q. M. and Ibrahim, J. G. (2000). Monte Carlo Methods in Bayesian Computation. Springer, New York.
4. Chib, S. (1995). Marginal likelihood from the Gibbs output. J. Amer. Statist. Assoc. 90, 1313-1321.
5. Chib, S. and Greenberg, E. (1998). Analysis of multivariate probit models. Biometrika 85, 347-361.
6. Dempster, A. P., Laird, N. M. and Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm (with discussion). J. Roy. Statist. Soc. Ser. B 39, 1-38.
7. Gelfand, A. E. (2002). Gibbs sampling. In Statistics in the list Century (Edited by A. E. Raftery, M. A. Tanner and M. T. Wells), 341-349. Chapman and Hall/CRC, Boca Raton.
8. Gelfand, A. E. and Dey, D. K. (1994). Bayesian model choice: asymptotic and exact calculations. J. Roy. Statist. Soc. Ser. B 56, 501-514.
9. Gelfand, A. E. and Smith, A. F. M. (1990). Sampling-based approaches to calculating marginal densities. /. Amer. Statist. Assoc. 85, 398-409.
10. Green, P. J. and Murdoch, D. J. (1999). Exact sampling for Bayesian inference: towards general purpose algorithms (with discussion). In Bayesian Statistics 6 (Edited by J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith), 301-321. Oxford University Press, Oxford.
11. Hammersley, J. M. and Clifford, M. S. (1970). Markov fields on finite graphs and lattices. Unpublished.
12. Jones, G. L. and Hobert, J. P. (2001). Honest exploration of intractable probability distribution via Markov chain Monte Carlo. Statist. Sci. 16, 312-334.
13. Laird, N. M. and Ware, J. H. (1982). Random effects models for longitudinal data. Biometrics 38, 963-974.
14. Liu, C. H. and Rubin, D. B. (1994). The ECME algorithm: A simple extension of EM and ECM with faster monotone convergence. Biometrika 81, 633-648.
15. Liu, C. H., Rubin, D. B. and Wu, Y. N. (1998). Parameter expansion to accelerate EM - the PX-EM algorithm. Biometrika 85, 755-770.
16. Louis, T. A. (1982). Finding the observed information matrix when using the EM algorithm. J. Roy. Statist. Soc. Ser. B 44, 226-233.
17. McCulloch, C. E. (1997). Maximum likelihood algorithms for generalized linear mixed models. J. Amer. Statist. Assoc. 92, 162-170.
18. Meng, X.L. (1996). Comment on "statistical inference and Monte Carlo algorithms" byG. Casella. Test 5, 310-318.
19. Meng, X.L. and van Dyk, D.A. (1997). The EM algorithm - an old folk song sung to a fast new tune (with discussion).J. Roy. Statist. Soc. Ser. B 59, 511-567.
20. Newton, M. A. and Raftery, A. E. (1994). Approximate Bayesian inference with the weighted likelihood bootstrap (with discussion). J. Roy. Statist. Soc. Ser. 556, 3-48.
21. Ng, K. W. (1997). Inversion of Bayes formula: explicit formulas for unconditional pdf. In Advances in the Theory and Practice in Statistics (Edited by N. L. Johnson and N. Balakrishnan), 571-584. Wiley, New York.
22. Pothoff, R. F. and Roy, S. N. (1964). A generalized multivariate analysis of variance model useful especially for growth curve problems. Biometrika 51, 313-326.
23. Qiu, Z., Song, P. and Tan, M. (2002). Bayesian hierarchical models for multi-level ordinal data using WinBUGS. J. Biopharm. Statist. 12, 121-135,
24. Robert, C. P. and Casella, G. (1999). Monte Carlo Statistical Methods. Springer, New York.
25. Rubin, D. B. (1988). Using the SIR algorithm to simulate posterior distributions (with discussion). In Bayesian Statistics 3 (Edited by J. M. Bernardo, M. H. DeGroot, D. V. Lindley and A. F. M. Smith), 395-402. Oxford University Press, Oxford.
26. Smith, A. F. M. and Gelfand, A. E. (1992). Bayesian statistics without tears: a sampling-resampling perspective. Amer. Statist. 46, 84-88.
27. Tan, M., Fang, H. B., Tian, G. L. and Houghton, P. J. (2002). Small-sample inference for incomplete longitudinal data with truncation and censoring in tumor xenograft models. Biometrics 58, 612-620.
28. Tanner, M. A. and Wong, W. H. (1987). The calculation of posterior distributions by data augmentation (with discussion). J. Amer. Statist. Assoc. 82, 528-540.
29. Tian, G. L., Ng, K. W. and Geng, Z. (2003). Baysian computation for contingency tables with incomplete cell-counts. Statist. Sinica 13, 189-206.
30. Tian, G. L. and Tan, M. (2003). Exact statistical solutions using the inverse Bayes formulae. Statist. Probab. Lett. 62, 305-315.
31. Tierney, L. and Kadane, J. B. (1986). Accurate approximations for posterior moments and marginal densities. J. Amer. Statist. Assoc. 81, 82-86.
32. Verbeke, G. and Molenberghs, G. (2000). Linear Mixed Models for Longitudinal Data. Springer, New York.