On convergence of the EM algorithm and the Gibbs sampler

Statistics and Computing

Volumn 9, Issue 1, 1999, Pages 55-64

  Sahu, Sujit K ^a   Roberts, Gareth O ^b  

^a CARDIFF UNIVERSITY   (United Kingdom)

^b LANCASTER UNIVERSITY   (United Kingdom)

Author keywords

Gaussian distribution; Generalized linear mixed models; Markov chain monte carlo; Parameterization; Rate of convergence

Indexed keywords

EID: 0041375875     PISSN: 09603174     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1008814227332     Document Type: Article

References (30)

1. Breslow, N. E. and Clayton, D. G. (1993) Approximate inference in generalized linear mixed models. J. Amer. Statist. Assoc., 88, 9-25.
2. Box, G. E. P. and Tiao, G. C. (1992) Bayesian Inference in Statistical Analysis. London: Addison-Wesley.
3. Crowder, M. J. (1978) Beta-binomial ANOVA for proportions. Appl. Statist., 27, 34-37.
4. Dellaportas, P. and Smith, A. F. M. (1993) Bayesian inference for generalised linear and proportional hazards models via Gibbs sampling. Appl. Statist., 42, 443-59.
5. Dempster, A. P., Laird, N. M. and Rubin, D. B. (1977) Maximum likelihood from incomplete data via the EM algorithm (with discussion). J.R. Statist. Soc. B, 39, 1-38.
6. Gamerman, D. (1997) Markov Chain Monte Carlo. London: Chapman and Hall.
7. Gelfand, A. E., Sahu, S. K. and Carlin, B. P. (1995) Efficient parametrization for normal linear mixed models. Biometrika, 82, 479- 88.
8. Gelman, A. (1997) Discussion of the paper by Meng and van Dyk. J. R. Statist. Soc. B, 59, 554.
9. Gilks, W. R. (1997) Discussion of the paper by Meng and van Dyk. J. R. Statist. Soc. B, 59, 543-45.
10. Gilks, W. R., Best, N. G. and Tan, K. K. C. (1995) Adaptive Rejection Metropolis Sampling within Gibbs Sampling. Appl. Statist., 455-72.
11. Gilks, W. R., Richardson, S. and Spiegelhalter, D. G. (1996) Markov Chain Monte Carlo In Practice, London: Chapman and Hall.
12. Jacobs, D. (Eds.) (1977) The State of the Art in Numerical Analysis. London: Academic Press.
13. Liu, C., Rubin, D. B. and Wu, Y. (1998) Parameter expansion for EM acceleration: the PX-EM algorithm. Biometrika, 85, 973-979.
14. Liu, J. S. (1996) Fraction of Missing Information and Convergence Rate of Data Augmentation. Preprint.
15. McCullagh, P. and Nelder, J. A. (1989) Generalized Linear Models. London: Chapman and Hall.
16. McCulloch, C. E. (1997) Maximum Likelihood Algorithms for Generalized Linear Mixed Models. J. Amer. Statist. Assoc., 92, 162-70.
17. Meng, X.-L. (1994) On the Rate of Convergence of the ECM Algorithm. Ann. Statist., 22, 326-339.
18. Meng, X.-L. and Rubin, D. B. (1993) Maximum likelihood estimation via the ECM algorithm: a general framework. Biometrika, 80, 267-78.
19. Meng, X-L. and van Dyk, D. (1997) The EM algorithm - an old folk-song sung to a fast new tune (with discussion). J. R. Statist. Soc. B, 59, 511-67.
20. Roberts, G. O. and Sahu, S. K. (1996) Rate of Convergence of the Gibbs Sampler by Gaussian Approximation. Technical Report, University of Cambridge.
21. Roberts, G. O. and Sahu, S. K. (1997) Updating Schemes, Correlation Structure, Blocking and Parameterisation for the Gibbs Sampler. J. R. Statist. Soc. B, 59, 291-317.
22. Roberts, G. O. and Sahu, S. K. (1997b) Discussion of the paper by Meng and van Dyk. J. R. Statist. Soc. B, 59, 558-59.
23. Sahu, S. K. (1997) Bayesian Estimation and Model Choice in Item Response Models. Available from http://www.cf.ac.uk/ uwcc/maths/sahu/.
24. Schafer, D. W. (1987) Covariate measurement error in generalized linear models. Biometrika, 74, 385-91.
25. Steele, B. M. (1996) A Modified EM Algorithm for Estimation in Generalized Mixed Models. Biometrics, 52, 1295-310.
26. Spiegelhalter, D. J., Thomas, A. and Best, N. G. (1996) Computation on Bayesian graphical models. In Bayesian Statistics 5, (Eds. J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith). Oxford: Oxford University Press, pp. 407-26.
27. Tanner, M. A. (1996) Tools for Statistical Inference. Springer-Verlag: Heidelberg.
28. van Dyk, D. and Meng, X.-L. (1997) On the Orderings and Groupings of Conditional Maximizations within ECM-type Algorithms. J. Comput. Graph. Statist., 6, 202-23.
29. Wedderburn, R. W. M. (1976) On the existence and uniqueness of the maximum likelihood estimates for certain generalized linear models. Biometrika, 63, 27-32.
30. Whitmore, A. S. and Keller J. B. (1989) Approximations for Regression With Covariate Measurement Error. J. Amer. Statist. Assoc., 83, 1057-66.