Maximizing generalized linear mixed model likelihoods with an automated Monte Carlo EM algorithm

Journal of the Royal Statistical Society. Series B: Statistical Methodology

Volumn 61, Issue 1, 1999, Pages 265-285

  Booth, James G ^a   Hobert, James P ^a,b  

^a UNIVERSITY OF FLORIDA   (United States)

^b University of Florida ^*  (United States)

Author keywords

Confidence ellipsoid; Hastings metropolis algorithm; Importance sampling; Laplace approximation; Markov chain Monte Carlo method; Rejection sampling; Salamander data; Sandwich variance estimate

Indexed keywords

EID: 0033475053     PISSN: 13697412     EISSN: None     Source Type: Journal    
DOI: 10.1111/1467-9868.00176     Document Type: Article

References (49)

1. Bates, D. M. and Watts, D. G. (1981) A relative offset orthogonality convergence criterion for nonlinear least squares. Technometrics, 23, 179-183.
2. Booth, J. G. and Hobert, J. P. (1998) Standard errors of prediction in generalized linear mixed models. J. Am. Statist. Ass., 93, 262-272.
3. Breslow, N. E. and Clayton, D. G. (1993) Approximate inference in generalized linear mixed models. J. Am. Statist. Ass., 88, 9-25.
4. Breslow, N. E. and Lin, X. (1995) Bias correction in generalized linear mixed models with a single component of dispersion. Biometrika, 82, 81-91.
5. de Bruijn, N. G. (1981) Asymptotic Methods in Analysis. New York: Dover Publications.
6. Celeux, G. and Diebolt, J. (1985) The SEM algorithm: a probabilistic teacher algorithm derived from the EM algorithm for the mixture problem. Comput. Statist. Q., 2, 73-82.
7. Chan, J. S. K. and Kuk, A. Y. C. (1997) Maximum likelihood estimation for probit-linear mixed models with correlated random effects. Biometrics, 53, 86-97.
8. Chan, K. S. and Geyer, C. J. (1994) Comments on Markov chains for exploring posterior distributions. Ann. Statist., 22, 1747-1757.
9. Chan, K. S. and Ledolter, J. (1995) Monte Carlo EM estimation for time series models involving counts. J. Am. Statist. Ass., 90, 242-252.
10. Cox, D. R. and Snell, E. J. (1988) Analysis of Binary Data, 2nd edn. London: Chapman and Hall.
11. Dempster, A. P., Laird, N. M. and Rubin, D. B. (1977) Maximum likelihood from incomplete data via the EM algorithm (with discussion). J. R. Statist. Soc. B, 39, 1-38.
12. Dorn, H. F. (1954) The relationship of cancer of the lung and the use of tobacco. Am. Statistn, 8, 7-13.
13. Geweke, J. (1996) Handbook of Computational Economics, ch. 15. Amsterdam: North-Holland.
14. Geyer, C. J. (1992) Practical Markov chain Monte Carlo. Statist. Sci., 7, 473-482.
15. Goldstein, H. (1991) Nonlinear multilevel models, with an application to discrete response data. Biometrika, 78, 45-51.
16. Hobert, J. P. and Geyer, C. J. (1997) Geometric ergodicity of Gibbs and block Gibbs samplers for a hierarchical random effects model. J. Multiv. Anal., to be published.
17. Karim, M. R. and Zeger, S. L. (1992) Generalized linear models with random effects; salamander mating revisited. Biometrics, 48, 631-644.
18. Kass, R. E. and Wasserman, L. (1996) The selection of prior distributions by formal rules. J. Am. Statist. Ass., 91, 1343-1370.
19. Kuk, A. Y. C. (1995) Asymptotically unbiased estimation in generalized linear models with random effects. J. R. Statist. Soc. B, 57, 395-407.
20. Lee, Y. and Neider, J. A. (1996) Hierarchical generalized linear models (with discussion). J. R. Statist. Soc. B, 58, 619-678.
21. Lin, X. and Breslow, N. E. (1996) Bias correction in generalized linear mixed models with multiple components of dispersion. J. Am. Statist. Ass., 91, 1007-1016.
22. Littell, R. C., Milliken, G. A., Stroup, W. W. and Wolfinger, R. D. (1996) SAS System for Mixed Models. Cary: SAS Institute.
23. Little, R. J. A. and Rubin, D. B. (1987) Statistical Analysis with Missing Data. New York: Wiley.
24. Liu, C. and Rubin, D. B. (1994) The ECME algorithm: a simple extension of EM and ECM with faster monotone convergence. Biometrika, 81, 633-648.
25. Longford, N. T. (1994) Logistic regression with random coefficients. Comput. Statist. Data Anal., 17, 1-15.
26. Louis, T. A. (1982) Finding the observed information matrix when using the EM algorithm. J. R. Statist. Soc. B, 44, 226-233.
27. McCullagh, P. (1981) A rapidly convergent series for computing ψ(z) and its derivatives. Math. Computn, 36, 247-248.
28. McCullagh, P. and Nelder, J. A. (1989) Generalized Linear Models, 2nd edn. London: Chapman and Hall.
29. McCulloch, C. E. (1994) Maximum likelihood variance components estimation for binary data. J. Am. Statist. Ass., 89, 330-335.
30. _(1997) Maximum likelihood algorithms for generalized linear mixed models. J. Am. Statist. Ass., 92, 162-170.
31. McGilchrist, C. A. (1994) Estimation in generalized mixed models. J. R. Statist. Soc. B, 56, 61-69.
32. McLachlan, G. J. and Krishnan, T. (1997) The EM Algorithm and Extensions. New York: Wiley.
33. Meng, X.-L. and van Dyk, D. (1997) The EM algorithm -an old folk-song sung to a fast new tune (with discussion). J. R. Statist. Soc. B, 59, 511-567.
34. Meng, X.-L. and Rubin, D. B. (1993) Maximum likelihood estimation via the ECM algorithm: a general framework. Biometrika, 80, 267-278.
35. Natarajan, R. and McCulloch, C. E. (1995) A note on the existence of the posterior distribution for a class of mixed models for binomial responses. Biometrika, 82, 639-643.
36. _(1998) Gibbs sampling with diffuse priors: a valid approach to data-driven inference? J. Comput. Graph. Statist., to be published.
37. Rai, S. N. and Matthews, D. E. (1993) Improving the EM algorithm. Biometrics, 49, 587-591.
38. Roberts, G. O. and Rosenthal, J. S. (1997) Geometric ergodicity and hybrid Markov chains. Electron. Communs Probab., 2, 13-25.
39. Sammel, M. D., Ryan, L. M. and Legler, J. M. (1997) Latent variable models for mixed discrete and continuous outcomes. J. R. Statist. Soc. B, 59, 667-678.
40. Schall, R. (1991) Estimation in generalized linear models with random effects. Biometrika, 78, 719-727.
41. Searle, S. R., Casella, G. and McCulloch, C. E. (1992) Variance Components. New York: Wiley.
42. Sinha, D., Tanner, M. A. and Hall, W. J. (1994) Maximization of the marginal likelihood of grouped survival data. Biometrika, 81, 53-60.
43. Steele, B. M. (1996) A modified EM algorithm for estimation in generalized mixed models. Biometrics, 52, 1295-1310.
44. Tanner, M. A. (1996) Tools for Statistical Inference: Methods for the Exploration of Posterior Distributions and Likelihood Functions, 3rd edn. New York: Springer.
45. Tierney, L. (1994) Markov chains for exploring posterior distributions (with discussion). Ann. Statist., 22, 1701-1762.
46. Wei, G. C. G. and Tanner, M. A. (1990) A Monte Carlo implementation of the EM algorithm and the poor man's data augmentation algorithms. J. Am. Statist. Ass., 85, 699-704.
47. Wolfinger, R. and O'Connell, M. (1993) Generalized linear mixed models: a pseudo-likelihood approach. J. Statist. Computn Simuln, 48, 233-243.
48. Wu, C. F. J. (1983) On the convergence properties of the EM algorithm. Ann. Statist., 11, 95-103.
49. Zeger, S. L. and Karim, R. M. (1991) Generalized linear models with random effects: a Gibbs sampling approach. J. Am. Statist. Ass., 86, 79-86.