Nesting EM algorithms for computational efficiency

Statistica Sinica

Volumn 10, Issue 1, 2000, Pages 203-225

  Van Dyk, David A ^a  

^a HARVARD UNIVERSITY   (United States)

Author keywords

Bridge sampling; Efficient data augmentation; Gibbs sampler; GLMM; Hierarchical models; Importance sampling; MCEM algorithm; MCMC; Probit models; t models; Working parameters

Indexed keywords

EID: 0034420823     PISSN: 10170405     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (25)

1. Chan, J. S. K. and Kuk, A. Y. C. (1997). Maximum likelihood estimation for probit-linear mixed models with correlated random effects. Biometrics 53, 86-97.
2. Chan, K. S. and Ledolter, J. (1995). Monte Carlo EM estimation for time series models involving counts. J. Amer. Statist. Assoc. 90, 242-252.
3. Dempster, A. P., Laird, N. M. and Rubin, D. B. (1977). Maximum likelihood estimation from incomplete-data via the EM algorithm (with discussion). J. Roy. Statist. Soc. Ser. B 39, 1-38.
4. Fessler, J. A. and Hero, A. O. (1994). Space-alternating generalized expectation-maximization algorithm. IEEE Tran. on Signal Processing 42, 2664-2677.
5. Levine, R. A. and Casella, G. (1999). Implementations to the Monte Carlo EM algorithm. Submitted to J. Comput. Graphical Statist.
6. Liu, C., Rubin, D. B. and Wu, Y. N. (1998). Parameter expansion for EM acceleration: the PX-EM algorithm. Biometrika 85, 755-770.
7. Liu, J. S., Wong, W. H. and Kong, A. (1995). Covariance structure and convergence rate of the Gibbs sampler with various scans. J. Roy. Statist. Soc. Ser. B 57, 157-169.
8. McCulloch, C. E. (1994). Maximum likelihood variance components estimation for binary data. J. Amer. Statist. Assoc. 89, 330-335.
9. McCulloch, C. E. (1997). Maximum likelihood algorithms for generalized linear mixed models. J. Amer. Statist. Assoc. 92, 162-170.
10. McLachlan, G. J. and Krishnan, T. (1997). The EM Algorithm and Extensions. John Wiley & Sons, New York.
11. Meng, X. L. and Schilling, S. (1996). Fitting full-information item factor models and an empirical investigation of bridge sampling. J. Amer. Statist. Assoc. 91, 1254-1267.
12. Meng, X. L. and Rubin, D. B. (1994). On the global and componentwise rates of convergence of the EM algorithm. Linear Algebra and Its Applications (Special issue honoring Ingram Olkin) 199, 413-425.
13. Meng, X. L. and van Dyk, D. A. (1997). The EM algorithm - an old folk song sung to a fast new tune (with discussion). J. Roy. Statist. Soc. Ser. B 59, 511-567.
14. Meng, X. L. and van Dyk, D. A. (1998). Fast EM implementations for mixed-effects models. J. Roy. Statist. Soc. Ser. B 60, 559-578.
15. Meng, X. L. and van Dyk, D. A. (1999). Seeking efficient data augmentation schemes via conditional and marginal augmentation. Biometrika 86, 301-320.
16. Meng, X. L. and Wong, W. H. (1996). Simulating ratios of normalizing constants via a simple identity: a theoretical exploration. Statist. Sinica 6, 831-860.
17. Potthoff, R. F. and Roy, S. N. (1964). A generalized multivariate analysis of variance model useful especially for growth curve problems. Biometrika 51, 313-326.
18. Roberts, G. O. and Sahu, S. K. (1997). Updating schemes, correlation structure, blocking and parameterization for the Gibbs sampler. J. Roy. Statist. Soc. Ser. B. 59, 291-317.
19. van Dyk, D. A. (1998). Nesting EM algorithms for computational efficiency. Unpublished Technical Report.
20. van Dyk, D. A. (2000a). Fitting mixed-effects models using efficient EM-type algorithms. J. Comput. Graphical Statist. To appear.
21. van Dyk, D. A. (2000b). Fast new EM-type algorithms with applications in astrophysics. Submitted to The Astrophysical J.
22. van Dyk, D. A., Conners, A., Kashyap, V. and Siemiginowska, A. (2000). Analysis of energy spectra with low photor counts via Bayesian posterior simulation. Unpublished Technical Report.
23. van Dyk, D. A. and Meng, X. L. (1999). The art of data augmentation. Submitted to Ann. Statist.
24. Wei, G. C. G. and Tanner, M. A. (1990). A Monte Carlo implementation of the EM algorithm and the poor man's data augmentation algorithm. J. Amer. Statist. Assoc. 85, 699-704.
25. Wu, C. F. J. (1983). On the convergence properties of the EM algorithm. Ann. Statist. 11, 95-103.