Parameter expansion to accelerate em: the px-em algorithm

Biometrika

Volumn 85, Issue 4, 1998, Pages 755-770

  Liu, Chuanhai ^a,b,c   Rubin, Donald B ^a,b,c   Ying Nian, W U ^a,b,c  

^a LUCENT TECHNOLOGIES   (United States)

^b HARVARD UNIVERSITY   (United States)

^c UNIVERSITY OF MICHIGAN   (United States)

Author keywords

AECM; Algorithms; Covariance adjustment; ECM; ECME; Factor analysis; Multivariate t distribution; Parameter expansion; Poisson imaging model; Probit regression; Random effects model

Indexed keywords

EID: 0001508169     PISSN: 00063444     EISSN: None     Source Type: Journal    
DOI: 10.1093/biomet/85.4.755     Document Type: Article

References (34)

1. ARSLAN, O., CONSTABLE, P. D. L. & KENT, J. (1995). Convergence behavior of the EM algorithm for the multivariate t-distribution. Commun. Statist. A 24, 2981-3000.
2. CHAMBERS, J. M. & HASTIE, T. J. ( 1992). Statistical Models in S. Pacific Grove, CA: Wadsworth & Brooks/Cole Advanced Books & Software.
3. DEMPSTER, A. P., LAIRD, N. M. & RUBIN, D. B. (1977). Maximum likelihood estimation from incomplete data via the EM algorithm (with Discussion). J. R. Statist. Soc. B 39, 1-38.
4. FESSLER, J. A. & HERO, A. O. (1994). Space-alternating generalized expectation-maximization algorithm. IEEE Trans. Sig. Procès. 42, 2664-77.
5. GELFAND, A. E., SAHU, S. K. & CARLIN, B. P. (1995). Efficient parameterisations for normal linear mixed models. Biometrika 82, 479-88.
6. GELFAND, A. E. & SMITH, A. F. M. (1990). Sampling-based approaches to calculating marginal densities. J. Am. Statist. Assoc. 85, 398-409.
7. HARTLEY, H. O. & RAO, J. N. K. (1967). Maximum-likelihood estimation for the mixed analysis of variance model. Biometrika 54, 93-108.
8. JAMSHIDIAN, M. & JENNRICH, R. I. (1993). Conjugate gradient acceleration of the EM algorithm. J. Am. Statist. Assoc. 88, 221-8.
9. KENT, J. T., TYLER, D. E. & VARDI, Y. (1994). A curious likelihood identity for the multivariate t distribution. Commun. Statist. B, 23, 441-53.
10. LAIRD, N., LANGE, N. & STRAM, D. (1987). Maximizing likelihood computations with repeated measures: application of the EM algorithm. J. Am. Statist. Assoc. 82, 97-105.
11. LAIRD, N. M. & WARE, J. H. (1982). Random effects models for longitudinal data. Biometrics 38, 963-74.
12. LANGE, K. ( 1995a). A gradient algorithm locally equivalent to the EM algorithm. J. R. Statist. Soc. B 57,425-38.
13. LANGE, K. (1995b). A quasi-Newtonian acceleration of the EM algorithm. Statist. Sinica 5, 1-18.
14. LANGE, K. & CARSON, R. (1984). EM reconstruction for emission and transmission tomography. J. Comp, Assist. Tomog. 8, 306-16.
15. LANGE, K., LITTLE, R. J. A. & TAYLOR, J. M. G. (1989). Robust statistical modeling using the t-distribution. J. Am. Statist. Assoc. 84, 881-96.
16. LINDSTROM, M. J. & BATES, D. M. (1988). Newton-Raphson and EM algorithms for linear mixed-effects models for repeated-measures data. J. Am. Statist. Assoc. 83, 1014-22.
17. LITTLE, R. J. A. & RUBIN, D. B. (1987). Statistical Analysis with Missing Data. New York: John Wiley.
18. Liu, C. (1997). ML estimation of the multivariate t distribution and the EM algorithms. J. Mult. Anal. 63,296-312.
19. Liu, C. & RUBIN, D. B. (1994a). The ECME algorithm: a simple extension of EM and ECM with faster monotone convergence. Biometrika 81, 633-48.
20. Liu, C. & RUBIN, D. B. (1994b). Application of the ECME algorithm and the Gibbs sampler to general linear mixed models. In Proceedings of the XVIIth International Biometrie Conference, Hamilton, Ontario, 1 (invited papers), Ed. IBC '94 Local Organizing Committee, pp. 97-107. Dept of Mathematics and Statistics, McMaster's University
21. Liu, C. & RUBIN, D. B. (1995). ML estimation of the multivariate t distribution. Statist. Sinica, 5, 19-39.
22. Liu, C. & RUBIN, D. B. (1998). Maximum likelihood estimation of factor analysis using the ECME algorithm with complete and incomplete data. Statist. Sinica 8. To appear.
23. Liu, J. S., WONG, W. H. & KONG, A. (1995). Covariance structure of the Gibbs sampler with applications to the comparisons of estimators and augmentation schemes. Biometrika 81, 27-40.
24. MENG, X. L. & RUBIN, D. B. (1993). Maximum likelihood estimation via the ECM algorithm: a general framework. Biometrika 80, 267-78.
25. MENG, X. L. & VAN DYK, D. A. (1997). The EM algorithm -an old folk song sung to a fast new tune (with Discussion). J. R. Statist. Soc. B 59, 511-67.
26. MENG, X. L. & VAN DYK, D. A. (1998). Fast EM-type implementation for mixed effects models. J. R. Statist. Soc. B 60, 559-78.
27. RUBIN, D. B. (1983). Iteratively reweighted least squares. In Encyclopedia of Statistical Sciences 4, Ed. S. Kotz, N. L. Johnson and C. B. Read, pp. 272-5. New York: John Wiley.
28. RUBIN, D. B. (1987). Multiple Imputation for Nonresponse in Surveys. New York: Wiley.
29. RUBIN, D. B. & THAYER, D. T. (1982). EM algorithms for ML factor analysis. Psychometrika 47, 69-76.
30. SHEPP, L. A. & VARDI, Y. (1982). Maximum likelihood reconstruction for emission tomography. IEEE Trans. Image. Procès. 2, 113-22.
31. TANNER, M. A. & WONG, W. H. (1987). The calculation of posterior distributions by data augmentation (with Discussion). J. Am. Statist. Assoc. 82, 805-11.
32. TITTERINGTON, D. M., SMITH, A. F. M. & MAKov, U. E. (1985). Statistical Analysis of Finite Mixture Distributions. New York: John Wiley.
33. VARDI, Y., SHEPP, L. A. & KAUFMAN, L. (1985). A statistical model for positron emission tomography. J. Am. Statist. Assoc. 80, 8-19.
34. Wu, C. F.'J. (1983). On the convergence properties of the EM algorithm. Ann. Statist. II, 95-103.