Parabolic acceleration of the em algorithm

Statistics and Computing

Volumn 19, Issue 1, 2009, Pages 35-47

  Berlinet, A ^a   Roland, C ^b  

^a UNIVERSITÉ DE MONTPELLIER   (France)

^b UNIVERSITÉ LILLE 1   (France)

Author keywords

Acceleration; Convergence; EM algorithm; Finite mixture; Fixed point iteration; Linear mixed model; Multivariate Student distribution; Restart strategies; Stability

Indexed keywords

EID: 58149481660     PISSN: 09603174     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11222-008-9067-x     Document Type: Article

References (25)

1. A. Berlinet Ch. Roland 2007 Acceleration schemes with application to the EM algorithm Comput. Stat. Data Anal. 51 3689 3702
2. C. Biernacki 2004 Initializing EM using the properties of its trajectories in Gaussian mixtures Stat. Comput. 14 3 267 279
3. C. Biernacki G. Celeux G. Govaert 2003 Choosing starting values for the EM algorithm for getting the highest likelihood in multivariate Gaussian mixture models Comput. Stat. Data Anal. 41 561 575
4. Brezinski, C., Zaglia, M.R.: Extrapolation Methods: Theory and Practice. Elsevier Science, Amsterdam (1991)
5. Cappé, O., Moulines, E., Rydén, T.: Inference in Hidden Markov Models. Springer, New York (2005)
6. A.P. Dempster N.M. Laird D.B. Rubin 1977 Maximum likelihood from incomplete data via the EM algorithm (with discussion) J. R. Stat. Soc. B 39 1 38
7. V. Hasselblad 1969 Estimation of finite mixtures of distributions from the exponential family J. Am. Stat. Assoc. 64 1459 1471
8. M. Jamshidian R.I. Jennrich 1993 Conjugate gradient acceleration of the EM algorithm J. Am. Stat. Assoc. 88 221 228
9. M. Jamshidian R.I. Jennrich 1997 Acceleration of the EM algorithm by using quasi-Newton methods J. R. Stat. Soc. B 59 3 569 587
10. J.T. Kent D.E. Tyler Y. Vardi 1994 A curious likelihood identity for the multivariate t distribution Commun. Stat. B 23 441 453
11. K. Lange 1995 A quasi-Newton acceleration of the EM algorithm Stat. Sin. 5 1 18
12. Lee, E.T.Y.: The rational Bézier representation for conics. In: Farin, G.E. (ed.) Geometric Modeling: Algorithms and New Trends. SIAM, Philadelphia (1987)
13. C. Liu D.B. Rubin 1994 The ECME algorithm: a simple extension of EM and ECM with faster monotone convergence Biometrika 81 633 648
14. C. Liu D.B. Rubin Y.N. Wu 1998 Parameter expansion to accelerate EM: The PX-EM algorithm Biometrika 85 755 770
15. M. Markatou A. Basu B.G. Lindsay 1998 Weighted likelihood equations with boostrap root search J. Am. Stat. Assoc. 93 442 740 750
16. McLachlan, G., Krishnan, T.: The EM Algorithm and Extensions, 1st edn. Wiley, New York (1997)
17. McLachlan, G., Krishnan, T.: The EM Algorithm and Extensions, 2nd edn. Wiley, New York (2008)
18. McLachlan, G., Peel, D.: Finite Mixture Models. Wiley, New York (2000)
19. X.L. Meng D. Rubin 1993 Maximum likelihood estimation via the ECM algorithm: A general framework Biometrika 80 267 278
20. X.L. Meng D. van Dyk 1997 The EM algorithm-an old folk-song sung to a fast new tune J. R. Stat. Soc. B 59 511 567
21. Snedecor, G.W., Cochran, W.C.: Statistical Methods. Iowa State University Press, Ames (1967)
22. Titterington, D.M., Smith, A.F.M., Makov, U.E.: Statistical Analysis of Finite Mixture Distributions' pp. 89-90. Wiley, New York (1985)
23. Varadhan, R., Roland, Ch.: Squared extrapolation methods (SQUAREM): A new class of simple and efficient numerical schemes for accelerating the convergence of the EM algorithm. Department of Biostatistics Working Paper, Johns Hopkins University (2004). http://www.bepress.com/jhubiostat/paper63
24. J.H. Wolfe 1970 Pattern clustering by multivariate mixture analysis Multivar. Behav. Res. 5 329 350
25. C.F.J. Wu 1983 On the convergence properties of the EM algorithm Ann. Stat. 11 95 103