Space-Alternating Generalized Expectation-Maximization Algorithm

IEEE Transactions on Signal Processing

Volumn 42, Issue 10, 1994, Pages 2664-2677

  Fessler, Jeffrey A ^a   Hero, Alfred O ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONVERGENCE OF NUMERICAL METHODS; IMAGE RECONSTRUCTION; OPTIMIZATION; PARAMETER ESTIMATION; SIGNAL PROCESSING; WHITE NOISE;

GAUSSIAN NOISE; HIDDEN DATA SPACES; SPACE ALTERNATING GENERALIZED EXPECTATION MAXIMIZATION ALGORITHM;

ALGORITHMS;

EID: 0028517016     PISSN: 1053587X     EISSN: 19410476     Source Type: Journal    
DOI: 10.1109/78.324732     Document Type: Article

References (43)

1. A. P. Dempster, N. M. Laird, and D. B. Rubin, “Maximum likelihood from incomplete data via the EM algorithm,” J. Royal Stat. Soc. Series B, vol. 39, no. 1, pp. 1–38, 1977.
2. M. Feder and E. Weinstein, “Parameter estimation of superimposed signals using the EM algorithm,” IEEE Trans. Acoust., Speech, Signal Processing, vol. 36, no. 4, pp. 477–489, Apr. 1988
3. K. Lange and R. Carson, “EM reconstruction algorithms for emission and transmission tomography,” J. Comp. Assisted Tomography, vol. 8, no. 2, pp. 306–316, Apr. 1984.
4. A. O. Hero and J. A. Fessler, “Asymptotic convergence properties of EM-type algorithms,” Communications and Signal Processing Laboratory, Dept. of EECS, Univ. of Michigan, Ann Arbor, MI, Technical Report 282, Apr. 1993.
5. J. A. Fessler, N. H. Clinthorne, and W. Leslie Rogers, “On complete data spaces for PET reconstruction algorithms,” IEEE Trans. Nucl Sci., vol. 40, no. 4, pp 1055–1061, Aug. 1993.
6. J. A. Fessler and A. O. Hero, “Complete-data spaces and generalized EM algorithms,” in Proc. IEEE Conf ASSP, 1993, vol. 4, pp. 1–4.
7. D. G. Politte and D. L. Snyder, “Corrections for accidental coinci-dences and attenuation in maximum-likelihood image reconstruction for positron-emission tomography,” IEEE Trans. Med. Imag., vol. 10, no. 1, pp. 82–89, Mar. 1991.
8. J. A. Fessler and A. O. Hero, “New complete-data spaces and faster algorithms for penalized-likelihood emission tomography,” in Conf Rec. IEEE Nucl. Sci. Symp. Med. Imag., 1993, pp. 1897–1901.
9. P. J. Green, “On use of the EM algorithm for penalized likelihood estimation,” J. Royal Stat. Soc. Series B, vol. 52, no. 3, pp. 443–452, 1990.
10. T. Hebert and R. Leahy, “A Bayesian reconstruction algorithm for emission tomography using a Markov random field prior,” in Proc. SPIE 1092, Med. Imag. III: Image Processing, 1989, pp. 458–466.
11. T. Hebert and R. Leahy, “A generalized EM algorithm for 3-D Bayesian reconstruction from Poisson data using Gibbs priors,” IEEE Trans. Med. Imag., vol. 8, no. 2, pp. 194–202, June 1989.
12. J. A. Fessler, N. H. Clinthorne, and W. L. Rogers, “Regularized emission image reconstruction using imperfect side information,” IEEE Trans. Nucl. Sci., vol. 39, no. 5, pp. 1464–1471, Oct. 1992.
13. K. Lange, “Convergence of EM image reconstruction algorithms with Gibbs smoothing,” IEEE Trans. Med. Imag., vol. 9, no. 4, pp. 439–446, Dec. 1990 (Corrections, June 1991).
14. B. W. Silverman et al. “A smoothed EM approach to indirect estimation problems, with particular reference to stereology and emission tomography,” J. Royal Stat. Soc. Series B, vol. 52, no 2, pp. 271–324, 1990.
15. A. R. De Pierro, “A generalization of the EM algorithm for maximum likelihood estimates from incomplete data,” Med. Imag. Processing Group, Dept. of Radiology, Univ. of Pennsylvania, Technical Report MIPG119 1987.
16. G. T. Herman, A. R. De Pierro, and N. Gai, “On methods for maximum a posteriori image reconstruction with a normal prior,” J. Visual Commun. Image. Represent., vol. 3, no. 4, pp. 316–324, Dec. 1992.
17. A. R. De Pierro, “A modified expectation maximization algorithm for penalized likelihood estimation in emission tomography,” to be published in IEEE Trans. Med. Imag.
18. M. Abdalla and J. W. Kay, “Edge-preserving image restoration,” in Stochastic Models, Statistical Methods, and Algorithms in Image Analysis (P. Borne, A. Frigessi, and M. Piccioni, Eds.)., vol. 74 of Lecture Notes in Statistics. New York: Springer, 1992, pp. 1–13.
19. C. Bouman and K. Sauer, “Fast numerical methods for emission and transmission tomographic reconstruction,” in Proc. Conf Inform. Sci. Syst. Johns Hopkins, 1993.
20. C. Bouman and K. Sauer, “A unified approach to statistical tomography using coordinate descent optimization,” 1993, submitted to IEEE Trans. Med. Imag.
21. T. A. Louis, “Finding the observed information matrix when using the EM algorithm,” J. Royal Stat. Soc. Series B, vol. 44, no. 2, pp. 226–233, 1992.
22. R. M. Lewitt and G. Muehllehner, “Accelerated iterative reconstruction for positron emission tomography based on the EM algorithm for maximum likelihood estimation,” IEEE Trans. Med. Imag., vol. MI-5, no. 1, pp. 16–22, Mar. 1986.
23. L. Kaufman, “Implementing and accelerating the EM algorithm for positron emission tomography,” IEEE Trans. Med. Imag., vol. MI-6, no. 1, pp. 37–51, Mar. 1987.
24. I. Meilijson, “A fast improvement to the EM algorithm on its own terms,” J. Royal Stat. Soc. Series B, vol. 5, no. 1, pp. 127-138, 1989.
25. M. Jamshidian and R. I. Jennrich, “Conjugate gradient acceleration of the EM algorithm,” J. Amer. Stat. Assoc., vol. 88, no. 421, pp. 221–228, 1993.
26. K. Sauer and C. Bouman, “A local update strategy for iterative reconstruction from projections,” IEEE Trans. Signal Processing, vol. 41, no. 2, pp. 534–548, Feb. 1993.
27. W. H. Press et al., Numerical Recipes in C. Cambridge, UK: Cambridge Univ. Press, 1988.
28. M. Segal and W. Weinstein, “The cascade EM algorithm,” Proc. IEEE, vol 76, no. 10, pp. 1388–1390, Oct. 1988.
29. J. A. Fessler, “Penalized weighted least-squares image reconstruction for positron emission tomography,” IEEE Trans. Med. Imag., vol. 13, no 2, 290–300, June 1994.
30. J. A. Fessler and A. O. Hero, “Space-alternating generalized EM algorithms for penalized maximum-likelihood image reconstruction,” Commun. and Signal Processing Lab., Dept. of Elec. Eng. and Comp. Sci., Univ. of Michigan, Ann Arbor, MI, Tech. Rep. 286, Feb. 1994.
31. R. Boyles, “On the convergence of the EM algorithm,” J. Royal StaL Soc. Series B, vol. 45, no. I, pp. 47–50, 1993.
32. L. A. Shepp and Y. Verdi, “Maximum likelihood reconstruction for emission tomography,” IEEE Trans. Med. Imag., vol. M1-1, no. 2, pp. 113–122, Oct. 1982.
33. C. L. Byrne, “Iterative image reconstruction reconstruction algorithms based on cross-entropy minimization,” IEEE Trans. Imag. Processing, vol. 2, no. 1, 96–103, Jan. 1993.
34. L. Kaufman, “Maximum likelihood, least squares, and penalized least squares for PET,” IEEE Trans. Med. Imag., vol. 12, no. 2, pp. 200–214, June 1993.
35. J. A. Fessler, “Object-based 3-D reconstuction of arterial trees from a few projections,” Ph.D. thesis, Stanford Univ., Stanford, CA, Aug. 1990.
36. D. Chazan, Y. Stettiner, and D. Malah, “Optimal multi-path estimation using the EM algorithm for co-channel speech separation,” in Proc. IEEE Conf. Acoust., Speech, Signal Processing, 1993, vol. 2, pp. 728–731.
37. D. M. Young. Iterative Solution of Large Linear Systems. New York: Academic, 1971.
38. I. Ziskind and M. Wax, “Maximum liklihood localization of multiple sources by alternating projection,” IEEE Trans. Acoust., Speech, Signal Processing, vol. 26, no. 10, pp. 1553–1560, Oct. 1988.
39. S. Kayalar and H. L. Weinert, “Error bounds for the method of alternating projections,” Math Contr. Signals Syst., vol. 1, pp. 43–59, 1988.
40. C. F. J. Wu, “On the convergence properties of the EM algorithm,” Ann. Stat., vol. 11, no. 1, pp. 95–103, 1983.
41. J. M. Ortega and W. C. Rheinboldt, Iterative Solution of Nonlinear in Several Variables. New York: Academic, 1970.
42. E. Polak, Computational Methods in Optimization: a Unified Approach. Orlando, FL: Academic, 1971.
43. A. O. Hero and J. A. Fessier, “Convergence in norm for alternating expectation-maximization (EM)-type algorithms,” to be published in Statistica Sinica.