Iterative Image Reconstruction Algorithms Based on Cross-Entropy Minimization

IEEE Transactions on Image Processing

Volumn 2, Issue 1, 1993, Pages 96-103

  Byrne, Charles L ^a  

^a UNIVERSITY OF MASSACHUSETTS LOWELL   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; DECISION THEORY; ENTROPY; FUNCTION EVALUATION; ITERATIVE METHODS; OPTIMIZATION;

CROSS-ENTROPY MINIMIZATION; ITERATIVE ALGORITHMS; LIKELIHOOD MAXIMIZATION; TOMOGRAPHIC IMAGES;

IMAGE RECONSTRUCTION;

EID: 0027190119     PISSN: 10577149     EISSN: 19410042     Source Type: Journal    
DOI: 10.1109/83.210869     Document Type: Article

References (46)

1. A. Rockmore and A. Macovski, “A maximum likelihood approach to emission image reconstruction from projections,” IEEE Trans. Nucl. Sci., vol. NS-23, pp. 1428–1432, 1976.
2. L. Shepp and Y. Vardi, “Maximum likelihood reconstruction for emission tomography,” IEEE Trans. Med. Imaging, vol. MI-1, pp. 113–122, Oct. 1982.
3. K. Lange and R. Carson, “EM reconstruction for emission and transmission tomography,” J. Comput. Assist. Tomog., vol. 8, pp. 306–312, 1984.
4. Z. Liang and H. Hart, “Bayesian image processing of data from constrained source distributions—I. Non-valued, correlated and uncorrelated constraints,” Bull. Math. Biol., vol. 49, no. 1, pp. 51–74, 1987.
5. D. Snyder and M. Miller, “The use of sieves to stabilize images produced with the EM algorithm for emission tomography,” IEEE Trans. Nucl. Sci., vol. NS-32, pp. 3864–3872, Oct. 1985.
6. Y. Vardi, L. Shepp, and L. Kaufman, “A statistical model for positron emission tomography, J. Amer. Statist. Ass., vol. 80, pp. 8–37, 1985.
7. T. Hebert and R. Leahy, “A generalized EM algorithm for 3-D Bayesian reconstruction from Poisson data using Gibbs priors,” IEEE Trans. Med. Imaging, vol. 8, pp. 194–202, June 1989.
8. S. Geman and D. Geman, “Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images,” IEEE Trans. Pattern Anal. Machine Intell, vol. PAMI-6, pp. 721–741, Nov. 1984.
9. K. Lange. M. Bahn, and R. Little. “A theoretical study of some maximum likelihood algorithms for emission and transmission tomography,” IEEE Trans. Med. Imaging, vol. MI-6, pp. 106-114, June 1987.
10. E. Levitan and G. Herman, “A maximum a posteriori probability expectation maximization algorithm for image reconstruction in emission tomography,” IEEE Trans. Med. Imaging, vol. MI-6, pp. 185-192, Sept. 1987.
11. Z. Liang, R. Jaszczak, C. Floyd, and K. Greer, “A spatial interaction model for statistical image processing,” presented at the 11th Int. Conf. Inform. Processing in Med. Imaging, Berkeley, CA, 1989.
12. P. Green. “Bayesian reconstructions from emission tomography data using a modified EM algorithm,” IEEE Trans. Med. Imaging, vol. 9, pp. 84–93. Mar. 1990.
13. S. Geman and D. McClure, “Bayesian image analysis: An application to single photon emission tomography,” in Proc. Statist. Comput. Sect., Amer. Statist. Assoc., DC, 1985, 12–18.
14. R. Leahy, T. Hebert, and R. Lee, “Applications of Markov random field models in medical imaging,” in Proc. Conf. Inform. Processing in Med. Imaging, IPMI-89, Lawrence-Berkeley Lab., June 1989.
15. B. W. Silverman, M.C. Jones, J. D. Wilson, and D.W. Nychka, “A smoothed EM approach to indirect estimation problems, with particular reference to stereology and emission tomography,” J. Roy Statist. Soc. B, vol. 52, no. 2, pp. 271–324, 1990.
16. S. Kullback and R. Leibler, “On information and sufficiency,” Ann. Math. Statist., vol. 22, no. 1, pp. 79–86, 1951.
17. D. Titterington, “On the iterative image space reconstruction algorithm for ECT,” IEEE Trans. Med. Imaging, vol. MI-6, pp. 52–56, Mar. 1987.
18. I. Csiszar and G. Tusnady, “Information geometry and alternating minimization procedures,” Statist. Decisions, suppl. issue no. 1, 205–237. 1984.
19. C. R. Smith and G. J. Erickson, Ed., Maximum-Entropy and Bayesian Spectral Analysis and Estimation Problems. Reidel, 1987.
20. R. MacKinnon, “Minimum cross-entropy noise reduction in images,” J. Opt. Soc. Amer A., vol. 6, pp. 739–747, June 1989.
21. E. Jaynes. “On the rationale of maximum-entropy methods,” Proc. IEEE, vol. 70, pp. 939–952, Sept. 1982.
22. I. Csiszar, “Why least squares and maximum entropy? An axiomatic approach to inverse problems,” preprint 19/1989, Math. Inst, of the Hungarian Acad, of Sci., Budapest.
23. J. Shore and R. Johnson, “Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy,” IEEE Trans. Inform. Theory, vol. IT-26, 26–37, Jan. 1980.
24. J. Shore, “Minimum cross-entropy spectral analysis,” IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-29, pp. 230–237, Apr. 1981.
25. L. Jones, “Approximation theoretic derivation of logarithmic entropy principles for inverse problems and unique extension of the maximum entropy method to incorporate prior knowledge,” SIAM J. Appl. Math., vol. 49, pp. 650–661, Apr. 1989.
26. L. Jones and C. Byrne, “General entropy criteria for inverse problems, with applications to data compression, pattern classification and cluster analysis,” IEEE Trans. Inform. Theory, vol. 36, pp. 23–30, Jan. 1990.
27. C. Byrne and L. Jones, “An axiomatic approach to certain inverse problems,” in SPIE Conf. Proc., vol. 1351, San Diego, CA, July 1990.
28. J. Burg, “The relationship between maximum entropy spectra and maximum likelihood spectra,” Geophys., vol. 37, pp. 375–376, Apr. 1975.
29. R. Lacoss, “Data adaptive spectral analysis methods,” Geophys., vol. 36, pp. 671–675, Aug. 1971.
30. B. Frieden, “Restoring with maximum likelihood and maximum entropy,” J. Opt. Soc. Amer., vol. 62, pp. 511–518, Apr. 1972.
31. S. Gull and G. Daniell, “Image reconstruction from incomplete and noisy data,” Nature, vol. 272, pp. 666-670, Apr. 1978.
32. R. Gordon, R. Bender, and G. Herman, “Algebraic reconstruction techniques (ART) for three-dimensional electron microscopy and x-ray photography,” J. Theoret Biol, vol. 29, pp. 471-481, 1970.
33. Y. Censor, “Finite series-expansion reconstruction methods,” Proc. IEEE, vol. 71, pp. 409-419, Mar. 1983.
34. Y. Censor, T. Elfving, and G. Herman, “Special-purpose algorithms for linearly constrained entropy maximization,” in Maximum-Entropy and Bayesian Spectral Analysis and Estimation Problems, C. R. Smith and G.J. Erickson, Ed. Reidel, 1987, pp. 241-254.
35. A. Lent, “A convergent algorithm for maximum entropy image restoration with a medical x-ray application,” in Image Analysis and Evaluation, R. Shaw, Ed., SPSE, Washington, DC, 1977, pp. 238-243 (also [46]).
36. A. Peressini, F. Sullivan, and J. Uhl, The Mathematics of Nonlinear Programming. New York: Springer-Verlag, 1988.
37. T. Cover, “An algorithm for maximizing log investment return,” IEEE Trans. Inform. Theory, vol. IT-30, pp. 369-373, Mar. 1984.
38. C. P. Smith and W. T. Grandy, Jr., Ed. Maximum Entropy and Bayesian Methods in Inverse Problems. Reidel, 1985.
39. G. Herman, “Applications of maximum entropy and Bayesian optimization methods to image reconstruction from projections,” in Maximum Entropy and Bayesian Methods in Inverse Problems, C. P. Smith and W. T. Grandy, Jr., Ed. Reidel, 1985, pp. 319-338.
40. W. H. Fleming, Functions of Several Variables. Reading, MA: Addison-Wesley, 1965.
41. C. Byrne and J. Graham-Eagle, “Convergence properties of the multiplicative algebraic reconstruction technique (MART),” in progress.
42. L. Shepp and R. Vanderbei, “New insights into emission tomography via linear programming,” AT&T Tech. Memo., Nov. 1988.
43. Y. Censor and J. Segman, “On block-iterative maximization,” J. Inform. Optimiz. Sci, vol. 8, no. 3, pp. 275-291, 1987.
44. S. Zenios and Y. Censor, “Parallel computing the block-iterative image reconstruction algorithms,” Appl. Numer. Math., vol. 7, pp. 399-415, 1991.
45. Y. Censor, “Parallel application of block-iterative methods in medical imaging and radiation therapy,” Math. Programming, vol. 42, pp. 307-325, 1988.
46. A. Lent and Y. Censor, “The primal-dual algorithm as a constraint-set-manipulation device,” Math. Programming, vol. 50, pp. 343-357, 1991.