ML parameter estimation for Markov random fields with applications to Bayesian tomography

IEEE Transactions on Image Processing

Volumn 7, Issue 7, 1998, Pages 1029-1044

  Saquib, Suhail S ^b   Bouman, Charles A ^a,c   Sauer, Ken ^a,d  

^a IEEE

^b POLAROID CORPORATION   (United States)

^c PURDUE UNIVERSITY   (United States)

^d University of Notre Dame   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; COMPUTATIONAL COMPLEXITY; COMPUTER SIMULATION; CONVERGENCE OF NUMERICAL METHODS; IMAGE ANALYSIS; IMAGE QUALITY; MARKOV PROCESSES; MATHEMATICAL MODELS; PARAMETER ESTIMATION;

BAYESIAN TOMOGRAPHY; MARKOV RANDOM FIELDS (MRF);

IMAGE RECONSTRUCTION;

EID: 0032123237     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/83.701163     Document Type: Article

References (57)

1. S. Geman and D. McClure, "Bayesian images analysis: An application to single photon emission tomography," in Proc. Statistical Computer Sect. Amer. Stat. Assoc., Washington, DC, 1985, pp. 12-18.
2. T. Hebert and R. Leahy, "A generalized EM algorithm for 3-d Bayesian reconstruction from Poisson data using Gibbs priors," IEEE Trans. Med. Imag., vol. 8, pp. 194-202, June 1989.
3. P. J. Green, "Bayesian reconstruction from emission tomography data using a modified EM algorithm," IEEE Trans. Med. Imag., vol. 9, pp. 84-93, Mar. 1990.
4. K. Lange and R. Carson, "EM reconstruction algorithms for emission and transmission tomography," J. Comput. Assist. Tomogr., vol. 8, pp. 306-316, Apr. 1984.
5. J. M. Ollinger, "Maximum-likelihood reconstruction of transmission images in emission computed tomography via the EM algorithm," IEEE Trans. Med. Imag., vol. 13, pp. 89-101, Mar. 1994.
6. K. Sauer and C. A. Bouman, "A local update strategy for iterative reconstruction from projections," IEEE Trans. Signal Processing, vol. 41, pp. 534-548, Feb. 1993.
7. B. Hunt, "Bayesian methods in nonlinear digital image restoration," IEEE Trans. Comput., vol. C-26, pp. 219-229, 1977.
8. S. Geman and D. Geman, "Stochastic relaxation, Gibbs distributions and the Bayesian restoration of images, "IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-6, pp. 721-741, Nov. 1984.
9. A. Blake and A. Zisserman, Visual Reconstruction. Cambridge, MA: MIT Press, 1987.
10. R. Stevenson and E. Delp, "Fitting curves with discontinuities," in Proc. 1st Int. Workshop on Robust Computer Vision, Oct. 1-3, 1990, pp. 127-126.
11. D. Geman and G. Reynolds, "Constrained parameters and the recovery of discontinuities," IEEE Trans. Pattern Anal. Machine Intell., vol. 14, pp. 367-383, 1992.
12. C. A. Bouman and K. Sauer, "A generalized Gaussian image model for edge-preserving map estimation," IEEE Trans. Image Processing, vol. 2, pp. 296-310, July 1993.
13. S. Brette, J. Idier, and A. Mohammed-Djafari, "Scale invariant Markov models for Bayesian inversion of linear inverse problems," in Maximum Entropy and Bayesian Methods, J. Skilling and S. Sibisi, Eds. Boston, MA: Kluwer, 1996, pp. 199-212.
14. L. E. Baum and T. Petrie, "Statistical inference for probabilistic functions of finite state Markov chains," Ann. Math. Stat., vol. 37, pp. 1554-1563, 1966.
15. L. Baum, T. Petrie, G. Soules, and N. Weiss, "A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains," Ann. Math. Stat., vol. 41, pp. 164-171, 1970.
16. L. Shepp and Y. Vardi, "Maximization likelihood reconstruction for emission tomography," IEEE Trans. Med. Imag., vol. MI-1, pp. 113-122, Oct. 1982.
17. D. Pickard, "Asymptotic inference for an ising lattice III: Nonzero field and ferromagnetic states," J. Appl. Prob., vol. 16, pp. 12-24, 1979.
18. _, "Inference for discrete Markov fields: The simplest nontrivial case," J. Amer. Stat. Assoc., vol. 82, pp. 90-96, Mar. 1987.
19. J. Besag, "On the statistical analysis of dirty pictures," J. R. Stat. Soc. B, vol. 48, pp. 259-302, 1986.
20. S. Geman and C. Graffigne, "Markov random field image models and their applications to computer vision," in Proc. Int. Congr. Mathematicians, Berkeley, CA, 1986, pp. 1496-1517.
21. S. Lakshmanan and H. Derin, "Simultaneous parameter estimates and segmentation of Gibbs random fields using simulated annealing," IEEE Trans. Pattern Anal. Machine Intell., vol. 11, pp. 799-813, Aug. 1989.
22. B. Chalmond, "An iterative Gibbsian technique for reconstruction of M-ary images," Pattern Recognit., vol. 22, pp. 747-761, 1989.
23. Y. Ogata, "A Monte Carlo method for an objective Bayesian procedure," Ann. Inst. Stat. Math., vol. 42, pp. 403-433, 1980.
24. C. Geyer and E. Thompson, "Constrained Monte Carlo maximum likelihood for dependent data," J. R. Stat. Soc. B, vol. 54, pp. 657-699, 1992.
25. B. Gidas, "Parameter estimation for Gibbs distributions from fully observed data," in Markov Random Fields: Theory and Applications, R. Chellappa and A. Jain, Eds. New York: Academic, 1993, pp. 471-499.
26. C. Geyer, "On the convergence of Monte Carlo maximum likelihood calculations," J. R. Stat. Soc. B, vol. 56, pp. 261-274, 1994.
27. G. G. Potamianos and J. K. Goutsias, "Partition function estimation of Gibbs random field images using Monte Carlo simulation," IEEE Trans. Inform. Theory, vol. 39, pp. 1322-1332, July 1993.
28. M. Jerrum and A. Sinclair, "Polynomial-time approximation algorithm for the Ising model," SIAM J. Comput., vol. 22, pp. 1087-1116, 1993.
29. N. P. Galatsanos and A. K. Katsaggelos, "Methods for choosing the regularization parameter and estimating the noise variance in image restoration and their relation," IEEE Trans. Image Processing, vol. 1, pp. 322-336, July 1992.
30. A. Mohammad-Djafari, "On the estimation of hyperparameters in Bayesian approach of solving inverse problems," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Processing, Minneapolis, MN, Apr. 27-30, 1993, pp. 495-498.
31. K. Lange, "An overview of Bayesian methods in image reconstruction," Proc. SPIE Conf. Digital Image Synthesis and Inverse Optics, San Diego, CA, 1990, vol. SPIE-1351, pp. 270-287.
32. Z. Zhou, R. Leahy, and J. Qi, "Approximate maximum likelihood hyperparameter estimation for Gibbs priors," IEEE Trans. Image Processing, vol. 6, pp. 844-861, June 1997.
33. A. Mohammad-Djafari, "Joint estimation of parameters and hyperparameters in a Bayesian approach of solving inverse problems," in Proc. IEEE Int. Conf. Image Processing, Lausanne, Switzerland, Sept. 16-19, 1996, vol. II, pp. 473-476.
34. R. Schultz, R. Stevenson, and A. Lumsdaine, "Maximum likelihood parameter estimation for non-Gaussian prior signal models," Proc. IEEE Int. Conf. Image Processing, Austin, TX, Nov. 1994, vol. 2, pp. 700-704.
35. D. M. Higdon, et al., "Fully Bayesian estimation of Gibbs hyperparameters for emission computed tomography data," IEEE Trans. Med. Imag., vol. 16, Oct. 1997.
36. Z. Zhou and R. Leahy, "Approximate maximum likelihood hyperparameter estimation for Gibbs prior," in Proc. IEEE Int. Conf. Image Processing, Washington, DC, Oct. 23-26, 1995, pp. 284-287.
37. J. Zhang, "The mean field theory in EM procedures for Markov random fields," IEEE Trans. Signal Processing, vol. 40, pp. 2570-2583, Oct. 1992.
38. W. Pun and B. Jeffs, "Shape parameter estimation for generalized Gaussian Markov random field models used in MAP image restoration," in Proc. 29th Asilomar Conf. Signals, Systems, and Computers, Oct. 29-Nov. 1, 1995.
39. B. D. Jeffs and W. H. Pun, "Simple shape parameter estimation from blurred observations for a generalized Gaussian MRF image prior used in MAP image restoration," in Proc. IEEE Int. Conf. Image Processing, Lausanne, Switzerland, Sept. 16-19, 1996, pp. 465-468.
40. S. Geman and D. McClure, "Statistical methods for tomographic image reconstruction," Bull. Int. Stat. Inst., vol. LII-4, pp. 5-21, 1987.
41. C. A. Bouman and K. Sauer, "Maximum likelihood scale estimation for a class of Markov random fields," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Processing, Adelaide, Australia, Apr. 19-22, 1994, vol. 5, pp. 537-540.
42. C. A. Bouman, K. Sauer, and S. S. Saquib, "Tractable models and efficient algorithms for Bayesian tomography," in Proc. Int. Conf. Acoustics, Speech, Signal Processing, May 9-12, 1995, Detroit, MI, pp. 2907-2910.
43. S. S. Saquib, C. A. Bouman, and K. Sauer, "Efficient ML estimation of the shape parameter for generalized Gaussian MRF," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, Atlanta, GA, May 7-10, 1996, vol. 4, pp. 2229-2232.
44. _, "ML parameter estimation for Markov random fields, with applications to Bayesian tomography," Tech. Rep. TR-ECE 95-24, School Electr. Comput. Eng., Purdue Univ., West Lafayette, IN, Oct. 1995.
45. K. Sauer and C. A. Bouman, "Maximum likelihood dosage estimation for Bayesian tomography," in Proc. IEEE Int. Conf. on Image Processing, Austin, TX, Nov. 13-16, 1994, vol. 2, pp. 844-848.
46. N. Metropolis, A. Rosenbluth, M. Rosenbluth, A. Teller, and E. Teller, "Equations of state calculations by fast computing machines," J. Chem. Phys., vol. 21, pp. 1087-1091, 1953.
47. W. K. Hastings, "Monte Carlo sampling methods using Markov chains and their applications," Biometrika, vol. 57, pp. 97-109, 1970.
48. P. H. Peskun, "Optimum Monte-Carlo sampling using Markov chains," Biometrika, vol. 60, pp. 607-612, 1973.
49. P. J. Green and X. Liang Han, "Metropolis methods, Gaussian proposals and antithetic variables," in Stochastic Models, Statistical Methods, and Algorithms in Image Analysis, P. Barone, A. Frigessi, and M. Picconi, Eds. Berlin, Germany: Springer-Verlag, 1992, pp. 142-164.
50. C. A. Bouman and K. Sauer, "A unified approach to statistical tomography using coordinate descent optimization," IEEE Trans. Image Processing, vol. 5, pp. 480-492, Mar. 1996.
51. A. Blake, "Comparison of the efficiency of deterministic and stochastic algorithms for visual reconstruction," IEEE Trans. Pattern Anal. Machine Intell., vol. 11, pp. 2-30, Jan. 1989.
52. J. Besag, "Toward Bayesian image analysis," J. Appl. Stat., vol. 16, pp. 395-407, 1989.
53. J. A. O'Sullivan, "Divergence penalty for image regularization," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Processing, Adelaide, Australia, Apr. 19-22, 1994, vol. 5, pp. 541-544.
54. S. Ihara, Information Theory for Continuous Systems. Singapore: World Scientific, 1993.
55. Y. Ogata and M. Tanemura, "Likelihood analysis of spatial point patterns," J. R. Stat. Soc. B, vol. 46, pp. 496-518, 1984.
56. _, "Likelihood estimation of soft-core interaction potentials for Gibbs point patterns," Ann. Inst. Stat. Math., vol. 41, pp. 583-600, 1989.
57. M. Abramowitz and I. Stegun, eds., Handbook of Mathematical Functions. New York: Dover, 1965.