Approximate maximum likelihood hyperparameter estimation for Gibbs priors

IEEE Transactions on Image Processing

Volumn 6, Issue 6, 1997, Pages 844-861

  Zhou, Zhenyu ^a,b   Leahy, Richard M ^a,b   Qi, Jinyi ^a,b  

^a IEEE   (United States)

^b University of Southern California ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; IMAGE QUALITY; IMAGE RECONSTRUCTION; INVERSE PROBLEMS; MARKOV PROCESSES; MATHEMATICAL MODELS; MONTE CARLO METHODS; OPTIMIZATION; PARAMETER ESTIMATION;

DATA ACQUISITION SYSTEMS; GIBBS-BOGOLIUBOV-FEYNMAN BOUND; MAXIMUM LIKELIHOOD ESTIMATION;

IMAGE PROCESSING;

EID: 0031166023     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/83.585235     Document Type: Article

References (42)

1. M. Almeida and G. Gidas, "A variational method for estimating the parameters of MRF from complete or incomplete data," Tech. Rep., Brown Univ., Providence, RI, 1989.
2. J. Besag, "Spatial interaction and the statistical analysis of lattice systems (with discussion)," J. Roy. Stat. Soc. B, vol. 36, pp. 192-326, 1974.
3. _, "On the statistical analysis of dirty pictures," J. Roy. Stat. Soc. B, vol. 48, no. 3, pp. 259-302, 1986.
4. J. Besag, P. Green, D. Higdon, and K. Mengersen, "Bayesian computation and stochastic systems," Stat. Sci., vol. 10, pp. 3-66, 1995.
5. A. Blake and A. Zisserman, "Visual reconstruction," in Artificial Intelligence. Cambodge, MA: MIT Press, 1987.
6. C. Bouman and K. Sauer, "Fast numerical methods for emission and transmission tomographic reconstruction," in Proc. Conf. Information Science and Systems, Johns Hopkins Univ., Baltimore, MD, 1993.
7. D. Chandler, Introduction to Modern Statistical Mechanics. Oxford, U.K.: Oxford Univ. Press, 1987.
8. A. Dempster, N. Laird, and D. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. Roy. Stat. Soc., vol. 29, pp. 1-38, 1977.
9. P. Craven and G. Wahba, "Smoothing noisy data with spline function," Numerische Math., vol. 31, pp. 377-403, 1979.
10. S. Geman and D. Geman, "Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-6, pp. 721-741, 1984.
11. S. Geman and D. McClure, "Statistical methods for tomographic image reconstruction," in Proc. 46th Sess. ISI, Bulletin ISI, 1987, vol. 52.
12. D. Geiger and F. Girosi, "Parallel and deterministic algorithms for MRFs: Surface reconstruction and integration," IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, pp. 401-412, 1991.
13. Geyer and Thompson, "Constrained Monte Carlo maximum likelihood for dependent data," J. Roy. Stat. Soc. B, vol. 54, pp. 657-699, 1992.
14. G. G. Potamianos and J. K. Goutsias, "Partition function estimation of Gibbs random field images using Monte Carlo simulations," IEEE Trans. Inform. Theory, vol. 39, pp. 1322-1332, 1993.
15. P. C. Hansen, "Analysis of discrete ill-posed problems by means of the L-curve," SIAM Rev., vol. 34, no. 4, pp. 561-580, 1992.
16. P. C. Hansen and D. P. O'Leary, "The use of the L-curve in the regularization of discrete ill-posed problems," Rep. UMIACS-TR-91-142, Dept. Comput. Sci., Univ. Maryland, College Park, MD.
17. T. J. Hebert and R. Leahy, "Statistic-based MAP image reconstruction from Poisson data using Gibbs priors," IEEE Trans. Signal Processing, vol. 40, no. 9, pp. 2290-2303, Sept. 1992.
18. V. E. Johnson, W. H. Wong, X. Hu, and C. Chen, "Image restoration using Gibbs priors: Boundary modeling, treatment of blurring, and selection of hyperparameter," IEEE Trans. Pattern Anal. Machine Intell., vol. 13, pp. 413-425, 1991.
19. S. Lakshmanan and H. Derin, "Simultaneous parameter estimation and segmentation of Gibbs random fields using simulated annealing," IEEE Trans. Pattern Anal. Machine Intell., vol. 11, pp. 799-813, 1989.
20. R. Leahy and X. Yan, "Incorporation of anatomical MR data for improved functional imaging with PET," in Information Processing in Medical Imaging, A. C. F. Colchester and D. J. Hawkes, Eds. New York: Springer-Verlag, 1991, pp. 105-120.
21. P. J. M. van Laarhoven and E. H. L. Arts, Simulated Annealing: Theory and Applications. Amsterdam, The Netherlands: Reidel, 1987.
22. D. Luenberger, Linear and Nonlinear Programming. Reading, MA: Addison-Wesley, 1989.
23. J. Mathews and R. L. Walker, Mathematical Methods of Physics. Menlo Park, CA: Benjamin Cummings, 1970.
24. J. Marroquin, "Probabilistic solution of inverse problems," Ph.D. dissertation, Mass. Inst. Technol., Cambridge, MA, 1985.
25. K. M. Manbeck, "Bayesian statistical methods applied to emission tomography with physical phantom and patient data," Ph.D. dissertation, Brown Univ., Providence, RI, 1990.
26. A. Mohammad-Djafari, "On the estimation of hyperparameters in Bayesian approach of solving inverse problems," in Proc. ICASSP, 1993, pp. V495-V498.
27. E. Mumcuoglu, R. Leahy, S. Cherry, and Z. Zhou, "Fast gradient-based methods for Bayesian reconstruction of transmission and emission PET images," IEEE Trans. Med. Imag., vol. 13, no. 4, pp. 687-701, 1994.
28. E. Mumcuoglu, R. Leahy, and S. Cherry, "Bayesian reconstruction of PET images: Methodology and performance analysis," Phys. Med. Biol., vol. 41, no. 9, pp. 1-31, 1996.
29. H. R. Schwarz and J. Waldvogel, Numerical Analysis -A Comprehensive Introduction. New York: Wiley, pp. 339-342.
30. A. Rangarajan, "Representation and recovery of discontinuities in some early vision problems," Ph.D. dissertation, Univ. Southern California, Los Angeles, 1990.
31. G. Gindi, M. Lee, A. Rangarajan et al., "A continuation method for emission tomography," in Proc. 1992 Nuclear Science Symp. and Medical Imaging Conf., 1992, pp. 1204-1206.
32. S. Saquib, C. Bouman, and K. Sauer, "ML parameter estimation for Markov random fields, with applications to Bayesian tomography," submitted for publication.
33. A. M. Thompson et al., "A study of methods of choosing the smoothing parameter in image restoration by regularization," IEEE Trans. Pattern Anal. Machine Intell., vol. 13, pp. 326-339, 1991.
34. J. Varah, "Pitfalls in the numerical solution of ill-posed problems," SIAM J. Sci. Stat. Comput., vol. 4, pp. 164-176, 1983.
35. G. Wahba, "Spline models for observational data," in Proc. CBMS-NSF Reg. Conf. Ser. Applied Mathematics, vol. 59, Soc. Ind. Appl. Math., Philadelphia, PA, 1990.
36. J. Zhang, "The mean field theory in EM procedures for Markov random fields," IEEE Trans. Signal Processing, vol. 40, pp. 2570-2583, Oct. 1992.
37. J. Zhang and J. Hanauer, "The mean field theory for image motion estimation," in Proc. ICASSP, 1993, pp. V197-V200.
38. J. Zhang, "The mean field theory in EM procedures for blind Markov random field image restoration," IEEE Trans. Image Processing, vol. 2, pp. 27-40, Jan. 1993.
39. J. Zhang, J. W. Modestino, and D. A. Langan, "Maximum-likelihood parameter estimation for unsupervised stochastic model-based image segmentation," IEEE Trans. Image Processing, vol. 3, pp. 404-420, Apr. 1994.
40. Z. Zhou, R. Leahy, and E. Mumguoclu, "A comparative study of using anatomical boundary in PET reconstruction," in Proc. IEEE Nuclear Science Symp. and Medical Imaging Conf., 1993, pp. 1749-1753.
41. _, "Maximum likelihood hyperparameter estimation for Gibbs priors from incomplete data with applications to positron emission tomography," in Information Processing in Medical Imaging, Y. Bizais, C. Barillot, and R. Di Paola, Eds. Boston, MA: Kluwer, 1995, pp. 39-51.
42. Z. Zhou, "Maximum likelihood hyperparameter estimation for Gibbs priors from incomplete data with applications in image processing," Ph.D. dissertation, Univ. Southern California, Los Angeles, 1994.