Maximum likelihood hyperparameter estimation for solvable Markov random field model in image restoration

IEICE Transactions on Information and Systems

Volumn E85-D, Issue 3, 2002, Pages 546-557

  Tanaka, Kazuyuki ^a   Inoue, Jun Ichi ^b  

^a TOHOKU UNIVERSITY   (Japan)

^b HOKKAIDO UNIVERSITY   (Japan)

Author keywords

Bayes statistics; Evidence; Image restoration; Markov random fields; Maximum likelihood estimation

Indexed keywords

ALGORITHMS; DISCRETE FOURIER TRANSFORMS; GAUSSIAN NOISE (ELECTRONIC); MATHEMATICAL MODELS; MAXIMUM LIKELIHOOD ESTIMATION; PARAMETER ESTIMATION; PROBABILITY DENSITY FUNCTION; STATISTICAL METHODS; WHITE NOISE;

ADDITIVE WHITE GAUSSIAN NOISE; BAYES STATISTICS; MARKOV RANDOM FIELDS; MAXIMUM LIKELIHOOD HYPERPARAMETER ESTIMATION;

IMAGE RECONSTRUCTION;

EID: 0036522787     PISSN: 09168532     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (30)

1. B.J. Frey, Graphical Models for Machine Learning and Digital Communication, MIT Press, Cambridge, 1998.
2. M.I. Jordan, eds., Learning in Graphical Models, MIT Press, Cambridge, 1999.
3. D.J. MacKay, "Bayesian interpolation," Neural Computation, vol.4, pp.415-447, 1992.
4. R. Takeuchi, D.J.C. MacKay, S. Nakazawa, and T. Matsumoto, "Inferring hyperparameters and regularizers for standard regularization problems," IEICE Trans, vol.J80-D-II no.9, pp.2502-2511, Sept. 1997.
5. A.P. Dempster, N.M. Laird, and D.B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. Royal Statistical Society, ser. B, vol.39, no.1, pp. 1-38, 1997.
6. A.D. Bruce and D. Saad, "Statistical mechanics of hypothesis evaluation," J. Physics A, vol.27, no.10, pp.3355-3363, May 1994.
7. J.M. Pryce and A.D. Bruce, "Statistical mechanics of image restoration," J. Physics A, vol.28, no.3, pp.511-532, Feb. 1995.
8. H. Nishimori, Introduction to the Physics of Information, Oxford University Press, Cambridge, 2001.
9. R.J. Baxter, Exactly Solved Models in Statistical Mechanics, Academic Press, London, 1982.
10. H. Nishimori, "Optimum decoding temperature for error-correcting codes," J. Phys. Soc. Jpn., vol.62, no.9, pp.2973-2975, Sept. 1993.
11. R. Vicente, D. Saad, and Y. Kabashima, "Error-correcting code on a cactus: A solvable model," Eurrophysics Letters, vol.51, pp.698-704, June 2000.
12. H. Derin, H. Elliott, R. Cristi, and D. Geman, "Bayes smoothing algorithms for segmentation of binary images modeled by Markov random fields," IEEE Trans. Pattern Anal. & Mach. Intell., vol.PAMI-6, no.6, pp.707-720, Nov. 1984.
13. J. Besag, "On the statistical analysis of dirty pictures" (with discussion), J. Royal Statistical Society, ser. B, vol.48, no.3, pp.259-302, 1986.
14. J. Marroquin, S. Mitter, and T. Poggio, "Probabilistic solution of ill-posed problems in computer vision," J. American Statistical Association, vol.82, no.397, pp.76-89, March 1987.
15. S. Geman and D. Geman, "Stochastic relaxation, Gibbs distribution and the Bayesian restoration of images," IEEE Trans. Pattern Anal. & Mach. Intell., vol.PAMI-6, no.6, pp.721-741, Nov. 1984.
16. F.C. Jeng and J.W. Woods, "Compound Gauss-Markov random fields for image estimation," IEEE Trans. Signal Process., vol.39, no.3, pp.683-697, March 1991.
17. R. Chellappa an A. Jain, eds., Markov Random Fields: Theory and Applications, Academic Press, New York, 1993.
18. S.Z. Li, Markov Random Field Modeling in Computer Vision, Springer-Verlag, Tokyo, 1995.
19. S. Geman and D.E. McClure, "Statistical method for topographic image reconstruction," Bull. Internat. Statist. Inst. vol.52, no.4, pp.5-21, 1987.
20. Z. Zhou, R.M. Leahy, and J. Qi, "Approximate maximum likelihood hyperparameter estimation for Gibbs priors," IEEE Trans. Image Process., vol.6, no.6, pp.844-861, June 1997.
21. K. Tanaka, "Theoretical study of hyperparameter estimation by maximization of marginal likelihood in image restoration by means of cluster variation method," IEICE Trans., vol.J83-A, no.10, pp.1148-1160, Oct. 2000.
22. K. Tanaka, "Maximum marginal likelihood estimation and constrained optimization in image restoration," Transactions of the Japanese Society for Artificial Intelligence, vol.16, no.2, pp.246-258, March 2000.
23. H. Nishimori and K.Y.M. Wong, "Statistical mechanics of image restoration and error-correcting codes," Physical Review E, vol.60, no.1, pp.132-144, July 1999.
24. J. Inoue and K. Tanaka, "Dynamics of the maximum likelihood hyper-parameter estimation in image restoration: Gradient descent versus expectation and maximization algorithm" Physical Review E, vol.65, no.1, Jan. 2002.
25. R. Molina, "On the hierarchical bayesian approach to image restoration: Applications to astronomical images," IEEE Trans. Pattern Anal. & Mach. Intell., vol.16, no.11, pp.1122-1128, Nov. 1994.
26. R. Molina, A.K. Katsaggelos, and J. Mateos, "Bayesian and regularization methods for hyperparameter estimation in image restoration," IEEE Trans. Image Process., vo.8, no.2, pp.231-246, Feb. 1999.
27. H. Nishimori, "Finite-temperature image restoration," BUSSEI KENKYU, vol.73, no., pp.850-857, Feb. 2000.
28. K. Tanaka and J. Inoue, "Bayesian-statistical approach in image restoration by means of solvable Markov random field model," IEICE Technical Report, PRMU2000-119, Dec. 2000.
29. J. Zhang, "The application of the Gibbs-Bogoliubov-Feynman inequality in mean field calculations for Markov random fields," IEEE Trans. Image Process., vol.5, no.7, pp.1208-1214, July 1996.
30. K. Tanaka, "Statistical-mechanical iterative algorithm by means of cluster variation method in compound Gauss-Markov random field model," Transactions of the Japanese Society for Artificial Intelligence, vol.16, no.2, pp.259-267, March 2000.