Bayesian and regularization methods for hyperparameter estimation in image restoration

IEEE Transactions on Image Processing

Volumn 8, Issue 2, 1999, Pages 231-246

  Molina, Rafael ^a,b   Katsaggelos, Aggelos K ^a,b   Mateos, Javier ^c  

^a IEEE   (Spain)

^b UNIVERSITY OF GRANADA   (Spain)

^c Northwestern University   (United States)

Author keywords

Hierarchical bayesian models; Image restoration; Parameter estimation; Regularization

Indexed keywords

ALGORITHMS; ITERATIVE METHODS; MATHEMATICAL MODELS; PARAMETER ESTIMATION; SET THEORY;

HIERARCHICAL BAYESIAN MODELS;

IMAGE RECONSTRUCTION;

EID: 0033078391     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/83.743857     Document Type: Article

References (39)

1. H. C. Andrews and B. R. Hunt, Digital Image Restoration. Englewood Cliffs, NJ: Prentice Hall, 1977.
2. G. Archer, "Some estimation and restoration techniques for statistical image analysis," Ph.D. dissertation, Univ. Glasgow, U.K., 1994.
3. G. Archer and D. M. Titterington, "On some Bayesian/regularization methods for image restoration," IEEE Trans. Image Processing, vol. 4, pp. 989-995, 1995.
4. J. O. Berger, Statistical Decision Theory and Bayesian Analysis. Berlin, Germany: Springer-Verlag, 1985, Chs. 3 and 4.
5. R. A. Boyles, "On the convergence of the EM algorithm," J. R. Stat. Soc., Ser. B, vol. 44, 1983.
6. W. L. Buntine, "A theory of learning classification rules," Ph.D. dissertation, Univ. Technol., Sydney, Australia, 1991.
7. _, "Theory refinement on Bayesian networks," in Proc. 7th Conf. Uncertainty in Artificial Intelligence, 1991, pp. 52-60.
8. W. L. Buntine and A. Weigund, "Bayesian back-propagation," Complex Syst., vol. 5, pp. 603-643, 1991.
9. G. F. Cooper and E. Herkovsits, "A Bayesian method for the induction of probabilistic networks from data," Machine Learn., vol. 9, pp. 309-347, 1992.
10. G. Demoment, "Image reconstruction and restoration: Overview of common estimation structure and problems," IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-37, pp. 2024-2036, Dec. 1989.
11. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data," J. R. Stat. Soc. B, vol. 39, pp. 1-38, 1972.
12. N. P. Galatsanos and A. K. Katsaggelos, "Methods for choosing the regularization parameter and estimating the noise variance in image restoration and their relation," IEEE Trans. Image Processing, vol. 1, pp. 322-336, 1992.
13. S. F. Gull, "Developments in maximum entropy data analysis," in Maximum Entropy and Bayesian Methods, Cambridge, J. Skilling, Ed. Boston, MA: Kluwer, 1989, pp. 53-71.
14. M. G. Kang, Adaptive Iterative Image Restoration Algorithms, Ph.D. dissertation, Dept. Elect. Eng. Comput. Sci., Northwestern Univ., June 1994.
15. M. G. Kang and A. K. Katsaggelos, "Simultaneous iterative image restoration and evaluation of the regularization parameter," IEEE Trans. Signal Processing, vol. 40, pp. 2320-2334, 1992.
16. A. K. Katsaggelos, "Iterative image restoration algorithms," Opt. Eng., vol. 28, pp. 735-748, July 1989.
17. _, Digital Image Restoration, Springer Series in Information Sciences, vol. 23. Berlin, Germany: Springer-Verlag, 1991.
18. A. K. Katsaggelos, J. Biemond, R. M. Mersereau, and R. W. Schafer, "An iterative method for restoring noisy blurred images," Circuits Syst. Signal Process., vol. 3, no. 2, pp. 139-160, 1984.
19. A. K. Katsaggelos, J. Biemond, R. W. Schafer, and R. M. Mersereau, "A regularized iterative image restoration algorithm," IEEE Trans. Signal Processing, vol. 39, pp. 914-929, 1991.
20. A. K. Katsaggelos and M. G. Kang, "Iterative evaluation of the regularization parameter in regularized image restoration," J. Vis. Commun. Image Represent., vol. 3, pp. 446-455, 1992.
21. R. Lagendijk and J. Biemond, Iterative Identification and Restoration of Images. Boston, MA: Kluwer, 1991, pp. 31-32 and 124-129.
22. K. T. Lay and A. K. Katsaggelos, "Image identification and restoration based on the expectation-maximization algorithm," Opt. Eng., vol. 29, pp. 436-445, 1990.
23. D. J. C. MacKay, "A practical Bayesian framework for backprop networks," Neural Comput., vol. 4, pp. 448-472, 1992.
24. _, "Bayesian interpolation," Neural Comput., vol. 4, pp. 415-447, 1992.
25. _, "Hyperparameters: Optimize or integrate out," submitted for publication.
26. K. V. Mardia, J. T. Kent, and J. M. Bibly, Multivariate Analysis. New York: Academic, 1979, pp. 41-43.
27. R. Molina, "On the hierarchical Bayesian approach to image restoration, application to astronomical images," IEEE Trans. Pattern Anal. Machine Intell., vol. 16, pp. 1222-1228, 1994.
28. R. Molina and A. K. Katsaggelos, "On the hierarchical Bayesian approach to image restoration and the iterative evaluation of the regularization parameter," in Proc. Visual Communication and Image Processing'94, Chicago, IL, pp. 244-251.
29. _, "Prior models and methods of choosing the unknown parameters in the Bayesian and regularization approaches to image restoration," in Proc. IEEE Workshop on Nonlinear Signal and Image Processing, 1995, pp. 102-105.
30. R. Molina, A. del Olmo, J. Perea, and B. D. Ripley, "Bayesian deconvolution in optical astronomy," Astrom. J., vol. 103, pp. 666-675, 1992.
31. R. Molina and B. D. Ripley, "Using spatial models as priors in astronomical images analysis," J. Appl. Stat., vol. 16, pp. 193-206, 1989.
32. R. Molina, et al., "Bayesian deconvolution with prior knowledge of object location, applications to ground-based planetary images," Astrom. J., vol. 104, pp. 1662-1668, 1992.
33. R. M. Neal, "Bayesian learning for neural networks," Ph.D. dissertation, Dept. Comput. Sci., Univ. Toronto, Toronto, Ont., Canada, 1995.
34. H. Raiffa and R. Schlaifer, Applied Statistical Decision Theory, Grad. School Bus. Admin., Harvard Univ., Boston, MA, 1961.
35. B. D. Ripley, Spatial Statistics. New York: Wiley, 1981, pp. 88-90.
36. D. J. Spiegelhalter and S. L. Lauritzen, "Sequential updating of conditional probabilities on directed graphical structures," Networks, vol. 20, pp. 579-605, 1990.
37. C. E. M. Strauss, D. H. Wolpert, and D. R. Wolf, "Alpha, evidence and the entropic prior," in Maximum Entropy and Bayesian Methods, A. Mohammed-Djafari, Ed. Boston, MA: Kluwer, 1992, pp. 53-71.
38. D. H. Wolpert, "On the use of evidence in neural networks," in Advances in Neural Information Processing Systems 5, C. L. Giles, S. J. Hanson, and J. D. Cowan, Eds. San Mateo, CA: Morgan Kaufmann, 1993, pp. 539-546.
39. C. F. J. Wu "On the convergence properties of the EM algorithm," Ann. Stat., no. 1, pp. 95-103, 1983.