Image Reconstruction and Restoration: Overview of Common Estimation Structures and Problems

IEEE Transactions on Acoustics, Speech, and Signal Processing

Volumn 37, Issue 12, 1989, Pages 2024-2036

  Demoment, Guy ^a  

^a SUPELEC   (France)

Author keywords

[No Author keywords available]

Indexed keywords

INFORMATION THEORY; MATHEMATICAL TECHNIQUES--INTEGRAL EQUATIONS; PROBABILITY; SIGNAL FILTERING AND PREDICTION--KALMAN FILTERING;

BAYESIAN APPROACH; FREDHOLM INTEGRAL EQUATION; HYPERPARAMETER ESTIMATION; IMAGE RESTORATION; KULLBACK DISTANCE; LOCAL ENERGY FUNCTIONS;

IMAGE PROCESSING;

EID: 0024928175     PISSN: 00963518     EISSN: None     Source Type: Journal    
DOI: 10.1109/29.45551     Document Type: Note

References (121)

1. H. C. Andrews and B. R. Hunt, Digital Image Restoration. Englewood Cliffs, NJ: Prentice-Hall, 1977.
2. B. R. Frieden, “Image enhancement and restoration,” in Picture Processing and Digital Processing, T. S. Huang, Ed. Berlin: Springer-Verlag, 1975, pp. 177-248.
3. G. T. Herman, H. K. Tuy, H. Langenberg, and P. C. Sabatier, Basic Methods of Tomography and Inverse Problems. Adams Hilger, 1987.
4. J. H. Justice, Maximum-Entropy and Bayesian Methods in Applied Statistics. Cambridge, England: Cambridge University Press, 1986.
5. A. C. Kak and M. Slaney, Principles of Computerized Tomographic Imaging. New York: IEEE Press, 1988.
6. A. Rosenfeld and A. C. Kak, Digital Picture Processing. New York: Academic, 1982.
7. C. R. Smith and W. T. Grandy, Jr., Maximum-Entropy and Bayesian Methods in Inverse Problems. Dordrecht, The Netherlands: Reidel, 1985.
8. A. S. Willsky, Digital Signal Processing and Control and Estimation Theory. Cambridge, MA: M.I.T. Press, 1979. B. Basic Regularization Techniques
9. M. Bertero, C. de Mol, and G. A. Viano, “The stability of inverse problems,” in Inverse Scattering Problems in Optics, H. P. Baltes, Ed. Berlin: Springer-Verlag, 1980.
10. J. W. Hilgers, “On the equivalence of regularization and certain reproducing kernel Hilbert space approaches for solving first kind problems,” SI AM J. Numer. Anal., vol. 13, pp. 172-184, 1976. (”Erratum,” vol. 15, p. 1301, 1978.)
11. M. Z. Nashed and G. Wahba, “Generalized inverses in reproducing kernel spaces: An approach to regularization of linear operators equations,” S1AMJ. Math. Anal., vol. 5, pp. 974-987, 1974.
12. M. Z. Nashed, “Operator-theoretic and computational approaches to ill-posed problems with applications to antenna theory,” IEEE Trans. Antennas Propagat., vol. AP-29, pp. 220-231, 1981.
13. D. L. Phillips, “A technique for the numerical solution of certain integral equations of the first kind,” J. Iss. Comput. Mach., vol. 9, pp. 84-97, 1962.
14. J. L. C. Sanz and T. S. Huang, “Unified Hilbert space approach to iterative leastsquares linear signal restoration,” J. Opt. Soc. Amer., vol. 73, pp. 1455-1465, 1983.
15. A. Tikhonov and V. Arsenin, Solutions of Ill-Posed Problems. Washington, DC: Winston, 1977.
16. S. Twomey, “On the numerical solution of Fredholm integral equations of the first kind by the inversion of the linear system produced by quadrature,” J. Comput. Mach., vol. 10, pp. 97-101, 1962.
17. G. Wahba, “Ill-posed problems: Numerical and statistical methods for mildly, moderately and severely ill-posed problems with noisy data,” in Proc. Int. Conf. Ill-Posed Problems, Newark, NJ, Oct. 1979.
18. “Constrained regularization for ill-posed linear operator equations, with applications in meteorology and medicine,” in Statistical Decision Theory and Related Topics III, S. S. Gupta and J. O. Berger, Ed. New York: Academic, 1982, pp. 383-417. C. Choice of a Regularization Prescription
19. M. Bertero, T. Poggio, and V. Torre, “Ill-posed problems in early vision,” M.I.T., Cambridge, Art. Intell. Lab. Memo 924, 1986.
20. S. Attasi, “Modelling and recursive estimation for double indexed sequences,” in System Identification: Advances and Studies, R. K. Mehra and D. G. Lainiotis, Eds. New York: Academic, 1976, pp. 289-348
21. M. R. Azimi-Sadjadi and P. W. Wong, “Two-dimensional block Kalman filtering for image restoration,” IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-35, pp. 1736-1749, 1987.
22. J. Biemond, J. Rieske, and J. J. Gerbrands, “A fast Kalman filter for images degraded by both blur and noise,” IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-31, pp. 1248-1256, 1983.
23. S. S. Dikshit, “A recursive Kalman window approach to image restoration,” IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-30, pp. 125-140, 1982.
24. D. X. Cheng, D. Saint-Felix, and G. Demoment, “Comparison between a factorization method and a partitioning method to derive invariant Kalman filters for fast image restoration,” in Mathematics in Signal Processing, T. S. Durrani et al., Eds. Oxford, England: Clarendon, 1987, pp. 349-362.
25. A. Habibi, “Two-dimensional Bayesian estimate of images,” Proc. IEEE, vol. 60, pp. 878-883, 1972.
26. M. S. Murphy and L. M. Silverman, “Image model representation and line-by-line recursive restoration,” IEEE Trans. Automat. Contr., vol. AC-23, pp. 809-816, 1978.
27. N. E. Nahi, “Role of recursive estimation in statistical image enhancement,” Proc. IEEE, vol. 60, pp. 872-877, 1972.
28. S. A. Rajala and R. J. P. de Figueiredo, “Adaptive nonlinear image restoration by a modified Kalman filtering approach,” IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-29, pp. 1033-1042, 1981.
29. R. Roesser, “A discrete state-space model for linear image processing,” IEEE Trans. Automat. Contr., vol. AC-20, pp. 1-10, 1975.
30. D. Rohler and P. S. Krishnaprasad, “Radon inversion and Kalman reconstructions: A comparison,” IEEE Trans. Automat. Contr., vol. AC-26, pp. 483-487, 1981.
31. D. SaintFélix, D. X. Cheng, and G. Demoment, “Image restoration using a Noncausal state space model and a fast 2D Kalman filter,” in Mathematics in Signal Processing, T. S. Durrani et al., Eds. Oxford, England: Clarendon, 1987, pp. 363-378.
32. B. R. Suresh and B. A. Shenoi, “New results in two-dimensional Kalman filtering with applications to image restoration,” IEEE Trans. Circuits Syst., vol. CAS-28, pp. 307-319, 1981.
33. S. L. Wood, A. Makovski, and M. Morf, “Reconstructions with limited data using estimation theory,” in Computer Aided Tomography and Ultrasonics in Medicine, J. Raviv et al., Eds. Amsterdam: North-Holland, 1979, pp. 219-231.
34. J. W. Woods and C. H. Radewan, “Kalman filtering in two dimensions,” IEEE Trans. Inform. Theory, vol. IT-23, pp. 473-482, 1977 (and “Correction,” IEEE Trans. Inform. Theory, vol. IT-25, pp. 628-629, 1979).
35. J. W. Woods and V. K. Ingle, “Kalman filtering in two dimensions: Further results,” IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-29, pp. 188-197, 1981.
36. J. W. Woods, J. Biemond, and A. M. Tekalp, “Boundary value problem in image restoration,” in Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing, 1985, pp. 1811.1-18.11.4.
37. J. W. Woods, S. Dravida, and R. Mediavilla, “Image estimation using doubly stochastic Gaussian random field models,” IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-9, pp. 245-253, 1987.
38. W. Zhe, “Multidimensional state-space model Kalman filtering with application to image restoration,” IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-33, pp. 1576-1592, 1986. G. Maximum Entropy
39. R. K. Bryan and J. Skilling, “Deconvolution by maximum entropy, as illustrated by application to the jet of M87,” Mon. Not. R. Astr. Soc., vol. 191, pp. 69-79, 1980.
40. S. F. Burch, S. F. Gull, and J. Skilling, “Image restoration by a powerful maximum entropy method,” Comput. Vision, Graphics, Image Processing, vol. 23, pp. 113-128, 1983.
41. G. J. Daniell and S. F. Gull, “Maximum entropy algorithm applied to image enhancement,” Proc. IEE, vol. 127-E, pp. 170-172, 1980.
42. B. R. Frieden, “Restoring with maximum likelihood and maximum entropy,” J. Opt. Soc. Amer., vol. 62, pp. 511-518, 1972.
43. “Restoring with maximum entropy, II: Superresolution of photographs of diffraction-blurred impulses,” J. Opt. Soc. Amer., vol. 62, pp. 1202-1210, 1972.
44. J. Cullum, “The effective choice of the smoothing norm in regularization,” Math. Comput., vol. 33, pp. 149-170, 1979.
45. P. Hall and D. M. Titterington, “Common structure of techniques for choosing smoothing parameters in regression problems,” J. Roy. Statist. Soc. B, vol. 49, pp. 184-198, 1987.
46. D. M. Titterington, “General structure of regularization procedures in image restoration,” Astron. Astrophys., vol. 144, pp. 381-387, 1985.
47. “Common structure of smoothing techniques in statistics,” Int. Statist. Rev., vol. 53, pp. 141-170, 1985. D. Standard Regularization Procedures
48. M. Bertero, C. de Mol, and G. A. Viano, “On the problems of object restoration and image extrapolation in optics,” J. Math. Phys., vol. 20, pp. 509-521, 1979.
49. C. W. Helstrom, “Image restoration by the method of least squares,” J. Opt. Soc. Amer., vol. 57, pp. 297-303, 1967.
50. B. R. Hunt, “The inverse problem of radiography,” Math. Biosci., vol. 8, pp. 161-179, 1970.
51. “Biased estimation for nonparametric identification of linear systems,” Math. Biosci., vol. 10, pp. 215-237, 1971.
52. “The application of constrained least squares estimation to image restoration by digital computer,” IEEE Trans. Comput., vol. C-22, pp. 805-812, 1973.
53. A. K. Katsaggelos, J. Biemond, R. M. Mersereau, and R. W. Schafer, “A general formulation of constrained iterative restoration algorithms,” in Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing, 1985, pp. 700-703. E. Bayesian Approach
54. J. F. Abramatic and L. M. Silverman, “Nonstationary linear restoration of noisy images,” in Proc. IEEE Conf. Decision Contr., Fort Lauderdale, FL, Dec. 1979, pp. 92-99.
55. B. P. Agrawal and V. K. Jain, “Digital restoration of images in the presence of correlated noise,” Comput. Elec. Eng., vol. 3, pp. 6574, 1976.
56. M. H. Buonocore, W. R. Brody, and A. Makovsky, “Fast minimum variance estimator for limited angle CT image reconstruction,” Med. Phys., vol. 8, pp. 695-702, 1981.
57. A. M. Darling, T. J. Hall, and M. A. Fiddy, “Stable noniterative object reconstruction from incomplete data using a priori knowledge,” J. Opt. Soc. Amer., vol. 73, pp. 1466-1469, 1983.
58. J. N. Franklin, “Well-posed stochastic extensions of ill-posed linear problems,” J. Math. Anal. Appl., vol. 31, pp. 682-716, 1970.
59. B. R. Frieden, “Statistical estimates of bounded optical scenes by the method of prior probabilites,” IEEE Trans. Inform. Theory, vol. IT-19, pp. 118-119, 1973.
60. K. M. Hanson, “Bayesian and related methods in image reconstruction from incomplete data,” in Image Recovery: Theory and Application, H. Stark, Ed. New York: Academic, 1987, pp. 79-125.
61. G. T. Herman and A. Lent, “A computer implementation of a Bayesian analysis of image reconstruction,” Inform. Contr., vol. 31, pp. 364-384, 1976.
62. G. T. Herman, H. Hurwitz, A. Lent, and H. P. Lung, “On the Bayesian approach to image reconstruction,” Inform. Contr., vol. 42, pp. 60-71, 1979.
63. B. R. Hunt and T. M. Cannon, “Nonstationary assumptions for Gaussian models of images,” IEEE Trans. Syst., Man, Cybern., vol. SMC-6, pp. 876-882, 1976.
64. B. R. Hunt, “Bayesian methods in nonlinear digital image restoration,” IEEE Trans. Comput., vol. C-26, pp. 219-229, 1977.
65. H. J. Trussel, “Improved methods of maximum a posteriori restoration,” IEEE Trans. Comput., vol. C-27, pp. 57-62, 1979.
66. “The relationship between image restoration by the maximum a posteriori method and a maximum entropy method,” IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-28, pp. 114-117, 1980.
67. S. L. Wood and M. Morf, “A fast implementation of a minimum variance estimator for computerized tomography image reconstruction,” IEEE Trans. Biomed. Eng., vol. BME-28, pp. 56-68, 1981. F. Kalman Filtering Techniques
68. A. O. Aboutalib, M. S. Murphy, and L. M. Silverman, “Digital restoration of images degraded by general motion blurs,” IEEE Trans. Automat. Contr., vol. AC-22, pp. 294-302, 1977.
69. “Restoring with maximum entropy. III. Poisson sources and backgrounds,” J. Opt. Soc. Amer., vol. 68, pp. 93-103, 1978.
70. “Statistical models for the image restoration problem,” Comput. Graphics Image Processing, vol. 12, pp. 40-59, 1980.
71. S. F. Gull and G. J. Daniell, “Image reconstruction from incomplete and noisy data,” Nature, vol. 272, pp. 686-690, 1978.
72. S. F. Gull and J. Skilling, “Maximum entropy method in image processing,” Proc. IEE, vol. 131-F, pp. 646-659, 1984.
73. E. T. Jaynes, “Prior probabilities,” IEEE Trans. Syst. Sci. Cybern., vol. SSC-4, pp. 227-241, 1968.
74. “On the rationale of maximum-entropy methods,” Proc. IEEE, vol. 70, pp. 939-952, 1982.
75. R. Kikuchi and B. H. Soffer, “Maximum entropy image restoration. I. The entropy expression,” J. Opt. Soc. Amer., vol. 67, pp. 16561665, 1977.
76. A. Mohammad-Djafari and G. Demoment, “Maximum-entropy diffraction tomography,” in Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing, Tokyo, Japan, Apr. 1986, pp. 1749-1752.
77. “Maximum-entropy Fourier synthesis with application to diffraction tomography,” Appl. Opt., vol. 26, pp. 1745-1754, 1987.
78. J. E. Shore and R. W. Johnson, “Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy,” IEEE Trans. Inform. Theory, vol. IT-26, pp. 26-37, 1980. (”Comments and correction,” IEEE Trans. Inform. Theory, vol. IT-29, pp. 942-943, 1983.)
79. S. Sibisi, “Two-dimensional reconstructions from one-dimensional data by maximum entropy,” Nature, vol. 301, pp. 134-136, 1983. cessing III, I. T. Young et al., Eds. New York: Elsevier, 1986, pp. 765-768.
80. F. O'Sullivan, B. S. Yandell, and W. J. Raynor, Jr. “Automatic smoothing of regression functions in generalized linear models,” J. Amer. Statist. Ass., vol. 81, pp. 96-103, 1986.
81. B. W. Silverman, “A fast and efficient cross-validation method for smoothing parameter choice in spline regression,” J. Amer. Statist. Ass., vol. 79, pp. 584-589, 1984.
82. A. M. Tekalp, H. Kaufman, and J. W. Woods, “Identification of image and blur parameters for the restoration of noncausal blurs,” IEEE Trans. Acoust., Speech, Signat Processing, vol. ASSP-34, pp. 963-972, 1986. J. Miscellaneous
83. J. F. Abramatic and L. M. Silverman, “Nonlinear restoration of noisy images,” IEEE Trans. Pattern Anal Machine Intell., vol. PAMI-4, pp. 141-149, 1982.
84. G. L. Anderson and A. N. Netravali, “Image restoration based on a subjective criterion,” IEEE Trans. Syst. Man, Cybern., vol. SMC-6, pp. 845-853, 1976.
85. C. L. Byrne, R. M. Fitzgerald, M. A. Fiddy, T. J. Hall, and A. M. Darling, “Image restoration and resolution enhancement.” J. Opt. Soc. Amer., vol. 73, pp. 1481-1487, 1983.
86. M. Cannon, “Blind deconvolution of spatially invariant image blurs with phase,” IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-24, pp. 58-63, 1976.
87. M. Cannon, H. J. Trussell, and B. R. Hunt, “Comparison of image restoration methods,” Appl. Opt., vol. 17, pp. 3384-3390, 1978.
88. P. Chan and J. S. Lim, “One-dimensional processing for adaptive image restoration,” IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-33, pp. 117-126, 1985.
89. R. Chellappa and R. L. Kashyap, “Digital image restoration using spatial interaction models,” IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-30, pp. 461-472, 1982.
90. M. E. Davison, “The ill-conditioned nature of the limited angle tomography problem,” SIAMJ. Appl. Math., vol. 43, pp. 428-448. 1983.
91. A. P. Dempster, N. M. Laird, and D. B. Rubin, “Maximum likelihood from incomplete data via the EM algorithm,” J. Roy. Statist. Soc. B, vol. 39, pp. 1-38, 1977.
92. M. P. Ekstrom and R. L. Roads, “On the application of eigenvector expansions to numerical deconvolution,” J. Comput. Phys. vol. 14, pp. 319-340, 1974.
93. G. T. Herman, A. Lent, and H. Hurwitz. “A storage-efficient algorithm for finding the regularized solution of a large, inconsistent system of equations,” J. Inst. Math. Appl., vol. 25, pp. 361-366, 1980.
94. A. K. Jain and E. Angel, “Image restoration, modeling, and reduction of dimensionality.” IEEE Trans. Comput., vol. C-23, pp. 470476, 1974.
95. A. K. Jain, “A semicausal model for recursive filtering of two-dimensional images,” IEEE Trans. Comput., vol. C-26, pp. 343-350, 1977.
96. A. K. Jain and J. R. Jain, “Partial differential equations and finite difference methods for image processing. Part II: Image restoration,” IEEE Trans. Automat. Contr., vol. AC-23, pp. 817-834. 1978.
97. H. E. Knutsson. R. Wilson, and G. H. Granlund, “Anisotropic nonstationary image estimation and its application. Part I: Restoration of noisy images,” IEEE Trans. Commun. vol. COM-31, pp. 388-397, 1983.
98. D. T. Kuan, A. A. Sawchuk, T. C. Strand, and P. Chavel, “Adaptive noise smoothing filter for images with signal-dependent noise,” IEEE Trans. Pattern Anal. Machine Intel!. vol. PAMI-7, pp. 165177, 1985.
99. R. M. Leahy and C. E. Goutis, “An optimal technique for constraint-based image restoration and reconstruction,” IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-34, pp. 1629-1642, 1986.
100. N. D. A. Mascarenhas and W. K. Pratt, “Digital image restoration under a regression model,” IEEE Trans. Circuits Syst. vol. CAS-22, pp. 252-266, 1975.
101. M. I. Sezan and H. Stark. “Image restoration by the method of convex projections,” IEEE Trans. Med. Imaging, vol. MI-1, pp. 95-101, 1982.
102. “Tomographic image reconstruction from incomplete view data H. Markov Random Fields and Related Estimation Techniques
103. J. Besag, “On the statistical analysis of dirty pictures,” J. Roy. Statist. Soc. B, vol. 48, pp. 259-302, 1986.
104. B. Chalmond, “Image restoration using an estimated Markov model,” Signal Processing, vol. 15, pp. 115-129, 1988.
105. S. Geman and D. Geman, “Stochastic relaxation, Gibbs distributions, and the Bayesien restoration of images,” IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-6, pp. 721-741, 1984.
106. S. Geman, “Stochastic relaxation methods for image restoration and expert systems,” in Maximum-Entropy and Bayesian Methods in Science and Engineering, G. J. Erikson and C. R. Smith, Eds. Norwell, MA: Kluwer Academic, 1988, pp. 265-311.
107. H. Jinchi, T. Simchony, and R. Chellapa, “Stochastic relaxation for MAP restoration of gray level images with multiplicative noise,” in Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing, Dallas, TX, Apr. 1987, pp. 1236-1239.
108. S. Kirkpatrick, C. D. Gellatt, and M. P. Vecchi, “Optimization by simulated annealing,” Science, vol. 220, pp. 671-680, 1983.
109. J. Marroquin, S. Mitter, and T. Poggio, “Probabilistic solution of ill-posed problems in computational vision,” J. Amer. Statist. Av.s., vol. 82, pp. 76-89, 1987.
110. N. Metropolis, A. Rosenbluth, M. Rosenbluth, A. Teller, and E. Teller, “Equation of state calculations by fast computing machines,” J. Chem. Phys., vol. 21, pp. 1087-1091, 1953.
111. J. W. Woods, “Two-dimensional discrete Markovian fields,” IEEE Trans. Inform. Theory, vol. IT-18, pp. 232-240, 1972.
112. “Markov image modeling,” IEEE Trans. Automat. Contr., vol. AC-23, pp. 846-850, 1978. I. Hyperparameter Estimation
113. D. Girard, “Les methodes de regularisation optimale et leurs applications en tomographic,” these de Docteur-Ingenieur, Institut National Poly technique de Grenoble, France, 1984.
114. G. H. Golub, M. Heath, and G. Wahba, “Generalized cross-validation as a method for choosing a good ridge parameter,” Technometrics, vol. 21, pp. 215-223, 1979.
115. Y. Goussard, G. Demoment, and F. Monfront, “Maximum a posteriori detection-estimation of Bernoulli-Gaussian processes,” in Proc. 2nd IMA Conf. Math. Signal Processing, Warwick. England, Dec. 1988, 19 pp.
116. J. W. Hilgers, “A note on estimating the optimal regularization parameter,” SIAMJ. Numer. Anal., vol. 17, pp. 472-473, 1980.
117. H. Kaufman, J. W. Woods, S. Dravida, and A. M. Tekalp, “Estimation and identification of two-dimensional images,” IEEE Trans. Automat. Contr., vol. AC-28. pp. 745-756, 1983.
118. F. van der Putten, J. Biemond, and J. W. Woods, “A hybrid identification scheme for image and blur parameters,” in Signal Pro- by convex projections and direct Fourier inversion,” IEEE Trans. Med. Imaging, vol. MI-3, pp. 91-98, 1984.
119. A. M. Tekalp and H. J. Trussell, “Comparative study of some recent statistical and set-theoretic methods for image restoration,” in Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing, New York, NY, Apr. 1988, pp. 988-991.
120. T. J. Uhl, “Linear and nonlinear image restoration methods in comparison,” in Signal Processing III, I. T. Young, Ed. New York: Elsevier Science, 1986, pp. 739-742.
121. D. C. Youla and H. Webb, “Image restoration by the method of convex projections. Part I—Theory,” IEEE Trans. Med. Imaging, vol. MI-1, pp. 81-94, 1982.