Methods for Choosing the Regularization Parameter and Estimating the Noise Variance in Image Restoration and Their Relation

IEEE Transactions on Image Processing

Volumn 1, Issue 3, 1992, Pages 322-336

  Galatsanos, Nikolas P ^a   Katsaggelos, Aggelos K ^b  

^a ILLINOIS INSTITUTE OF TECHNOLOGY   (United States)

^b NORTHWESTERN UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

NOISE, SPURIOUS SIGNAL;

ILL-CONDITIONED PROBLEMS; IMAGE RESTORATION;

IMAGE PROCESSING;

EID: 0026898364     PISSN: 10577149     EISSN: 19410042     Source Type: Journal    
DOI: 10.1109/83.148606     Document Type: Article

References (38)

1. H. Andrews and B. Hunt, Digital Image Restoration. Englewood Cliffs, NJ: Prentice Hall, 1977.
2. D. L. Angwin and H. Kaufman, “Non-homogeneous image identification and restoration procedures,” in Digital Image Restoration, A. K. Katsaggelos, ed., Springer Verlag New York: vol. 23, 1991.
3. P. Craven and G. Wahba, ‘‘Smoothing noisy data with spline functions,” Numer. Math., vol. 31, pp. 377–403, 1975.
4. G. Demoment, ‘‘Image reconstruction and restoration: Overview of common estimation problems,” IEEE Trans. Acoust. Speech Signal Processing, vol. 37, pp. 2024–2036, Dec. 1989.
5. J. A. Fessler, ‘‘Nonparametric fixed-interval smoothing with vector splines,” IEEE Trans. Signal Processing, vol. 39, pp. 852–859, Apr. 1991.
6. N. P. Galatsanos, and A. K. Katsaggelos ‘‘Cross validation and other criteria for estimating the regularization parameter and the noise variance,” in Proc. IEEE ICASSP, Toronto, Canada, May 1991, pp. 3021–3024.
7. —, ‘‘The use of cross-validation and maximum-likelihood in regularized image restoration,” in Proc. Conf. Information Sciences and Systems, Mar. 20–22, 1991, pp. 459–464.
8. R. M. Gray, ‘‘On the asymptotic eigenvalue distribution of Toeplitz matrices,” IEEE Trans. Inform. Theory, vol. IT-18, pp. 725–730, Nov. 1972.
9. G. H. Golub, M. Heath, and G. Wahba, ‘‘Generalized cross-validation as a method for choosing a good ridge parameter,” Technometr., vol. 21, no. 2, pp. 215–223, 1979.
10. P. Hall and D. Titterington, ‘‘Common structure of techniques for choosing smoothing parameters in regression problems,” J. Roy. Stat. Soc. B, vol. 49, no. 2, pp. 184–198, 1987.
11. A. E. Hoerl and R. W. Kennard, ‘‘Ridge regression: Biased estimation for nonorthogonal problems,” Technometr., vol. 12, no. 1, pp. 55–67, 1970.
12. B. R. Hunt, ‘‘The application of constrained least squares estimation to image restoration by digital computer,’’ IEEE Trans. Comput., vol. 22, pp. 805–812, Sept. 1973.
13. M. G. Kang and A. K. Katsaggelos, ‘‘Simultaneous iterative image restoration and evaluation of the regularization parameter,” to be published.
14. A. Katsaggelos, J. Biemond, R. M. Mersereau, and R. W. Schafer, ‘‘A general formulation of constrained iterative image restoration,” in Proc. ICASSP-85, Mar. 1985, pp. 700–703.
15. A. K. Katsaggelos, ‘‘Iterative image restoration algorithms,” Opt. Eng., vol. 28, no. 7, pp. 735–748, July 1989.
16. A. K. Katsaggelos, J. Biemond, R. M. Mersereau, and R. W. Schafer, ‘‘A regularized iterative image restoration algorithm,” IEEE Trans. Signal Processing, vol. 39, pp. 914–929, Apr. 1991.
17. S. M. Kay, Modern Spectral Estimation: Theory and Applications, Englewood Cliff, NJ: Prentice Hall, 1988.
18. R. L. Lagendijk, J. Biemond, and D. E. Bokee, ‘‘Identification and restoration of noisy blurred images using the expectation-maximization algorithm,” IEEE Trans. Acoust. Speech Signal Processing, vol. 38, pp. 1180–1191, July 1990.
19. K. T. Lay and A. K. Katsaggelos, ‘‘Image identification and restoration based on the expectation maximization algorithm,” Opt. Eng., vol. 29, no. 5, pp. 436–445, May 1990.
20. G. Kitagawa and W. Gersch, ‘‘A smoothness priors long AR model method for spectral estimation,” IEEE Trans. Autom. Contr., vol. AC-30, pp. 57–65, Jan. 1985.
21. P. Meer, J. Jolion, and A. Rosenfeld, ‘‘A fast parallel algorithm for blind estimation of noise variance,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, pp. 216–222, Feb. 1990.
22. D. Nychka, ‘‘Confidence intervals for smoothing splines,” J. Amer. Stat. Assoc., vol. 83, pp. 1134–1143, 1988.
23. S. J. Reeves and R. M. Mersereau, ‘‘Optimal estimation of the regularization parameters and stabilizing functional for regularized image restoration,” Opt. Eng., vol. 29, pp. 446–454, May 1990.
24. S. J. Reeves, “A cross-validation approach to image restoration and blur identification,” Ph.D. dissertation, Inst. 1990.
25. J. A. Rice, “Choice of smoothing parameter in deconvolution problems,” in Contemporary Mathematics, vol. 59, J. S. Maron, ed. Providence, RI: American Math Soc., 1986.
26. V. Solo, “Linear image restoration: An analytical study,” Tech. Rep. 88-VS-May-1988, Dept, of ECE, The John Hopkins Univ., Balti-more, MD, May 1988.
27. M. Stone, “Cross validatory choice and assesment of statistical predictions,” J. Roy. Stattist. Soc., Series B, vol. 36, pp. 111–147, 1974.
28. A. M. Tekalp, H. Kaufman, and J. W. Woods, ‘‘Identification of image and blur parameters for the restoration of noncausal blurs,” IEEE Trans. Acoust. Speech Signal Processing, vol. 34, pp. 963–972, Aug. 1986.
29. A. M. Tekalp and H. Kaufman, “On statistical identification of a class of linear phase space-invariant blurs using non-minimum phase ARM A models,” IEEE Trans. Acoust. Speech Signal Processing, vol. 36, pp. 1360–1363, Aug. 1988.
30. A. M. Thompson, J. W. Kay, and D. M. Titterington, “A cautionary note about the crossvalidatory choice,” J. Statist. Comput. Simul., vol. 33, pp. 199–216, 1989.
31. A. M. Thompson, J. C. Brown, J. W. Kay, and D. M. Titterington, “A study of methods of choosing the smoothing parameter in image restoration by regularization,” IEEE Trans. Pattern Analy. Mach. Intell., vol. 13, no. 4, pp. 326–339, Apr. 1991.
32. A. Tikhonov and V. Arsenin, Solution of Ill-Posed Problems. New York: Wiley, 1977.
33. H. J. Trussel, “Convergence criteria for iterative restoration methods,” IEEE Trans. Acoust. Speech Signal Processing, vol. ASSP-31, pp. 129–136, Feb. 1983.
34. H. J. Trussel and M. R. Civanlar, “The feasible solution in signal restoration,” IEEE Trans. Acoust. Speech Signal Processing, vol. 32, pp. 201–212, Apr. 1984.
35. G. Wahba, “Practical approximate solutions to linear operator equations when the data are noisy,” SIAM, J. Numer. Anal., vol. 14, pp. 651–667, Sept. 1977.
36. —, “Bayesian ‘confidence intervals’ for the cross-validated smoothing splines,” J. Roy. Stat. Soc. B, vol. 45, pp. 133–150, 1983.
37. —, “A comparison of GCV and GML for choosing the smoothing parameter in the generalized spline smoothing problem,” Annals Statist., vol. 13, no. 4, pp. 1378–1402, 1985.
38. —, “Spline models for observational data,” presented at SIAM-59, Philadelphia, PA, 1990.