Regularization parameter selection for nonlinear iterative image restoration and mri reconstruction using GCV and SURE-based methods

IEEE Transactions on Image Processing

Volumn 21, Issue 8, 2012, Pages 3659-3672

  Ramani, Sathish ^a   Liu, Zhihao ^a   Rosen, Jeffrey ^a   Nielsen, Jon Fredrik ^a   Fessler, Jeffrey A ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Generalized cross validation (GCV); image restoration; magnetic resonance image (MRI) reconstruction; regularization parameter; Stein's unbiased risk estimate (SURE)

Indexed keywords

GENERALIZED CROSS VALIDATION; ITERATIVE ALGORITHM; ITERATIVE RECONSTRUCTION ALGORITHMS; ITERATIVE REWEIGHTED LEAST SQUARE; MAGNETIC RESONANCE IMAGES; MEAN SQUARED ERROR; MRI RECONSTRUCTION; NOISE VARIANCE; NON LINEAR RECONSTRUCTION; NONLINEAR ALGORITHMS; RECONSTRUCTION ALGORITHMS; REGULARIZATION PARAMETERS; THEORETICAL DERIVATIONS; TOTAL VARIATION; UNBIASED RISK ESTIMATES;

GAUSSIAN NOISE (ELECTRONIC); IMAGE RECONSTRUCTION; INVERSE PROBLEMS; ITERATIVE METHODS; JACOBIAN MATRICES; MAGNETIC RESONANCE IMAGING; OPTIMIZATION; PARAMETERIZATION; RISK PERCEPTION;

ALGORITHMS;

ALGORITHM; ANATOMY AND HISTOLOGY; BRAIN; COMPUTER ASSISTED DIAGNOSIS; HUMAN; IMAGE ENHANCEMENT; NONLINEAR SYSTEM; NORMAL DISTRIBUTION; NUCLEAR MAGNETIC RESONANCE IMAGING; PROCEDURES; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; STATISTICAL ANALYSIS; ARTICLE; HISTOLOGY; METHODOLOGY;

ALGORITHMS; BRAIN; DATA INTERPRETATION, STATISTICAL; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; NONLINEAR DYNAMICS; NORMAL DISTRIBUTION; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY;

EID: 84864136882     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2012.2195015     Document Type: Article

References (66)

1. W. C. Karl, "Regularization in image restoration and reconstruction," in Handbook of Image Video Processing, A. Bovik, Ed. New York: Elsevier, 2005, pp. 183-202.
2. P. C. Hansen, "Analysis of discrete ILL-posed problems by means of the L-curve," SIAM Rev., vol. 34, no. 4, pp. 561-580, 1992.
3. P. C. Hansen and D. P. O'Leary, "The use of the L-curve in the regularization of discrete ILL-posed problems," SIAM J. Sci. Comput., vol. 14, no. 6, pp. 1487-1503, 1993.
4. T. Regínska, "A regularization parameter in discrete ILL-posed problems," SIAM J. Sci. Comput., vol. 17, no. 3, pp. 740-749, 1996.
5. C. R. Vogel, "Non-convergence of the L-curve regularization parameter selection method," Inv. Problems, vol. 12, no. 4, pp. 535-547, Aug. 1996. (Pubitemid 126655737)
6. G. Wahba, Spline Models for Observational Data. Philadelphia, PA: SIAM, 1990.
7. P. Craven and G. Wahba, "Smoothing noisy data with spline functions," Numer. Math., vol. 31, no. 4, pp. 377-403, 1979.
8. G. H. Golub, M. Heath, and G. Wahba, "Generalized cross-validation as a method for choosing a good ridge parameter," Technometrics, vol. 21, no. 2, pp. 215-223, May 1979.
9. S. J. Reeves and R. M. Mersereau, "Optimal estimation of the regularization parameter and stabilizing functional for regularized image restoration," Opt. Eng., vol. 29, no. 5, pp. 446-454, 1990.
10. S. J. Reeves, "Optimal space-varying regularization in iterative image resotration," IEEE Trans. Image Process., vol. 3, no. 3, pp. 319-324, May 1994.
11. D. A. Girard, "The fast Monte-Carlo cross-validation and CL procedures: Comments, new results and application to image recovery problems," Comput. Statist., vol. 10, no. 3, pp. 205-231, 1995.
12. D. A. Girard, "A fast Monte-Carlo cross-validation procedure for large least squares problems with noisy data," Numer. Math., vol. 56, no. 1, pp. 1-23, Jan. 1989.
13. J. D. Carew, G. Wahba, X. Xie, E. V. Nordheim, and M. E. Meyerandb, "Optimal spline smoothing of fMRI time series by generalized crossvalidation," Neuroimage, vol. 18, no. 4, pp. 950-961, 2003. (Pubitemid 36513468)
14. S. Sourbron, R. Luypaert, P. V. Schuerbeek, M. Dujardin, and T. Stadnik, "Choice of the regularization parameter for perfusion quantification with MRI," Phys. Med. Biol., vol. 49, no. 14, pp. 3307-3324, 2004. (Pubitemid 39140013)
15. F. O'Sullivan and G. Wahba, "A cross validated Bayesian retrieval algorithm for nonlinear remote sensing experiments," J. Comp. Phys., vol. 59, no. 3, pp. 441-455, Jul. 1985.
16. L. N. Deshpande and D. A. Girard, "Fast computation of cross-validated robust splines and other non-linear smoothing splines," in Curves and Surfaces, L. Laurent, Eds. Boston, MA: Academic, 1991, pp. 143-148.
17. D. A. Girard, "The fast Monte-Carlo cross-validation and CL procedures: Comments, new results and application to image recovery problems-rejoinder," Comput. Statist., vol. 10, no. 3, pp. 251-258, 1995.
18. C. Stein, "Estimation of the mean of a multivariate normal distribution," Ann. Statist., vol. 9, no. 6, pp. 1135-1151, Nov. 1981.
19. L. Desbat and D. A. Girard, "The minimum reconstruction error choice of regularization parameters: Some more efficient methods and their applicaiton to deconvolution problems," SIAM J. Sci. Comput., vol. 16, no. 6, pp. 1387-1403, Nov. 1995.
20. J. A. Rice, "Choice of smoothing parameter in deconvolution problems," Contemp. Math., vol. 59, pp. 137-152, Feb. 1986.
21. A. M. Thompson, J. C. Brown, J. W. Kay, and D. M. Titterington, "A study of methods of choosing the smoothing parameter in image restoration by regularization," IEEE Trans. Patt. Anal. Mach. Intell., vol. 13, no. 4, pp. 326-339, Apr. 1991. (Pubitemid 21645724)
22. N. P. Galatsanos and A. K. Katsaggelos, "Methods for choosing the regularization parameter and estimating the noise variance in image restoration and their relation," IEEE Trans. Image Process., vol. 1, no. 3, pp. 322-336, Jul. 1992.
23. S. Ramani, C. Vonesch, and M. Unser, "Deconvolution of 3D fluorescence micrographs with automatic risk minimization," in Proc. IEEE 5th Int. Symp. Biomed. Imag., May 2008, pp. 732-735.
24. Y. C. Eldar, "Generalized SURE for exponential families: Applications to regularization," IEEE Trans. Signal Process., vol. 57, no. 2, pp. 471-481, Feb. 2009.
25. R. Giryes, M. Elad, and Y. C. Eldar, "The projected GSURE for automatic parameter tuning in iterative shrinkage methods," Appl. Comput. Harmon. Anal., vol. 30, no. 3, pp. 407-422, May 2011.
26. J.-C. Pesquet, A. Benazza-Benyahia, and C. Chaux, "A SURE approach for digital signal/image deconvolution problems," IEEE Trans. Signal Process., vol. 57, no. 12, pp. 4616-4632, Dec. 2009.
27. A. Marin, C. Chaux, J.-C. Pesquet, and P. Ciuciu, "Image reconstruction from multiple sensors using stein's principle. Application to parallel MRI," in Proc. IEEE Int. Symp. Biomed. Imag.: Nano Macro, Mar.-Apr. 2011, pp. 465-468.
28. C. Vonesch, S. Ramani, and M. Unser, "Recursive risk estimation for non-linear image deconvolution with a wavelet-domain sparsity constraint," in Proc. IEEE 15th Int. Conf. Image Process., Oct. 2008, pp. 665-668.
29. M. Ting, R. Raich, and A. O. Hero, "Sparse image reconstruction using sparse priors," in Proc. IEEE Int. Conf. Image Process., Oct. 2006, pp. 1261-1264.
30. O. Batu and M. Çetin, "Parameter selection in sparsity-driven SAR imaging," IEEE Trans. Aerosp. Electron. Syst., vol. 47, no. 4, pp. 3040-3050, Oct. 2011.
31. X. Zhu and P. Milanfar, "Automatic parameter selection for denoising algorithms using a no-reference measure of image content," IEEE Trans. Image Process., vol. 19, no. 12, pp. 3116-3132, Dec. 2010.
32. X.-P. Zhang and M. D. Desai, "Adaptive denoising based on SURE risk," IEEE Signal Process. Lett., vol. 5, no. 10, pp. 265-267, Oct. 1998. (Pubitemid 128556770)
33. F. Luisier, T. Blu, and M. Unser, "A new SURE approach to image denoising: Interscale orthonormal wavelet thresholding," IEEE Trans. Image Process., vol. 16, no. 3, pp. 593-606, Mar. 2007. (Pubitemid 46431959)
34. T. Blu and F. Luisier, "The SURE-LET approach to image denoising," IEEE Trans. Image Process., vol. 16, no. 11, pp. 2778-2786, Nov. 2007. (Pubitemid 350141850)
35. D. Ville and M. Kocher, "Nonlocal means with dimensionality reduction and SURE-based parameter selection," IEEE Trans. Image Process., vol. 20, no. 9, pp. 2683-2690, Sep. 2011.
36. S. Ramani, T. Blu, and M. Unser, "Monte-Carlo SURE: A blackbox optimization of regularization parameters for general denoising algorithms," IEEE Trans. Image Process., vol. 17, no. 9, pp. 1540-1554, Sep. 2008.
37. M. A. T. Figueiredo and R. D. Nowak, "An EM algorithm for waveletbased image restoration," IEEE Trans. Image Process., vol. 12, no. 8, pp. 906-916, Aug. 2003.
38. M. Elad, P. Milanfar, and R. Rubinstein, "Analysis versus synthesis in signal priors," Inv. Problems, vol. 23, no. 3, pp. 947-968, 2007. (Pubitemid 46838835)
39. P. J. Huber, Robust Statistics. New York: Wiley, 1981.
40. J. A. Fessler and S. D. Booth, "Conjugate-gradient preconditioning methods for shift-variant PET image reconstruction," IEEE Trans. Image Process., vol. 8, no. 5, pp. 688-699, May 1999.
41. G. Archer and D. M. Titterington, "On some Bayesian/regularization methods for image restoration," IEEE Trans. Image Process., vol. 4, no. 7, pp. 989-995, Jul. 1995.
42. R. Molina, A. K. Katsaggelos, and J. Mateos, "Bayesian and regularization methods for hyperparameter estimation in image restoration," IEEE Trans. Image Process., vol. 8, no. 2, pp. 231-246, Feb. 1999.
43. J. P. Oliveira, J. M. Bioucas-Dias, and M. A. T. Figueiredo, "Adaptive total variation image deblurring: A majorization-minimization approach," Signal Process., vol. 89, no. 9, pp. 1683-1693, 2009.
44. S. D. Babacan, R. Molina, and A. K. Katsaggelos, "Variational Bayesian blind deconvolution using a total variation prior," IEEE Trans. Image Process., vol. 18, no. 1, pp. 12-26, Jan. 2009.
45. S. D. Babacan, R. Molina, and A. K. Katsaggelos, "Parameter estimation in TV image restoration using variational distribution approximation," IEEE Trans. Image Process., vol. 17, no. 3, pp. 326-339, Mar. 2008. (Pubitemid 351395084)
46. T. Goldstein and S. Osher, "The split Bregman method for L1-regularized problems," SIAM J. Imag. Sci., vol. 2, no. 2, pp. 323-343, 2009.
47. S. Ramani and J. A. Fessler, "An accelerated iterative reweighted least squares algorithm for compressed sensing MRI," in Proc. IEEE Int. Symp. Biomed. Imag., Apr. 2010, pp. 257-260.
48. S. Ramani, J. Rosen, Z. Liu, and J. A. Fessler, "Iterative weighted risk estimation for nonlinear image restoration with analysis priors," Proc. SPIE, Comput. Imaging X, vol. 8296, no. 1, pp. 82960N1-82960N12, Jan. 2012.
49. S. Ramani and J. A. Fessler, "Parallel MR image reconstruction using augmented Lagrangian methods," IEEE Trans. Med. Imag., vol. 30, no. 3, pp. 694-706, Mar. 2011.
50. E. H. Lieb and M. Loss, Analysis, 2nd ed. Providence, RI: American Mathematical Society, 2001.
51. D. H. Brandwood, "A complex gradient operator and its application in adaptive array theory," IEE Proc. H: Microw. Opt. Antenn., vol. 130, no. 1, pp. 11-16, Feb. 1983. (Pubitemid 13526378)
52. M. Brookes. (2001). The Matrix Reference Manual[Online]. Available: http://www.ee.imperial.ac.uk/hp/staff/dmb/matrix/calculus.html
53. A. Hjorungnes and D. Gesbert, "Complex-valued matrix differentiation: Techniques and key results," IEEE Trans. Signal Process., vol. 55, no. 6, pp. 2740-2746, Jun. 2007. (Pubitemid 46851638)
54. H. Liao, F. Li, and M. K. Ng, "Selection of regularization parameter in total variation image restoration," J. Opt. Soc. Amer. A, vol. 26, no. 11, pp. 2311-2320, 2009.
55. H. Liao and M. K. Ng, "Blind deconvolution using generalized crossvalidation approach to regularization parameter estimation," IEEE Trans. Image Process., vol. 20, no. 3, pp. 670-680, Mar. 2011.
56. M. V. Afonso, J. M. Bioucas-Dias, and M. A. T. Figueiredo, "Fast image recovery using variable splitting and constrained optimization," IEEE Trans. Image Process., vol. 19, no. 9, pp. 2345-2356, Sep. 2010.
57. W. Hackbusch, Iterative Solution of Large Sparse Systems of Equations. New York: Springer-Verlag, 1994.
58. C. Chaux, P. L. Combettes, J.-C. Pesquet, and V. R. Wajs, "A variational formulation for frame-based inverse problems," Inv. Problems, vol. 23, no. 4, pp. 1495-1518, Aug. 2007. (Pubitemid 47411222)
59. M. F. Hutchinson, "A stochastic estimator of the trace of the influence matrix for Laplacian smoothing splines," Commun. Statist. Simul. Comput., vol. 19, no. 2, pp. 433-450, 1990.
60. Z. Bai, M. Fahey, and G. Golub, "Some large-scale matrix computation problems," J. Comput. Appl. Math., vol. 74, nos. 1-2, pp. 71-89, 1996. (Pubitemid 126381008)
61. S. Dong and K. Liu, "Stochastic estimation with z2 noise," Phys. Lett. B, vol. 328, nos. 1-2, pp. 130-136, 1994.
62. Brainweb: Simulated MRI Volumes for Normal Brain[Online]. Available: http://www.bic.mni.mcgill.ca/brainweb/
63. Y. Hu and M. Jacob, "Higher degree total variation (HDTV) regularization for image recovery," IEEE Trans. Image Process., to be published.
64. S. Lefkimmiatis, A. Bourquard, and M. Unser, "Hessian-based norm regularization for image restoration with biomedical applications," IEEE Trans. Image Process., vol. 21, no. 3, pp. 983-995, Mar. 2012.
65. A. Elmoataz, O. Lezoray, and S. Bougleux, "Nonlocal discrete regularization on weighted graphs: A framework for image and manifold processing," IEEE Trans. Image Process., vol. 17, no. 7, pp. 1047-1060, Jul. 2008.
66. Y. Wang, J. Yang, W. Yin, and Y. Zhang, "A new alternating minimization algorithm for total variation image reconstruction," SIAM J. Image. Sci., vol. 1, no. 3, pp. 248-72, 2008.