A new TwIST: Two-step iterative shrinkage/thresholding algorithms for image restoration

IEEE Transactions on Image Processing

Volumn 16, Issue 12, 2007, Pages 2992-3004

  Bioucas Dias, José M ^a   Figueiredo, Mário A T ^a  

^a INSTITUTO DE TELECOMUNICAÇÕES   (Portugal)

Author keywords

Algorithm design and analysis; Convex analysis; Deconvolution; Image deconvolution; Image restoration; Non smooth optimization; Optimization; Regularization; Total variation; Wavelets

Indexed keywords

ALGORITHMS; CONVERGENCE OF NUMERICAL METHODS; DECONVOLUTION; INVERSE PROBLEMS; MATHEMATICAL MODELS; OPTIMIZATION;

CONVERGENCE RATE; CONVEX ANALYSIS; IMAGE DECONVOLUTION; NON-SMOOTH OPTIMIZATION;

IMAGE RECONSTRUCTION;

ALGORITHM; ARTICLE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; IMAGE ENHANCEMENT; METHODOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING;

ALGORITHMS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING, COMPUTER-ASSISTED;

EID: 36749005582     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2007.909319     Document Type: Article

References (50)

1. H. Andrews and B. Hunt, Digital Image Restoration. Englewood Cliffs, NJ: Prentice-Hall, 1977.
2. G. Archer and D. Titterington, "On Bayesian/regularization methods for image restoration," IEEE Trans. Image Process., vol. 4, no. 3, pp. 989-995, Jul. 1995.
3. O. Axelsson, Iterative Solution Methods. New York: Cambridge Univ. Press, 1996.
4. 1-unified variational framework for image restoration," in Proc. Eur. Conf. Computer Vision, 2004, pp. 1-13, Springer-Verlag.
5. M. Bertero and P. Boccacci, Introduction to Inverse Problems in Imaging. Bristol, U.K.: IOP, 1998.
6. J. Bioucas-Dias, "Fast GEM wavelet-based image deconvolution algorithm," in Proc. IEEE Int. Conf. Image Processing, 2003, vol. 2, pp. 961-964.
7. J. Bioucas-Dias, "Bayesian wavelet-based image deconvolution: A GEM algorithm exploiting a class of heavy-tailed priors," IEEE Trans. Image Process., vol. 15, no. 4, pp. 937-951, Apr. 2006.
8. J. Bioucas-Dias and M. Figueiredo, "Two-step algorithms for linear inverse problems with non-quadratic regularization," presented at the IEEE Int. Conf. Image Processing, San Antonio, TX, 2007.
9. J. Bioucas-Dias, M. Figueiredo, and J. Oliveira, "Total variation image deconvolution: A majorization-minimization approach," presented at the IEEE Int. Conf. Acoustics, Speech, and Signal Processing, Toulouse, France, 2006.
10. Z.-H. Cao, "On the convergence on nonstationary iterative methods for symmetric positive (semi)definite systems," Appl. Numer. Math., vol. 37, pp. 319-330, 2001.
11. A. Chambolle, "An algorithm for total variation minimization and applications," J. Math. Imag. Vis., vol. 20, pp. 89-97, 2004.
12. A. Chambolle, "Total variation minimization and a class of binary MRF models," in Proc. Int. Workshop on Energy Minimization Methods in Computer Vision and Pattern Recognition, 2005, pp. 136-152, Springer Verlag.
13. A. Chambolle, R. De Vore, N. Lee, and B. Lucier, "Nonlinear wavelet image processing: Variational problems, compression, and noise removal through wavelet shrinkage," IEEE Trans. Image Process., vol. 7, no. 3, pp. 319-335, Mar. 1998.
14. A. Chambolle and P.-L. Lions, "Image recovery via total variation minimization and related problems," Numer. Math., vol. 76, pp. 167-188, 1997.
15. T. Chan, S. Esedoglu, F. Park, and A. Yip, "Recent developments in total variation image restoration," in Mathematical Models of Computer Vision, N. Paragios, Y. Chen, and O. Faugeras, Eds. New York: Springer Verlag, 2005.
16. C. Chaux, P. Combettes, J.-C. Pesquet, and V. Wajs, "Iterative image deconvolution using overcomplete representations," presented at the Fur. Signal Processing Conf., Florence, Italy, 2006.
17. S. Chen, D. Donoho, and M. Saunders, "Atomic decomposition by basis pursuit," SIAM J. Sci. Comput., vol. 20, pp. 33-61, 1998.
18. F. Clarke, Optimization and Nonsmooth Analysis. New York: Wiley, 1983.
19. P. Combettes and V. Wajs, "Signal recovery by proximal forward-backward splitting," SIAM J. Multiscale Model. Simul., vol. 4, pp. 1168-1200, 2005.
20. J. Darbon and M. Sigelle, "A fast and exact algorithm for total variation minimization," in Proc. 2nd Iberian Conf. Pattern Recognition and Image Analysis, 2005, vol. 3522, pp. 351-359.
21. I. Daubechies, M. Defriese, and C. De Mol, "An iterative thresholding algorithm for linear inverse problems with a sparsity constraint," Commun. Pure Appl. Math., vol. LVII pp. 1413-1457, 2004.
22. D. Donoho and I. Johnstone, "Adapting to unknown smoothness via wavelet shrinkage," J. Amer. Statist. Assoc., vol. 90, no. 432, pp. 1200-1224, 1995.
23. D. Donoho, "De-noising by soft thresholding," IEEE Trans. Inf. Theory, vol. 41, no. 3, pp. 613-627, May 1995.
24. M. Elad, "Why simple shrinkage is still relevant for redundant representations?," IEEE Trans. Inf. Theory, vol. 52, no. 12, pp. 5559-5569, Dec. 2006.
25. M. Elad, B. Matalon, and M. Zibulevsky, "Image denoising with shrinkage and redundant representations," presented at the IEEE Comput. Soc. Conf. Computer Vision and Pattern Recognition, New York, 2006.
26. M. Figueiredo, "Adaptive sparseness for supervised learning," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 9, pp. 1150-1159, Sep. 2003.
27. M. Figueiredo, J. Bioucas-Dias, and R. Nowak, "Majorization-minimization algorithms for wavelet-based image restoration," IEEE Trans. Image Process., to be published.
28. M. Figueiredo and R. Nowak, "An EM algorithm for wavelet-based image restoration," IEEE Trans. Image Process., vol. 12, no. 8, pp. 906-916, Aug. 2003.
29. M. Figueiredo and R. Nowak, "A bound optimization approach to wavelet-based image deconvolution," presented at the IEEE Int. Conf. Image Processing, Genoa, Italy, 2005.
30. M. Figueiredo, J. Bioucas-Dias, J. Oliveira, and R. Nowak, "On total-variation denoising: A new majorization-minimization algorithm and an experimental comparison with wavalet denoising," presented at the IEEE Int. Conf. Image Processing, 2006.
31. J. Guerrero-Colon and J. Portilla, "Deblurring-by-denoising using spatially adaptive Gaussian scale mixtures in overcomplete pyramids," presented at the IEEE Int. Conf. Image Processing, Atlanta, GA, 2006.
32. Y. Grandvalet and S. Canu, "Outcomes of the equivalence of adaptive ridge with least absolute shrinkage," in Advances in Neural Information Processing Systems-NIPS-11. Cambridge, MA: MIT Press, 1999.
33. D. Hunter and K. Lange, "A tutorial on MM algorithms," Amer. Statist., vol. 58, pp. 30-37, 2004.
34. A. Jalobeanu, N. Kingsbury, and J. Zerubia, "Image deconvolution using hidden Markov tree modeling of complex wavelet packets," presented at the IEEE Int. Conf. Image Processing, Thessaloniki, Greece, 2001.
35. A. Katsaggelos, Digital Image Restoration, ser. Ser. Inf. Sci.. New York: Springer-Verlag, 1991, vol. 23.
36. D. Lorenz, "Wavelet shrinkage in signal and image processing: An investigation of relations and equivalences" Ph.D. dissertation, Zentrum für Technomathematik, Univ. Bremen, Bremen, Germany, 2004 [Online. Available: Www.math.uni-bremen.de/dlorenz
37. D. Lorenz, "Variational denoising in besov spaces and interpolation of hard and soft wavelet shrinkage," Tech. Rep. Zentrum für Technomathematik, Univ. Bremen, Germany, 2004 [Online]. Available: www.math.uni-bremen.de/dlorenz
38. L. Lu and C. Pearce, "Some new bounds for singular values and eigenvalues of matrix products," Ann. Oper. Res., vol. 98, pp. 141-148, 2000.
39. P. Moulin and J. Liu, "Analysis of multiresolution image denoising schemes using generalized-Gaussian and complexity priors," IEEE Trans. Inf. Theory, vol. 45, no. 3, pp. 909-919, Apr. 1999.
40. R. Neelamani, H. Choi, and R. Baraniuk, "ForWaRD: Fourier-wavelet regularized deconvolution for ill-conditioned systems," IEEE Trans. Signal Process., vol. 52, no. 2, pp. 418-433, Feb. 2004.
41. R. Nowak and M. Figueiredo, "Fast wavelet-based image deconvolution using the EM algorithm," in Proc. 35th Asilomar Conf. Signals, Systems, Computers, 2001, vol. 1, pp. 371-375.
42. S. Osher, L. Rudin, and E. Fatenti, "Nonlinear total variation based noise removal algorithms," Phys. D, vol. 60, pp. 259-268, 1992.
43. J. Portilla, V. Strela, M. Wainwright, and E. Simoncelli, "Image denoising using scale mixtures of Gaussians in the wavelet domain," IEEE Trans. Image Process., vol. 12, no. 11, pp. 1338-1351, Nov. 2003.
44. R. T. Rockafellar and R. Wets, Variational Analysis. Berlin, Germany: Springer Verlag, 1998.
45. J.-L. Starck, E. Candès, and D. Donoho, "Astronomical image representation by the curvelet transform," Astron. Astrophys., vol. 398, pp. 785-800, 2003.
46. J.-L. Starck, M. Nguyen, and F. Murtagh, "Wavelets and curvelets for image deconvolution: A combined approach," Signal Process., vol. 83, pp. 2279-2283, 2003.
47. D. Sun and L. Qi, "Solving variational inequality problems via smoothing-nonsmooth reformulations," J. Comput. Appl. Math., vol. 129, pp. 37-62, 2001.
48. J. Theys, "Joint spectral radius: Theory and approximations" Ph.D. dissertation, Univ. Catholique de Louvain, Louvain, Belgium, 2005 [Online]. Available: Www.inma.ucl.ac.be/~blonde1/05thesetheys.pdf
49. C. Wu, "On the convergence properties of the EM algorithm," Ann. Statist., vol. 11, pp. 95-103, 1983.
50. C. Zalinescu, Convex Analysis in General Vector Spaces. Singapore: World Scientific, 2002.