A general framework for sparsity-based denoising and inversion

IEEE Transactions on Signal Processing

Volumn 59, Issue 11, 2011, Pages 5202-5211

  Gholami, Ali ^a   Hosseini, S Mohammad ^b  

^a UNIVERSITY OF TEHRAN   (Iran)

^b TARBIAT MODARES UNIVERSITY   (Iran)

Author keywords

Potential function; proximity operator; regularization; sparse approximation

Indexed keywords

APPROXIMATE SOLUTION; CLOSED FORM; COMPUTATIONAL EXPERIMENT; DE-NOISING; EFFICIENT RECONSTRUCTION; NONCONVEX; NUMERICAL EXPERIMENTS; POTENTIAL FUNCTION; PROXIMITY OPERATOR; REGULARIZATION; SHRINKAGE FUNCTIONS; SPARSE APPROXIMATIONS; SPARSE REPRESENTATION; STABLE SOLUTIONS; STILL MISSING; VARIATIONAL APPROACHES;

SIGNAL PROCESSING;

EXPERIMENTS;

EID: 80054083273     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2011.2164074     Document Type: Article

References (37)

1. H.-L. Taylor, S.-C. Banks, and J.-F. McCoy, "Deconvolution with the-norm," Geophys. , vol. 44, pp. 39-52, 1979.
2. S. Levy and P.-K. Fullager, "Reconstruction of a sparse spike train from a portion of its spectrum and application to high-resolution deconvolution," Geophys. , vol. 46, no. 9, pp. 1235-1243, 1981.
3. S. Geman and D.-L. McClure, "Bayesian image analysis: An application to single photon emission tomography," in Proc. Stat. Comput. Section, Amer. Stat. Assoc. , 1985, pp. 12-18.
4. T. Hebert and R. Leahy, "A generalized EM algorithm for 3-D Bayesian reconstruction from Poisson data using Gibbs priors," IEEE Trans. Med. Imag. , vol. 8, no. 2, pp. 194-202, 1989.
5. D.-L. Donoho and I.-M. Johnstone, "Ideal spatial adaptation via wavelet shrinkage," Biometrika, vol. 81, pp. 425-455, 1994.
6. H. Gao, "Wavelet shrinkage denoising using the nonnegative garrote," J. Comput. Graph. Stat. , vol. 7, pp. 469-488, 1998.
7. M.-A. Figueiredo and R.-D. Nowak, "Wavelet-based image estimation: An empirical Bayes approach using Jeffrey's noninformative prior," IEEE Trans. Image Process. , vol. 10, no. 9, pp. 1322-1331, 2001.
8. A. Antoniadis and J. Fan, "Regularization of wavelet approximations," J. Amer. Stat. Assoc. , vol. 96, pp. 939-967, 2001.
9. M. O'Brien, A. Sinclair, and S. Kramer, "Recovery of a sparse spike time series by-norm deconvolution," IEEE Trans. Signal Process. , vol. 42, no. 12, pp. 3353-3365, 1994.
10. A. Gholami and H.-R. Siahkoohi, "Regularization of linear and nonlinear geophysical ill-posed problems with joint sparsity constraints," Geophys. J. Int. , vol. 180, pp. 871-882, 2010.
11. D.-L. Donoho, "Compressed sensing," IEEE Trans. Inf. Theory, vol. 52, no. 4, pp. 1289-1306, 2006.
12. E. Candes, J. Romberg, and T. Tao, "Stable signal recovery from incomplete and inaccurate measurements," Commun. Pure Appl. Math. , vol. 59, pp. 1207-1223, 2006.
13. A.-N. Tikhonov and V.-Y. Arsenin, Solutions of Ill-Posed Problems. Washington: Winston, 1977.
14. P.-C. Hansen, Rank-Deficient and Discrete Ill-Posed Problems: Numerical Aspects of Linear Inversion. Philadelphia, PA: SIAM, 1999.
15. G. Archer and D. Titterington, "On Bayesian/regularization methods for image restoration," IEEE Trans. Image Process. , vol. 4, no. 3, pp. 989-995, 1995.
16. J.-M. Bioucas-Dias and M. Figueiredo, "A new TwIST: Two-step iterative shrinkage/thresholding algorithms for image restoration," IEEE Trans. Image Process. , vol. 16, pp. 2980-2991, 2007.
17. J.-M. Bioucas-Dias, "Bayesian wavelet-based image deconvolution: A GEM algorithm exploiting a class of heavy-tailed priors," IEEE Trans. Image Process. , vol. 15, no. 4, pp. 937-951, 2006.
18. M. Elad, P. Milanfar, and R. Rubinstein, "Analysis versus synthesis in signal priors," Inverse Problems, vol. 23, no. 3, pp. 947-968, 2007.
19. T. Goldstein and S. Osher, "The Split Bregman method for L1 regularized problems," SIAM J. Imag. Sci. , vol. 2, no. 2, pp. 223-243, 2009.
20. P. Charbonnier, L. Blanc-Feraud, G. Aubert, and M. Barlaud, "Deterministic edge-preserving regularization in computed imaging," IEEE Trans. Image Process. , vol. 6, pp. 298-311, 1997.
21. D.-L. Donoho, "For most large underdetermined systems of linear equations, the minimal solution is also the sparsest solution," Commun. Pure Applied Mathematics, vol. 59, pp. 907-934, 2006.
22. D. A. Lorenz, "Non-convex variational denoising of images: Interpolation between hard and soft wavelet shrinkage," Current Development in Theory and Application of Wavelets, vol. 1, no. 1, pp. 31-56, 2007.
23. K. Bredies and D. Lorenz,Minimization of Non-Smooth, Non-Convex Functionals by Iterative Thresholding 2009, Preprint.
24. I. Daubechies, M. Defriese, and C. De Mol, "An iterative thresholding algorithm for linear inverse problems with a sparsity constraint," Commun. Pure Appl. Math. , vol. LVII, pp. 1413-1457, 2004.
25. S.-J. Wright, R.-D. Nowak, and M.-A. Figueiredo, "Sparse reconstruction by separable approximation," IEEE Trans. Signal Process. , vol. 57, no. 7, pp. 2479-2493, Jul. 2009.
26. L. Montefusco, D. Lazzaro, and S. Papi, "Nonlinear filtering for sparse signal recovery from incomplete measurements," IEEE Trans. Signal Process. , vol. 57, no. 7, pp. 2494-2402, Jul 2009.
27. T. Blumensath and M.-E. Davis, "Iterative hard thresholding for compressed sensing," App. Comput. Harmon. Anal. , vol. 27, no. 3, pp. 265-274, 2009.
28. P.-L. Combettes and V. R. Wajs, "Signal recovery by proximal forward-backward splitting," Multiscale Model. Simul. , vol. 4, no. 4, pp. 1168-1200, 2005.
29. C. Chaux, P. L. Combettes, J.-C. Pesquet, and V. R. Wajs, "A variational formulation for frame-based inverse problems," Inverse Problems, vol. 23, no. 4, pp. 1495-1518, 2007.
30. J.-L. Starck, F. Murtagh, and J. M. Fadili, Sparse Image and Signal Processing: Wavelets, Curvelets, Morphological Diversity. New York: Cambridge Univ. Press, 2010.
31. P. Moulin and J. Liu, "Analysis of multiresolution image denoising schemes using generalized-Gaussian and complexity priors," IEEE Trans. Inf. Theory, vol. 45, no. 3, pp. 909-919, 1999.
32. S. Geman and G. Reynolds, "Constrained restoration and the recovery of discontinuities," IEEE Trans. Pattern Anal. Machine Intell. , vol. 14, no. 3, pp. 367-383, 1992.
33. K. Bredies, "A forward-backward splitting algorithmfor theminimization of non-smooth convex functionals in banach space," Inverse Problems, vol. 25, p. 015005, 2009.
34. K. Bredies and D.-A. Lorenz, "Linear convergence of iterative softthresholding," J. Fourier Anal. Appl. , vol. 14, no. 5-6, pp. 813-837, 2008.
35. H. Attouch, J. Bolte, and B.-F. Svaiter, Convergence of Descent Methods for Semi-Algebraic and Tame Problems: Proximal Algorithms, Forward-Backward Splitting, and Regularized Gauss-Seidel Methods [Online]. Available: http://www. optimization-online.org/DB-HTML/2010/12/2864. html, preprint
36. L. Borup and M. Nielsen, Some Remarks on Shrinkage Operators preprint, 2003 [Online]. Available: http://people. math. aau. dk/ ~mnielsen/reprints/R- 2003-07. ps
37. T. Tao and B. Vidakovic, "Almost everywhere convergence of general wavelet shrinkage estimators," Appl. Comput. Harmon. Anal. , vol. 9, pp. 72-82, 2000.