Why simple shrinkage is still relevant for redundant representations?

IEEE Transactions on Information Theory

Volumn 52, Issue 12, 2006, Pages 5559-5569

  Elad, Michael ^a,b  

^a IEEE   (Israel)

^b TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Basis pursuit; Denoising; Frame; Overcomplete; Redundant; Shrinkage; Sparse representation; Thresholding

Indexed keywords

BASIS PURSUIT; DENOISING; FRAMES; OVERCOMPLETE; SPARSE REPRESENTATION; THRESHOLDING;

ITERATIVE METHODS; OPTIMIZATION; PROBLEM SOLVING; REDUNDANCY; WHITE NOISE;

GAUSSIAN NOISE (ELECTRONIC);

EID: 33947361050     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2006.885522     Document Type: Article

References (44)

1. J. L. Rudin, S. Osher, and C. Fatemi, "Nonlinear total variation based noise removal algorithms," Physica D, vol. 60, pp. 259-268, 1992.
2. A. S. Carasso, "Linear and nonlinear image deblurring: A documented study," SIAM J. Num. Anal., vol. 36, pp. 1659-1689, 1999.
3. J. Weickert, B. M. Romeny, and M. A. Viergever, "Efficient and reliable schemes for nonlinear diffusion filtering," IEEE Trans. Image Process., vol. 7, no. 3, pp. 398-110, Mar. 1998.
4. M. Elad, "On the bilateral filter and ways to improve it," IEEE Trans. Image Process., vol. 11, no. 10, pp. 1141-1151, Oct. 2002.
5. D. L. Donoho and I. M. Johnstone, "Ideal spatial adaptation by wavelet shrinkage," Biometrika, vol. 81, no. 3, pp. 425-455, Sept. 1994.
6. D. L. Donoho, "Denoising by soft thresholding," IEEE Trans. Inf. Theory, vol. 41, no. 3, pp. 613-627, May 1995.
7. D. L. Donoho, I. M. Johnstone, G. Kerkyacharian, and D. Picard, "Wavelet shrinkage-asymptopia," J. Roy. Statist. Soc. Ser. B-Methodological, vol. 57, no. 2, pp. 301-337, 1995.
8. D. L. Donoho and I. M. Johnstone, "Adapting to unknown smoothness via wavelet shrinkage," J. Amer. Statist. Assoc., vol. 90, no. 432, pp. 1200-1224, Dec. 1995.
9. D. L. Donoho, "Wedgelets: Nearly minimax estimation of edges," Ann. Statist., vol. 27, no. 3, pp. 859-897, Jim. 1998.
10. D. L. Donoho and I. M. Johnstone, "Minimax estimation via wavelet shrinkage," Ann. Stat., vol. 26, no. 3, pp. 879-921, Jun. 1998.
11. E. P. Simoncelli and E. H. Adelson, "Noise removal via Bayesian wavelet coring," in Proc. Int. Conf. Image Processing, Laussanne, Switzerland, Sep. 1996, pp. 379-382.
12. P. Moulin and J. Liu, "Analysis of multiresolution image denoising schemes using generalized Gaussian and complexity priors," IEEE Trans. Inf. Theory, vol. 45, no. 3, pp. 909-919, Apr. 1999.
13. M. Jansen, Noise Reduction by Wavelet Thresholding. New York: Springer-Verlag, 2001.
14. E. J. Candes and D. L. Donoho, "Recovering edges in ill-posed inverse problems: Optimality of curvelet frames," Ann. Statist., vol. 30, no. 3, pp. 784-842, Jun. 2002.
15. J.-L. Starck, E. J. Candes, and D. L. Donoho, "The curvelet transform for image denoising," IEEE Trans. Image Process., vol. 11, no. 6, pp. 670-684, Jun. 2002.
16. J.-L. Starck, M. Elad, and D. L. Donoho, "Redundant multi-scale transforms and their application for morphological component separation," Adv. Imaging Electron Phys., vol. 132, pp. 287-348, 2004.
17. M. N. Do and M. Vetterli, "Rotation invariant texture characterization and retrieval using steerable wavelet-domain hidden markov models," IEEE Trans. Multimedia, vol. 4, no. 4, pp. 517-527, Dec. 2002.
18. M. N. Do and M. Vetterli, "Framing pyramids," IEEE Trans. Signal Process., vol. 51, no. 9, pp. 2329-2342, Sep. 2003.
19. P. Ishwar and P. Moulin, "Shift invariant restoration - An overcomplete maxent MAP framework," in Proc. Int. Conf. Image Processing, Vancouver, BC, Canada, 2000, vol. 3, pp. 270-272.
20. M. N. Do and M. Vetterli, "The finite ridgelet transform for image representation," IEEE Trans. Image Process., vol. 12, no. 1, pp. 16-28, Jan. 2003.
21. P. Carre and E. Andres, "Discrete analytical ridgelet transform," Signal Process., vol. 84, no. 11, pp. 2165-2173, Nov. 2004.
22. M. Lang, H. Guo, and J. E. Odegard, "Noise reduction using undecimated discrete wavelet transform," IEEE Signal Process. Lett., vol. 3, no. 1, pp. 10-12, Jan. 1996.
23. R. Eslami and H. Radha, "The contourlet transform for image de-noising using cycle spinning," in Proc. Asilomar Conf. Signals, Systems, and Computers, Pacific Grove, CA, Nov. 2003, pp. 1982-1986.
24. R. Eslami and H. Radha, "Translation-invariant contourlet transform and its application to image denoising," IEEE Trans. Image Process., submitted for publication.
25. S.S. Chen, D. L. Donoho, and M. A. Saunders, "Atomic decomposition by basis pursuit," SIAM Rev., vol. 43, no. 1, pp. 129-159, 2001.
26. 1 norms," J. Approx. Theory, vol. 3, pp. 123-127, 1970.
27. I. F. Gorodnitsky and B. D. Rao, "Sparse signal reconstruction from limited data using FOCUSS: A re-weighted norm minimization algorithm," IEEE Trans. Signal Process., vol. 45, no. 3, pp. 600-616, Mar. 1997.
28. J. Scharcanski, C. R. Jung, and R. T. Clarke, "Adaptive image denoising using scale and space consistency," IEEE Trans. Image Process., vol. 11, no. 9, pp. 1092-1101, Sep. 2002.
29. C. R. Jung and J. Scharcanski, "Adaptive image denoising and edge enhancement in scale-space using the wavelet transform," Pattern Recogn. Lett., vol. 24, no. 7, pp. 965-971, Apr. 2003.
30. J. Portilla, V. Strela, M. J. Wainwright, and E. P. Simoncelli, "Adaptive Wiener denoising using a gaussian scale mixture model in the wavelet domain," in Proc. 8th Int. Conf. Image Process., Thessaloniki, Greece, Oct. 2001, vol. 2, pp. 37-40.
31. J. Portilla, V. Strela, M. J. Wainwright, and E. P. Simoncelli, "Image denoising using scale mixtures of gaussians in the wavelet domain," IEEE Trans. Image Process., vol. 12, no. 11, pp. 1338-1351, Nov. 2003.
32. O. G. Guleryuz, "Weighted overcomplete denoising," in Proc. Asilomar Conf. Signals, Systems, and Computers, Pacific Grove, CA, Nov. 2003, vol. 2, pp. 1992-1996.
33. A. G. Bruce, S. Sardy, and P. Tseng, "Block coordinate relaxation methods for nonparametric signal de-noising," Proc. SPIE, vol. 3391, pp. 75-86, 1998.
34. S. G. Chang, B. Yu, and M. Vettereli, "Adaptive wavelet thresholding for image denoising and compression," IEEE Trans. Image Process., vol. 9, no. 9, pp. 1532-1546, Sep. 2000.
35. _, "Wavelet thresholding for multiple noisy image copies," IEEE Trans. Image Process., vol. 9, no. 9, pp. 1631-1635, Sep. 2000.
36. _, "Spatially adaptive wavelet thresholding with context modeling for image denoising," IEEE Trans. Image Process., vol. 9, no. 9, pp. 1522-1531, Sep. 2000.
37. P. Mrázek and J. Weickert, "Rotationally invariant wavelet shrinkage," in Lecture Notes in Computer Science. Berlin, Germany: Springer-Verlag, 2003, vol. 2781, pp. 156-163.
38. G. Steidl, J. Weickert, T. Brox, P. Mrázek, and M. Welk, "On the equivalence of soft wavelet shrinkage, total variation diffusion, total variation regularization, and SIDEs," SIAM J. Numer. Anal., vol. 42, no. 2, pp. 686-713, 2004.
39. J. Weickert, G. Steidl, P. Mrázek, M. Welk, and T. Brox, "Diffusion filters and wavelets: What can they learn from each other?," in Mathematical Models of Computer Vision: The Handbook, N. Paragios, Y. Chen, and O. Faugeras, Eds. Berlin, Germany: Springer-Verlag, 2005.
40. J.-L. Starck, E. Candes, and D. L. Donoho, "Astronomical image representation by the curvelet transform," Astron. Astrophys., vol. 398, pp. 785-800, 2003.
41. J.-L. Starck, M. Elad, and D. L. Donoho, "Redundant multiscale transforms and their application for morphological component analysis," J. Adv. Imag. Electron Phys., vol. 132, pp. 287-348, 2004.
42. M. A. Figueiredo and R. D. Nowak, "An EM algorithm for wavelet-based image restoration," IEEE Trans. Image Process., vol. 12, no. 8, pp. 906-916, Aug. 2003.
43. I. Daubechies, M. Defrise, and C. De-Mol, "An iterative thresholding algorithm for linear inverse problems with a sparsity constraint," Commun. Pure and Applied Math., vol. LVII, pp. 1413-1457, 2004.
44. B. Matalon, M. Elad, and M. Zibulevsky, "Improved denoising of images using modeling of the redundant contourlet transform," in Proc. SPIE Conf. Wavelets, San Diego, CA, Jul. 2005, vol. 5914.