On the role of sparse and redundant representations in image processing

Proceedings of the IEEE

Volumn 98, Issue 6, 2010, Pages 972-982

  Elad, Michael ^a   Figueiredo, Mário A T ^b   Ma, Yi ^c  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

^b INSTITUTO SUPERIOR TÉCNICO   (Portugal)

^c University of Illinois at Urbana Champaign   (United States)

Author keywords

Deconvolution; Denoising; Dictionary learning; Frames; Inpainting; Redundant dictionaries; Sparse representations; Superresolution; Wavelets

Indexed keywords

DECONVOLUTION; ELECTRICAL ENGINEERING;

DE-NOISING; DICTIONARY LEARNING; FRAMES; INPAINTING; REDUNDANT DICTIONARIES; SPARSE REPRESENTATION; SUPER RESOLUTION; WAVELETS;

IMAGE PROCESSING;

EID: 77952740831     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2009.2037655     Document Type: Article

References (59)

1. M. Aharon, M. Elad, and A. M. Bruckstein, "The K-SVD: An algorithm for designing of overcomplete dictionaries for sparse representation," IEEE Trans. Signal Process., vol.54, pp. 4311-4322, Nov. 2006. (Pubitemid 44637761)
2. H. Andrews and B. Hunt, Digital Image Restoration. Englewood Cliffs, NJ: Prentice-Hall, 1977.
3. A. Beck and M. Teboulle, "A fast iterative shrinkage-thresholding algorithm for linear inverse problems," SIAM J. Imag. Sci., vol.2, no.1, pp. 183-202, 2009.
4. 1-unified variational framework for image restoration," in Proc. Eur. Conf. Comput. Vision (ECCV'2004), 2004, pp. 1-13. (Pubitemid 38717169)
5. J. Bioucas-Dias and M. Figueiredo, "A new TwIST: Two-step iterative shrinkage/thresholding algorithms for image restoration," IEEE Trans. Image Process., vol.16, pp. 2992-3004, 2007. (Pubitemid 350201232)
6. A. Blake and A. Zisserman, Visual Reconstruction. Cambridge, MA: MIT Press, 1987.
7. A. Bruckstein, D. Donoho, and M. Elad, "From sparse solutions of systems of equations to sparse modelling of signals and images," SIAM Rev., vol.51, pp. 34-81, 2009.
8. A. Buades, B. Coll, and J.-M. Morel, "A non-local algorithm for image denoising," in Proc. IEEE Conf. Comput. Vision Pattern Recognit. (CVPR'05), San Diego, CA, 2005, pp. 60-65. (Pubitemid 43897338)
9. 2 singularities," Commun. Pure Appl. Math., vol.57, pp. 219-266, 2004. (Pubitemid 38651818)
10. E. J. Candès and T. Tao, "The Dantzig selector: Statistical estimation when p is much larger than n," Ann. Statistics., vol.35, pp. 2313-2351, 2005.
11. E. J. Candès and M. B. Wakin, "An introduction to compressive sampling," IEEE Signal Process. Mag., vol.24, pp. 21-30, Mar. 2008.
12. T. Chan, S. Esedoglu, F. Park, and A. Yip, "Recent developments in total variation image restoration," in Handbook of Mathematical Models in Computer Vision, N. Paragios, Y. Chen, and O. Faugeras, Eds. Berlin, Germany: Springer-Verlag, 2005. (Pubitemid 41364769)
13. S. Chen, D. Donoho, and M. Saunders, "Atomic decompositions by basis pursuit," SIAM Rev., vol.43, pp. 129-159, 2001.
14. R. Coifman and D. L. Donoho, "Translation invariant de-noising," in Wavelets and Statistics, vol.103, A. Antoniadis and G. Oppenheim, Eds. New York: Springer-Verlag, 1995, pp. 125-150.
15. P. Combettes and V. Wajs, "Signal recovery by proximal forward-backward splitting," SIAM J. Multiscale Model. Simul., vol.4, pp. 1168-1200, 2005. (Pubitemid 44932287)
16. S. Dai, M. Han, W. Xu, Y. Wu, and Y. Gong, "Soft edge smoothness prior for alpha channel super resolution," in Proc. Int. Conf. Comput. Vision, 2007. (Pubitemid 47529922)
17. I. Daubechies, M. Defriese, and C. De Mol, "An iterative thresholding algorithm for linear inverse problems with a sparsity constraint," Commun. Pure Appl. Math., vol.LVII, pp. 1413-1457, 2004. (Pubitemid 39427442)
18. D. L. Donoho, "De-noising by soft-thresholding," IEEE Trans. Inf. Theory, vol.41, pp. 613-627, 1995.
19. D. L. Donoho and I. Johnstone, "Ideal adaptation via wavelet shrinkage," Biometrika, vol.81, pp. 425-455, 1994.
20. D. L. Donoho and J. Tanner, "Neighborliness of randomly-projected simplices in high dimensions," Proc. Nat. Acad. Sci., vol.102, pp. 9452-9457, 2005. (Pubitemid 40981702)
21. A. Efros and T. Leung, "Texture synthesis by non-parametric sampling," in Proc. Int. Conf. Computer Vision (ICCV'99), Corfu, Greece, 1999, pp. 1033-1038. (Pubitemid 32079980)
22. M. Elad, B. Matalon, and M. Zibulevsky, "Coordinate and subspace optimization methods for linear least squares with non-quadratic regularization," Appl. Comput. Harmon. Anal., vol. 23, pp. 346-367, 2007. (Pubitemid 47552874)
23. M. Elad, "Why simple shrinkage is still relevant for redundant representations?" IEEE Trans. Inf. Theory, vol. 52, pp. 5559-5569, 2006. (Pubitemid 46445399)
24. M. Elad and M. Aharon, "Image denoising via sparse and redundant representations over learned dictionaries," IEEE Trans. Image Process., vol.15, pp. 3736-3745, Dec. 2006. (Pubitemid 44811686)
25. M. Elad, B. Matalon, and M. Zibulevsky, "Image denoising with shrinkage and redundant representations," in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognit. (CVPR'2006), New York, 2006.
26. M. Elad, P. Milanfar, and R. Rubinstein, "Analysis versus synthesis in signal priors," Inverse Prob., vol.23, pp. 947-968, 2007. (Pubitemid 46838835)
27. M. Elad, J.-L. Starck, P. Querre, and D. L. Donoho, "Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA)," J. Appl. Comput. Harmon. Anal., vol.19, pp. 340-358, Nov. 2005. (Pubitemid 41660098)
28. M. Figueiredo and R. Nowak, "Wavelet-based image estimation: An empirical Bayes approach using Jeffreys' noninformative prior," IEEE Trans. Image Process., vol.10, pp. 1322-1331, 2001. (Pubitemid 32949956)
29. M. Figueiredo and R. Nowak, "An EM algorithm for wavelet-based image restoration," IEEE Trans. Image Process., vol.12, no.8, pp. 906-916, 2003.
30. M. Figueiredo and R. Nowak, "A bound optimization approach to wavelet-based image deconvolution," in Proc. IEEE Int. Conf. Image Process. (ICIP'05), Genoa, Italy, 2005. (Pubitemid 44539056)
31. W. T. Freeman, T. R. Jones, and E. C. Pasztor, "Example-based super-resolution," IEEE Comput. Graph. Applicat., vol.22, no.2, 2002.
32. S. Geman and D. Geman, "Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images," IEEE Trans. Pattern Anal. Machine Intell., vol.PAMI-6, pp. 721-741, 1984. (Pubitemid 15453722)
33. O. G. Guleryuz, "Nonlinear approximation based image recovery using adaptive sparse reconstructions and iterated denoisingVPart I: Theory," IEEE Trans. Image Process., vol.15, pp. 539-554, Mar. 2006. (Pubitemid 43257554)
34. O. G. Guleryuz, "Nonlinear approximation based image recovery using adaptive sparse reconstructions and iterated denoisingVPart II: Adaptive algorithms," IEEE Trans. Image Process., vol.15, pp. 555-571, Mar. 2006. (Pubitemid 43257555)
35. W. Hong, J. Wright, K. Huang, and Y. Ma, "Multi-scale hybrid linear models for lossy image representation," IEEE Trans. Image Process., vol.15, no.12, pp. 3655-3671, Dec. 2006. (Pubitemid 44811680)
36. A. Hyv̈arinen, "Sparse code shrinkage: Denoising of non-Gaussian data by maximum likelihood estimation," Neural Comput., vol.11, pp. 1739-1768, 1999.
37. M. Lang, H. Guo, J. E. Odegard, C. S. Burrus, and R. O. Wells, "Noise reduction using an undecimated discrete wavelet transform," IEEE Signal Process. Lett., vol.3, pp. 10-12, 1996. (Pubitemid 126551079)
38. Y. Ma, A. Yang, H. Derksen, and R. Fossum, "Estimation of subspace arrangements with applications in modeling and segmenting mixed data," SIAM Rev., vol.50, no.3, Aug. 2008.
39. Y. Ma, H. Derksen, W. Hong, and J. Wright, "Segmentation of multivariate mixed data via lossy coding and compression," IEEE Trans. Pattern Anal. Machine Intell., vol.29, pp. 1546-1562, Sep. 2007. (Pubitemid 47299910)
40. J. Mairal, M. Elad, and G. Sapiro, "Sparse representation for color image restoration," IEEE Trans. Image Process., vol.17, pp. 53-69, Jan. 2008.
41. S. Mallat, "A theory of multiresolution signal decomposition: The wavelet representation," IEEE Trans. Pattern Anal. Machine Intell., vol.11, pp. 674-693, 1989.
42. S. Mallat, A Wavelet Tour of Signal Processing. San Diego, CA: Academic, 1998.
43. M. Miḩcak, I. Kozintsev, K. Ramchandran, and P. Moulin, "Low-complexity image denoising based on statistical modeling of wavelet coefficients," IEEE Signal Process. Lett., vol.6, pp. 300-303, 1999. (Pubitemid 30519149)
44. P. Moulin and J. Liu, "Analysis of multiresolution image denoising schemes using generalized-Gaussian and complexity priors," IEEE Trans. Inf. Theory, vol.45, pp. 909-919, 1999.
45. D. Mumford, "Empirical statistics and stochastic models for visual signals," in New Directions in Statistical Signal Processing: From Systems to Brain, S. Haykin, J. Principe, T. Sejnowski, and J. McWhirter, Eds. Cambridge, MA: MIT Press, 2005.
46. R. Nowak and M. Figueiredo, "Fast wavelet-based image deconvolution using the EM algorithm," in Proc. 35th Asilomar Conf. Signals, Syst., Comput., 2001, vol.1, pp. 371-375. (Pubitemid 34244663)
47. B. Olshausen and D. Field, "Emergence of simple-cell receptive field properties by learning a sparse code for natural images," Nature, vol.381, pp. 607-609, 1996. (Pubitemid 26177476)
48. G. Peyŕe, "Manifold models for signals and images," Comput. Vision Image Understand., vol.113, pp. 249-260, 2009.
49. L. Rudin, S. Osher, and E. Fatemi, "Nonlinear total variation based noise removal algorithms," Phys. D, vol.60, pp. 259-268, 1992.
50. E. P. Simoncelli, W. T. Freeman, E. H. Adelson, and D. J. Heeger, "Shiftable multiscale transforms," IEEE Trans. Inf. Theory, vol.38, pp. 587-607, Mar. 1992.
51. E. Simoncelli and E. H. Adelson, "Noise removal via Bayesian wavelet coring," in Proc. IEEE Int. Conf. Image Process., Lausanne, Switzerland, 1996, pp. 379-382.
52. J.-L. Starck, E. Candès, and D. Donoho, "Astronomical image representation by the curvelet transform," Astron. Astrophys., vol.398, pp. 785-800, 2003.
53. J.-L. Starck, M. Nguyen, and F. Murtagh, "Wavelets and curvelets for image deconvolution: A combined approach," Signal Process., vol.83, pp. 2279-2283, 2003.
54. M. Vetterli, "A theory of multirate filter banks," IEEE Trans. Acoust., Speech, Signal Process., vol.ASSP-35, pp. 356-372, 1987.
55. B. Vidakovic, "Nonlinear wavelet shrinkage with Bayes rules and Bayes factors," J. Amer. Statist. Assoc., vol.93, pp. 173-179, 1998. (Pubitemid 128040491)
56. R. Vidal, Y. Ma, and S. Sasry, "Generalized principal component analysis," IEEE Trans. Pattern Anal. Machine Intell., vol.27, pp. 1945-1959, Dec. 2005.
57. S. Wright, R. Nowak, and M. Figueiredo, "Sparse reconstruction by separable approximation," IEEE Trans. Signal Process., vol.57, no.7, pp. 2479-2493, 2009.
58. J. Yang, H. Tang, Y. Ma, and T. Huang, "Face hallucination via sparse coding," in Proc. Int. Conf. Image Process., 2008.
59. J. Yang, J. Wright, T. Huang, and Y. Ma, "Image super-resolution as sparse representation of raw image patches," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2008.