Closed-Form MMSE estimation for signal denoising under sparse representation modeling over a unitary dictionary

IEEE Transactions on Signal Processing

Volumn 58, Issue 7, 2010, Pages 3471-3484

  Protter, Matan ^a   Yavneh, Irad ^a   Elad, Michael ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Maximum a posteriori probability (MAP); Minimum mean squared error (MMSE); Sparse representations; Unitary dictionary

Indexed keywords

BAYESIAN; CARDINALITIES; CLOSED FORM; CLOSED FORM SOLUTIONS; EXTENDED MODEL; HETEROSCEDASTIC; IMAGE PATCHES; MAXIMUM A POSTERIORI PROBABILITIES; MEAN-SQUARED ERRORS; MINIMUM MEAN SQUARED ERROR; MMSE ESTIMATION; NONZERO ENTRIES; REAL-WORLD; RECURSIVE EXPRESSIONS; SIGNAL DENOISING; SIMPLE ALGORITHM; SPARSE REPRESENTATION;

ESTIMATION; MEAN SQUARE ERROR; SIGNAL PROCESSING; THREE TERM CONTROL SYSTEMS;

PROBABILITY;

EID: 77953788394     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2010.2046596     Document Type: Article

References (30)

1. A. M. Bruckstein, D. L. Donoho, and M. Elad, "From sparse solutions of systems of equations to sparse modeling of signals and images," SIAM Rev., vol.51, no.1, pp. 34-81, Feb. 2009.
2. B. K. Natarajan, "Sparse approximate solutions to linear systems," SIAM J. Comput., vol.24, pp. 227-234, 1995.
3. S. S. Chen, D. L. Donoho, and M. A. Saunders, "Atomic decomposition by basis pursuit," SIAM Rev., vol.43, no.1, pp. 129-159, 2001.
4. S. Mallat and Z. Zhang, "Matching pursuits with time-frequency dictionaries," IEEE Trans. Signal Process., vol.41, no.12, pp. 3397-3415, Dec. 1993.
5. S. Chen, S. A. Billings, and W. Luo, "Orthogonal least squares methods and their application to non-linear system identification," Int. J. Control, vol.50, no.5, pp. 1873-1896, 1989.
6. Y. C. Pati, R. Rezaifar, and P. S. Krishnaprasad, "Orthogonal matching pursuit: Recursive function approximation with applications to wavelet decomposition," in 27th Asilomar Conf. Signals, Systems and Computers, Nov. 1993.
7. E. G. Larsson and Y. Selen, "Linear regression with a sparse parameter vector," IEEE Trans. Signal Process., vol.55, no.2, pp. 451-460, Feb. 2007.
8. P. Schnitter, L. C. Potter, and J. Ziniel, "Fast Bayesian matching pursuit," presented at the Workshop on Information Theory and Applications (ITA), La Jolla, CA, Jan. 2008.
9. M. Elad and I. Yavneh, "A plurality of sparse representations is better than the sparsest one alone," IEEE Trans. Inf. Theory, vol.55, no.10, pp. 4701-4714, Oct. 2009.
10. M. Protter, I. Yavneh, and M. Elad, "Closed-form MMSE estimator for denoising signals under sparse reconstruction modelling," in Proc. IEEE 25th Convention of Electrical Eng. in Israel, Eilat, Israel, Dec. 2008, pp. 580-584.
11. M. J. Fadili, J.-L. Starck, and L. Boubchir, "Morphological diversity and sparse image denoising," in Proc. IEEE ICASSP, Honolulu, HI, Apr. 2007, vol.I, pp. 589-592.
12. J. L. Starck, D. L. Donoho, and E. Candes, "Very high quality image restoration by combining wavelets and curvelets," in Proc.Wavelet Applications in Signal and Image Processing IX, A. Aldroubi, A. F. Laine, and M. A. Unser, Eds., 2001, vol.4478, Proc. SPIE.
13. A. Dalalyan and A. B. Tsybakov, "Aggregation by exponential weighting, sharp PAC-Bayesian bounds and sparsity," Mach. Learning, vol.72, no.1-2, pp. 39-61, 2008.
14. A. Dalalyan and A. B. Tsybakov, "Sparse regression learning by aggregation and Langevin Monte-Carlo," presented at the 22nd Annu. Conf. Learning Theory (COLT 2009), Quebec, ON, Canada, Jun. 18-21, 2009 [Online]. Available: http://www.cs.mcgill.ca/∼colt2009/papers/ 009.pdf
15. A. Juditsky, P. Rigollet, and A. B. Tsybakov, "Learning by mirror averaging," Ann. Stat., vol.36, no.5, pp. 2183-2206, 2008.
16. D. L. Donoho and I. M. Johnstone, "Ideal spatial adaptation by wavelet shrinkage," Biometrica, vol.81, no.3, pp. 425-455, Sep. 1994.
17. D. L. Donoho and I. M. Johnstone, "Adapting to unknown smoothness via wavelet shrinkage," J. Amer. Stat. Assoc., vol.90, no.432, pp. 1200-1224, Dec. 1995.
18. A. Antoniadis and J. Q. Fan, "Regularization of wavelet approximations," J. Amer. Stat. Assoc., vol.96, no.455, pp. 939-955, Sep. 2001.
19. M. Elad, "Why simple shrinkage is still relevant for redundant representations?," IEEE Trans. Inf. Theory, vol.52, no.12, pp. 5559-5569, Dec. 2006.
20. M. Clyde and E. I. George, "Empirical Bayes estimation in wavelet nonparametric regression," in Bayesian Inference in Wavelet Based Models, P. Muller and B. Vidakovic, Eds. New York: Springer-Verlag, 1998, vol.141, Lecture Notes in Statistics, pp. 309-322.
21. M. Clyde and E. I. George, "Flexible empirical Bayes estimation for wavelets," J. R. Stat. Soc. B, vol.62, pp. 681-698, 2000.
22. M. Clyde, G. Parmigiani, and B. Vidakovic, "Multiple shrinkage and subset selection in wavelets," Biometrika, vol.85, pp. 391-401, 1998.
23. F. Abramovich, T. Sapatinas, and B. W. Silverman, "Wavelet thresholding via a Bayesian approach," J. R. Stat. Soc. B, vol.60, pp. 725-749, 1998.
24. A. Antoniadis, J. Bigot, and T. Sapatinas, "Wavelet estimators in nonparametric regression: A comparative simulation study," J. Stat. Softw., vol.6, no.6, 2001.
25. P. Moulin and J. Liu, "Analysis of multiresolution image denoising schemes using generalized-Gaussian priors," IEEE Trans. Inf. Theory, vol.45, no.3, pp. 909-919, Apr. 1999.
26. M. N. Do and M. Vetterli, "Wavelet-based texture retreival using generalized Gaussian density and Kullback-Leibler distance," IEEE Trans. Image Process., vol.11, no.2, pp. 146-158, Feb. 2002.
27. K. Dabov, A. Foi, and K. Egiazarian, "Video denoising by sparse 3-D transform-domain collaborative filtering," presented at the Eur. Signal Process. Conf. (EUSIPCO-2007), Poznan, Poland, Sep. 2007.
28. M. Aharon, M. Elad, and A. M. Bruckstein, "On the uniqueness of overcomplete dictionaries, and a practical way to retrieve them," J. Linear Alg. Appl., vol.416, pp. 48-67, Jul. 2006.
29. M. Aharon, M. Elad, and A. M. Bruckstein, "The K-SVD: An algorithm for designing of overcomplete dictionaries for sparse representation," IEEE Trans. Signal Process., vol.54, no.11, pp. 4311-4322, Nov. 2006.
30. Z. Wang, A. C. Bovik, H. R. Sheikk, and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Process., vol.13, no.4, pp. 600-612, Apr. 2004.