Dictionary learning for analysis-synthesis thresholding

IEEE Transactions on Signal Processing

Volumn 62, Issue 22, 2014, Pages 5962-5972

  Rubinstein, Ron ^a   Elad, Michael ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Analysis dictionary learning; signal deblurring; sparse representation; thresholding

Indexed keywords

ANALYSIS-SYNTHESIS; DEBLURRING; DICTIONARY LEARNING; SPARSE REPRESENTATION; THRESHOLDING;

EID: 84908425479     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2014.2360157     Document Type: Article

References (38)

1. M. Elad, Sparse and Redundant Representations: From Theory to Applicationsin Signal and Image Processing. NewYork,NY,USA:Springer, 2010.
2. M. Elad, P. Milanfar, and R. Rubinstein, "Analysis versus synthesis insignal priors," Inverse Problems, vol. 23, no. 3, pp. 947-968, 2007.
3. S. Nam, M. E. Davies,M. Elad, and R. Gribonval, "The cosparse analysismodel and algorithms," Appl. Comput. Harmon. Anal., vol. 34, no.1, pp. 30-56, Jan. 2013.
4. E. J. Candes, Y. C. Eldar, D. Needell, and P. Randall, "Compressedsensing with coherent and redundant dictionaries," Appl. Comput.Harmon. Anal., vol. 31, no. 1, pp. 59-73, 2011.
5. D. L. Donoho and J. M. Johnstone, "Ideal spatial adaptation bywaveletshrinkage," Biometrika, vol. 81, no. 3, pp. 425-455, 1994.
6. R. Rubinstein, A. M. Bruckstein, and M. Elad, "Dictionaries for sparserepresentation modeling," Proc. IEEE, vol. 98, no. 6, pp. 1045-1057,2010.
7. M. Elad, "Why simple shrinkage is still relevant for redundant representations?,"IEEE Trans. Inf. Theory, vol. 52, no. 12, pp. 5559-5569,2006.
8. B. Ophir,M. Elad, N. Bertin, and M. D. Plumbley, "Sequential minimaleigenvalues-An approach to analysis dictionary learning," presentedat the Eur. Signal Process. Conf. (EUSIPCO), Barcelona, Spain, Aug.29, 2011.
9. M. Yaghoobi, S. Nam, R. Gribonval, and M. E. Davies, "Analysis operatorlearning for overcomplete cosparse representations," presentedat the Eur. Signal Process. Conf. (EUSIPCO), Barcelona, Spain, Aug.29, 2011.
10. M. Yaghoobi, S. Nam, R. Gribonval, and M. E. Davies, "Noise awareanalysis operator learning for approximately cosparse signals," presentedat the Int. Conf. Acoust., Speech, Signal Process. (ICASSP),Kyoto, Japan, Mar. 25-30, 2012.
11. R. Rubinstein, T. Peleg, andM. Elad, "Analysis K-SVD: A dictionarylearningalgorithm for the analysis sparse model," IEEE Trans. Signal Process., vol. 61, no. 3, pp. 661-677, 2013.
12. S. Hawe, M. Kleinsteuber, and K. Diepold, "Analysis operatorlearning and its application to image reconstruction," IEEE Trans.Image Process., vol. 22, no. 6, Jun. 2013.
13. G. Peyré and J. Fadili, "Learning analysis sparsity priors," presented atthe Sampl. Theory Appl. (SampTA), Singapore, May 2-6, 2011.
14. Y. Chen, T. Pock, and H. Bischof, "Learning-based analysis andsynthesis sparsity priors using bi-level optimization," presented at theWorkshop Anal. Operat. Learn. vs. Diction. Learn.: Fraternal Twins inSparse Model., South Lake Tahoe, CA, USA, Dec. 7, 2012.
15. D. L. Donoho and I.M. Johnstone, "Adapting to unknown smoothnessvia wavelet shrinkage," J. Amer. Statist. Assoc., vol. 90, no. 432, pp.1200-1224, 1995.
16. D. L. Donoho, I. M. Johnstone, G. Kerkyacharian, and D. Picard,"Wavelet shrinkage: Asymptopia?," J. Roy. Statist. Soc. Ser. B(Methodolog.), vol. 57, no. 2, pp. 301-369, 1995.
17. S. G. Chang, B. Yu, and M. Vetterli, "Adaptive wavelet thresholdingfor image denoising and compression," IEEE Trans. Image Process.,vol. 9, no. 9, pp. 1532-1546, 2000.
18. J. L. Starck, E. J. Candès, and D. L. Donoho, "The curvelet transformfor image denoising," IEEE Trans. Image Process., vol. 11, no. 6, pp.670-684, 2002.
19. F. Abramovich, Y. Benjamini, D. L. Donoho, and I. M. Johnstone,"Adapting to unknown sparsity by controlling the false discovery rate,"Ann. Statist., vol. 34, no. 2, pp. 584-653, 2006.
20. M. Aharon, M. Elad, and A. M. Bruckstein, "The K-SVD: An algorithmfor designing of overcomplete dictionaries for sparse representation,"IEEE Trans. Signal Process., vol. 54, no. 11, pp. 4311-4322,2006.
21. The CVG Granada Image Database [Online]. Available: http://decsai.ugr.es/cvg/dbimagenes/
22. H. Takeda, S. Farsiu, and P. Milanfar, "Deblurring using regularizedlocally-adaptive kernel regression," IEEE Trans. Image Process., vol.17, no. 4, pp. 550-563, 2008.
23. Regularized Kernel Regression-Based Deblurring [Online]. Available:http://users.soe.ucsc.edu/~htakeda/AKTV.htm
24. R. Neelamani, H. Choi, and R. Baraniuk, "ForWaRD: Fourier-waveletregularized deconvolution for ill-conditioned systems," IEEE Trans.Signal Process., vol. 52, no. 2, pp. 418-433, 2004.
25. V. Katkovnik, K. Egiazarian, and J. Astola, "A spatially adaptive nonparametricregression image deblurring," IEEE Trans. Image Process.,vol. 14, no. 10, pp. 1469-1478, 2005.
26. A. Danielyan, V. Katkovnik, and K. Egiazarian, "BM3D frames andvariational image deblurring," IEEE Trans. Image Process., vol. 21,no. 4, pp. 1715-1728, 2012.
27. Fourier-Wavelet Regularized Deconvolution (Matlab SoftwarePackage) [Online]. Available: http://dsp.rice.edu/software/forward
28. Y. Hel-Or and D. Shaked, "A discriminative approach for wavelet denoising,"IEEE Trans. Image Process., vol. 17, no. 4, pp. 443-457,2008.
29. Y. Bengio, "Learning deep architectures for AI," Found. Trends Mach.Learn., vol. 2, no. 1, pp. 1-127, 2009.
30. Y. Bengio, A. Courville, and P. Vincent, "Representation learning: Areview and new perspectives," IEEE Trans. Pattern Anal.Mach. Intell.,vol. 35, no. 8, pp. 1798-1828, 2013.
31. A. Adler, Y. Hel-Or, and M. Elad, "A shrinkage learning approachfor single image super-resolution with overcomplete representations,"presented at the Eur. Conf. Comput. Vis. (ECCV), Crete-Greece, Sep.5-11, 2010.
32. A. Adler, Y. Hel-Or, and M. Elad, "A weighted discriminative approachfor image denoising with overcomplete representations," presentedat the Int. Conf. Acoust., Speech, Signal Process. (ICASSP),Dallas, TX, USA, Mar. 14-19, 2010.
33. G. E. Hinton, S. Osindero, and Y.-W. Teh, "A fast learning algorithmfor deep belief nets," Neural Comput., vol. 18, no. 7, pp. 1527-1554,2006.
34. K. Kavukcuoglu, P. Sermanet, Y.-L. Boureau, K. Gregor, M. Mathieu,and Y. L. Cun, "Learning convolutional feature hierarchies for visualrecognition," presented at the Conf. Neural Inf. Process. Syst. (NIPS),Vancouver, BC, Canada, Dec. 6-8, 2010.
35. K. Jarrett, K. Kavukcuoglu, M. Ranzato, and Y. LeCun, "What isthe best multi-stage architecture for object recognition?," in Proc.Int. Conf. Comput. Vision (ICCV), Kyoto, Japan, Sep. 2009, pp.2146-2153.
36. P. Vincent, H. Larochelle, I. Lajoie, Y. Bengio, and P.-A. Manzagol,"Stacked denoising autoencoders: Learning useful representations in adeep network with a local denoising criterion," J. Mach. Learn. Res.,vol. 11, pp. 3371-3408, 2010.
37. K. Kavukcuoglu, M. Ranzato, and Y. LeCun, "Fast inferencein sparse coding algorithms with applications to object recognition,"2010, arXiv preprint arXiv:1010.3467 [Online]. Available:http://arxiv.org/abs/1010.3467
38. R. Rubinstein, M. Zibulevsky, and M. Elad, "Double sparsity:Learning sparse dictionaries for sparse signal approximation," IEEE Trans. Signal Process., vol. 58, no. 3, pp. 1553-1564, 2010.