Analysis K-SVD: A dictionary-learning algorithm for the analysis sparse model

IEEE Transactions on Signal Processing

Volumn 61, Issue 3, 2013, Pages 661-677

  Rubinstein, Ron ^a   Peleg, Tomer ^a   Elad, Michael ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Analysis Model; Backward Greedy (BG) Pursuit; Dictionary learning; Image denosing; K SVD; Optimized backward greedy pursuit (OBG); Sparse representations; Synthesis model

Indexed keywords

ANALYSIS MODELS; BACKWARD GREEDY PURSUITS; DICTIONARY LEARNING; GREEDY PURSUITS; IMAGE DE-NOSING; K-SVD; SPARSE REPRESENTATION; SYNTHESIS MODELS;

OPTIMIZATION;

ALGORITHMS;

EID: 84897584301     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2012.2226445     Document Type: Article

References (31)

1. A. M. Bruckstein, D. L. Donoho, and M. Elad, "From sparse solutions of systems of equations to sparse modeling of signals and images," SIAM Rev., vol. 51, no. 1, pp. 34-81, Feb. 2009.
2. M. Elad, Sparse and Redundant Representations: From Theory to Applications in Signal and Image Processing. NewYork:Springer, 2010.
3. K. Engan, S.Aase, and J.Hakon-Husoy, "Method of optimal directions for frame design," in Proc. Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 1999, pp. 2443-2446.
4. M. Aharon, M. Elad, and A. M. Bruckstein, "K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation," IEEE Trans. Signal Process., vol. 54, no. 11, pp. 4311-4322, Nov. 2006. (Pubitemid 44637761)
5. R. Rubinstein, A. Bruckstein, and M. Elad, "Dictionaries for sparse representation modeling," IEEE Proc., vol. 98, no. 6, pp. 1045-1057, Apr. 2010.
6. M. Elad, P. Milanfar, and R. Rubinstein, "Analysis versus synthesis in signal priors," Inverse Problems, vol. 23, no. 3, pp. 947-968, Jun. 2007. (Pubitemid 46838835)
7. E. J. Candes, Y. C. Eldar, D. Needell, and P. Randall, "Compressed sensing with coherent and redundant dictionaries," Appl. Comput. Harmon. Anal., vol. 31, no. 1, pp. 59-73, Jul. 2011.
8. S. Nam, M. Davies, M. Elad, and R. Gribonval, "Cosparse analysis modeling -Uniqueness and algorithms," in Proc. Int. Conf. Acoust., Speech, Signal Process. (ICASSP), May 2010, pp. 5804-5807.
9. S. Nam, M. Davies,M. Elad, andR.Gribonval, "The cosparse analysis model and algorithms," Appl. Comput. Harmon. Anal., vol. 34, no. 1, pp. 30-56, Jan. 2013.
10. S. Nam, M. E. Davies, M. Elad, and R. Gribonval, "Cosparse analysis modeling," in Proc. SampTA, Singapore, May 2011.
11. R. Giryes, S. Nam, R. Gribonval, andM. E. Davies, "Iterative cosparse projection algorithms for the recovery of cosparse vectors," in Proc. EUSIPCO, Barcelona, Spain, Sep. 2011.
12. S. Vaiter, G. Peyré, C. Dossal, and J. Fadili, "Robust sparse analysis regularization," arXiv:1109.6222 [cs.IT] [Online]. Available: http://arxiv.org/abs/1109.6222
13. B. Ophir, M. Elad, N. Bertin, and M. D. Plumbley, "Sequential minimal eigenvalues -An approach to analysis dictionary learning," in Proc. EUSIPCO, Barcelona, Spain, Sep. 2011.
14. M. Yaghoobi, S. Nam, R. Gribonval, andM. E. Davies, "Analysis operator learning for overcomplete cosparse representations," in Proc. EUSIPCO, Barcelona, Spain, Sep. 2011.
15. M. Yaghoobi, S. Nam, R. Gribonval, and M. E. Davies, "Noise aware analysis operator learning for approximately cosparse signals," Proc. Int. Conf. Acoust., Speech, Signal Process. (ICASSP), pp. 5409-5412, Mar. 2012.
16. G. Peyré and J. Fadili, "Learning analysis sparsity priors," in Proc. SampTA, Singapore, May 2011.
17. S. Roth and M. J. Black, "Fields of experts: A framework for learning image priors," Proc. CVPR, vol. 2, pp. 860-867, Jun. 2005.
18. S. Roth andM. J. Black, "Fields of experts," Int. J. Comput. Vis. (IJCV), vol. 82, no. 2, pp. 205-229, Apr. 2009.
19. G. E. Hinton and Y.W. Teh, "Discovering multiple constraints that are frequently approximately satisfied," in Proc. Int. Conf. Uncertainty in Artif. Intell. (UAI), Aug. 2001, vol. 17, pp. 227-234.
20. M.Welling, G. Hinton, and S. Osindero, "Learning sparse topographic representations with products of student-t distributions," Adv. Neural Inf. Process. Syst., vol. 15, pp. 1359-1366, 2002.
21. M. Elad and M. Aharon, "Image denoising via sparse and redundant representations over learned dictionaries," IEEE Trans. Image Process., vol. 15, no. 12, pp. 3736-3745, 2006. (Pubitemid 44811686)
22. S. Hawe, M. Kleinsteuber, and K. Diepold, "Analysis operator learning and its application to image reconstruction," IEEE Trans. Image Process., submitted for publication.
23. Y. M. Lu and M. N. Do, "A theory for sampling signals from a union of subspaces," IEEE Trans. Signal Process., vol. 56, no. 6, pp. 2334-2345, Jun. 2008. (Pubitemid 351795887)
24. S. S. Chen,D. L.Donoho, andM.A. Saunders, "Atomic decomposition by basis pursuit," SIAM J. Sci. Comput., vol. 20, pp. 33-61, 1998. (Pubitemid 128689501)
25. I. F. Gorodnitsky and B. D. Rao, "Sparse signal reconstruction from limited data using FOCUSS: A re-weighted norm minimization algorithm," IEEE Trans. Signal Process., vol. 45, pp. 600-616, 1997. (Pubitemid 127765947)
26. S. Mallat and Z. Zhang, "Matching pursuits with time-frequency dictionaries," IEEE Trans. Signal Process., vol. 41, pp. 3397-3415, 1999.
27. Y. C. Pati, R. Rezaiifar, and P. S.Krishnaprasad, "Orthogonal matching pursuit: Recursive function approximation with applications to wavelet decomposition," in Proc. 27th Asilomar Conf. Signals, Syst., Comput., 1993, vol. 1, pp. 40-44.
28. L. Rebollo-Neira and D. Lowe, "Optimized orthogonal matching pursuit approach," IEEE Signal Process. Lett., vol. 9, no. 4, pp. 137-140, Apr. 2002. (Pubitemid 34711502)
29. J. Dahl, P. C. Hansen, S. H. Jensen, and T. L. Jensen, "Algorithms and software for total-variation image reconstruction via first-order methods," Numer. Algorithms, vol. 53, no. 1, pp. 67-92, 2010.
30. K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian, "Image denoising by sparse 3-d transform-domain collaborative filtering," IEEE Trans. Image Process., vol. 16, no. 8, pp. 2080-2095, Aug. 2007. (Pubitemid 47225460)
31. T. Peleg and M. Elad, "Performance guarantees of the thresholding algorithm for the co-sparse analysis model," IEEE Trans. Inf. Theory., DOI: 10.1109/TIT.2012.2226924, preprint.