Improving dictionary learning: Multiple dictionary updates and coefficient reuse

IEEE Signal Processing Letters

Volumn 20, Issue 1, 2013, Pages 79-82

  Smith, Leslie N ^a   Elad, Michael ^b  

^a NAVAL RESEARCH LABORATORY   (United States)

^b TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Dictionary learning; K SVD; MOD; sparse and redundant representations

Indexed keywords

DICTIONARY-LEARNING; K-SVD; MOD; MULTIPLE DICTIONARIES; REDUNDANT REPRESENTATION; SPARSE CODING;

ELECTRICAL ENGINEERING; SIGNAL PROCESSING;

LEARNING ALGORITHMS;

EID: 84870874964     PISSN: 10709908     EISSN: None     Source Type: Journal    
DOI: 10.1109/LSP.2012.2229976     Document Type: Article

References (15)

1. M. Elad, Sparse and Redundant Representations: From Theory to Applications in Signal and Image Processing. Berlin, Germany: Springer, 2010.
2. B. A. Olshausen and D. J. Field, "Sparse coding with an overcomplete basis: A strategy employed by V1?," Vis. Res., vol. 37, no. 23, pp. 3311-3325, 1997.
3. M. S. Lewicki and T. J. Sejnowski, "Learning overcomplete representations," Neural Comput., vol. 12, no. 2, pp. 337-365, 2000.
4. S. Lesage, R. Gribonval, F. Bimbot, and L. Benaroya, "Learning unions of orthonormal bases with thresholded singular value decomposition," ICASSP, vol. 5, pp. 293-296, 2005.
5. M. Yaghoobi, T. Blumensath, and M. E. Davies, "Dictionary learning for sparse approximations with the majorization method," IEEE Trans. Signal Process., vol. 57, no. 6, pp. 2178-2191, 2009.
6. J. Mairal, F. Bach, J. Ponce, and G. Sapiro, "Online learning for matrix factorization and sparse coding," JMLR, vol. 11, pp. 19-60, 2010.
7. K. Skretting and K. Engan, "Recursive least squares dictionary learning algorithm," IEEE Trans. Signal Process., vol. 58, no. 4, pp. 2121-2130, 2010.
8. I. Tosic and P. Frossard, "Dictionary learning: What is the right representation for my signal?," IEEE Signal Process. Mag., vol. 28, no. 2, pp. 27-38, 2011.
9. K. Engan, S. O. Aase, and J. H. Hakon-Husoy, "Method of optimal directions for frame design," ICASSP, vol. 5, pp. 2443-2446, 1999.
10. K. Engan, K. Skretting, and J. Hakon-Husoy, "Family of iterative LS-based dictionary learning algorithms, ILS-DLA, for sparse signal representation," Digital Signal Process., vol. 17, no. 1, pp. 32-49, 2007.
11. M. Aharon, M. Elad, and A. Bruckstein, "K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation," IEEE Trans. Signal Process., vol. 54, no. 11, pp. 4311-4322, 2006.
12. M. Elad and M. Aharon, "Image denoising via sparse and redundant representations over learned dictionaries," IEEE Trans. Image Process., vol. 15, no. 12, pp. 3736-3745, 2006.
13. D. Needell and J. A. Tropp, "CoSAMP: Iterative signal recovery from incomplete and inaccurate samples," ACHA, vol. 26, 2008.
14. W. Dai and O. Milenkovic, "Subspace pursuit for compressive sensing," IEEE Trans. Inf. Theory, vol. 55, no. 5, pp. 2230-2249, 2009.
15. R. Rubinstein, M. Zibulevsky, and M. Elad, Efficient Implementation of the K-SVD Algorithm Using Batch Orthogonal Matching Pursuit, CS Tech. Rep., Technion-Israel Inst. Technol., Haifa, 2009.