An augmented Lagrangian approach to general dictionary learning for image denoising

Journal of Visual Communication and Image Representation

Volumn 23, Issue 5, 2012, Pages 753-766

  Liu, Qiegen ^a,c   Wang, Shanshan ^a   Luo, Jianhua ^a   Zhu, Yuemin ^b   Ye, Meng ^a  

^a SHANGHAI JIAO TONG UNIVERSITY   (China)

^b UNIVERSITÉ LYON 1   (France)

^c NANCHANG UNIVERSITY   (China)

Author keywords

Accelerated technique; Augmented Lagrangian; Bregman iterative method; Dictionary learning; Gaussian noise removal; Impulse noise removal; Iteratively Reweighted Norm; Sparse representation

Indexed keywords

ACCELERATED TECHNIQUE; AUGMENTED LAGRANGIANS; DICTIONARY LEARNING; ITERATIVELY REWEIGHTED NORM; SPARSE REPRESENTATION;

ALGORITHMS; GAUSSIAN NOISE (ELECTRONIC); IMAGE QUALITY; IMPULSE NOISE; ITERATIVE METHODS; LAGRANGE MULTIPLIERS;

IMAGE DENOISING;

EID: 84860866172     PISSN: 10473203     EISSN: 10959076     Source Type: Journal    
DOI: 10.1016/j.jvcir.2012.04.003     Document Type: Article

References (38)

1. M. Aharon, M. Elad, and A.M. Bruckstein The K-SVD: an algorithm for designing of overcomplete dictionaries for sparse representations IEEE Trans. Signal Process. 54 11 2006 4311 4322
2. M. Elad, and M. Aharon Image denoising via sparse and redundant representations over learned dictionaries IEEE Trans. Image Process. 15 12 2006 3736 3745
3. M. Aharon, and M. Elad Sparse and redundant modeling of image content using an image-signature-dictionary SIAM J. Imaging Sci. 1 2008 228 247
4. J.A. Tropp Greed is good: algorithmic results for sparse approximation IEEE Trans. Inf. Theor. 50 10 2004 2231 2242
5. R. Rubinstein, M. Zibulevsky, M. Elad, Efficient implementation of the K-SVD algorithm using batch orthogonal matching pursuit, Technical Report - CS Technion, 2008.
6. H. Lee, A. Battle, R. Rajat, A.Y. Ng, Efficient sparse coding algorithms, in: Proceedings of NIPS' 2006, (2006) 801-808.
7. S.S. Chen, D.L. Donoho, and M.A. Saunders Atomic decomposition by basis pursuit SIAM Rev. 43 1 2001 129 159
8. I. Gorodnitsky, and B. Rao Sparse signal reconstruction from limited data using FOCUSS: a re-weighted minimum norm algorithm IEEE Trans. Signal Process. 45 3 1997 600 616
9. B.D. Rao, and K.K-. Delgado An affine scaling methodology for best basis selection IEEE Trans. Signal Process. 47 1 1999 187 200
10. B. Efron, T. Hastie, I. Johnstone, and R. Tibshirani Least angle regression Ann. Stat. 32 2 2004 407 499
11. B. Olshausen, and D. Field Sparse coding with an overcomplete basis set: a strategy employed by V1? Vis. Res. 37 23 1997 3311 3325
12. B.A. Olshausen, and D.J. Field Emergence of simple-cell receptive field properties by learning a sparse code for natural images Nature 381 1996 607 609
13. K.K-. Delgado, J. Murray, B. Rao, K. Engan, T. Lee, and T. Sejnowski Dictionary learning algorithms for sparse representation Neural Comput. 15 2 2003 349 396
14. K. Engan, S.O. Aase, J.H. Husoy, Frame based signal compression using method of optimal directions (MOD), in: Proceedings of ISCS, 1999.
15. J. Mairal, F. Bach, J. Ponce, G. Sapiro, Online dictionary learning for sparse coding. ICML, 2009.
16. J. Mairal, F. Bach, J. Ponce, G. Sapiro, A. Zisserman, Non-local sparse models for image restoration, in: Proceedings of ICCV, 2009.
17. A. Buades, B. Coll, J.M. Morel, A non-local algorithm for image denoising, in: Proceedings of IEEE International Conference on Comput. Vis. Pattern Recognit. (CVPR), 2005, pp. 60-65.
18. J.A. Tropp Algorithms for simultaneous sparse approximation Signal Process. 86 2006 572 602
19. M. Zhou, H. Chen, J. Paisley, L. Ren, G. Sapiro, and L. Carin Non-parametric bayesian dictionary learning for sparse image representations Neural Inform. Process. Syst. (NIPS) 2009
20. N. Dobigeon, and J.Y. Tourneret Bayesian orthogonal component analysis for sparse representation IEEE Trans. Signal Process. 58 5 2010 2675 2685
21. Q. Liu, S. Wang, and J. Luo A novel predual dictionary learning algorithm J. Vis. Commun. Image Representation 23 2012 182 193
22. Q. Liu, J. Luo, S. Wang, M. Xiao, and M. Ye An augmented Lagrangian multi-scale dictionary learning algorithm EURASIP J. Adv. Signal Process. 2011 58 2011 10.1186/1687-6180-2011-58
23. F. Malgouyres, and T. Zeng A predual proximal point algorithm solving a non-negative basis pursuit denoising model Int. J. Comput. Vis. 83 3 2009 294 311
24. S. Osher, M. Burger, D. Goldfarb, J. Xu, and W. Yin An iterative regularization method for total variation-based image restoration SIAM J. Multiscale Model. Simul. 4 2005 460 489
25. W. Yin, S. Osher, D. Goldfarb, and J. Darbon Bregman iterative algorithms for l1-minimization with applications to compressed sensing SIAM J. Imaging Sci. 1 2008 142 168
26. P. Rodriguez, and B. Wohlberg Efficient minimization method for a generalized total variation functional IEEE Trans. Image Process. 18 2 2009 322 332
27. P. Rodriguez, B. Wohlberg, An efficient algorithm for sparse representations with lp data fidelity term, in: Proceedings of 4th IEEE Andean Technical Conference (ANDESCON), 2008.
28. I. Daubechies, M. Defrise, and C. De Mol An iterative thresholding algorithm for linear inverse problems with a sparsity constraint Commun. Pure Appl. Math. 57 2004 1413 1457
29. M. Afonso, J. B-Dias, and M. Figueiredo Fast image recovery using variable splitting and constrained optimization IEEE Trans. Image Process. 19 9 2010 2345 2356
30. J. Xu, and S. Osher Iterative regularization and nonlinear inverse scale space applied to wavelet-based denoising IEEE Trans. Image Process. 16 2 2007 534 544
31. M. Burger, S. Osher, J. Xu, and G. Gilboa Nonlinear inverse scale space methods for image restoration Lect. Notes Comput. Sci. 3752 2005 25 36
32. D. Bertsekas Constrained Optimization and Lagrange Multiplier Method 1982 Academic Press
33. J. Yang, Y. Zhang, Alternating direction algorithms for l1 problems in compressive sensing, Technical Report, Rice University, 2009.
34. A. Beck, and M. Teboulle A fast iterative shrinkage-thresholding algorithm for linear inverse problems SIAM J. Imaging Sci. 2 1 2009 183 202
35. K. Skretting, and K. Engan Recursive least squares dictionary learning algorithm IEEE Trans. Signal Process. 58 4 2010 2121 2130
36. L. Granai, P. Vandergheynst, Sparse Approximation by Linear Programming using an L1 Data-Fidelity Term, in: Proceedings of Workshop on Signal Processing with Adaptative Sparse Structured Representations, Parallel Computing in Electrical Engineering, 2005.
37. H. Takeda, S. Farsiu, and P. Milanfar Robust kernel regression for restoration and reconstruction of images from sparse noisy data In ICIP. 2006 1257 1260
38. Z. Wang, A.C. Bovik, H.R. Sheikh, and E.P. Simoncelli Image quality assessment: from error visibility to structural similarity IEEE Trans. Image Process. 13 4 2004 600 612