L0 norm based dictionary learning by proximal methods with global convergence

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn , Issue , 2014, Pages 3858-3865

  Bao, Chenglong ^a   Ji, Hui ^a   Quan, Yuhui ^a   Shen, Zuowei ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

dictionary learning; global convergence; proximal method

Indexed keywords

CONVEX OPTIMIZATION; FACE RECOGNITION; ITERATIVE METHODS;

DICTIONARY LEARNING; GLOBAL CONVER-GENCE; GLOBALLY CONVERGENT; LINEAR CONVERGENCE RATE; NONCONVEX OPTIMIZATION; OPTIMIZATION PROBLEMS; PROXIMAL METHODS; STATIONARY POINTS;

LEARNING SYSTEMS;

EID: 84911417441     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2014.493     Document Type: Conference Paper

References (28)

1. M. Aharon and M. E. Bruckstein. K-SVD: An algorithm for designing of overcomplete dictionaries for sparse representation. IEEE Trans. Signal Process., 2006.
2. A. Rakotomamonjy. Direct optimization of the dictionary learning. IEEE Trans. Signal Process., 2013.
3. H. Attouch and J. Bolte. On the convergence of the proximal algorithm for nonsmooth functions involving analytic features. Mathematical Programming, 2009.
4. A. Beck and M. Teboulle. A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM J Imaging Sci., 2009.
5. J. Bolte, A. Daniilidis, A. Lewis, and M. Shiota. Clarke subgradients of stratifiable functions. SIAM J Optimiz, 2007.
6. J. Cai, H. Ji, Z. Shen, and G. Ye. Data-driven tight frame construction and image denoising. Appl. Comp. Harm. Anal., In Press, 2014.
7. S. Chen, D. Donoho, and M. Saunders. Atomic decomposition by basis pursuit. SIAM J. Sci. Comput., 1999.
8. M. Elad and M. Aharon. Image denoising via sparse and redundant representations over learned dictionaries. IEEE Trans. Image Process, 2006.
9. J. Fan and R. Li. Variable selection via nonconcave penalized likelihood and its oracle properties. J. Am. Statist. Assoc., 2001.
10. J. H. Friedman. Fast sparse regression and classification. International Journal of Forecasting, 2012.
11. A. S. Georghiades, P. N. Belhumeur, and D. J. Kriegman. From few to many: Illumination cone models for face recognition under variable lighting and pose. IEEE PAMI, 2001.
12. E. T. Hale, W. Yin, and Y. Zhang. A fixed-point continuation method for i\-regularized minimization with applications to compressed sensing. CAAM Report, 2007.
13. R. Jenatton, J. Mairal, F. R. Bach, and G. R. Obozinski. Proximal methods for sparse hierarchical dictionary learning. In ICML, 2010.
14. B. Jerome, S. Shoham, and M. Teboulle. Proximal alternating linearized minimization for nonconvex and nonsmooth problems. Mathematical Programming, 2013.
15. Z. Jiang, Z. Lin, and L. Davis. Learning a dicscriminative dictionary for sparse coding via label consistent K-SVD. In CVPR, 2011.
16. J. Mairal, F Bach, J. Ponce, and G. Sapiro. Online learning for matrix factorization and sparse coding. JMLR, 2010.
17. J. Mairal, F Bach, J. Ponce, G. Sapiro, and A. Zisserman. Supervised dictionary learning. In NIPS, 2009.
18. A. Martínez and R. Benavente. The AR face database. Technical report, Computer Vision Center, 1998.
19. R. T. Rockafellar and R. J.-B. Wets. Variational analysis: grundlehren der mathematischen wissenschaften, volume 317. Springer, 1998.
20. R. Rubinstein, M. Zibulevsky, and M. Elad. Efficient implementation of the K-SVD algorithm using batch orthogonal matching pursuit. CS Technion, 2008.
21. J. Shi, X. Ren, G. Dai, J. Wang, and Z. Zhang. A non-convex relaxation approach to sparse dictionary learning. In CVPR, 2011.
22. S. Sra. Scalable nonconvex inexact proximal splitting. In NIPS, 2012.
23. I. Tosic and P. Frossard. Dictionary learning. IEEE Signal Process. Mag., 2011.
24. A. Tropp. Greed is good: algorithmic results for sparse approximation. IEEE Trans. Inf. Theory, 2004.
25. P. Tseng. On accelerated proximal gradient methods for convex-concave optimization. SIAM J. Optimiz., 2008.
26. Y Xu and W Yin. A fast patch-dictionary method for the whole image recovery. UCLA CAM report, 2013.
27. C.-H. Zhang. Nearly unbiased variable selection under min-imax concave penalty. The Annals of Statistics, 2010.
28. Q. Zhang and B. Li. Discriminative K-SVD for dictionary learning in face recognition. In CVPR, 2010.