Accelerating gradient projection methods for ℓ1-constrained signal recovery by steplength selection rules

Applied and Computational Harmonic Analysis

Volumn 27, Issue 2, 2009, Pages 247-254

  Loris, I ^a   Bertero, M ^b   De Mol, C ^c   Zanella, R ^d   Zanni, L ^d  

^a VRIJE UNIVERSITEIT BRUSSEL   (Belgium)

^b UNIVERSITY OF GENOA   (Italy)

^c UNIVERSITÉ LIBRE DE BRUXELLES   (Belgium)

^d UNIVERSITY OF MODENA AND REGGIO EMILIA   (Italy)

Author keywords

1 penalty; Gradient projection method; Sparsity

Indexed keywords

EID: 67650436159     PISSN: 10635203     EISSN: 1096603X     Source Type: Journal    
DOI: 10.1016/j.acha.2009.02.003     Document Type: Letter

References (32)

1. Barzilai J., and Borwein J.M. Two point step size gradient methods. IMA J. Numer. Anal. 8 (1988) 141-148
2. Beck A., and Teboulle M. A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM J. Imaging Sci. 2 (2009) 183-202
3. Bertsekas D.P. Nonlinear Programming. second ed. (1999), Athena Scientific
4. Birgin E.G., Martínez J.M., and Raydan M. Inexact spectral projected gradient methods on convex sets. IMA J. Numer. Anal. 23 (2003) 539-559
5. Bonettini S., Zanella R., and Zanni L. A scaled gradient projection method for constrained image deblurring. Inverse Problems 25 (2009) 015002
6. Candès E., Romberg J., and Tao T. Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information. IEEE Trans. Inform. Theory 52 (2006) 489-509
7. Candès E., and Tao T. Near optimal signal recovery from random projections: Universal encoding strategies?. IEEE Trans. Inform. Theory 52 (2006) 5406-5425
8. Chambolle A. An algorithm for total variation minimization and applications. J. Math. Imaging Vision 20 (2004) 89-97
9. Chen S.S., Donoho D., and Saunders M.A. Atomic decomposition by basis pursuit. SIAM J. Sci. Comput. 20 (1998) 33-61
10. Combettes P.L., and Wajs V.R. Signal recovery by proximal forward-backward splitting. Multiscale Model. Simul. 4 (2005) 1168-1200
11. Dai Y.H., and Fletcher R. On the asymptotic behaviour of some new gradient methods. Math. Program. 103 (2005) 541-559
12. Dai Y.H., and Fletcher R. New algorithms for singly linearly constrained quadratic programming problems subject to lower and upper bounds. Math. Program. 106 (2006) 403-421
13. Dai Y.H., Hager W.W., Schittkowski K., and Zhang H. The cyclic Barzilai-Borwein method for unconstrained optimization. IMA J. Numer. Anal. 26 (2006) 604-627
14. Daubechies I., Defrise M., and De Mol C. An iterative thresholding algorithm for linear inverse problems with a sparsity constraint. Comm. Pure Appl. Math. 57 (2004) 1413-1457
15. Daubechies I., Fornasier M., and Loris I. Accelerated projected gradient method for linear inverse problems with sparsity constraints. J. Fourier Anal. Appl. 14 (2008) 764-792
16. Donoho D.L. Compressed sensing. IEEE Trans. Inform. Theory 52 (2006) 1289-1306
17. Efron B., Hastie T., Johnstone I., and Tibshirani R. Least angle regression. Ann. Statist. 32 (2004) 407-499
18. R. Fletcher, On the Barzilai-Borwein method, Technical Report NA/207, Department of Mathematics, University of Dundee, Dundee, UK, 2001
19. Figueiredo M.A.T., and Nowak R.D. An EM algorithm for wavelet-based image restoration. IEEE Trans. Image Process. 12 (2003) 906-916
20. Figueiredo M.A.T., Nowak R.D., and Wright S.J. Gradient projection for sparse reconstruction: Application to compressed sensing and other inverse problems. IEEE J. Sel. Topics Signal Process. 1 (2007) 586-597
21. Frassoldati G., Zanghirati G., and Zanni L. New adaptive stepsize selections in gradient methods. J. Ind. Manag. Optim. 4 (2008) 299-312
22. Friedlander A., Martínez J.M., Molina B., and Raydan M. Gradient method with retards and generalizations. SIAM J. Numer. Anal. 36 (1999) 275-289
23. Grippo L., Lampariello F., and Lucidi S. A nonmonotone line-search technique for Newton's method. SIAM J. Numer. Anal. 23 (1986) 707-716
24. 1-regularized least squares. IEEE Trans. Sel. Topics Signal Process. 1 (2007) 606-617
25. 1-penalized functionals. Inverse Problems 25 (2009) 035008
26. 1-norm regularization of wavelet coefficients. Geophys. J. Internat. 170 (2007) 359-370
27. Osborne M.R., Presnell B., and Turlach B.A. A new approach to variable selection in least squares problems. IMA J. Numer. Anal. 20 (2000) 389-403
28. Serafini T., Zanghirati G., and Zanni L. Gradient projection methods for quadratic programs and applications in training support vector machines. Optim. Methods Softw. 20 (2005) 343-378
29. Tibshirani R. Regression selection and shrinkage via the lasso. J. R. Stat. Soc. Ser. B 58 (1996) 267-288
30. S. Wright, R. Nowak, M. Figueiredo, Sparse reconstruction by separable approximation, IEEE Trans. Signal Process. (2009), in press
31. Zanni L. An improved gradient projection-based decomposition technique for support vector machines. Comput. Manag. Sci. 3 (2006) 131-145
32. Zhou B., Gao L., and Dai Y.H. Gradient methods with adaptive step-sizes. Comput. Optim. Appl. 35 (2006) 69-86