Enhancing sparsity by reweightedℓ1 minimization

Journal of Fourier Analysis and Applications

Volumn 14, Issue 5-6, 2008, Pages 877-905

  Candès, Emmanuel J ^a   Wakin, Michael B ^b   Boyd, Stephen P ^c  

^a CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

^b Department of Geology and Geological Engineering   (United States)

^c Stanford University   (United States)

Author keywords

1 Minimization; Compressive sensing; Dantzig selector; FOCUSS; Iterative reweighting; Sparsity; Underdetermined systems of linear equations

Indexed keywords

EID: 57349174008     PISSN: 10695869     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00041-008-9045-x     Document Type: Article

References (62)

1. Boyd, S., Vandenberghe, L.: Convex Optimization. Cambridge University Press, Cambridge (2004)
2. 1 norm Geophysics 44 1 39 52
3. J.F. Claerbout F. Muir 1973 Robust modeling with erratic data Geophysics 38 5 826 844
4. F. Santosa W.W. Symes 1986 Linear inversion of band-limited reflection seismograms SIAM J. Sci. Stat. Comput. 7 4 1307 1330
5. D.L. Donoho P.B. Stark 1989 Uncertainty principles and signal recovery SIAM J. Appl. Math. 49 3 906 931
6. D.L. Donoho B.F. Logan 1992 Signal recovery and the large sieve SIAM J. Appl. Math. 52 2 577 591
7. R. Tibshirani 1996 Regression shrinkage and selection via the lasso J. R. Stat. Soc. B 58 1 267 288
8. S. Chen D. Donoho M. Saunders 1998 Atomic decomposition by basis pursuit SIAM J. Sci. Comput. 20 1 33 61
9. L.I. Rudin S. Osher E. Fatemi 1992 Nonlinear total variation based noise removal algorithms Physica D 60 1-4 259 268
10. P. Blomgren T.F. Chan 1998 Color TV: total variation methods for restoration of vector-valued images IEEE Trans. Image Process. 7 304 309
11. Vandenberghe, L., Boyd, S., El Gamal, A.: Optimal wire and transistor sizing for circuits with non-tree topology. In: Proceedings of the 1997 IEEE/ACM International Conference on Computer Aided Design, pp. 252-259 (1997)
12. L. Vandenberghe S. Boyd A. El Gamal 1998 Optimizing dominant time constant in RC circuits IEEE Trans. Comput.-Aided Des. 2 2 110 125
13. A. Hassibi J. How S. Boyd 1999 Low-authority controller design via convex optimization AIAA J. Guid. Control Dyn. 22 6 862 872
14. Dahleh, M., Diaz-Bobillo, I.: Control of Uncertain Systems: A Linear Programming Approach. Prentice-Hall, Englewood Cliffs (1995)
15. M. Lobo M. Fazel S. Boyd 2006 Portfolio optimization with linear and fixed transaction costs Ann. Oper. Res. 152 1 341 365
16. Ghosh, A., Boyd, S.: Growing well-connected graphs. In: Proceedings of the 45th IEEE Conference on Decision and Control, December 2006, pp. 6605-6611
17. J. Sun S. Boyd L. Xiao P. Diaconis 2006 The fastest mixing Markov process on a graph and a connection to a maximum variance unfolding problem SIAM Rev. 48 4 681 699
18. 1 trend filtering. SIAM Rev. (2008, to appear); available at www.stanford.edu/~boyd/l1- trend-filter.html
19. D.L. Donoho X. Huo 2001 Uncertainty principles and ideal atomic decomposition IEEE Trans. Inf. Theory 47 7 2845 2862
20. M. Elad A.M. Bruckstein 2002 A generalized uncertainty principle and sparse representation in pairs of bases IEEE Trans. Inf. Theory 48 9 2558 2567
21. R. Gribonval M. Nielsen 2003 Sparse representations in unions of bases IEEE Trans. Inf. Theory 49 12 3320 3325
22. J.A. Tropp 2006 Just relax: convex programming methods for identifying sparse signals in noise IEEE Trans. Inf. Theory 52 1030 1051
23. E.J. Candès J. Romberg T. Tao 2006 Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information IEEE Trans. Inf. Theory 52 2 489 509
24. E.J. Candès T. Tao 2006 Near optimal signal recovery from random projections: Universal encoding strategies? IEEE Trans. Inf. Theory 52 12 5406 5425
25. Donoho, D.: Compressed sensing. IEEE Trans. Inf. Theory 52(4) (2006)
26. D.L. Donoho J. Tanner 2009 Counting faces of randomly-projected polytopes when the projection radically lowers dimension J. Am. Math. Soc. 22 1 53
27. E.J. Candès J. Romberg T. Tao 2006 Stable signal recovery from incomplete and inaccurate measurements Commun. Pure Appl. Math. 59 8 1207 1223
28. D. Donoho Y. Tsaig 2006 Extensions of compressed sensing Signal Process. 86 3 533 548
29. Takhar, D., Bansal, V., Wakin, M., Duarte, M., Baron, D., Kelly, K.F., Baraniuk, R.G.: A compressed sensing camera: New theory and an implementation using digital micromirrors. In: Proceedings of Comp. Imaging IV at SPIE Electronic Imaging, San Jose, California, January 2006
30. Lustig, M., Donoho, D., Pauly, J.M.: Sparse MRI: The application of compressed sensing for rapid MR imaging. Preprint (2007)
31. E.J. Candès T. Tao 2005 Decoding by linear programming IEEE Trans. Inf. Theory 51 12 4203 4215
32. Candès, E.J., Randall, P.A.: Highly robust error correction by convex programming. Available on the ArXiV preprint server ( cs/0612124 ) (2006)
33. Healy, D.L.: Analog-to-information (A-to-I). DARPA/MTO Broad Agency Announcement BAA 05-35 (July 2005)
34. Bajwa, W., Haupt, J., Sayeed, A., Nowak, R.: Compressive wireless sensing. In: Proceedings of Fifth Int. Conf. on Information Processing in Sensor Networks, pp. 134-142 (2006)
35. Baron, D., Wakin, M.B., Duarte, M.F., Sarvotham, S., Baraniuk, R.G.: Distributed compressed sensing. Preprint (2005)
36. Lange, K.: Optimization, Springer Texts in Statistics. Springer, New York (2004)
37. Fazel, M.: Matrix rank minimization with applications. Ph.D. thesis, Electrical Engineering Department, Stanford University (2002)
38. M.S. Lobo M. Fazel S. Boyd 2007 Portfolio optimization with linear and fixed transaction costs Ann. Oper. Res. 152 1 341 365
39. Fazel, M., Hindi, H., Boyd, S.: Log-det heuristic for matrix rank minimization with applications to Hankel and Euclidean distance matrices. In: Proceedings of Am. Control Conf., June 2003
40. Figueiredo, M.A.T., Nowak, R.D.: A bound optimization approach to wavelet-based image deconvolution. In: Proceedings of IEEE Int. Conf. on Image Processing (ICIP), vol. 2 (2005)
41. M. Figueiredo J.M. Bioucas-Dias R.D. Nowak 2007 Majorization-minimization algorithms for wavelet-based image restoration IEEE Trans. Image Process. 16 12 2980 2991
42. Wipf, D.P., Nagarajan, S.: A new view of automatic relevance determination. In: Proceedings on Neural Information Processing Systems (NIPS), vol. 20 (2008)
43. H. Zou 2006 The adaptive Lasso and its oracle properties J. Am. Stat. Assoc. 101 476 1418 1429
44. H. Zou R. Li 2008 One-step sparse estimates in nonconcave penalized likelihood models Ann. Stat. 36 4 1509 1533
45. E.J. Schlossmacher 1973 An iterative technique for absolute deviations curve fitting J. Am. Stat. Assoc. 68 344 857 859
46. P. Holland R. Welsch 1977 Robust regression using iteratively reweighted least-squares Commun. Stat. Theor. Methods A6 813 827
47. Huber, P.J.: Robust Statistics. Wiley-Interscience, New York (1981)
48. p deconvolution IEEE Trans. Acoust. Speech Signal Process. 33 1 174 182
49. 1-minimization with applications to compressed sensing SIAM J. Imaging Sci. 1 1 143 168
50. E.J. Candès T. Tao 2007 The Dantzig selector: Statistical estimation when p is much larger than n Ann. Stat. 35 6 2313 2351
51. D. Goldfarb W. Yin 2005 Second-order cone programming methods for total variation-based image restoration SIAM J. Sci. Comput. 27 2 622 645
52. R. Chartrand 2007 Exact reconstruction of sparse signals via nonconvex minimization Signal Process. Lett. 14 10 707 710
53. J.-L. Starck M. Elad D.L. Donoho 2004 Redundant multiscale transforms and their application for morphological component analysis Adv. Imaging Electron. Phys. 132 288 348
54. M. Elad P. Milanfar R. Rubinstein 2007 Analysis versus synthesis in signal priors Inverse Probl. 23 3 947 968
55. I.F. Gorodnitsky B.D. Rao 1997 Sparse signal reconstruction from limited data using FOCUSS: A re-weighted minimum norm algorithm IEEE Trans. Signal Process. 45 3 600 616
56. Chartrand, R., Yin, W.: Iteratively reweighted algorithms for compressive sensing. In: Proceedings of Int. Conf. on Acoustics, Speech, Signal Processing (ICASSP), pp. 3869-3872 (2008)
57. Wipf, D.P.: Personal communication (January 2008)
58. Harikumar, G., Bresler, Y.: A new algorithm for computing sparse solutions to linear inverse problems. In: Proceedings of Int. Conf. on Acoustics, Speech, Signal Processing (ICASSP). IEEE, New York (1996)
59. A.H. Delaney Y. Bresler 1998 Globally convergent edge-preserving regularized reconstruction: An application to limited-angle tomography IEEE Trans. Image Process. 7 2 204 221
60. Saab, R., Chartrand, R., Yilmaz, O.: Stable sparse approximations via nonconvex optimization. In: 33rd International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2008
61. M.J. Black G. Sapiro D.H. Marimont D. Heeger 1998 Robust anisotropic diffusion IEEE Trans. Image Process. 7 3 421 432
62. Boyd, S.: Lecture notes for EE364B: convex optimization II. Available at www.stanford.edu/class/ee364b/ (2007)