Breakdown of equivalence between the minimal ℓ1-norm solution and the sparsest solution

Signal Processing

Volumn 86, Issue 3, 2006, Pages 533-548

  Tsaig, Yaakov ^a   Donoho, David L ^a  

^a STANFORD UNIVERSITY   (United States)

Author keywords

Basis pursuit; Linear programming; Overcomplete systems; Partial Fourier matrix ensemble; Partial Hadamard matrix ensemble; Random matrix theory; Random signs matrix ensemble; Sparse representations; Underdetermined systems of linear equations

Indexed keywords

APPROXIMATION THEORY; HEURISTIC METHODS; LINEAR EQUATIONS; LINEAR PROGRAMMING; MATRIX ALGEBRA; SET THEORY;

OVERCOMPLETE SYSTEMS; RANDOM MATRIX THEORY; SPARSE REPRESENTATION;

EQUIVALENCE CLASSES;

EID: 30844458202     PISSN: 01651684     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sigpro.2005.05.028     Document Type: Article

References (26)

1. R.R. Coifman, Y. Meyer, S. Quake, M.V. Wickerhauser, Signal processing and compression with wavelet packets, in: J.S. Byrnes, J.L. Byrnes, K.A. Hargreaves, K. Berry (Eds.), Wavelets and Their Applications, 1994.
2. S. Mallat, and Z. Zhang Matching pursuits with time-frequency dictionaries IEEE Trans. Signal Process. 41 12 1993 3397 3415
3. S. Chen, D.L. Donoho, and M.A. Saunders Atomic decomposition by basis pursuit SIAM J. Sci. Comput. 20 1 1999 33 61
4. B.K. Natarajan Sparse approximate solutions to linear systems SIAM J. Comput. 24 1995 227 234
5. D.L. Donoho, and X. Huo Uncertainty principles and ideal atomic decomposition IEEE Trans. Inform. Theory 47 7 November 2001 2845 2862
6. D.L. Donoho, and M. Elad Optimally sparse representation from overcomplete dictionaries via ℓ 1 norm minimization Proc. Nat. Acad. Sci. USA 100 5 March 4, 2002 2197 2202
7. M. Elad, and A.M. Bruckstein A generalized uncertainty principle and sparse representations in pairs of bases IEEE Trans. Inform. Theory 49 2002 2558 2567
8. J.J. Fuchs On sparse representations in arbitrary redundant bases IEEE Trans. Inform. Theory 50 6 June 2004 1341 1344
9. R. Gribonval, and M. Nielsen Sparse representations in unions of bases IEEE Trans. Inform. Theory 49 12 December 2003 1320 1325
10. J.A. Tropp Greed is good: algorithmic results for sparse approximation IEEE Trans. Inform. Theory 50 11 October 2004 2231 2242
11. J.A. Tropp, Just relax: convex programming methods for subset selection and sparse approximation, Manuscript.
12. D.M. Malioutov, M. Çetin, A.S. Willsky, Optimal sparse representations in general overcomplete bases, IEEE International Conference on Acoustics, Speech and Signal Processing, May 2004, Montreal, Canada.
13. E.J. Candès, J. Romberg, T. Tao, Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information, Manuscript, 2004.
14. D.L. Donoho, For most large underdetermined systems of linear equations, the minimal ℓ 1 solution is also the sparsest solution, Manuscript, submitted for publication, URL: http://www-stat.stanford.edu/~donoho/Reports/2004.
15. T. Strohmer, and R. Heath Jr. Grassmannian frames with applications to coding and communications Appl. Comput. Harm. Anal. 14 3 2003 257 275
16. E.J. Candès, T. Tao, Near optimal signal recovery from random projections: universal encoding strategies? Manuscript, 2004.
17. D.L. Donoho, M. Elad, V. Temlyakov, Stable recovery of sparse overcomplete representations in the presence of noise, IEEE Trans. Inform. Theory, to appear.
18. D.L. Donoho, Compressed sensing. Manuscript, submitted for publication, URL: http://www-stat.stanford.edu/~donoho/Reports/2004.
19. Y. Tsaig, D.L. Donoho, Extensions of compressed sensing, Signal Process., to appear.
20. P. Billingsley Probability and Measure 1995 Wiley New York
21. D.L. Donoho, For most underdetermined systems of linear equations, the minimal ℓ 1 -norm near-solution approximates the sparsest near-solution, Manuscript, submitted for publication, URL: http://www-stat.stanford.edu/~donoho/Reports/2004.
22. A. Edelman Eigenvalues and condition numbers of random matrices SIAM J. Matrix Anal. Appl. 9 1988 543 560
23. B.S. Kashin Diameters of certain finite-dimensional sets in classes of smooth functions Izv. Akad. Nauk SSSR, Ser. Mat. 41 2 1977 334 351
24. A.Y. Garnaev, and E.D. Gluskin On widths of the Euclidean ball Soviet Math. Dokl. 30 1984 200 203 (in English)
25. M. Harwit, and N.J.A. Sloane Hadamard Transform Optics 1979 Academic Press New York
26. G. Pisier The Volume of Convex Bodies and Banach Space Geometry 1989 Cambridge University Press Cambridge