Compressive sensing with redundant dictionaries and structured measu rements

SIAM Journal on Mathematical Analysis

Volumn 47, Issue 6, 2015, Pages 4606-4629

  Krahmer, Felix ^a   Needell, Deanna ^b   Ward, Rachel ^c  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^b CLAREMONT MCKENNA COLLEGE   (United States)

^c UNIVERSITY OF TEXAS AT AUSTIN   (United States)

Author keywords

Compressive sensing; Redundant dictionaries; Restricted isometry property

Indexed keywords

MATRIX ALGEBRA; SIGNAL RECONSTRUCTION;

COMPRESSIVE SENSING; ORTHOGONAL MATRIX; REDUNDANT DICTIONARIES; RESTRICTED ISOMETRY PROPERTIES; SENSING SYSTEMS; SPARSE EXPANSIONS; SPARSE REPRESENTATION; STRUCTURAL CONSTRAINTS;

COMPRESSED SENSING;

EID: 84953330766     PISSN: 00361410     EISSN: 10957111     Source Type: Journal    
DOI: 10.1137/151005245     Document Type: Article

References (67)

1. N. AILON AND B. CHAZELLE, The fast Johnson-Lindenstrauss transform and approximate nearest neighbors, SIAM J. Comput., 39(2009), pp. 302-322.
2. D. ACHLIOPTAS, Database-friendly random projections: Johnson-Lindenstrauss with binary coins, J. Comput. System Sci., 66(2003), pp. 671-687.
3. B. ADCOCK, A. C. HANSEN, C. POON, AND B. ROMAN, Breaking the coherence barrier: A new theory for compressed sensing, preprint, arXiv:1302.0561.
4. R. BARANIUK, M. DAVENPORT, R. DE VORE, AND M. WAKIN, A simple proof of the restricted isometry property for random matrices, Constr. Approx., 28(2008), pp. 253-263.
5. N. BURQ, S. DYATLOV, R. WARD, AND M. ZWORSKI, Weighted eigenfunction estimates with applications to compressed sensing, SIAM J. Math. Anal., 44(2012), pp. 3481-3501.
6. O. BOUSQUET, Concentration inequalities for sub-additive functions using the entropy method, in Stochastic Inequalities and Applications, Progr. Probab. 56, Birkhäuser, Basel, 2003, pp. 213-247.
7. R. BARANIUK AND P. STEEGHS, Compressive radar imaging, in Proceedings of the IEEE Radar Conference, IEEE, 2007, pp. 128-133.
8. J. BOBIN, J.-L. STARCK, AND R. OTTENSAMER, Compressed sensing in astronomy, IEEE J. Sel. Top. Signa., 2(2008), pp. 718-726.
9. B. CARL, Inequalities of Bernstein-Jackson-type and the degree of compactness of operators in Banach spaces, Ann. Inst. Fourier (Grenoble), 35(1985), pp. 79-118.
10. J.-F. CAI, R. H. CHAN, AND Z. SHEN, A framelet-based image inpainting algorithm, Appl. Comput. Harmon. Anal., 24(2008), pp. 131-149.
11. E. J. CANDÈS AND D. L. DONOHO, New tight frames of curvelets and optimal representations of objects with piecewise c2 singularities, Comm. Pure Appl. Math., 57(2004), pp. 219-266.
12. E. J. CANDÈS, Y. C. ELDAR, D. NEEDELL, AND P. RANDALL, Compressed sensing with coherent and redundant dictionaries, Appl. Comput. Harmon. Anal., 31(2010), pp. 59-73.
13. E. J. CANDÈS AND C. FERNANDEZ-GRANDA, Super-resolution from noisy data, J. Fourier Anal. Appl., 19(2013), pp. 1229-1254.
14. E. J. CANDÈS AND C. FERNANDEZ-GRANDA, Towards a mathematical theory of superre solution, Comm. Pure Appl. Math., 67(2014), pp. 906-956.
15. P. CASAZZA, M. FICKUS, D. MIXON, Y. WANG, AND Z. ZHOU, Constructing tight fusion frames, Appl. Comput. Harmon. Anal., 30(2011), pp. 175-187.
16. M. CHERAGHCHI, V. GURUSWAMI, AND A. VELINGKER, Restricted isometry of Fourier matrices and list decodability of random linear codes, SIAM J. Comput., 42(2013), pp. 1888-1914.
17. P. CASAZZA, A. HEINECKE, F. KRAHMER, AND G. KUTYNIOK, Optimally sparse frames, IEEE Trans. Inform. Theory, 57(2011), pp. 7279-7287.
18. E. J. CANDÈS AND Y. PLAN, A probabilistic and RIPless theory of compressed sensing, IEEE Trans. Inform. Theory, 57(2011), pp. 7235-7254.
19. E. J. CANDÈS AND J. ROMBERG, Sparsity and incoherence in compressive sampling, IEEE Trans. Inform. Theory, 23(2007), p. 969.
20. E. J. CANDÈS AND T. TAO, Decoding by linear programming, IEEE Trans. Inform. Theory, 51(2005), pp. 4203-4215.
21. E. J. CANDÈS AND T. TAO, Near-optimal signal recovery from random projections: Universal encoding strategies, IEEE Trans. Inform. Theory, 52(2005), pp. 5406-5425.
22. R. A. DE VORE, Deterministic Constructions of Compressed Sensing Matrices, J. Complexity, 23(2007), pp. 918-925.
23. S. DASGUPTA AND A. GUPTA, An elementary proof of a theorem of Johnson and Lindenstrauss, IEEE Trans. Inform. Theory, 22(2003), pp. 60-65.
24. M. DAVENPORT, D. NEEDELL, AND M. B. WAKIN, Signal space CoSaMP for sparse recovery with redundant dictionaries, IEEE Trans. Inform. Theory, 59(2012), p. 6820.
25. D. L. DONOHO, Compressed sensing, IEEE Trans. Inform. Theory, 52(2006), pp. 1289-1306.
26. R. M. DUDLEY, The sizes of compact subsets of Hilbert space and continuity of Gaussian processes, J. Funct. Anal., 1(1967), pp. 290-330.
27. P. DUTILLEUX, An implementation of the "algorithme a trous" to compute the wavelet transform, in Wavelets: Time-Frequency Methods and Phase-Space, J. M. Combes, A. Grossmann, and P. Tchamitchian, eds., Springer, New York, 1989.
28. G. EASLEY, D. LABATE, AND W.-Q. LIM, Sparse directional image representations using the discrete shearlet transform, Appl. Comput. Harmon. Anal., 25(2008), pp. 25-46.
29. M. ELAD, P. MILANFAR, AND R. RUBINSTEIN, Analysis versus synthesis in signal priors, Inverse Problems, 23(2007), pp. 947-968.
30. S. FOUCART, Dictionary-sparse recovery via thresholding-based algorithms, J. Fourier Anal. Appl., 2015, pp. 1-14.
31. S. FOUCART AND H. RAUHUT, A Mathematical Introduction to Compressive Sensing, Appl. Numer. Harmon. Anal., Birkhauser, Basel, 2013.
32. R. GIRYES, Sampling in the analysis transform domain, Appl. Comput. Harmon. Anal., to appear.
33. R. GIRYES AND D. NEEDELL, Greedy signal space methods for incoherence and beyond, Appl. Comput. Harmon. Anal., 39(2015), pp. 1-20.
34. R. GIRYES AND D. NEEDELL, Near oracle performance and block analysis of signal space greedy methods, J. Approx. Theory, 194(2015), pp. 157-174.
35. R. GIRYES, S. NAM, M. ELAD, R. GRIBONVAL, AND M. E. DAVIES, Greedy-like algorithms for the cosparse analysis model, Linear Algebra Appl., 441(2014), pp. 22-60.
36. R. GIRYES, Y. PLAN, AND R. VERSHYNIN, On the effective measure of dimension in analysis cosparse models, in Proceedings of the 11th International Conference on Samp TA, 2015.
37. J. HAMPTON AND A. DOOSTAN, Compressive sampling of polynomial chaos expansions: Convergence analysis and sampling strategies, J. Comput. Phys., 280(2015), pp. 363-386.
38. M. A. HERMAN AND T. STROHMER, High-resolution radar via compressed sensing, IEEE Trans. Signal Proces., 57(2009), pp. 2275-2284.
39. A. HINRICHS AND J. VYBIRAL, Johnson-Lindenstrauss lemma for circulant matrices, Random Structures Algorithms, 39(2011), pp. 391-398.
40. M. KABANAVA AND H. RAUHUT, Analysis t1-recovery with frames and Gaussian measurements, Acta Appl. Math., to appear.
41. A. KHINTCHINE, Uber dyadische bruche, Math. Z., 18(1923), pp. 109-116.
42. G. KUTYNIOK AND D. LABATE, Construction of regular and irregular shear lets, J. Wavelet Theory and Appl., 1(2007), pp. 1-10.
43. F. KRAHMER, S. MENDELSON, AND H. RAUHUT, Suprema of chaos processes and the restricted isometry property, Commun. Pure Appl. Math., 67(2014), pp. 1877-1904.
44. F. KRAHMER AND R. WARD, New and improved Johnson-Lindenstrauss embeddings via the restricted isometry property, SIAM J. Math. Anal., 43(2011), pp. 1269-1281.
45. F. KRAHMER AND R. WARD, Stable and robust sampling strategies for compressive imaging, IEEE Trans. Image Process., 23(2014), pp. 612-622.
46. M. LUSTIG, D. DONOHO, AND J. M. PAULY, Sparse MRI: The application of compressed sensing for rapid MR imaging, Magnet. Reson. Med., 58(2007), pp. 1182-1195.
47. D. LABATE, W.-Q. LIM, G. KUTYNIOK, AND G. WEISS, Sparse multidimensional representation using shearlets, in Proceedings of SPIE, International Society for Optics and Photonics, 2005, pp. 59140U-59140U.
48. Y. LIU, T. MI, AND S. LI, Compressed sensing with general frames via optimal-dualbased-analysis, IEEE Trans. Inform. Theory, 58(2012), pp. 4201-4214.
49. S. MALLAT, A Wavelet Tour of Signal Processing, 2nd ed., Academic Press, London, 1999.
50. S. NAM, M. E. DAVIES, M. ELAD, AND R. GRIBONVAL, The cosparse analysis model and algorithms, Appl. Comput. Harmon. Anal., 34(2013), pp. 30-56.
51. D. NEEDELL AND R. WARD, Near-optimal compressed sensing guarantees for total variation minimization, IEEE Trans. Image Process., 22(2013), pp. 3941-3949.
52. D. NEEDELL AND R. WARD, Stable image reconstruction using total variation minimization, SIAM J. Imaging Sci., 6(2013), pp. 1035-1058.
53. T. PELEG AND M. ELAD, Performance guarantees of the thresholding algorithm for the cosparse analysis model, IEEE Trans. Inform. Theory, 59(2013), pp. 1832-1845.
54. C. POON, On the role of total variation in compressed sensing, SIAM J. Imaging Sci., 8(2015), pp. 682-720.
55. C. POON, Structure dependent sampling in compressed sensing: Theoretical guarantees for tight frames, Appl. Comput. Harmon. Appl., to appear.
56. H. RAUHUT, Compressive sensing and structured random matrices, in Theoretical Foundations and Numerical Methods for Sparse Recovery, M. Fornasier, ed., Radon Ser. Comput. Appl. Math. 9, de Gruyter, Berlin, 2010, pp. 1-92.
57. H. RAUHUT, J. ROMBERG, AND J. A. TROPP, Restricted isometries for partial random circulant matrices, Appl. Comput. Harmon. Anal., 32(2012), pp. 242-254.
58. H. RAUHUT, K. SCHNASS, AND P. VANDERGHEYNST, Compressed sensing and redundant dictionaries, IEEE Trans. Inform. Theory, 54(2008), pp. 2210-2219.
59. M. RUDELSON AND R. VERSHYNIN, On sparse reconstruction from Fourier and Gaussian measurements, Comm. Pure Appl. Math., 61(2008), pp. 1025-1045.
60. H. RAUHUT AND R. WARD, Sparse recovery for spherical harmonic expansions, preprint, arXiv: 1102.4097, 2011.
61. H. RAUHUT AND R. WARD, Sparse Legendre expansions via t\-minimization, J. Approx. Theory, 164(2012), pp. 517-533.
62. H. RAUHUT AND R. WARD, Interpolation via weighted t\ minimization, preprint, arXiv: 1308.0759, 2013.
63. P. STOICA AND P. BABU, Sparse estimation of spectral lines: Grid selection problems and their solutions, IEEE Trans. Signal Process., 60(2012), pp. 962-967.
64. J. L. STARCK, M. ELAD, AND D. L. DONOHO, Redundant multiscale transforms and their application for morphological component analysis, Adv. Imag. Elect. Phys., 2004, p. 132.
65. J. L. STARCK, J. FADILI, AND F. MURTAGH, The undecimated wavelet decomposition and its reconstruction, IEEE Trans. Signal Process., 16(2007), pp. 297-309.
66. G. TANG, B. N. BHASKAR, P. SHAH, AND B. RECHT, Compressive sensing off the grid, in Proceedings of the Allerton Conference on Communication, Control, and Computing, IEEE, Piscataway, NJ, 2012, pp. 778-785.
67. R. VALE AND S. WALDRON, Tight frames and their symmetries, Constr. Approx., 21(2004), pp. 83-112.