Rank awareness in joint sparse recovery

IEEE Transactions on Information Theory

Volumn 58, Issue 2, 2012, Pages 1135-1146

  Davies, Mike E ^a   Eldar, Yonina C ^b  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

^b TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Compressed sensing; Multiple measurement vectors; Rank; Sparse representations

Indexed keywords

ARRAY SIGNAL PROCESSING; COMPRESSED SENSING; INCOMPLETE MEASUREMENTS; MATCHING PURSUIT; MIXED-NORM; MULTI-CHANNEL; MULTIPLE MEASUREMENT VECTORS; MULTIPLE MEASUREMENTS; ORTHOGONAL MATCHING PURSUIT; RANK; SINGLE CHANNELS; SPARSE MULTIPLES; SPARSE RECOVERY; SPARSE REPRESENTATION; SPARSE VECTORS; WORST-CASE ANALYSIS;

ALGORITHMS; SIGNAL RECONSTRUCTION; VECTORS;

RECOVERY;

EID: 84856895585     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2011.2173722     Document Type: Article

References (49)

1. E. Candès, J. Romberg, and T. Tao, "Stable signal recovery from incomplete and inaccurate measurements," Comm. Pure Appl. Math., vol. 59, no. 8, pp. 1207-1223, 2006.
2. D. Donoho, "Compressed sensing," IEEE Trans. Inf. Theory, vol. 52, no. 4, pp. 1289-1306, Apr. 2006.
3. B. K. Natarajan, "Sparse approximate solutions to linear systems," SIAM J. Comput., vol. 24, pp. 227-234, Apr. 1995.
4. G. Davis, S. Mallat, and M. Avellaneda, "Adaptive greedy approximations," Constr. Approx., vol. 13, no. 1, pp. 57-98, 1997.
5. S. S. Chen, D. L. Donoho, and M. A. Saunders, "Atomic decomposition by basis pursuit," SIAM J. Scientif. Comput., vol. 20, no. 1, pp. 33-61, 1998.
6. I. F. Gorodnitsky and B. D. Rao, "Sparse signal reconstruction from limited data using FOCUSS: A re-weighted minimum norm algorithm," IEEE Trans. Signal Process., vol. 45, no. 3, pp. 600-616, Mar. 1997.
7. J. A. Tropp, "Greed is good: Algorithmic results for sparse approximation," IEEE Trans. Inf. Theory, vol. 50, no. 10, pp. 2231-2242, Oct. 2004.
8. D. Needell and J. Tropp, "COSAMP: Iterative signal recovery from incomplete and inaccurate samples," Appl. Comput. Harmon. Anal., vol. 26, pp. 301-321, 2008.
9. T. Blumensath and M. Davies, "Iterative thresholding for sparse approximations," J. Fourier Anal. and Applic., Special Issue on Sparsity, vol. 14, no. 5, pp. 629-654, 2008.
10. S. F. Cotter, B. D. Rao, K. Engan, and K. K-Delgado, "Sparse solutions to linear inverse problems with multiple measurement vectors," IEEE Trans. Signal Process., vol. 53, no. 7, pp. 2477-2488, Jul. 2005.
11. D. Baron, M. F. Duarte, M. B. Wakin, S. Sarvotham, and R. G. Baraniuk, "Distributed Compressive Sensing," Tech. Rep. Rice University, Houston, 2005, to be published.
12. J. Chen and X. Huo, "Theoretical results on sparse representations of multiple-measurement vectors," IEEE Trans. Signal Process., vol. 54, no. 12, pp. 4634-4643, Dec. 2006.
13. M. Mishali and Y. C. Eldar, "Reduce and boost: Recovering arbitrary sets of jointly sparse vectors," IEEE Trans. Signal Process., vol. 56, pp. 4692-4702, Oct. 2008.
14. Y. C. Eldar and H. Rauhut, "Average case analysis of multichannel sparse recovery using convex relaxation," IEEE Trans. Inform. Theory, vol. 56, no. 1, pp. 505-519, Jan. 2010.
15. Y. Lu and M. Do, "A theory for sampling signals from a union of subspaces," IEEE Trans. Signal Process., vol. 56, no. 6, pp. 2334-2345, Jun. 2008.
16. T. Blumensath and M. E. Davies, "Sampling theorems for signals from the union of finite-dimensional linear subspaces," IEEE Trans. Inf. Theory, vol. 55, no. 4, pp. 1872-1882, Apr. 2009.
17. Y. C. Eldar and M. Mishali, "Robust recovery of signals from a structured union of subspaces," IEEE Trans. Inf. Theory, vol. 55, no. 11, pp. 5302-5316, Nov. 2009.
18. Y. C. Eldar, P. Kuppinger, and H. Bölcskei, "Block-sparse signals: Uncertainty relations and efficient recovery," IEEE Trans. Signal Process., vol. 58, no. 6, pp. 3042-3054, Jun. 2010.
19. R. G. Baraniuk, V. Cevher,M. F. Duarte, and C. Hegde, "Model-based compressive sensing," IEEE Trans. Inf. Theory, vol. 56, no. 4, pp. 1982-2001, 2010.
20. S. Gleichman and Y. Eldar, "Blind compressed sensing," IEEE Trans. Inf. Theory, to be published.
21. M. Mishali and Y. C. Eldar, "Blind multiband signal reconstruction: Compressed sensing for analog signals," IEEE Trans. Signal Process., vol. 57, pp. 993-1009, Mar. 2009.
22. J. A. Tropp, A. C. Gilbert, and M. J. Strauss, "Algorithms for simultaneous sparse approximation. Part I: Greedy pursuit," Signal Process., vol. 86, no. 3, pp. 572-588, 2006.
23. J. A. Tropp, "Algorithms for simultaneous sparse approximation. Part II: Convex relaxation," Signal Process., vol. 86, pp. 589-602, 2006.
24. M. Fornasier and H. Rauhut, "Recovery algorithms for vector valued data with joint sparsity constraints," SIAM J. Numer. Anal., vol. 46, no. 2, pp. 577-613, 2008.
25. R. Gribonval, H. Rauhut, K. Schnass, and P. Vandergheynst, "Atoms of all channels, unite! Average case analysis of multi-channel sparse recovery using greedy algorithms," J. Fourier Anal. and Applic., Special Issue on Sparsity, vol. 14, pp. 655-687, 2008.
26. R. Gribonval, B. Mailhe, H. Rauhut, K. Schnass, and P. Vandergheynst, "Average case analysis of multichannel thresholding," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., 2007, vol. II, pp. 853-856.
27. P. Feng, "Universal Minimum-Rate Sampling and Spectrum-Blind Reconstruction for Multiband Signals," Ph.D. dissertation, University of Illinois, Urbana-Champaign, 1998.
28. R. O. Schmidt, "Multiple emitter location and signal parameter estimation," in Proc. RADC Spectral Estimation Workshop, 1979, pp. 243-258.
29. M. E. Davies and Y. C. Eldar, "Rank awareness and in joint sparse recovery," ArXiv, vol. 1004.4529, 2010.
30. K. Lee and Y. Bresler, iMUSIC: Iterative MUSIC Algorithm for Joint Sparse Recovery with Any Rank 2010 [Online].Available: arXiv:1004. 3071v1
31. J. M. Kim, O. K. Lee, and J. C. Ye, Compressive MUSIC: A Missing Link Between Compressive Sensing and Array Signal Processing [Online]. Available: arXiv:1004.4398v1
32. A. Fannjiang, "The MUSIC algorithm for sparse objects:Acompressed sensing analysis," CoRR, vol. abs/1006.1678, 2010.
33. J. C. Ye, Personal Communication Sep. 2010.
34. B. Recht, M. Fazel, and P. A. Parrilo, "Guaranteed minimum-rank solutions of linear matrix equations via nuclear norm minimization," SIAM Rev., vol. 52, pp. 471-501, 2010.
35. D. L. Donoho and M. Elad, "Optimally-sparse representation in general (non-orthogonal) dictionaries via l1 minimization," Proc. Nat. Acad. Sci., vol. 100, pp. 2197-2202, 2003.
36. P. Feng and Y. Bresler, "Spectrum-blind minimum-rate sampling and reconstruction of multiband signals," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, 1996, pp. 1688-1691.
37. G. W. Stewart, "Error and perturbation bounds for subspaces associated with certain eigenvalue problems," SIAM Rev., vol. 15, no. 4, pp. 727-764.
38. H. L. V. Trees, Optimum Array Processing. New York: Wiley, 2002.
39. A. Lutoborski and V. N. Temlyakov, "Vector greedy algorithms," J. Complex., vol. 19, no. 4, pp. 458-473, 2003.
40. R. Gribonval and M. Nielsen, Highly Sparse Representations are Unique and Independent of the Sparseness Measure Dept. Mathemat. Sci., Univ. Aalborg, Aalborg, Denmark, 2003, Tech. Rep. R2003-16.
41. A. Cohen, W. Dahmen, and R. DeVore, "Compressed sensing and best k-term approximation," J. AMS, vol. 22, pp. 211-231, 2009.
42. E. v. Berg and M. P. Friedlander, "Theoretical and empirical results for recovery from multiple measurements," IEEE Trans. Inf. Theory, vol. 56, no. 5, pp. 2516-2527, May 2010.
43. S. Chen, S. A. Billings, and W. Luo, "Orthogonal least squares methods and their application to non-linear system identification," Int. J. Control, vol. 50, no. 5, pp. 1873-1896, 1989.
44. T. Blumensath and M. Davies, On the Difference between Orthogonal Matching Pursuit and Orthogonal Least Squares 2007 [Online]. Available: http://www.personal.soton.ac.uk/tb1m08/papers/BDOMPvsOLS07. pdf, unpublished
45. S. K. Oh and C. K. Un, "A sequential estimation approach for performance improvement of eignenstructure-based methods in array processing," IEEE Trans. Signal Process., vol. 41, pp. 457-463, 1993.
46. P. Stoica, P. Handel, and A. Nehorai, "Improved sequential MUSIC," IEEE Trans. Aerosp. Electron. Syst., vol. 31, pp. 1230-1238, 1995.
47. J. C. Mosher and R. M. Leahy, "Source localization using recursively applied and projected (RAP) MUSIC," IEEE Trans. Signal Process., vol. 47, pp. 332-340, 1999.
48. T. Blumensath and M. E. Davies, "Normalized iterated hard thresholding; guaranteed stability and performance," IEEE J. Selecte. Topics Signal Process., vol. 4, no. 2, pp. 298-309, Feb. 2010.
49. T. Blumensath and M. Davies, "Iterative hard thresholding for compressed sensing," Appl. Comput. Harmon. Anal., vol. 27, no. 3, pp. 265-274, 2009.