Near-oracle performance of greedy block-sparse estimation techniques from noisy measurements

IEEE Journal on Selected Topics in Signal Processing

Volumn 5, Issue 5, 2011, Pages 1032-1047

  Ben Haim, Zvika ^a,b   Eldar, Yonina C ^a,c  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

^b Google Inc   (Israel)

^c STANFORD UNIVERSITY   (United States)

Author keywords

Block sparsity; Gaussian noise; orthogonal matching pursuit; performance guarantees; thresholding

Indexed keywords

BLOCK SPARSITY; CONSTANT FACTORS; ESTIMATION TECHNIQUES; GAUSSIAN NOISE MODEL; GREEDY ALGORITHMS; HIGH SIGNAL-TO-NOISE RATIO; NOISE POWER; NOISY MEASUREMENTS; ORTHOGONAL MATCHING PURSUIT; PARAMETER VECTORS; PERFORMANCE GUARANTEES; SPARSE METHODS; THRESHOLDING; THRESHOLDING ALGORITHMS;

ALGORITHMS; FADING (RADIO); GAUSSIAN DISTRIBUTION; GAUSSIAN NOISE (ELECTRONIC); SIGNAL TO NOISE RATIO;

ESTIMATION;

EID: 80051713661     PISSN: 19324553     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSTSP.2011.2160250     Document Type: Article

References (41)

1. D. L. Donoho, "Compressed sensing," IEEE Trans. Inf. Theory, vol. 52, no. 4, pp. 1289-1306, Apr. 2006.
2. E. J. Candès, J. K. Romberg, and T. Tao, "Stable signal recovery from incomplete and inaccurate measurements," Commun. Pure Appl. Math., vol. LIX, pp. 1207-1223, 2006. (Pubitemid 43988295)
3. J. A. Tropp, "Just relax: Convex programming methods for identifying sparse signals in noise," IEEE Trans. Inf. Theory, vol. 52, no. 3, pp. 1030-1051, Mar. 2006. (Pubitemid 46444890)
4. D. L. Donoho, M. Elad, and V. N. Temlyakov, "Stable recovery of sparse overcomplete representations in the presence of noise," IEEE Trans. Inf. Theory, vol. 52, no. 1, pp. 6-18, Jan. 2006. (Pubitemid 43263116)
5. M. M. Bronstein, A. M. Bronstein, M. Zibulevsky, and Y. Y. Zeevi, "Blind deconvolution of images using optimal sparse representations," IEEE Trans. Image Process., vol. 14, no. 6, pp. 726-736, Jun. 2005. (Pubitemid 40794805)
6. M. J. Fadili, J.-L. Starck, and F. Murtagh, "Inpainting and zooming using sparse representations," Comput. J., vol. 52, no. 1, pp. 64-79, 2009.
7. Y. M. Lu and M. N. Do, "A theory for sampling signals from a union of subspaces," IEEE Trans. Signal Process., vol. 56, no. 6, pp. 2334-2345, Jun. 2008. (Pubitemid 351795887)
8. Y. C. Eldar and M. Mishali, "Robust recovery of signals from a structured union of subspaces," IEEE Trans. Inf. Theory, vol. 55, no. 11, pp. 5302-5316, Nov. 2009.
9. M. Vetterli, P. Marziliano, and T. Blu, "Sampling signals with finite rate of innovation," IEEE Trans. Signal Process., vol. 50, no. 6, pp. 1417-1428, Jun. 2002. (Pubitemid 34822552)
10. P. L. Dragotti, M. Vetterli, and T. Blu, "Sampling moments and reconstructing signals of finite rate of innovation: Shannon meets Strang-Fix," IEEE Trans. Signal Process., vol. 55, no. 7, pp. 1741-1757, Jul. 2007. (Pubitemid 46691625)
11. K. Gedalyahu and Y. C. Eldar, "Time delay estimation from low rate samples:Aunion of subspaces approach," IEEE Trans. Signal Process., vol. 58, no. 6, pp. 3017-3031, Jun. 2010.
12. K. Gedalyahu, R. Tur, and Y. C. Eldar, "Multichannel sampling of pulse streams at the rate of innovation," IEEE Trans. Signal Process., vol. 59, no. 4, pp. 1491-1504, Apr. 2011.
13. M. Mishali and Y. C. Eldar, "From theory to practice: Sub-Nyquist sampling of sparse wideband analog signals," IEEE J. Sel. Topics Signal Process., vol. 4, no. 2, pp. 375-391, Apr. 2010.
14. M. Mishali and Y. C. Eldar, "Blind multi-band signal reconstruction: Compressed sensing for analog signals," IEEE Trans. Signal Process., vol. 57, no. 3, pp. 993-1009, Mar. 2009.
15. M. Mishali, Y. C. Eldar, O. Dounaevsky, and E. Shoshan, "Xampling: Analog to digital at sub-Nyquist rates," IET J. Circuits, Devices Syst., vol. 5, no. 1, pp. 8-20, Jan. 2010.
16. M. Yuan and Y. Lin, "Model selection and estimation in regression with grouped variables," J. R. Statist. Soc. B, vol. 68, pp. 49-67, 2006. (Pubitemid 43415335)
17. M. Stojnic, F. Parvaresh, and B. Hassibi, "On the reconstruction of block-sparse signals with an optimal number of measurements," IEEE Trans. Signal Process., vol. 57, no. 8, pp. 3075-3085, Aug. 2009.
18. Y. C. Eldar, P. Kuppinger, and H. Bölcskei, "Block-sparse signals: Uncertainty relations and efficient recovery," IEEE Trans. Signal Process., vol. 58, no. 6, pp. 3042-3054, Jun. 2010.
19. R. G. Baraniuk, V. Cevher,M. F. Duarte, and C. Hegde, "Model-based compressive sensing," IEEE Trans. Inf. Theory, vol. 56, no. 4, pp. 1982-2001, 2010.
20. A. C. Lozano, G.Ś wirszcz, and N. Abe, "Group orthogonal matching pursuit for variable selection and prediction," in Adv. Neural Inf. Process. Syst. 22, Y. Bengio, D. Schuurmans, J. Lafferty, C. K. I. Williams, and A. Culotta, Eds., 2009, pp. 1150-1158.
21. E. Candes and T. Tao, "The Dantzig selector: Statistical estimation when is much larger than," Ann. Statist., vol. 35, no. 6, pp. 2313-2351, 2007, with discussion.
22. Z. Ben-Haim, Y. C. Eldar, and M. Elad, "Coherence-based performance guarantees for estimating a sparse vector under random noise," IEEE Trans. Signal Process., vol. 58, no. 10, pp. 5030-5043, Oct. 2010.
23. R. Giryes and M. Elad, "RIP-based near-oracle performance guarantees for SP, CoSaMP, and IHT," IEEE Trans. Signal Process. [Online]. Available: http://www.cs.technion.ac.il/-elad/publications/journals/2011/NearOracle- IEEETSP.pdf, submitted for publication
24. K. Schnass and P. Vandergheynst, "Average performance analysis for thresholding," IEEE Signal Process. Lett., vol. 14, no. 11, pp. 828-831, Nov. 2007. (Pubitemid 350130772)
25. Y. C. Eldar and H. Rauhut, "Average case analysis of multichannel sparse recovery using convex relaxation," IEEE Trans. Inf. Theory, vol. 56, no. 1, pp. 505-519, Jan. 2010.
26. E. J. Candès and Y. Plan, "Near-ideal model selection by-minimization," Ann. Statist., vol. 37, no. 5A, pp. 2145-2177, Oct. 2009.
27. C. Chesneau and M. Hebiri, "Some theoretical results on the grouped variables lasso," Math. Methods Statist., vol. 17, pp. 317-326, 2008.
28. F. R. Bach, "Consistency of the group lasso and multiple kernel learning," J. Mach. Learn. Res., vol. 9, pp. 1179-1225, 2008.
29. J. A. Tropp, A. C. Gilbert, and M. J. Strauss, "Algorithms for simultaneous sparse approximation. Part I: Greedy pursuit," Signal Process., vol. 86, no. 3, pp. 572-588, 2006. (Pubitemid 43106572)
30. Y. C. Pati, R. Rezaiifar, and P. S. Krishnaprasad, "Orthogonal matching pursuit: Recursive function approximation with applications to wavelet decomposition," in Proc. 27th Asilomar Conf. Signals, Syst., Comput., Nov. 1993, pp. 40-44.
31. S. M. Kay, Fundamentals of Statistical Signal Processing: Estimation Theory. Englewood Cliffs, NJ: Prentice-Hall, 1993.
32. J. D. Gorman and A. O. Hero, "Lower bounds for parametric estimation with constraints," IEEE Trans. Inf. Theory, vol. 26, no. 6, pp. 1285-1301, Nov. 1990.
33. P. Stoica and B. C. Ng, "On the Cramér-Rao bound under parametric constraints," IEEE Signal Process. Lett., vol. 5, no. 7, pp. 177-179, Jul. 1998.
34. Z. Ben-Haim and Y. C. Eldar, "On the constrained Cramér-Rao bound with a singular Fisher information matrix," IEEE Signal Process. Lett., vol. 16, no. 6, pp. 453-456, Jun. 2009.
35. Z. Ben-Haim and Y. C. Eldar, "The Cramér-Rao bound for estimating a sparse parameter vector," IEEE Trans. Signal Process., vol. 58, no. 6, pp. 3384-3389, Jun. 2010.
36. G. H. Golub and C. F. Van Loan, Matrix Computations, 3rd ed. Baltimore, MD: Johns Hopkins Univ. Press, 1996.
37. D. G. Feingold and R. S. Varga, "Block diagonally dominant matrices and generalizations of the Gerschgorin circle theorem," Pacific J. Math., vol. 12, no. 4, pp. 1241-1250, 1962.
38. Z. Sidák, "Rectangular confidence regions for the means of multivariate normal distributions," J. Amer. Statist. Assoc., vol. 62, no. 318, pp. 626-633, Jun. 1967.
39. T. W. Anderson, "The integral of a symmetric unimodal function over a symmetric convex set and some probability inequalities," in Proc. Amer. Math. Soc., 1955, vol. 6, pp. 170-176.
40. A. Stuart and J. K. Ord, Kendall's Advanced Theory of Statistics, 6th ed. London, U.K.: Edward Arnold, 1994, vol. 1.
41. M. Abramowitz and I. A. Stegun, Handbook of Mathematical Functions With Formulas, Graphs, and Mathematical Tables. New York: Dover, 1964.