Performance bounds for sparsity pattern recovery with quantized noisy random projections

IEEE Journal on Selected Topics in Signal Processing

Volumn 6, Issue 1, 2012, Pages 43-57

  Wimalajeewa, Thakshila ^a   Varshney, Pramod K ^a  

^a Syracuse University   (United States)

Author keywords

Compressed sensing; maximum likelihood estimation; performance analysis; quantization; support recovery

Indexed keywords

ADDITIVE WHITE GAUSSIAN NOISE CHANNEL; COMPRESSED SENSING; GAUSSIANS; MEASUREMENT MATRIX; PERFORMANCE ANALYSIS; PERFORMANCE BOUNDS; PERFORMANCE LIMITS; PROJECTION MATRIX; QUANTIZATION; QUANTIZATION LEVELS; RANDOM PROJECTIONS; SIGNAL DIMENSIONS; SIGNAL TO NOISE; SPARSE SIGNALS; SPARSITY PATTERNS; SUFFICIENT CONDITIONS;

DECODING; GAUSSIAN NOISE (ELECTRONIC); MAXIMUM LIKELIHOOD ESTIMATION; SIGNAL TO NOISE RATIO; WHITE NOISE;

RECOVERY;

EID: 84856397592     PISSN: 19324553     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSTSP.2011.2175700     Document Type: Article

References (45)

1. D. Malioutov, M. Cetin, and A. Willsky, "A sparse signal reconstruction perspective for source localization with sensor arrays," IEEE Trans. Signal Process., vol. 53, no. 8, pp. 3010-3022, Aug. 2005. (Pubitemid 41372811)
2. V. Cevher, P. Indyk, C. Hegde, and R. G. Baraniuk, "Recovery of clustered sparse signals from compressive measurements," in Proc. Int. Conf. Sampling Theory Applicat. (SAMPTA 2009), Marseille, France, May. 2009, pp. 18-22.
3. B. K. Natarajan, "Sparse approximate solutions to linear systems," SIAM J. Comput., vol. 24, no. 2, pp. 227-234, 1995.
4. A. J. Miller, Subset Selection in Regression. New York: Chapman- Hall, 1990.
5. E. G. Larsson and Y. Selén, "Linear regression with a sparse parameter vector," IEEE Trans. Signal Process., vol. 55, no. 2, pp. 451-460, Feb. 2007. (Pubitemid 46351271)
6. Z. Tian and G. Giannakis, "Compressed sensing for wideband cognitive radios," in Proc. Acoust., Speech, Signal Process. (ICASSP), Honolulu, HI, Apr. 2007, pp. IV-1357-IV-1360. (Pubitemid 47178630)
7. S. S. Chen, D. L. Donoho, and M. A. Saunders, "Atomic decomposition by basis pursuit," SIAM J. Sci. Comput., vol. 20, no. 1, pp. 33-61, 1998. (Pubitemid 128689501)
8. D. Donoho, "Compressed sensing," IEEE Trans. Inf. Theory, vol. 52, no. 4, pp. 1289-1306, Apr. 2006.
9. E. Candès and M. B. Wakin, "An introduction to compressive sampling," IEEE Signal Process. Mag., vol. 25, no. 2, pp. 21-30, Mar. 2008.
10. R. G. Baraniuk, "Compressive sensing," IEEE Signal Process. Mag., vol. 124, pp. 118-120, Jul. 2008.
11. E. Candès, J. Romberg, and T. Tao, "Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information," IEEE Trans. Inf. Theory, vol. 52, no. 2, pp. 489-509, Feb. 2006. (Pubitemid 43174093)
12. E. Candès and T. Tao, "Near-optimal signal recovery from random projections: Universal encoding strategies?," IEEE Trans. Info. Theory, vol. 52, no. 12, pp. 5406-5425, Dec. 2006. (Pubitemid 46445381)
13. E. Candès and J. Romberg, "Practical signal recovery from random projections," Proc. SPIE Comput. Imag., vol. 5674, pp. 76-86, 2005. (Pubitemid 40949239)
14. E. Candès, J. Romberg, and T. Tao, "Stable signal recovery from incomplete and inaccurate measurements," Commun. Pure Appl. Math., vol. 59, no. 8, pp. 1207-1223, Aug. 2006. (Pubitemid 43988295)
15. J. K. Romberg, "Sparse signal recovery via l1 minimization," in Proc. 40th Annual Conf. Inf. Sci. Syst. (CISS), Princeton, NJ, Mar. 2006, pp. 213-215.
16. J. N. Laska, M. A. Davenport, and R. G. Baraniuk, "Exact signal recovery from sparsely corrupted measurements through the pursuit of justice," in Proc. Asilomar Conf. Signals, Syst., Comput., Pacific Grove, CA, Nov. 2009, pp. 1556-1560.
17. J. Tropp and A. Gilbert, "Signal recovery from random measurements via orthogonal matching pursuit," IEEE Trans. Inf. Theory, vol. 53, no. 12, pp. 4655-4666, Dec. 2007.
18. M. A. T. Figueiredo, R. D. Nowak, and S. J. Wright, "Gradient projection for sparse reconstruction: Application to compressed sensing and other inverse problems," IEEE J. Sel. Topics Signal Process.: Special Iss. Convex Optimizat. Methods for Signal Process., vol. 1, no. 4, pp. 586-597, Jun. 2007. (Pubitemid 351276802)
19. T. Blumensath and M. E. Davies, "Iterative thresholding for sparse approximations," J. Fourier Anal. Applicat., Special Iss. on Sparsity, vol. 14, no. 5, pp. 629-654, 2008.
20. T. Blumensath and M. E. Davies, "Gradient pursuits," IEEE Trans. Signal Process., vol. 56, no. 6, pp. 2370-2382, Jun. 2008. (Pubitemid 351795890)
21. D. Needell and R. Vershynin, "Uniform uncertainty principle and signal recovery via regularized orthogonal matching pursuit," Found. Comput. Math., vol. 9, no. 3, pp. 317-334, 2009.
22. J. Haupt and R. Nowak, "Signal reconstruction from noisy random projections," IEEE Trans. Inf. Theory, vol. 53, no. 9, pp. 4036-4048, Sep. 2006. (Pubitemid 44363832)
23. M. Raginsky, R. M. Willett, Z. T. Harmany, and R. F. Marcia, "Compressed sensing performance bounds under Poisson noise," IEEE Trans. Signal Process., vol. 58, no. 8, pp. 3990-4002, Aug. 2010.
24. M. J. Wainwright, "Information-theoretic limits on sparsity recovery in the high-dimensional and noisy setting," , Dept. of Statist., Univ. of California, Berkeley, Jan. 2007, Tech. Rep.
25. M. J.Wainwright, "Information-theoretic limits on sparsity recovery in the high-dimensional and noisy setting," IEEE Trans. Inf. Theory, vol. 55, no. 12, pp. 5728-5741, Dec. 2009.
26. W.Wang, M. J.Wainwright, and K. Ramachandran, "Information-theoretic limits on sparse signal recovery: Dense versus sparse measurement matrices," IEEE Trans. Inf. Theory, vol. 56, no. 6, pp. 2967-2979, Jun. 2010.
27. A. K. Fletcher, S. Rangan, and V. K. Goyal, "Necessary and sufficient conditions for sparsity pattern recovery," IEEE Trans. Inf. Theory, vol. 55, no. 12, pp. 5758-5772, Dec. 2009.
28. M. M. Akcakaya and V. Tarokh, "Shannon-theoretic limits on noisy compressive sampling," IEEE Trans. Inf. Theory, vol. 56, no. 1, pp. 492-504, Jan. 2010.
29. G. Reeves and M. Gastpar, "Sampling bounds for sparse support recovery in the presence of noise," in Proc. IEEE Int. Symp. Inf. Theory (ISIT), Toronto, ON, Canada, Jul. 2008, pp. 2187-2191.
30. G. Tang and A. Nehorai, "Performance analysis for sparse support recovery," IEEE Trans. Inf. Theory, vol. 56, no. 3, pp. 1383-1399, Mar. 2010.
31. V. K. Goyal, A. K. Fletcher, and S. Rangan, "Compressive sampling and lossy compression," IEEE Signal Process. Mag., vol. 25, no. 2, pp. 48-56, Mar. 2008.
32. A. Gupta, R. Nowak, and B. Recht, "Sample complexity for 1-bit compressed sensing and sparse classification," in Proc. IEEE Int. Symp. Inf. Theory (ISIT), Austin, TX, Jun. 2010, pp. 1553-1557.
33. W. Dai, H. V. Pham, and O. Milenkovic, "A comparative study of quantized compressive sensing schemes," in Proc. IEEE Int. Symp. Inf. Theory (ISIT), Seoul, Korea, Jun. 2009, pp. 11-15.
34. P. Boufounos and R. Baraniuk, "Quantization of sparse representations," in Proc. Data Compression Conf. (DCC), Snowbird, UT, Mar. 2007.
35. A. Zymnis, S. Boyd, and E. Candes, "Compressed sensing with quantized measurements," IEEE Signal Process. Lett., vol. 17, no. 2, pp. 149-152, Feb. 2010.
36. P. T. Boufounos and R. G. Baraniuk, "1-bit compressive sensing," in Proc. 42nd Annu. Conf. Inf. Sci. Syst. (CISS), Princeton, NJ, Mar. 2008, pp. 16-21.
37. J. N. Laska, Z.Wen, W.Yin, and R. G. Baraniuk, "Trust, but verify: Fast and accurate signal recovery from 1-bit compressive measurements," IEEE Trans. Signal Process., vol. 59, no. 11, pp. 5289-5301, Nov. 2011.
38. J. Z. Sun and V. K. Goyal, "Optimal quantization of random measurements in compressed sensing," in Proc. IEEE Int. Symp. Inf. Theory (ISIT), Seoul, Korea, Jul. 2009, pp. 6-10.
39. L. Jacques, J. N. Laska, P. T. Boufounos, and R. G. Baraniuk, Robust 1-bit compressive sensing via binary stable embeddings of sparse vectors arXiv:1104.3160, 2011.
40. Y. Jin, Y.-H. Kim, and B. D. Rao, Support recovery of sparse signals arXiv:1003.0888v1[cs.IT], 2010.
41. P. T. Boufounos, "Reconstruction of sparse signals from distorted randomized measurements," in Proc. Acoust., Speech, Signal Process. (ICASSP), Dallas, TX, Mar. 2010, pp. 3998-4001.
42. T. S. Han and S. Verdu, "Generalizing the Fano inequality," IEEE Trans. Inf. Theory, vol. 40, no. 4, pp. 1247-1251, Jul. 1994.
43. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 2006.
44. R. Niu, B. Chen, and P. K. Varshney, "Decision fusion rules in wireless sensor networks using fading channel statistics," in Proc. Conf. Inf. Sci. Syst., Mar. 2003, The Johns Hopkins Univ..
45. C. Rose and M. D. Smith, The Bivariate Normal, 6.4 A in Mathematical Statistics with Mathematica. New York: Springer-Verlag, 2002.