A single-letter characterization of optimal noisy compressed sensing

2009 47th Annual Allerton Conference on Communication, Control, and Computing, Allerton 2009

Volumn , Issue , 2009, Pages 52-59

  Guo, Dongning ^a   Baron, Dror ^b   Shamai, Shlomo ^b  

^a Northwestern University   (United States)

^b TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

ASYMPTOTIC SCALING; ASYMPTOTICALLY OPTIMAL; BELIEF PROPAGATION; COMPRESSED SENSING; ERROR PROBABILITIES; GAUSSIAN NOISE; HIGH-DIMENSIONAL; LINEAR MEASUREMENTS; LINEAR SPACES; MEAN SQUARED ERROR; POSTERIOR DISTRIBUTIONS; REPLICA METHOD; SPARSE REPRESENTATION; SPARSE SIGNALS; SUFFICIENT STATISTICS;

GAUSSIAN NOISE (ELECTRONIC); OPTICAL COMMUNICATION; PROBABILITY; SIGNAL RECONSTRUCTION;

ASYMPTOTIC ANALYSIS;

EID: 77949635021     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ALLERTON.2009.5394838     Document Type: Conference Paper

References (26)

1. D. L. Donoho, "Compressed sensing," IEEE Trans. Inform. Theory, vol. 52, pp. 1289-1306, Apr. 2006.
2. E. J. Candes and T. Tao, "Near-optimal signal recovery from random projections: Universal encoding strategies?," IEEE Trans. Inform. Theory, vol. 52, pp. 5406-5425, Dec. 2006.
3. D. Donoho and J. Tanner, "Neighborliness of randomly projected simplices in high dimensions," Proc. Nat. Acad. Sci., vol. 102, no. 27, pp. 9452-9457, 2005.
4. D. L. Donoho, A. Maleki, and A. Montanari, "Message passing algorithms for compressed sensing," arxiv:0907.3574v1, 2009.
5. E. Candes and T. Tao, "The Dantzig selector: Statistical estimation when p is much larger than n," Annals of Statistics, vol. 35, no. 6, pp. 2313-2351, 2007.
6. S. Sarvotham, D. Baron, and R. Baraniuk, "Measurements vs. bits: Compressed sensing meets information theory," in Proc. Allerton Conf. Commun., Control, and Computing, 2006.
7. M. Akçakaya and V. Tarokh, "Shannon theoretic limits on noisy compressive sampling," arXiv:0711.0366v1, 2007.
8. W.Wang, M.Wainwright, and K. Ramchandran, "Information-theoretic limits on sparse support recovery: Dense versus sparse measurements," in Proc. IEEE Int. Symp. Inform. Theory, pp. 2197-2201, Toronto, Canada, 2008.
9. P. Tune, S. R. Bhaskaran, and S. Hanly, "Number of measurements in sparse signal recovery," in Proc. IEEE Int. Symp. Inform. Theory, pp. 16-20, Seoul, Korea, 2009.
10. S. Rangan, A. K. Fletcher, and V. K. Goyal, "Asymptotic analysis of MAP estimation via the replica method and applications to compressed sensing," arXiv:0906.3234v1, 2009.
11. S. Aeron, M. Zhao, and V. Saligrama, "Information theoretic bounds to performance of compressed sensing and sensor networks," arXiv:0804.3439v2, 2009.
12. T. Tanaka, "A statistical mechanics approach to large-system analysis of CDMA multiuser detectors," IEEE Trans. Inform. Theory, vol. 48, pp. 2888-2910, Nov. 2002.
13. D. Guo and S. Verdù, "Multiuser detection and statistical mechanics," in Communications, Information and Network Security (V. Bhargava, H. V. Poor, V. Tarokh, and S. Yoon, eds.), ch. 13, pp. 229-277, Kluwer Academic Publishers, 2002.
14. D. Guo and S. Verdú, "Randomly spread CDMA: Asymptotics via statistical physics," IEEE Trans. Inform. Theory, vol. 51, pp. 1982-2010, June 2005.
15. D. Guo and T. Tanaka, "Generic multiuser detection and statistical physics," in Advances in Multiuser Detection (M. Honig, ed.), ch. 5, Wiley-IEEE Press, 2009.
16. R. R. Müller, "Channel capacity and minimum probability of error in large dual antenna array systems with binary modulation," IEEE Trans. Signal Processing, vol. 51, pp. 2821-2828, Nov. 2003.
17. D. Guo and C.-C. Wang, "Multiuser detection of sparsely spread CDMA," IEEE J. Select. Areas Commun., vol. 26, pp. 421-431, Apr. 2008.
18. T. Hastie, R. Tibshirani, and J. H. Friedman, The Elements of Statistical Learning. Springer, August 2001.
19. D. Baron, S. Sarvotham, and R. G. Baraniuk, "Bayesian compressive sensing via belief propagation," to appear in IEEE Trans. Signal Process., 2009.
20. A. Montanari, "Estimating random variables from random sparse observations," European Trans. Telecommun., vol. 19, pp. 385-403, Apr. 2008.
21. p ball from limited measurements," in Data Compression Conference, pp. 33-42, 2006.
22. P. T. Boufounos and R. G. Baraniuk, "1-bit compressive sensing," in Proc. Conf. Inform. Sciences & Systems, Princeton, NJ, USA, 2008.
23. W. Dai and O. Milenkovic, "Subspace pursuit for compressive sensing signal reconstruction," IEEE Trans. Inform. Theory, vol. 55, pp. 2230-2249, 2009.
24. D. Needell and J. A. Tropp, "CoSaMP: Iterative signal recovery from incomplete and inaccurate samples," Applied and Computational Harmonic Analysis, vol. 26, pp. 301-321, 2009.
25. M. Figueiredo, R. Nowak, and S. Wright, "Gradient projection for sparse reconstruction: Application to compressed sensing and other inverse problems," IEEE J. Sel. Top. Signal Process., vol. 1, pp. 586-597, 2007.
26. P. Schniter, L. C. Potter, and J. Ziniel, "Fast Bayesian matching pursuit: Model uncertainty and parameter estimation for sparse linear models," IEEE Trans. Signal Process., 2009.